This is great; I have to admit that I have largely neglected top_p sampling and have focused primarily on adjusting the temperature. The table of suggested temperature and top_p values for different use cases is very helpful.
This is great; I have to admit that I have largely neglected top_p sampling and have focused primarily on adjusting the temperature. The table of suggested temperature and top_p values for different use cases is very helpful.