Temperature, Top-k and Top-p: How LLMs Choose Their Next Word
What temperature, top-k and top-p actually do when an LLM picks its next token, how they differ, and which values to use for your tasks.
The Blog
Articles tagged Sampling.
What temperature, top-k and top-p actually do when an LLM picks its next token, how they differ, and which values to use for your tasks.