Temperature (Sampling)

August 23, 2025 2 weeks ago 1 min read

Decoding parameter that sharpens or flattens the probability distribution over next tokens; lower values are more deterministic, higher values more diverse.