Top‑p (Nucleus Sampling)

August 23, 2025 2 weeks ago 1 min read

Sampling from the smallest set of tokens whose cumulative probability exceeds p (e.g., 0.9), balancing diversity with coherence in generation.