Beam Search
A decoding strategy that keeps the top-k highest-probability partial sequences at each step instead of greedily picking one.
LLMs
A decoding strategy that keeps the top-k highest-probability partial sequences at each step instead of greedily picking one.