Awesome

candle-sampling

Sampling techniques for Candle.

Currently implemented methods are:

multinomial (ancestral)
top-k
top-p (nucleus)
top-n logprobs
repeat penalty (frequency penalty)
presence penalty
logit bias