How much randomness to use during sampling. Higher values improve improvisation, and lower values result in determinism.

Controls diversity via nucleus sampling. Reduces the probability mass from which to sample.

Positive values discourage repetition; negative values encourage it.

Penalizes new tokens based on their frequency in the text so far.