* Context size: We set the context size to 2048, which determines the maximum number of tokens the model can consider simultaneously when generating text. * Maximum sequence length: We limit the generated sequence length to 512 tokens to ensure that the outputs remain focused and relevant to the input prompt. * Temperature: We set the temperature to 0.2, which controls the randomness of the sampling process. Lower values make the model generate more focused and deterministic outputs, while higher values increase diversity at the cost of coherence. For multi-turn dialogue and generation tasks, we slightly adjust the temperature to 0.5 to allow a more diverse output. * Top-\(k\) sampling: We use Top-\(k\) sampling with \(k=40\), meaning that the model selects its next token from the top 40 most probable tokens at each step, adding an element of randomness and diversity to the generated text. * Top-\(p\) sampling: We also employ Top-\(p\) sampling with \(p=0.9\), which further enhances diversity by considering a dynamic set of tokens that collectively account for 90% of the probability mass. * Repetition penalty: To discourage the model from generating repetitive text, we apply a repetition penalty with a factor of 1.1, penalizing tokens that have already been selected.