# Qwen 2.5 coder 7b best inference hyperparameters

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fqwen-2-5-coder-7b-best-inference-hyperparameters%2F129008%3E%5C
**Category:** Models\
**Created:** [December 3, 2024, 7:35am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fqwen-2-5-coder-7b-best-inference-hyperparameters%2F129008 "2024-12-03T07:35:13Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![sleepywalker](https://avatars.discourse-cdn.com/v4/letter/s/6f9a4e/32.png) [@sleepywalker](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsleepywalker)%5C
**Post date:** [December 3, 2024, 7:35am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fqwen-2-5-coder-7b-best-inference-hyperparameters%2F129008%2F1 "2024-12-03T07:35:13Z")

</div>

What are the best inference hyperparameters of Qwen 2.5 coder 7b? I tried only do\_sample=True and do\_sample=False and I can’t understand why but model with do\_sample=True has better quality than with do\_sample=False. Maybe it’s because I didn’t pass good enough temperature, top\_p, top\_k parameters with do\_sample=False. Can somebody who used this model tell me about it?