# How do I increase max\_new\_tokens

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-do-i-increase-max-new-tokens%2F43098%3E%5C
**Category:** Beginners\
**Created:** [June 13, 2023, 3:44pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-do-i-increase-max-new-tokens%2F43098 "2023-06-13T15:44:43Z")\
**Posts on this page:** 1\
**Showing post:** 4

<div class="post-metadata">

**Author:** ![Wi1](https://avatars.discourse-cdn.com/v4/letter/w/34f0e0/32.png) [@Wi1](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FWi1)%5C
**Post date:** [August 19, 2023, 1:15am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-do-i-increase-max-new-tokens%2F43098%2F4 "2023-08-19T01:15:18Z")

</div>

@gkrishnan I’m late to the post but you can always manually pass in the model/pipeline:

```python
from transformers import pipeline, AutoModelForCausalLM, AutoTokenizer
from langchain.llms import HuggingFacePipeline

model = AutoModelForCausalLM.from_pretrained(model_path)
tokenizer = AutoTokenizer.from_pretrained(model_path)
gen = pipeline('text-generation', model=model, tokenizer=tokenizer, max_new_tokens=200)

llama_llm = HuggingFacePipeline(pipeline=gen)

```

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-do-i-increase-max-new-tokens%2F43098)._