# \[Tokenizers\]What this max\_length number?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftokenizers-what-this-max-length-number%2F28484%3E%5C
**Category:** Beginners\
**Created:** [December 27, 2022, 2:30am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftokenizers-what-this-max-length-number%2F28484 "2022-12-27T02:30:17Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ssunbell](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/ssunbell/32/17521_2.png) [@Ssunbell](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FSsunbell)%5C
**Post date:** [December 27, 2022, 2:30am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftokenizers-what-this-max-length-number%2F28484%2F1 "2022-12-27T02:30:17Z")

</div>

When I called FastTokenizer, I could see the strange number of “model\_max\_length” as “1000000000000000019884624838656”. What is the meaning of the strange model max length?

```auto
from transformers import AutoTokenizer
model_name = 'microsoft/mdeberta-v3-base'

tokenizer = AutoTokenizer.from_pretrained(model_name)
vars(tokenizer)

```

 ![스크린샷 2022-12-27 오전 11.01.30](https://us1.discourse-cdn.com/hellohellohello/original/2X/6/627da761e13dfae0b4b87dd456554f4bd09e59a3.png)

---

<div class="post-metadata">

**Author:** ![sgugger](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sgugger/32/2291_2.png) [@sgugger](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsgugger)%5C
**Post date:** [December 27, 2022, 7:19am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftokenizers-what-this-max-length-number%2F28484%2F2 "2022-12-27T07:19:44Z")

</div>

It’s just the largest integer in this precision, because this model does not have a max length.

---

<div class="post-metadata">

**Author:** ![brando](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/brando/32/30114_2.png) [@brando](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fbrando)%5C
**Post date:** [January 18, 2024, 11:32pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftokenizers-what-this-max-length-number%2F28484%2F3 "2024-01-18T23:32:50Z")

</div>

fyi this can happen for llama2-7b.

---

<div class="post-metadata">

**Author:** ![alikeram](https://avatars.discourse-cdn.com/v4/letter/a/d78d45/32.png) [@alikeram](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Falikeram)%5C
**Post date:** [March 3, 2025, 10:20am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftokenizers-what-this-max-length-number%2F28484%2F4 "2025-03-03T10:20:17Z")

</div>

I see similar behavior for `mt5-large`. Does the model support inputs of any size?