# Serverless Inference API Token Limits/Settings

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fserverless-inference-api-token-limits-settings%2F127725%3E%5C
**Category:** Beginners\
**Created:** [November 25, 2024, 9:02pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fserverless-inference-api-token-limits-settings%2F127725 "2024-11-25T21:02:23Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![MisterAI](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/misterai/32/64444_2.png) [@MisterAI](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FMisterAI)%5C
**Post date:** [November 25, 2024, 9:02pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fserverless-inference-api-token-limits-settings%2F127725%2F1 "2024-11-25T21:02:23Z")

</div>

Hi,

As written in Topic Title :  
My request :  
Where can i found information about the Token limits/Settings using Free Serverless Inference API ?

Context :  
Trying automation for testing purposes from [Make.com](http://Make.com) with HF\_Models the responses generated by the models are Incomplete/truncated  
Maybe there are some limits or Maybe there are some settings to do in  
Makemodule : HTTP : make an API Key AUTH Request  
NB : My knowledge is low

NB: Before opening the request I consulted the links below without finding an answer.  
[https://huggingface.co/docs/api-inference/rate-limits](https://huggingface.co/docs/api-inference/rate-limits)  
[/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fsearch%3Fq%3DAPI%2520limit%2520token%5D(https%3A%2F%2Fdiscuss.huggingface.co%2Fsearch%3Fq%3DAPI%2520limit%2520token)

Any Help Welcome.  
Thank You.

---

<div class="post-metadata">

**Author:** ![MisterAI](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/misterai/32/64444_2.png) [@MisterAI](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FMisterAI)%5C
**Post date:** [November 26, 2024, 8:14pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fserverless-inference-api-token-limits-settings%2F127725%2F2 "2024-11-26T20:14:46Z")

</div>

**For the record:**  
Useful documentation :  
[https://huggingface.co/docs/api-inference/tasks/text-generation?code=js#api-specification](https://huggingface.co/docs/api-inference/tasks/text-generation?code=js#api-specification)  
[https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1?inference\_api=true](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1?inference_api=true)

It would appear that there is a default limit of 500 tokens.  
I still have to figure out how to send the ‘max\_new\_tokens’ parameter at the same time as my request from a Make module.  
I am continuing my research on  
[https://community.make.com/c/how-to/66](https://community.make.com/c/how-to/66)

regards

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/hellohellohello/original/2X/d/de4155eb4aa4108ecb32a1389d7cc37ae69f88b7.png) [@system](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsystem)%5C
**Post date:** [November 27, 2024, 8:14am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fserverless-inference-api-token-limits-settings%2F127725%2F3 "2024-11-27T08:14:55Z")

</div>

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.
