# What token settings are used on the Hosted inference API

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhat-token-settings-are-used-on-the-hosted-inference-api%2F25509%3E%5C
**Category:** 🤗Hub\
**Created:** [November 3, 2022, 11:45pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhat-token-settings-are-used-on-the-hosted-inference-api%2F25509 "2022-11-03T23:45:31Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Samuel-Fipps](https://avatars.discourse-cdn.com/v4/letter/s/e56c9b/32.png) [@Samuel-Fipps](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FSamuel-Fipps)%5C
**Post date:** [November 3, 2022, 11:45pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhat-token-settings-are-used-on-the-hosted-inference-api%2F25509%2F1 "2022-11-03T23:45:32Z")

</div>

When I run my model locally, I can’t seem to get the same output.

> **[Samuel-Fipps/t5-efficient-large-nl36\_fine\_tune\_sum\_V2 · Hugging Face](https://huggingface.co/Samuel-Fipps/t5-efficient-large-nl36_fine_tune_sum_V2)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

---

<div class="post-metadata">

**Author:** ![Samuel-Fipps](https://avatars.discourse-cdn.com/v4/letter/s/e56c9b/32.png) [@Samuel-Fipps](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FSamuel-Fipps)%5C
**Post date:** [November 4, 2022, 9:30pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhat-token-settings-are-used-on-the-hosted-inference-api%2F25509%2F2 "2022-11-04T21:30:03Z")

</div>

Figured it out, you don’t include the " summerize" in front