# Bos token for T5?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbos-token-for-t5%2F25613%3E%5C
**Category:** 🤗Transformers\
**Created:** [November 6, 2022, 12:35am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbos-token-for-t5%2F25613 "2022-11-06T00:35:18Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![sachin](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sachin/32/26534_2.png) [@sachin](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsachin)%5C
**Post date:** [November 6, 2022, 12:35am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbos-token-for-t5%2F25613%2F1 "2022-11-06T00:35:18Z")

</div>

Hello! I’m using T5-base for my model, and it seems to be generating something reasonable when I do `model.generate`. But my question is how?

The decoder part of this model needs a starting token to start decoding doesn’t it? How does it figure out what the very first token is supposed to look like?

Or am I doing the training wrong where I should have included a token?