# Adding a New tokens to ViT

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fadding-a-new-tokens-to-vit%2F33510%3E%5C
**Category:** 🤗Transformers\
**Created:** [March 10, 2023, 2:53pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fadding-a-new-tokens-to-vit%2F33510 "2023-03-10T14:53:17Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![tankwell](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/tankwell/32/18511_2.png) [@tankwell](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Ftankwell)%5C
**Post date:** [March 10, 2023, 2:53pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fadding-a-new-tokens-to-vit%2F33510%2F1 "2023-03-10T14:53:17Z")

</div>

Hey,

I want to add 2 custom embeddings (tokens) to a pretrained transformers  
Those tokens will represent some argument to the image  
I have seen there is a similar method to BERT and text transformers (add a word to the vocabulary) but I did not find something for image transformers

Currently I do it with ugly code that overrides the embeddings of the built-in Vit and adds the token.  
If you have a smarter solutions / similar ideas I would be happy to hear 🤗

Thanks