# How do tokenizer(text\_target=text) work

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-do-tokenizer-text-target-text-work%2F28364%3E%5C
**Category:** 🤗Transformers\
**Created:** [December 24, 2022, 7:19am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-do-tokenizer-text-target-text-work%2F28364 "2022-12-24T07:19:43Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![blackWizard](https://avatars.discourse-cdn.com/v4/letter/b/8baadc/32.png) [@blackWizard](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FblackWizard)%5C
**Post date:** [December 24, 2022, 7:19am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-do-tokenizer-text-target-text-work%2F28364%2F1 "2022-12-24T07:19:43Z")

</div>

Hello everyone, I’m doing on translating task and I don’t understand how tokenizer switches specific-tokenizer for source language and target language (eg: ‘en’ and ‘fr’). Because I see they read in the same vocabulary file. Thank you for any help.