# Tokenizer not created when training whisper-small model

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftokenizer-not-created-when-training-whisper-small-model%2F61876%3E%5C
**Category:** Beginners\
**Created:** [November 11, 2023, 1:17am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftokenizer-not-created-when-training-whisper-small-model%2F61876 "2023-11-11T01:17:33Z")\
**Posts on this page:** 1\
**Showing post:** 4

<div class="post-metadata">

**Author:** ![vishakha-lall](https://avatars.discourse-cdn.com/v4/letter/v/db5fbb/32.png) [@vishakha-lall](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fvishakha-lall)%5C
**Post date:** [February 15, 2024, 5:36am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftokenizer-not-created-when-training-whisper-small-model%2F61876%2F4 "2024-02-15T05:36:10Z")

</div>

This is what helped me.  
Although this command is found in the [Google Colab](https://colab.research.google.com/github/sanchit-gandhi/notebooks/blob/main/fine_tune_whisper.ipynb#scrollTo=-2zQwMfEOBJq) linked in the blog, I believe the author accidentally skipped it in the blog itself.  
Before starting the training, we need to save the processor which is not trainable and hence does not change during training.

```auto
processor.save_pretrained(training_args.output_dir)

```

This will add the necessary files for the tokenizer and whether you use the model locally or push it to hub, it will have all the necessary files.

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftokenizer-not-created-when-training-whisper-small-model%2F61876)._
