# Finetuning Wav2Vec2 on TPU

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetuning-wav2vec2-on-tpu%2F10609%3E%5C
**Category:** 🤗Transformers\
**Created:** [October 8, 2021, 7:38am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetuning-wav2vec2-on-tpu%2F10609 "2021-10-08T07:38:54Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![pere](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/pere/32/40613_2.png) [@pere](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fpere)%5C
**Post date:** [October 8, 2021, 7:38am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetuning-wav2vec2-on-tpu%2F10609%2F1 "2021-10-08T07:38:54Z")

</div>

I am planning to finetune a Wav2Vec2-XLSR-53 on a newly generated speech dataset. Are there any example scripts on how to finetune Wav2Vec2 on TPUs? I do find some PyTorch examples but these are for GPUs only.

I would prefer using Flax for this but the only scripts I am able to find is for pretraining.

---

<div class="post-metadata">

**Author:** ![MBMMurad](https://avatars.discourse-cdn.com/v4/letter/m/ba9def/32.png) [@MBMMurad](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FMBMMurad)%5C
**Post date:** [August 14, 2022, 8:18pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetuning-wav2vec2-on-tpu%2F10609%2F2 "2022-08-14T20:18:07Z")

</div>

Hi. Were you able to finetune it with TPUs? I’m working on it now and it’d be great help to find some resources.

---

<div class="post-metadata">

**Author:** ![pere](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/pere/32/40613_2.png) [@pere](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fpere)%5C
**Post date:** [August 14, 2022, 9:35pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetuning-wav2vec2-on-tpu%2F10609%2F3 "2022-08-14T21:35:35Z")

</div>

Sorry. This project was delayed. I have not tried this yet. Hopefully, I will look into it soon.