# Need help on wav2vec 2.0 models training

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fneed-help-on-wav2vec-2-0-models-training%2F8880%3E%5C
**Category:** 🤗Transformers\
**Created:** [July 31, 2021, 5:55pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fneed-help-on-wav2vec-2-0-models-training%2F8880 "2021-07-31T17:55:19Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Krawist](https://avatars.discourse-cdn.com/v4/letter/k/bbce88/32.png) [@Krawist](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FKrawist)%5C
**Post date:** [July 31, 2021, 5:55pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fneed-help-on-wav2vec-2-0-models-training%2F8880%2F1 "2021-07-31T17:55:19Z")

</div>

Hello guys, I’m using transformers library and I want to build speech recognition systems base on wav2vec 2.0

I have different problems

1. Base on the exemple here [Wav2Vec2 — transformers 4.7.0 documentation](https://huggingface.co/transformers/master/model_doc/wav2vec2.html#wav2vec2forpretraining)  
I have tried to pretrain a model. But I have seen in the github on fairseq wav2vec that the loss object at the end, I can call a backward method on, but here I can.

2. how can I perform batch training in wav2vec.

Guys please I need help, even another documentation or examples.

---

<div class="post-metadata">

**Author:** ![ahmedlone123](https://avatars.discourse-cdn.com/v4/letter/a/c4cdca/32.png) [@ahmedlone123](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fahmedlone123)%5C
**Post date:** [July 31, 2021, 6:06pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fneed-help-on-wav2vec-2-0-models-training%2F8880%2F2 "2021-07-31T18:06:04Z")

</div>

[https://github.com/huggingface/blog/blob/master/fine-tune-wav2vec2-english.md](https://github.com/huggingface/blog/blob/master/fine-tune-wav2vec2-english.md)

try this

---

<div class="post-metadata">

**Author:** ![Krawist](https://avatars.discourse-cdn.com/v4/letter/k/bbce88/32.png) [@Krawist](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FKrawist)%5C
**Post date:** [July 31, 2021, 6:26pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fneed-help-on-wav2vec-2-0-models-training%2F8880%2F3 "2021-07-31T18:26:36Z")

</div>

Thanks you
