# PreTrain Wav2Vec2 in Spanish
**URL:**
**Author:**  [@mariagrandury](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmariagrandury)%5C
**Post date:** [June 30, 2021, 5:29pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpretrain-wav2vec2-in-spanish%2F7763%2F1 "2021-06-30T17:29:06Z")
# PreTrain Wav2Vec2 in Spanish
There is currently only a multilingually pretrained model for Spanish Wav2Vec2. Let’s make a Wav2Vec2 only pretrained on Spanish.
## Model
A randomly initialized Wav2Vec2 model.
## Datasets
We can use the Spanish portion of [Common Voice](https://commonvoice.mozilla.org/en/languages). The dataset is available through the `datasets` library here: [common\_voice · Datasets at Hugging Face](https://huggingface.co/datasets/common_voice).
## Available training scripts
FlaxWav2Vec2 will be merged soon: [[Flax] Add wav2vec2 by patrickvonplaten · Pull Request #12271 · huggingface/transformers · GitHub ](https://github.com/huggingface/transformers/pull/12271) and a pretraining script should be relatively easy to be merged.
## (Optional) Desired project outcome
The best Spanish ASR model.
## (Optional) Challenges
It would be nice to use more data than just the Common Voice dataset.
---
**Author:**  [@mrm8488](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmrm8488)%5C
**Post date:** [June 30, 2021, 5:31pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpretrain-wav2vec2-in-spanish%2F7763%2F2 "2021-06-30T17:31:51Z")
I am in!
cc: @patrickvonplaten @valhalla
---
**Author:**  [@valhalla](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fvalhalla)%5C
**Post date:** [June 30, 2021, 5:42pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpretrain-wav2vec2-in-spanish%2F7763%2F3 "2021-06-30T17:42:18Z")
Awesome, added you both to the team 🙂
---
**Author:**  [@edugp](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fedugp)%5C
**Post date:** [June 30, 2021, 7:12pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpretrain-wav2vec2-in-spanish%2F7763%2F4 "2021-06-30T19:12:20Z")
I am interested on this one as well, if there’s still time to join! 🙂
---
**Author:**  [@pcuenq](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fpcuenq)%5C
**Post date:** [July 1, 2021, 12:22pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpretrain-wav2vec2-in-spanish%2F7763%2F5 "2021-07-01T12:22:46Z")
I took part in the Wav2Vec2 fine-tuning week for Spanish, this is [my forum post](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fspanish-asr-fine-tuning-wav2vec2%2F4586). My [model card](https://huggingface.co/pcuenq/wav2vec2-large-xlsr-53-es) describes some of the pre-processing and training steps I took.
It would be awesome to create a pretrained model using Jax/Flax. I’m not sure I’ll have the time to take part in this one (I already signed up for a different project, and I know nothing about Jax), but I’ll try to follow your discussions if I can. Good luck!