# PreTrain Wav2Vec2 in Dhivehi

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpretrain-wav2vec2-in-dhivehi%2F7644%3E%5C
**Category:** Flax/JAX Projects\
**Created:** [June 29, 2021, 2:24pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpretrain-wav2vec2-in-dhivehi%2F7644 "2021-06-29T14:24:22Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![eyna](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/eyna/32/2063_2.png) [@eyna](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Feyna)%5C
**Post date:** [June 29, 2021, 2:24pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpretrain-wav2vec2-in-dhivehi%2F7644%2F1 "2021-06-29T14:24:22Z")

</div>

# PreTrain Wav2Vec2 in Dhivehi

There is currently only a multilingually pretrained model for Dhivehi Wav2Vec2. We would like to make a Wav2Vec2 only pre-trained on Dhivehi.

# Model

A randomly initialized Wav2Vec2 model

# Datasets

- commonvoice has 18hrs in the last released dataset. [32hrs+ if mid 2021 dataset released in time]
- podcast data [30hr]
- others 

## Available training scripts

FlaxWav2Vec2 will be merged soon: [[Flax] Add wav2vec2 by patrickvonplaten · Pull Request #12271 · huggingface/transformers · GitHub](https://github.com/huggingface/transformers/pull/12271) and a pretraining script should be relatively easy to be merged.

## (Optional) Desired project outcome

The best Dhivehi ASR model

## (Optional) Challenges

scraping publicly available Dhivehi audio from various sources

---

<div class="post-metadata">

**Author:** ![politecat314](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/politecat314/32/2074_2.png) [@politecat314](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fpolitecat314)%5C
**Post date:** [June 29, 2021, 2:36pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpretrain-wav2vec2-in-dhivehi%2F7644%2F3 "2021-06-29T14:36:47Z")

</div>

Am interested and would like to join this project

---

<div class="post-metadata">

**Author:** ![patrickvonplaten](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/patrickvonplaten/32/2171_2.png) [@patrickvonplaten](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fpatrickvonplaten)%5C
**Post date:** [June 29, 2021, 2:37pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpretrain-wav2vec2-in-dhivehi%2F7644%2F4 "2021-06-29T14:37:40Z")

</div>

Awesome! Let’s finalize it directly

---

<div class="post-metadata">

**Author:** ![Ankit-Kumar-Saini](https://avatars.discourse-cdn.com/v4/letter/a/e99b99/32.png) [@Ankit-Kumar-Saini](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FAnkit-Kumar-Saini)%5C
**Post date:** [July 1, 2021, 12:35pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpretrain-wav2vec2-in-dhivehi%2F7644%2F5 "2021-07-01T12:35:11Z")

</div>

This is a very interesting project. I always wanted to work on speech recognition task. This is a great opportunity to learn and contribute. Looking forward to be a part of this project.