# Fine tuning whisper on custom dataset

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tuning-whisper-on-custom-dataset%2F33301%3E%5C
**Category:** Beginners\
**Created:** [March 8, 2023, 1:49am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tuning-whisper-on-custom-dataset%2F33301 "2023-03-08T01:49:28Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![byoussef](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/byoussef/32/22890_2.png) [@byoussef](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fbyoussef)%5C
**Post date:** [March 8, 2023, 1:49am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tuning-whisper-on-custom-dataset%2F33301%2F1 "2023-03-08T01:49:28Z")

</div>

I’m trying to fine tune whisper large v2 on a custom dataset of over 7000 hours of speech. However, the audio files are very long since they are recordings of news reports, radio broadcasts, conferences… etc. I think on average most files are over an hour long  
is it possible or do I have to split them to 30 seconds? and if I have to, please advise me on an efficient way to process that much data quick…  
I have access to a server with 8x A100 GPUs, so memory shouldn’t be a problem

---

<div class="post-metadata">

**Author:** ![iam-pia](https://avatars.discourse-cdn.com/v4/letter/i/ccd318/32.png) [@iam-pia](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fiam-pia)%5C
**Post date:** [January 11, 2024, 12:46pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tuning-whisper-on-custom-dataset%2F33301%2F2 "2024-01-11T12:46:26Z")

</div>

Hi @byoussef, I have the same problem. Did you find a solution or a smart way to solve your problem?

---

<div class="post-metadata">

**Author:** ![byoussef](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/byoussef/32/22890_2.png) [@byoussef](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fbyoussef)%5C
**Post date:** [January 11, 2024, 2:46pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tuning-whisper-on-custom-dataset%2F33301%2F3 "2024-01-11T14:46:47Z")

</div>

Hi @iam-pia  
Sorry to hear you’re facing the same issue. Fortunately for me the transcription json files had timestamps based on utterances so I just wrote a script to chunk up the audios based on those timestamps and extract the relevant utterances from the transcript.

---

<div class="post-metadata">

**Author:** ![iam-pia](https://avatars.discourse-cdn.com/v4/letter/i/ccd318/32.png) [@iam-pia](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fiam-pia)%5C
**Post date:** [January 11, 2024, 5:17pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tuning-whisper-on-custom-dataset%2F33301%2F4 "2024-01-11T17:17:29Z")

</div>

Ahh thats lucky! Thanks for the reply 🙂