# Is there any mothed speed generate examples

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fis-there-any-mothed-speed-generate-examples%2F23076%3E%5C
**Category:** 🤗Datasets\
**Created:** [September 13, 2022, 8:50am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fis-there-any-mothed-speed-generate-examples%2F23076 "2022-09-13T08:50:00Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![zhengken](https://avatars.discourse-cdn.com/v4/letter/z/87869e/32.png) [@zhengken](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fzhengken)%5C
**Post date:** [September 13, 2022, 8:50am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fis-there-any-mothed-speed-generate-examples%2F23076%2F1 "2022-09-13T08:50:00Z")

</div>

Hello, Is there any mothed speed generate examples? I have almost 60,000,000 examples in my corpus, and It seems takes almost several hours to load complete.

 ![image](https://us1.discourse-cdn.com/hellohellohello/original/2X/5/5060865afda99b02f7b919f45ee6553ceb69686c.png)

---

<div class="post-metadata">

**Author:** ![lhoestq](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lhoestq/32/64813_2.png) [@lhoestq](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Flhoestq)%5C
**Post date:** [September 23, 2022, 5:02pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fis-there-any-mothed-speed-generate-examples%2F23076%2F2 "2022-09-23T17:02:46Z")

</div>

Hi ! This step is single-processed right now, once we add parallelism it will be much faster 🙂

In the meantime your can try splitting your dataset into smaller ones, and then use `concatenate_datasets()`