# Load\_datasets is extremely slow in loading HF datasets

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fload-datasets-is-extremely-slow-in-loading-hf-datasets%2F65740%3E%5C
**Category:** Beginners\
**Created:** [December 14, 2023, 12:59am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fload-datasets-is-extremely-slow-in-loading-hf-datasets%2F65740 "2023-12-14T00:59:13Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![mkha](https://avatars.discourse-cdn.com/v4/letter/m/ac91a4/32.png) [@mkha](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmkha)%5C
**Post date:** [December 14, 2023, 12:59am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fload-datasets-is-extremely-slow-in-loading-hf-datasets%2F65740%2F1 "2023-12-14T00:59:13Z")

</div>

Hello,  
I hope someone can help me to figure out the weird issue with load\_datasets on my PC (Ubuntu LTS 22.04).  
It took a lot of times to just load a dataset from Huggingface like “imdb”, “PolyAI/Banking77”  
It did not raise errors (as you can see the completion status in the below screenshots), but the time to complete is surely abnormal (see the below screenshot):

- 40 minutes for a light dataset to load at the first time
- Retry 2nd time with the same dataset also took 11 minutes
- on my Mac laptop, this just takes under 1 minutes (with same wifi)

- I tried to reinstall datasets (version 2.15.0) and many ways but it does not fix this issue. I tested internet speed and it is absolutely normal (e.g., downloading models from HF is normal). Note that loading local datasets is working normally.

 ![Screenshot from 2023-12-14 07-57-26](https://us1.discourse-cdn.com/hellohellohello/original/3X/e/9/e957c4fb14f67517357862260063a2fe043a823e.png)

Thank you!

---

<div class="post-metadata">

**Author:** ![lhoestq](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lhoestq/32/52888_2.png) [@lhoestq](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Flhoestq)%5C
**Post date:** [December 15, 2023, 11:26am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fload-datasets-is-extremely-slow-in-loading-hf-datasets%2F65740%2F2 "2023-12-15T11:26:48Z")

</div>

Hi ! I just tried on colab and it’s quite fast now (30sec for imdb, 5sec for PolyAI/banking77). Maybe it was a transient issue ?

The raw data files of those datasets are hosted on GitHub. Maybe their hosting was slow yesterday somehow