# Parsing dataset

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fparsing-dataset%2F69559%3E%5C
**Category:** Beginners\
**Created:** [January 18, 2024, 1:10am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fparsing-dataset%2F69559 "2024-01-18T01:10:02Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![DongJunChan](https://avatars.discourse-cdn.com/v4/letter/d/47e85d/32.png) [@DongJunChan](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FDongJunChan)%5C
**Post date:** [January 18, 2024, 1:10am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fparsing-dataset%2F69559%2F1 "2024-01-18T01:10:02Z")

</div>

Hi I am examining open source datasets, specifically tiiuae/falcon-refinedweb. I have set streaming = True to avoid downloading the whole dataset.  
Are there any ways I can speed up the process of iterating through the dataset? I am currently exploring using multiprocessing and numba. I am not sure if numba will work.  
Any other suggestion is welcomed =) TIA!
