# Datasets mapping slow down in the end

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdatasets-mapping-slow-down-in-the-end%2F137519%3E%5C
**Category:** 🤗Datasets\
**Created:** [January 27, 2025, 10:13am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdatasets-mapping-slow-down-in-the-end%2F137519 "2025-01-27T10:13:45Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![sleepywalker](https://avatars.discourse-cdn.com/v4/letter/s/6f9a4e/32.png) [@sleepywalker](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsleepywalker)%5C
**Post date:** [January 27, 2025, 10:13am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdatasets-mapping-slow-down-in-the-end%2F137519%2F1 "2025-01-27T10:13:45Z")

</div>

Hello! Can someone explain is it possible to fix dataset.map slowing down in the end with num\_of\_processes \> 1? For example, I got dataset with 60 millions samples and 98% of this dataset processed in 30 minutes and processes like 20k samples per second but from 98% to 99% it took 11 hours and processes few samples per second. I tried to reduce num\_of\_processes but it didn’t help. I’ve read other topics about it and answers from @lhoestq but I didn’t find any relevant answer