# Which data parallel does trainer use? DP or DDP?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhich-data-parallel-does-trainer-use-dp-or-ddp%2F16021%3E%5C
**Category:** 🤗Transformers\
**Created:** [March 24, 2022, 6:03am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhich-data-parallel-does-trainer-use-dp-or-ddp%2F16021 "2022-03-24T06:03:27Z")\
**Posts on this page:** 1\
**Showing post:** 3

<div class="post-metadata">

**Author:** ![brando](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/brando/32/30114_2.png) [@brando](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fbrando)%5C
**Post date:** [August 17, 2022, 3:03pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhich-data-parallel-does-trainer-use-dp-or-ddp%2F16021%2F3 "2022-08-17T15:03:18Z")

</div>

perhaps useful to you: [Using Transformers with DistributedDataParallel — any examples?](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fusing-transformers-with-distributeddataparallel-any-examples%2F10775)

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhich-data-parallel-does-trainer-use-dp-or-ddp%2F16021)._