# \`accelerate config\` alternative for multi-node training

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Faccelerate-config-alternative-for-multi-node-training%2F22567%3E%5C
**Category:** 🤗Accelerate\
**Created:** [September 5, 2022, 2:06pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Faccelerate-config-alternative-for-multi-node-training%2F22567 "2022-09-05T14:06:33Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![cyk1337](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/cyk1337/32/24460_2.png) [@cyk1337](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fcyk1337)%5C
**Post date:** [September 5, 2022, 2:06pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Faccelerate-config-alternative-for-multi-node-training%2F22567%2F1 "2022-09-05T14:06:33Z")

</div>

For multi-node training, the `accelerate` library requires manually running `accelerate config` on each machine. It is inconvenient if the node number exceeds 10+ (manually setting the configuration for 10+ times). Is there a solution that we can automatically generate the config file on each machine?

---

<div class="post-metadata">

**Author:** ![muellerzr](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/muellerzr/32/21583_2.png) [@muellerzr](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmuellerzr)%5C
**Post date:** [September 5, 2022, 9:29pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Faccelerate-config-alternative-for-multi-node-training%2F22567%2F2 "2022-09-05T21:29:47Z")

</div>

> [@cyk1337](#):
>
> Is there a solution that we can automatically generate the config file on each machine?

You can just use the same single yaml and tweak it for the node number, and copy/paste onto each machine.

> **[Launching your 🤗 Accelerate scripts](https://huggingface.co/docs/accelerate/basic_tutorials/launch#custom-configurations)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

---

<div class="post-metadata">

**Author:** ![cyk1337](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/cyk1337/32/24460_2.png) [@cyk1337](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fcyk1337)%5C
**Post date:** [September 6, 2022, 2:04am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Faccelerate-config-alternative-for-multi-node-training%2F22567%2F3 "2022-09-06T02:04:40Z")

</div>

Hi @muellerzr, I was wondering whether there is such a tool. If not, I would develop one. Thank you very much for your answers.
