# DialoGPT fine-tuning dataset format

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdialogpt-fine-tuning-dataset-format%2F5682%3E%5C
**Category:** Models\
**Created:** [April 22, 2021, 10:26am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdialogpt-fine-tuning-dataset-format%2F5682 "2021-04-22T10:26:41Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![HatterTheMad](https://avatars.discourse-cdn.com/v4/letter/h/91b2a8/32.png) [@HatterTheMad](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FHatterTheMad)%5C
**Post date:** [April 22, 2021, 10:26am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdialogpt-fine-tuning-dataset-format%2F5682%2F1 "2021-04-22T10:26:42Z")

</div>

I experience issues with training the model directly from the .csv file, I think I am doing something wrong with the formatting. Can somebody share an example of the format?

**@patrickvonplaten** by any chance?

---

<div class="post-metadata">

**Author:** ![HatterTheMad](https://avatars.discourse-cdn.com/v4/letter/h/91b2a8/32.png) [@HatterTheMad](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FHatterTheMad)%5C
**Post date:** [April 22, 2021, 11:10pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdialogpt-fine-tuning-dataset-format%2F5682%2F2 "2021-04-22T23:10:52Z")

</div>

May be you can help @julien-c ?

---

<div class="post-metadata">

**Author:** ![julien-c](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/julien-c/32/41937_2.png) [@julien-c](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fjulien-c)%5C
**Post date:** [April 23, 2021, 10:16am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdialogpt-fine-tuning-dataset-format%2F5682%2F3 "2021-04-23T10:16:33Z")

</div>

Which script or service (AutoNLP?) are you using to train?

---

<div class="post-metadata">

**Author:** ![HatterTheMad](https://avatars.discourse-cdn.com/v4/letter/h/91b2a8/32.png) [@HatterTheMad](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FHatterTheMad)%5C
**Post date:** [April 27, 2021, 4:59pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdialogpt-fine-tuning-dataset-format%2F5682%2F4 "2021-04-27T16:59:03Z")

</div>

Sorry. I am not sure I understand it correctly. I am trying to appropriate this [git](https://github.com/Xirider/finetune-gpt2xl) for my model’s training. I use “DeepSpeed” is that what you are looking for?