# PAD with Collator

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpad-with-collator%2F6377%3E%5C
**Category:** 🤗Datasets\
**Created:** [May 25, 2021, 8:54pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpad-with-collator%2F6377 "2021-05-25T20:54:14Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Felipehonorato](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/felipehonorato/32/48418_2.png) [@Felipehonorato](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FFelipehonorato)%5C
**Post date:** [May 25, 2021, 8:54pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpad-with-collator%2F6377%2F1 "2021-05-25T20:54:14Z")

</div>

Hey guys. I’m trying to fine-tune a GPT2 model using the DataCollatorForLanguageModelling, but I’m getting a message like:

 ![image](https://us1.discourse-cdn.com/hellohellohello/original/2X/b/bed01ab1b72b9996c79a85b6aa25339aa6c3de23.png)  
I’m not asking to pad it anywhere, does anyone has a clue about what should be going wrong?

---

<div class="post-metadata">

**Author:** ![lhoestq](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lhoestq/32/52888_2.png) [@lhoestq](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Flhoestq)%5C
**Post date:** [June 4, 2021, 9:36am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpad-with-collator%2F6377%2F2 "2021-06-04T09:36:44Z")

</div>

Hi ! I think some users have already experienced this issue and found a fix in this thread:  
[https://github.com/huggingface/transformers/issues/3859](https://github.com/huggingface/transformers/issues/3859)

I hope that helps 🙂