# Longformer for sequenceclassification
**URL:**
**Author:**  [@shainaraza](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fshainaraza)%5C
**Post date:** [October 12, 2020, 7:00pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flongformer-for-sequenceclassification%2F1496%2F1 "2020-10-12T19:00:40Z")
I am using the Longformer for sequence classification task (taking example code from here), the model is running somehow on a small batch, the issue is with the wrong predictions, is there any example of the Longformer sequence classification for GLUE tasks.
thanks
---
**Author:**  [@valhalla](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fvalhalla)%5C
**Post date:** [October 13, 2020, 7:20am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flongformer-for-sequenceclassification%2F1496%2F2 "2020-10-13T07:20:31Z")
try the example script [here](https://github.com/huggingface/transformers/tree/master/examples/text-classification)
---
**Author:**  [@shainaraza](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fshainaraza)%5C
**Post date:** [October 13, 2020, 10:28am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flongformer-for-sequenceclassification%2F1496%2F3 "2020-10-13T10:28:09Z")
thanks, so instead of --model\_name\_or\_path bert-base-multilingual-uncased , I could use longformer?
---
**Author:**  [@valhalla](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fvalhalla)%5C
**Post date:** [October 13, 2020, 10:49am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flongformer-for-sequenceclassification%2F1496%2F4 "2020-10-13T10:49:25Z")
Yes, all you’ll need to do is change the model name!
---
**Author:**  [@shainaraza](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fshainaraza)%5C
**Post date:** [October 13, 2020, 12:34pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flongformer-for-sequenceclassification%2F1496%2F5 "2020-10-13T12:34:49Z")
thanks @valhalla appreciate yours response everytime
---
**Author:**  [@shainaraza](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fshainaraza)%5C
**Post date:** [October 13, 2020, 4:59pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flongformer-for-sequenceclassification%2F1496%2F6 "2020-10-13T16:59:33Z")
can you check this notebook quickly, where am I going wrong, the predictions are too poor, I just take a sample of dataset during fine-tuning because of performance issue
>