# Fintuning Transformer on CLEF dataset

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffintuning-transformer-on-clef-dataset%2F9584%3E%5C
**Category:** 🤗Transformers\
**Created:** [August 30, 2021, 8:13am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffintuning-transformer-on-clef-dataset%2F9584 "2021-08-30T08:13:39Z")\
**Posts on this page:** 1\
**Showing post:** 7

<div class="post-metadata">

**Author:** ![lewtun](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lewtun/32/30995_2.png) [@lewtun](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Flewtun)%5C
**Post date:** [September 2, 2021, 11:46am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffintuning-transformer-on-clef-dataset%2F9584%2F7 "2021-09-02T11:46:44Z")

</div>

One other thing regarding long-contexts: you can also try using a sliding window approach as suggested in [this thread](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flongformer-and-sentiment-analysis%2F9416%2F6).

This is actually how the question-answering pipelines are able to handle long contexts and I think the above suggestion could also work nicely in your case 🙂

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffintuning-transformer-on-clef-dataset%2F9584)._