# Train reformer QA model from pre-trained model

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftrain-reformer-qa-model-from-pre-trained-model%2F24731%3E%5C
**Category:** 🤗Transformers\
**Created:** [October 20, 2022, 12:24pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftrain-reformer-qa-model-from-pre-trained-model%2F24731 "2022-10-20T12:24:18Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![franko99](https://avatars.discourse-cdn.com/v4/letter/f/f475e1/32.png) [@franko99](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Ffranko99)%5C
**Post date:** [October 20, 2022, 12:24pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftrain-reformer-qa-model-from-pre-trained-model%2F24731%2F1 "2022-10-20T12:24:18Z")

</div>

Hi, i’m trying to train a reformer from a pre-trainend model like “google/crime-and-punishment” and “google/enwiki8”. Is it possible? I have a lot of problems about that
