# GPT-GPT encoder decoder

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fgpt-gpt-encoder-decoder%2F5968%3E%5C
**Category:** 🤗Transformers\
**Created:** [May 4, 2021, 9:37am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fgpt-gpt-encoder-decoder%2F5968 "2021-05-04T09:37:17Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Yeah](https://avatars.discourse-cdn.com/v4/letter/y/dbc845/32.png) [@Yeah](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FYeah)%5C
**Post date:** [May 4, 2021, 9:37am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fgpt-gpt-encoder-decoder%2F5968%2F1 "2021-05-04T09:37:18Z")

</div>

May i create an encoder decoder in transformer, in which the encoder and decoder part both are GPT2.  
Anyone has suggestion for that?

Thanks a lot and appreciate for any feedback.