# Possible encoder decoder models

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpossible-encoder-decoder-models%2F6742%3E%5C
**Category:** Beginners\
**Created:** [June 11, 2021, 9:44pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpossible-encoder-decoder-models%2F6742 "2021-06-11T21:44:46Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![scienceapptest](https://avatars.discourse-cdn.com/v4/letter/s/bcef8e/32.png) [@scienceapptest](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fscienceapptest)%5C
**Post date:** [June 11, 2021, 9:44pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpossible-encoder-decoder-models%2F6742%2F1 "2021-06-11T21:44:46Z")

</div>

Hi huggingface team,

Is there a list of compatible models that work with the `EncoderDecoder` model?

For instance the docs mention `BERT` Encoder/Decoder and I think @patrickvonplaten has written some beautiful notebooks using `RoBERTa`, but can it be used for models like the `Reformer` or `ALBERT`? in other words, is something like below possible?

```auto
config_encoder = AlbertConfig()
config_decoder = AlbertConfig()

config = EncoderDecoderConfig.from_encoder_decoder_configs(config_encoder, config_decoder)

```