# Request for Further Information on Datasets

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Frequest-for-further-information-on-datasets%2F2251%3E%5C
**Category:** Beginners\
**Created:** [November 26, 2020, 10:58am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Frequest-for-further-information-on-datasets%2F2251 "2020-11-26T10:58:18Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Piyumal](https://avatars.discourse-cdn.com/v4/letter/p/3d9bf3/32.png) [@Piyumal](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FPiyumal)%5C
**Post date:** [November 26, 2020, 10:58am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Frequest-for-further-information-on-datasets%2F2251%2F1 "2020-11-26T10:58:18Z")

</div>

Hi,

I am a newbie to NLP. However I am using the pre-trained models for my research on memory characterization. If someone can provide me details or a pointer to where I can get information on which datasets the following inbuilt models were trained, I would greatly appreciate:  
1.BERT  
2.DistilBERT  
3. Roberta  
3. OpenAI GPT2  
4. Albert  
5. XLNet  
6. Transfomer XL

Thank You!