# Text generation, LLMs and fine-tuning

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftext-generation-llms-and-fine-tuning%2F27492%3E%5C
**Category:** Beginners\
**Created:** [December 8, 2022, 9:26pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftext-generation-llms-and-fine-tuning%2F27492 "2022-12-08T21:26:41Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Lolorent](https://avatars.discourse-cdn.com/v4/letter/l/90db22/32.png) [@Lolorent](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FLolorent)%5C
**Post date:** [December 8, 2022, 9:26pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftext-generation-llms-and-fine-tuning%2F27492%2F1 "2022-12-08T21:26:41Z")

</div>

I have a few questions I would like to ask to my favorite experts. 😉

I have a big dataset with 50 millions of entries. Each entry is a text that could be assimilated to a tweet/midjourney prompt (between 50-100 words, sentence and/or keywords).

I would like to find the best LLM models to be able to generate new random entries. I still don’t know what model to use.

1. If I use GPT3+fine-tuning, I assume it’s state of the art but it will cost me a $$$$.

2. If I use huggingface,

3. If I want to run a light model on my Nvidia 3090 RTX, what model can I use? GPT2-Large? GPT2-XL? Bloom 1B? GPT-NeoX?

4. Maybe I do not need to use all these LLMs and I can use BERT models, like ROBERTa, distilbert, etc. It will make the job perfectly? Which one to use? 😃

Thanks in advance for all your help! I definitively need it. 😉