# HuggingArtists | Train a model to generate lyrics
**URL:**
**Author:**  [@AlekseyKorshuk](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FAlekseyKorshuk)%5C
**Post date:** [August 7, 2021, 3:28pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhuggingartists-train-a-model-to-generate-lyrics%2F9045%2F1 "2021-08-07T15:28:56Z")
In [HuggingArtists](https://github.com/AlekseyKorshuk/huggingartists), we can generate lyrics by a specific artist. This was made by fine-tuning a pre-trained [HuggingFace Transformer](https://huggingface.co/) on parsed datasets from [Genius](https://genius.com/).
As well, we use [Weights & Biases integration](https://docs.wandb.com/huggingface) to automatically log model performance and predictions.
[](https://wandb.ai/huggingartists/huggingartists)
Project repository:
[](https://github.com/AlekseyKorshuk/huggingartists)
## About
Create training script for TPU with Flax/JAX. So users can choose GPU or TPU in Colab.
## Model
A pre-trained GPT2 model in English and fine-tune it to learn English lyrics.
The GPT2 model, pre-trained in English: [link](https://huggingface.co/gpt2).
## Datasets
Parsed with [this script](https://github.com/AlekseyKorshuk/huggingartists/blob/master/datasets/parse.py) from [Genius](https://genius.com/).
## Training scripts
GPU with PyTorch is available in project Colab:
[](https://colab.research.google.com/github/AlekseyKorshuk/huggingartists/blob/master/huggingartists-demo.ipynb)
So we need to create for TPU with Flax/JAX.
## Project outcome
Create training script for TPU with Flax/JAX. So users can choose GPU or TPU in Colab.
## Challenges
- I am new with Flax/JAX, so I need some help.
- There is no other challenges 😉
## Conclusion
We can integrate this project with Video and Music generation so we can create our AI-Artist 🤘
I hope to find like-minded people and create a cool project 💥
---
**Author:**  [@julien-c](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fjulien-c)%5C
**Post date:** [August 8, 2021, 12:56pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhuggingartists-train-a-model-to-generate-lyrics%2F9045%2F2 "2021-08-08T12:56:21Z")
Wow this is really cool!
---
**Author:**  [@AlekseyKorshuk](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FAlekseyKorshuk)%5C
**Post date:** [August 8, 2021, 8:53pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhuggingartists-train-a-model-to-generate-lyrics%2F9045%2F3 "2021-08-08T20:53:47Z")
Thank you 🤗
Can we add this project to “[Community Notebooks](https://huggingface.co/transformers/master/community.html#community-notebooks)”?
I would be very pleased to be on this list 😊
---
**Author:**  [@sgugger](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsgugger)%5C
**Post date:** [August 9, 2021, 5:56am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhuggingartists-train-a-model-to-generate-lyrics%2F9045%2F4 "2021-08-09T05:56:26Z")
Sure, we’ll be happy to accept a PR with it!
---
**Author:**  [@AlekseyKorshuk](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FAlekseyKorshuk)%5C
**Post date:** [August 13, 2021, 8:12pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhuggingartists-train-a-model-to-generate-lyrics%2F9045%2F6 "2021-08-13T20:12:13Z")
@sgugger
Can I join spaces for this project?
---
**Author:**  [@AlekseyKorshuk](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FAlekseyKorshuk)%5C
**Post date:** [August 19, 2021, 9:25am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhuggingartists-train-a-model-to-generate-lyrics%2F9045%2F7 "2021-08-19T09:25:53Z")
HuggingArtists and Spaces integration is available now: [Huggingartists - a Hugging Face Space by AlekseyKorshuk](https://huggingface.co/spaces/AlekseyKorshuk/huggingartists)
Thanks to @osanseviero for adding me to Spaces 🤗