# Finetune LLaMA2 model with datasets missing labels

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetune-llama2-model-with-datasets-missing-labels%2F73310%3E%5C
**Category:** 🤗Transformers\
**Created:** [February 15, 2024, 12:25pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetune-llama2-model-with-datasets-missing-labels%2F73310 "2024-02-15T12:25:37Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Gloria79](https://avatars.discourse-cdn.com/v4/letter/g/f07891/32.png) [@Gloria79](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FGloria79)%5C
**Post date:** [February 15, 2024, 12:25pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetune-llama2-model-with-datasets-missing-labels%2F73310%2F1 "2024-02-15T12:25:37Z")

</div>

Hello,

I’ve reviewed examples of fine-tuning the LLaMA2 model, but it appears that only labeled datasets are used for fine-tuning.

I’m curious if I can fine-tune the LLaMA2 model to learn the style of text (e.g., all the texts in the datasets are from Shakespeare).

In particular, I believe using autotrain-advanced is an effective tool for fine-tuning, but it necessitates a specific text format (i.e., ### Human: xxx ### Assistant: xxx).

Any comments are welcome.