# Fine tuning LoRa merge

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tuning-lora-merge%2F68647%3E%5C
**Category:** Beginners\
**Created:** [January 10, 2024, 11:23am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tuning-lora-merge%2F68647 "2024-01-10T11:23:36Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Federic](https://avatars.discourse-cdn.com/v4/letter/f/e99b99/32.png) [@Federic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FFederic)%5C
**Post date:** [January 10, 2024, 11:23am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tuning-lora-merge%2F68647%2F1 "2024-01-10T11:23:36Z")

</div>

After finished fine tuning with model using LoRA, i need to merge adapter and model. If I use a 4bit bitsandbytes configuration I have to merge the adapter with the same model 4bit or with the full model ?
