# Help with merging LoRA weights back into base model :-)

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhelp-with-merging-lora-weights-back-into-base-model%2F40968%3E%5C
**Category:** Beginners\
**Created:** [May 25, 2023, 2:04pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhelp-with-merging-lora-weights-back-into-base-model%2F40968 "2023-05-25T14:04:15Z")\
**Posts on this page:** 1\
**Showing post:** 10

<div class="post-metadata">

**Author:** ![nielsr](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/nielsr/32/39617_2.png) [@nielsr](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fnielsr)%5C
**Post date:** [May 1, 2024, 2:33pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhelp-with-merging-lora-weights-back-into-base-model%2F40968%2F10 "2024-05-01T14:33:04Z")

</div>

Hi,

I explain it in more detail : [Config.json is not saving after finetuning Llama 2 - #6 by nielsr](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fconfig-json-is-not-saving-after-finetuning-llama-2%2F56871%2F6)%2C hope you find it useful!

And this is a bit related: [Further finetuning a LoRA finetuned CausalLM Model - #4 by nielsr](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffurther-finetuning-a-lora-finetuned-causallm-model%2F36987%2F4)

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhelp-with-merging-lora-weights-back-into-base-model%2F40968)._