# Failed to create LLM 'llama' from .GGUF

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffailed-to-create-llm-llama-from-gguf%2F132965%3E%5C
**Category:** Beginners\
**Created:** [December 25, 2024, 6:24am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffailed-to-create-llm-llama-from-gguf%2F132965 "2024-12-25T06:24:11Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![VolcanoJ](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/volcanoj/32/38101_2.png) [@VolcanoJ](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FVolcanoJ)%5C
**Post date:** [December 25, 2024, 6:24am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffailed-to-create-llm-llama-from-gguf%2F132965%2F1 "2024-12-25T06:24:11Z")

</div>

I was able to get some code together that let me run several of the models stored here successfully. I focused on llama 7b GGUF models. Then I wanted to fine tune it using LoRA. Then I merged the weights back in, quantized it, and converted it to GGUF. However, when I try to load the new GGUF model using the same code for the model I downloaded I get the error:  
Error loading model: Failed to create LLM ‘llama’ from ‘D:\models\finalModel\finalModel.gguf’.  
I’ve torn apart the ctransformer AutoModelForCausalLM.from\_pretrained() method and executed in a scratch environment and both models seem to be loading pretty much the same up until they get to avx2/ctransformers.dll and then it switches from python to c++ and I can’t continue inspecting them.  
I’ve parsed the binaries as best I can and see they both have the Magic Number set to GGUF and a matching tensor count. I’m not sure how to figure out what is causing that error or what other comparisons I can do.