# Regarding GGUF Quantize model

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fregarding-gguf-quantize-model%2F84477%3E%5C
**Category:** Models\
**Created:** [April 30, 2024, 7:55am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fregarding-gguf-quantize-model%2F84477 "2024-04-30T07:55:16Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![akarshan8001](https://avatars.discourse-cdn.com/v4/letter/a/977dab/32.png) [@akarshan8001](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fakarshan8001)%5C
**Post date:** [April 30, 2024, 7:55am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fregarding-gguf-quantize-model%2F84477%2F1 "2024-04-30T07:55:17Z")

</div>

I have use PEFT lora technique to fine tune a mistral model i used bit and byte for my quantization so wanted to where its saving ,mu quantize model and how i can use quantize model with my adapter layer. if any reference please share article