# Model size doubles after finetuning

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmodel-size-doubles-after-finetuning%2F17807%3E%5C
**Category:** Models\
**Created:** [May 11, 2022, 8:31am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmodel-size-doubles-after-finetuning%2F17807 "2022-05-11T08:31:16Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![sripaad](https://avatars.discourse-cdn.com/v4/letter/s/9de0a6/32.png) [@sripaad](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsripaad)%5C
**Post date:** [May 11, 2022, 8:31am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmodel-size-doubles-after-finetuning%2F17807%2F1 "2022-05-11T08:31:16Z")

</div>

I noticed that deberta-v3-small(~273 MB) and MiniLM-L6-H768(~157 MB) model size increased by a lot to 541MB and 313MB respectively post finetuning.  
More details :  
AutoModelForSequenceClassification(5 labels)  
used default trainer and training args with minor changes  
warmup = 0.3  
decay = 0.03  
32 bs  
I am having trouble understanding why, does anyone have any clue?