# Accuracy drops using Gradient checkpointing

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Faccuracy-drops-using-gradient-checkpointing%2F53953%3E%5C
**Category:** 🤗Transformers\
**Created:** [September 7, 2023, 2:22pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Faccuracy-drops-using-gradient-checkpointing%2F53953 "2023-09-07T14:22:33Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![jaideepcs](https://avatars.discourse-cdn.com/v4/letter/j/ecae2f/32.png) [@jaideepcs](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fjaideepcs)%5C
**Post date:** [September 7, 2023, 2:22pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Faccuracy-drops-using-gradient-checkpointing%2F53953%2F1 "2023-09-07T14:22:33Z")

</div>

Hi,  
I am not able to replicate same performance as without using gradient checkpointing.  
With Gradient ckp eval metrics is half without gradient ckp. I use lora adpaters . Am i missing any thing ?
