# How much memory is needed for mbart-large-cc25?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-much-memory-is-needed-for-mbart-large-cc25%2F291%3E%5C
**Category:** 🤗Transformers\
**Created:** [July 15, 2020, 4:55am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-much-memory-is-needed-for-mbart-large-cc25%2F291 "2020-07-15T04:55:05Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![marton-avrios](https://avatars.discourse-cdn.com/v4/letter/m/ecae2f/32.png) [@marton-avrios](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmarton-avrios)%5C
**Post date:** [July 15, 2020, 4:55am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-much-memory-is-needed-for-mbart-large-cc25%2F291%2F1 "2020-07-15T04:55:05Z")

</div>

I tried to finetune without freezing but a 16GB V100 ran out of memory with batch size 1, max source length 512.

---

<div class="post-metadata">

**Author:** ![akhooli](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/akhooli/32/38599_2.png) [@akhooli](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fakhooli)%5C
**Post date:** [August 29, 2020, 3:19pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-much-memory-is-needed-for-mbart-large-cc25%2F291%2F2 "2020-08-29T15:19:33Z")

</div>

I am trying to run the mbart En-Ro example and I get CUDA OOM even with max\_len 64, n\_train 5000 and bs 1 (using Google colab with 15GB gpu P8).  
Anyone managed to run it with under 16 GB?