# Albert giving OOM compared to Bert

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Falbert-giving-oom-compared-to-bert%2F2769%3E%5C
**Category:** Models\
**Created:** [December 10, 2020, 1:35pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Falbert-giving-oom-compared-to-bert%2F2769 "2020-12-10T13:35:04Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![hfawaz](https://avatars.discourse-cdn.com/v4/letter/h/ea666f/32.png) [@hfawaz](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fhfawaz)%5C
**Post date:** [December 10, 2020, 1:35pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Falbert-giving-oom-compared-to-bert%2F2769%2F1 "2020-12-10T13:35:04Z")

</div>

Hey,  
I am tried running on GTX 1080 (10GB) bert-base-uncased with sucess on IMDB dataset with a batch-size equal to 16 and sequence length equal to 128.  
Running albert-base-v2 with the same sequence length and same batch size is giving me Out-of-memory issues.  
Is the reason that Bert is uncased ? Is albert-base-v2 case or uncased ?