# Issue in Model Loading

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fissue-in-model-loading%2F105248%3E%5C
**Category:** Models\
**Created:** [September 4, 2024, 10:50am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fissue-in-model-loading%2F105248 "2024-09-04T10:50:01Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![saurabh2203](https://avatars.discourse-cdn.com/v4/letter/s/d9b06d/32.png) [@saurabh2203](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsaurabh2203)%5C
**Post date:** [September 4, 2024, 10:50am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fissue-in-model-loading%2F105248%2F1 "2024-09-04T10:50:01Z")

</div>

Hi , I tried to load , **meta-llama/Meta-Llama-3.1-70B** INT4 version but i am getting the fatal error as we have 32 GB Ram in my server…here model is loaded successfully but during prediction i am getting fatal error …can somebody help me on this