# Fine tunning a Pre-trained Model

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tunning-a-pre-trained-model%2F86645%3E%5C
**Category:** Models\
**Created:** [May 14, 2024, 10:27am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tunning-a-pre-trained-model%2F86645 "2024-05-14T10:27:08Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![rishuhuhu](https://avatars.discourse-cdn.com/v4/letter/r/3ab097/32.png) [@rishuhuhu](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Frishuhuhu)%5C
**Post date:** [May 14, 2024, 10:27am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tunning-a-pre-trained-model%2F86645%2F1 "2024-05-14T10:27:08Z")

</div>

I want to fine tune distilBERT for news classification, But instead of using

```auto
model_checkpoint = "distilbert-base-uncased"

```

I want to use “dima806/news-category-classifier-distilbert” model for fine tunning, as it is already been trained on news data. How can I do that?

 ![Screenshot 2024-05-13 232416](https://us1.discourse-cdn.com/hellohellohello/original/3X/0/f/0f5e596717bdb707420f1c8c992a19258c55fca9.png)  
I am getting the above error !!