# Use BertLMHeadModel to finetunning a language model

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fuse-bertlmheadmodel-to-finetunning-a-language-model%2F5200%3E%5C
**Category:** 🤗Transformers\
**Created:** [March 30, 2021, 7:38am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fuse-bertlmheadmodel-to-finetunning-a-language-model%2F5200 "2021-03-30T07:38:33Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![davidhu](https://avatars.discourse-cdn.com/v4/letter/d/5e9695/32.png) [@davidhu](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fdavidhu)%5C
**Post date:** [March 30, 2021, 7:38am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fuse-bertlmheadmodel-to-finetunning-a-language-model%2F5200%2F1 "2021-03-30T07:38:33Z")

</div>

Is it possible to use BertLMHeadModel to finetune a language model if i set the is\_decoder=True ?