# Models for Multilingual Classification Tasks

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmodels-for-multilingual-classification-tasks%2F13003%3E%5C
**Category:** Models\
**Created:** [December 21, 2021, 10:21am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmodels-for-multilingual-classification-tasks%2F13003 "2021-12-21T10:21:17Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![mox](https://avatars.discourse-cdn.com/v4/letter/m/f04885/32.png) [@mox](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmox)%5C
**Post date:** [December 21, 2021, 10:21am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmodels-for-multilingual-classification-tasks%2F13003%2F1 "2021-12-21T10:21:17Z")

</div>

Hello,

I want to build a multilingual classification model (english, hindi, malayalam…) and wanted to ask if anyone has some suggentions which models to use. I would like to explore the performance of different models.  
So which models are good in general for the usecase of a text classification with different languages?

Thanks in advance!

---

<div class="post-metadata">

**Author:** ![nielsr](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/nielsr/32/39617_2.png) [@nielsr](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fnielsr)%5C
**Post date:** [December 21, 2021, 1:53pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmodels-for-multilingual-classification-tasks%2F13003%2F2 "2021-12-21T13:53:17Z")

</div>

Some great multilingual models:

- [multilingual BERT](https://huggingface.co/bert-base-multilingual-cased)/[DistilBERT](https://huggingface.co/distilbert-base-multilingual-cased)
- [XLM-RoBERTa](https://huggingface.co/docs/transformers/model_doc/xlmroberta)
- [RemBERT](https://huggingface.co/docs/transformers/model_doc/rembert)
- [CANINE](https://huggingface.co/docs/transformers/model_doc/canine)

These are all encoder-only Transformer models (great for classification, question-answering, NER,…).  
CANINE is a relatively new model that is tokenizer-free, meaning it’s a character-level model and does not require an explicit tokenization step.

For summarization/translation/etc. (seq2seq tasks), [mT5](https://huggingface.co/docs/transformers/model_doc/mt5) is a great model.

---

<div class="post-metadata">

**Author:** ![mox](https://avatars.discourse-cdn.com/v4/letter/m/f04885/32.png) [@mox](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmox)%5C
**Post date:** [December 21, 2021, 2:40pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmodels-for-multilingual-classification-tasks%2F13003%2F3 "2021-12-21T14:40:15Z")

</div>

Thanks for your answer! I am looking for classification models, so the first ones look good for me! 🙂