# Fine-Tune TrOCR on Arabic

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tune-trocr-on-arabic%2F25577%3E%5C
**Category:** Beginners\
**Created:** [November 5, 2022, 10:30am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tune-trocr-on-arabic%2F25577 "2022-11-05T10:30:23Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![AbrarMAO](https://avatars.discourse-cdn.com/v4/letter/a/cab0a1/32.png) [@AbrarMAO](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FAbrarMAO)%5C
**Post date:** [November 5, 2022, 10:30am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tune-trocr-on-arabic%2F25577%2F1 "2022-11-05T10:30:23Z")

</div>

I am trying to fine-tune TrOCR on Arabic, I followed [TrOCR Fine-Tune Tutorials by @NielsRogge](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/TrOCR/Fine_tune_TrOCR_on_IAM_Handwriting_Database_using_Seq2SeqTrainer.ipynb), choose a suitable encoder/decoder option suggested by @NielsRogge on discussion board but I get very high WER score and the generated text is gibberish, I tried the pytorch implementation and it generated text prediction to continue the sentence instead of writing the sentence in the image.

[Notebook of Code](https://github.com/AbrarAlotaibi/TrOCR-FineTune/blob/main/ocr-trasformer.ipynb)

---

<div class="post-metadata">

**Author:** ![AlhitawiMohammed22](https://avatars.discourse-cdn.com/v4/letter/a/b5a626/32.png) [@AlhitawiMohammed22](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FAlhitawiMohammed22)%5C
**Post date:** [April 15, 2023, 4:06pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tune-trocr-on-arabic%2F25577%2F2 "2023-04-15T16:06:05Z")

</div>

It seems you have a configuration issue

 ![image](https://us1.discourse-cdn.com/hellohellohello/original/2X/0/0dea260788dd41bd5d0df97659dd639907965909.png)

---

<div class="post-metadata">

**Author:** ![AbrarMAO](https://avatars.discourse-cdn.com/v4/letter/a/cab0a1/32.png) [@AbrarMAO](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FAbrarMAO)%5C
**Post date:** [May 21, 2023, 6:10am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tune-trocr-on-arabic%2F25577%2F3 "2023-05-21T06:10:26Z")

</div>

how should  
I fix it?

---

<div class="post-metadata">

**Author:** ![Cherryblade29](https://avatars.discourse-cdn.com/v4/letter/c/e95f7d/32.png) [@Cherryblade29](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FCherryblade29)%5C
**Post date:** [August 24, 2024, 1:54pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tune-trocr-on-arabic%2F25577%2F4 "2024-08-24T13:54:30Z")

</div>

did you arrive to a solution ?  
check mine and tell me : [(successful run)HandWritten-OCR-TrOCR (kaggle.com)](https://www.kaggle.com/code/cherryblade29/successful-run-handwritten-ocr-trocr)
