# Is there any pretraining script for BART?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fis-there-any-pretraining-script-for-bart%2F710%3E%5C
**Category:** 🤗Transformers\
**Created:** [August 14, 2020, 7:17am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fis-there-any-pretraining-script-for-bart%2F710 "2020-08-14T07:17:52Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![eagle705](https://avatars.discourse-cdn.com/v4/letter/e/91b2a8/32.png) [@eagle705](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Feagle705)%5C
**Post date:** [August 14, 2020, 7:17am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fis-there-any-pretraining-script-for-bart%2F710%2F1 "2020-08-14T07:17:52Z")

</div>

Hi all,

I’m looking for pretraining script for BART.

I have a plan for pretraining BART model in Korean but I can not find any pretraining script even in fairseq repo ([https://github.com/pytorch/fairseq/issues/1614](https://github.com/pytorch/fairseq/issues/1614)).

is there any suggestion to pretrain model for other language?

thx 🙂