# Seq2seq optimizer

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fseq2seq-optimizer%2F71605%3E%5C
**Category:** 🤗AutoTrain\
**Created:** [February 2, 2024, 12:50pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fseq2seq-optimizer%2F71605 "2024-02-02T12:50:28Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![FoodIntake](https://avatars.discourse-cdn.com/v4/letter/f/74df32/32.png) [@FoodIntake](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FFoodIntake)%5C
**Post date:** [February 2, 2024, 12:50pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fseq2seq-optimizer%2F71605%2F1 "2024-02-02T12:50:28Z")

</div>

I’ve looked through topics about fine-tuning t5 models and saw recommendations to use AdaFactor:  
" Additional training tips:

- T5 models need a slightly higher learning rate than the default one set in the `Trainer` when using the AdamW optimizer. Typically, 1e-4 and 3e-4 work well for most problems (classification, summarization, translation, question answering, question generation). Note that T5 was pre-trained using the AdaFactor optimizer."

Is there a way to set other optimizers except “optimizer”: “adamw\_torch”?