# TPU slow finetuning T5-base

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftpu-slow-finetuning-t5-base%2F14629%3E%5C
**Category:** Models\
**Created:** [February 11, 2022, 3:27pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftpu-slow-finetuning-t5-base%2F14629 "2022-02-11T15:27:22Z")\
**Posts on this page:** 1\
**Showing post:** 11

<div class="post-metadata">

**Author:** ![phosseini](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/phosseini/32/26690_2.png) [@phosseini](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fphosseini)%5C
**Post date:** [March 3, 2022, 3:10am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftpu-slow-finetuning-t5-base%2F14629%2F11 "2022-03-03T03:10:37Z")

</div>

For folks who are still struggling, I think I found one potential reason for why training on TPU is slow, look [here](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhen-can-we-expect-tpu-trainer%2F10353%2F5) (I set padding to `True` in my tokenizer and I’m already seeing a speedup in my TPU training, basically it looks like it didn’t have anything to do with my torch xla installation)

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftpu-slow-finetuning-t5-base%2F14629)._