# T5 inference performance

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ft5-inference-performance%2F15494%3E%5C
**Category:** Models\
**Created:** [March 8, 2022, 9:53am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ft5-inference-performance%2F15494 "2022-03-08T09:53:41Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![YannAgora](https://avatars.discourse-cdn.com/v4/letter/y/c0e974/32.png) [@YannAgora](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FYannAgora)%5C
**Post date:** [March 8, 2022, 1:31pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ft5-inference-performance%2F15494%2F2 "2022-03-08T13:31:02Z")

</div>

Hey 👋,

Did you try quantization ?

There is an example for pegasus model [here](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpegasus-model-weights-compression-pruning%2F6381%2F9). I tried and it performed pretty well for summarization with an inference time decrease by 2x or 3x

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ft5-inference-performance%2F15494)._