# Quantizing Facebook's segment anything model

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fquantizing-facebooks-segment-anything-model%2F42674%3E%5C
**Category:** Beginners\
**Created:** [June 9, 2023, 4:02pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fquantizing-facebooks-segment-anything-model%2F42674 "2023-06-09T16:02:08Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![shaivalp](https://avatars.discourse-cdn.com/v4/letter/s/eada6e/32.png) [@shaivalp](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fshaivalp)%5C
**Post date:** [June 9, 2023, 4:02pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fquantizing-facebooks-segment-anything-model%2F42674%2F1 "2023-06-09T16:02:08Z")

</div>

Hello,  
I am trying to quantize Facebook’s segment anything transformer model “facebook/sam-vit-huge”, especially the encoder side so that I can get a lower inference time. I have an NVIDIA RTX 3060 12GB RAM GPU. Can anyone help me get started with this?

---

<div class="post-metadata">

**Author:** ![1elsa1](https://avatars.discourse-cdn.com/v4/letter/1/7ab992/32.png) [@1elsa1](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2F1elsa1)%5C
**Post date:** [June 28, 2023, 10:06am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fquantizing-facebooks-segment-anything-model%2F42674%2F2 "2023-06-28T10:06:37Z")

</div>

I concern too