# Multiple queries at same time to same endpoint

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultiple-queries-at-same-time-to-same-endpoint%2F139454%3E%5C
**Category:** Inference Endpoints on the Hub\
**Created:** [February 7, 2025, 7:24am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultiple-queries-at-same-time-to-same-endpoint%2F139454 "2025-02-07T07:24:55Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![alckasoc](https://avatars.discourse-cdn.com/v4/letter/a/7feea3/32.png) [@alckasoc](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Falckasoc)%5C
**Post date:** [February 7, 2025, 7:24am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultiple-queries-at-same-time-to-same-endpoint%2F139454%2F1 "2025-02-07T07:24:55Z")

</div>

Hello,

I have an endpoint and my team and I are sending requests to the same endpoint and it ends up crashing our individual runs. Do endpoints allow for concurrent queries and, if so, are there any changes done in the setup creation of the endpoint?

Thanks!

---

<div class="post-metadata">

**Author:** ![meganariley](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/meganariley/32/56966_2.png) [@meganariley](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmeganariley)%5C
**Post date:** [February 7, 2025, 11:10pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultiple-queries-at-same-time-to-same-endpoint%2F139454%2F2 "2025-02-07T23:10:34Z")

</div>

Hey @alckasoc! Are you using autoscaling at all with your endpoints? The default scaling of endpoints is based on hardware utilization with 80% threshold. It might be helpful to look at lowering the threshold, or switch to pending requests, and increasing the max replicas above 1. Please feel free to check out [Autoscaling](https://huggingface.co/docs/inference-endpoints/autoscaling) for more information and let us know how it goes!

---

<div class="post-metadata">

**Author:** ![alckasoc](https://avatars.discourse-cdn.com/v4/letter/a/7feea3/32.png) [@alckasoc](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Falckasoc)%5C
**Post date:** [February 8, 2025, 4:58am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultiple-queries-at-same-time-to-same-endpoint%2F139454%2F3 "2025-02-08T04:58:53Z")

</div>

Hi @meganariley , with each replica, does the price per hour increase? What if I’m at the quota limit for the hardware? I think right now I’m using 8 x A100s and I’m at the quota limit.