# 504 Gateway Time-out in Inference Server Endpoints

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2F504-gateway-time-out-in-inference-server-endpoints%2F66410%3E%5C
**Category:** Inference Endpoints on the Hub\
**Created:** [December 20, 2023, 5:06am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2F504-gateway-time-out-in-inference-server-endpoints%2F66410 "2023-12-20T05:06:55Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![deepsync](https://avatars.discourse-cdn.com/v4/letter/d/c77e96/32.png) [@deepsync](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fdeepsync)%5C
**Post date:** [December 20, 2023, 5:06am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2F504-gateway-time-out-in-inference-server-endpoints%2F66410%2F1 "2023-12-20T05:06:55Z")

</div>

On calling a large Whisper model, with a certain longer audio file, it seems to give 504 Gateway Time-out on a POST request to the API.  
I had used the model on Spaces as well, and it had worked quite well, when being tested on multiple larger audio files.  
Point to note is that I started getting this error from 19th December 2023, it was running quite smoothly before that.

---

<div class="post-metadata">

**Author:** ![michellehbn](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/michellehbn/32/58964_2.png) [@michellehbn](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmichellehbn)%5C
**Post date:** [December 20, 2023, 10:18am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2F504-gateway-time-out-in-inference-server-endpoints%2F66410%2F2 "2023-12-20T10:18:33Z")

</div>

Hi @deepsync , Thanks for reporting. We’ll take a look and get back to you soon.

---

<div class="post-metadata">

**Author:** ![rexmadden](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/rexmadden/32/22308_2.png) [@rexmadden](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Frexmadden)%5C
**Post date:** [December 20, 2023, 5:11pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2F504-gateway-time-out-in-inference-server-endpoints%2F66410%2F3 "2023-12-20T17:11:23Z")

</div>

We’re having the same problem that started yesterday at 5am Eastern Time.

---

<div class="post-metadata">

**Author:** ![deepsync](https://avatars.discourse-cdn.com/v4/letter/d/c77e96/32.png) [@deepsync](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fdeepsync)%5C
**Post date:** [December 21, 2023, 5:29am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2F504-gateway-time-out-in-inference-server-endpoints%2F66410%2F4 "2023-12-21T05:29:40Z")

</div>

Thank you @michellehbn  
Looking forward to the solution. Also, if possible, it would be great if you can let us know the cause of it.

---

<div class="post-metadata">

**Author:** ![feliperafael](https://avatars.discourse-cdn.com/v4/letter/f/ac91a4/32.png) [@feliperafael](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Ffeliperafael)%5C
**Post date:** [December 21, 2023, 8:54am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2F504-gateway-time-out-in-inference-server-endpoints%2F66410%2F5 "2023-12-21T08:54:07Z")

</div>

exactly the same problem here. In fact, if I try to send short audios I don’t get the 504 error. Audios longer than 5 minutes are giving 504

---

<div class="post-metadata">

**Author:** ![michellehbn](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/michellehbn/32/58964_2.png) [@michellehbn](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmichellehbn)%5C
**Post date:** [December 21, 2023, 3:05pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2F504-gateway-time-out-in-inference-server-endpoints%2F66410%2F6 "2023-12-21T15:05:23Z")

</div>

Hi @feliperafael @deepsync @rexmadden, Thanks for bearing with us while we investigated. We’ve applied a fix and this should now be working as expected. Please let us know though if that’s not the case.

---

<div class="post-metadata">

**Author:** ![feliperafael](https://avatars.discourse-cdn.com/v4/letter/f/ac91a4/32.png) [@feliperafael](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Ffeliperafael)%5C
**Post date:** [December 21, 2023, 4:40pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2F504-gateway-time-out-in-inference-server-endpoints%2F66410%2F7 "2023-12-21T16:40:44Z")

</div>

I haven’t had any more issues over here. Thanks for the quick support.
