# How to add parameter in inference endpoint?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-add-parameter-in-inference-endpoint%2F44034%3E%5C
**Category:** Inference Endpoints on the Hub\
**Created:** [June 21, 2023, 12:10pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-add-parameter-in-inference-endpoint%2F44034 "2023-06-21T12:10:32Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Foson](https://avatars.discourse-cdn.com/v4/letter/f/34f0e0/32.png) [@Foson](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FFoson)%5C
**Post date:** [June 21, 2023, 12:10pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-add-parameter-in-inference-endpoint%2F44034%2F1 "2023-06-21T12:10:32Z")

</div>

How to add parameter in inference endpoint(not inference API)?  
Here is my code:

```auto
        self.API_URL = url
        self.headers = {"Authorization": f"Bearer {open('config/hugging_face.txt').read()}", 'Content-Type': 'application/json'}
        
    def get_answers(self, input, n):
        data = json.dumps({"inputs": input, "parameters": {"return_full_text": False, "num_return_sequences": n, "do_sample": True}})
        response = requests.request("POST", self.API_URL, headers=self.headers, data=data)
        return [output['generated_text'] for output in json.loads(response.content.decode("utf-8"))]

```

Anyway, it keeps returning a sequence, instead of 5(n = 5).  
Help appreciated!

---

<div class="post-metadata">

**Author:** ![philschmid](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/philschmid/32/38022_2.png) [@philschmid](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fphilschmid)%5C
**Post date:** [June 21, 2023, 1:37pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-add-parameter-in-inference-endpoint%2F44034%2F2 "2023-06-21T13:37:31Z")

</div>

> [@Foson](#):
>
> `num_return_sequences`

is only supported with beam search.

---

<div class="post-metadata">

**Author:** ![Foson](https://avatars.discourse-cdn.com/v4/letter/f/34f0e0/32.png) [@Foson](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FFoson)%5C
**Post date:** [June 22, 2023, 2:11am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-add-parameter-in-inference-endpoint%2F44034%2F3 "2023-06-22T02:11:04Z")

</div>

How can I turn beam search on in inference endpoint? looks as if I don’t need to turn it on in inference API.
