# Problem with onnx export and usage

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fproblem-with-onnx-export-and-usage%2F19618%3E%5C
**Category:** Beginners\
**Created:** [June 25, 2022, 3:19pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fproblem-with-onnx-export-and-usage%2F19618 "2022-06-25T15:19:07Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![SnoozingSimian](https://avatars.discourse-cdn.com/v4/letter/s/35a633/32.png) [@SnoozingSimian](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FSnoozingSimian)%5C
**Post date:** [June 25, 2022, 3:19pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fproblem-with-onnx-export-and-usage%2F19618%2F1 "2022-06-25T15:19:07Z")

</div>

Hello everyone, I have been trying to speed up the GPT-Neo 1.3B model using Onnx, and have been facing significant issues.

I first exported the `GPT-Neo 1.3B` model using the `Causal-LM` feature. This created a folder with lots of files and the model.onnx file as well.

Thereafter I tried using the onnx model using onnx-runtime as shown in the [this page](https://huggingface.co/docs/transformers/serialization#onnx:~:text=%3E%3E%3E%20from-,transformers,-import%20AutoTokenizer%0A%3E%3E%3E).

Here is the code I used.

```auto
tokenizer = GPT2Tokenizer.from_pretrained(model_name)
ONNX_PROVIDERS = ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider']

session = rt.InferenceSession("onnx/model.onnx", providers=ONNX_PROVIDERS)

inputs = tokenizer("Using gpt-neo with ONNX Runtime and ", return_tensors="np")
outputs = session.run(output_names=["logits"], input_feed=dict(inputs))

```

I used the `%%time` magic in the Jupyter cell and the above code took more than 5 minutes to execute.

After that I used a longer sentence and tried to inference again but the cell never completed execution (I waited for about an hour).

```auto
%%time
inputs = tokenizer("Using gpt-neo with ONNX Runtime again and this time with many more words which will put considerable load on the GPU as well as the CPU ", return_tensors="np")
outputs = session.run(output_names=["logits"], input_feed=dict(inputs))

```

I seem to be missing something, as I am certain this shouldn’t take so long. Could anyone please help me?