# How to multithread my RAG Model?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-multithread-my-rag-model%2F95490%3E%5C
**Category:** Models\
**Created:** [July 4, 2024, 9:17am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-multithread-my-rag-model%2F95490 "2024-07-04T09:17:37Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Kv-boii](https://avatars.discourse-cdn.com/v4/letter/k/3be4f8/32.png) [@Kv-boii](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FKv-boii)%5C
**Post date:** [July 4, 2024, 9:17am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-multithread-my-rag-model%2F95490%2F1 "2024-07-04T09:17:37Z")

</div>

I have built a RAG model with LlamaIndex and now to reduce the response time, as well as for a new usecase, I want to execute multiple prompts at the same time which is not supported within the llamaIndex framework. So I tried using Threading library but I’m not getting the results as the model goes in error state when i try to execute more than one thread, btw I’m using free google colab as my production environment