# how to evaluate RAG-end2end

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-evaluate-rag-end2end%2F7663%3E%5C
**Category:** Models\
**Created:** [June 29, 2021, 5:58pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-evaluate-rag-end2end%2F7663 "2021-06-29T17:58:35Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![giobin](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/giobin/32/28182_2.png) [@giobin](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fgiobin)%5C
**Post date:** [June 29, 2021, 5:58pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-evaluate-rag-end2end%2F7663%2F1 "2021-06-29T17:58:35Z")

</div>

Hi,

Is there a script like [eval\_rag.py](https://github.com/huggingface/transformers/blob/5257818e685c89fb473504afb5cbcd7b34301811/examples/research_projects/rag/eval_rag.py) but for RAG-end2end ? I see that the eval\_rag.py file in the RAG-end2end folder is the same as for RAG, but I am not sure on how to adapt it to load the finetuned dpr\_ctx\_encoder from a RAG-end2end checkpoint, which seems not that trivial.

Thank you