# Evaluating RAG only with open-source

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fevaluating-rag-only-with-open-source%2F77057%3E%5C
**Category:** Intermediate\
**Created:** [March 12, 2024, 10:02am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fevaluating-rag-only-with-open-source%2F77057 "2024-03-12T10:02:22Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![dkoterwa](https://avatars.discourse-cdn.com/v4/letter/d/e9c0ed/32.png) [@dkoterwa](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fdkoterwa)%5C
**Post date:** [March 12, 2024, 10:02am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fevaluating-rag-only-with-open-source%2F77057%2F1 "2024-03-12T10:02:22Z")

</div>

Hi,  
are there any RAG evaluation tools based solely on open-source models (for example using only HuggingFace models)? I would like to load models for generating responses/judging responses from HuggingFace and compute metrics based on the scores of the judge.

---

<div class="post-metadata">

**Author:** ![elfailali](https://avatars.discourse-cdn.com/v4/letter/e/c67d28/32.png) [@elfailali](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Felfailali)%5C
**Post date:** [May 24, 2024, 8:53pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fevaluating-rag-only-with-open-source%2F77057%2F2 "2024-05-24T20:53:30Z")

</div>

Try Ragas framework