# Evaluate question answering with squad dataset

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fevaluate-question-answering-with-squad-dataset%2F10586%3E%5C
**Category:** Beginners\
**Created:** [October 7, 2021, 9:33am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fevaluate-question-answering-with-squad-dataset%2F10586 "2021-10-07T09:33:59Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![aycha](https://avatars.discourse-cdn.com/v4/letter/a/c4cdca/32.png) [@aycha](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Faycha)%5C
**Post date:** [October 7, 2021, 9:33am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fevaluate-question-answering-with-squad-dataset%2F10586%2F1 "2021-10-07T09:33:59Z")

</div>

Hello everybody

I want to build question answering system by fine tuning bert using squad1.1 or squad2.0  
i would like to ask about evaluating question answering system, i know there is [squad](https://huggingface.co/metrics/squad) and squad\_v2 metrics, how can we use them when fine-tune bert with pytorch?  
thank you

---

<div class="post-metadata">

**Author:** ![nbroad](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/nbroad/32/26465_2.png) [@nbroad](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fnbroad)%5C
**Post date:** [October 7, 2021, 5:26pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fevaluate-question-answering-with-squad-dataset%2F10586%2F2 "2021-10-07T17:26:22Z")

</div>

This example should hopefully answer your question.

> <https://github.com/huggingface/transformers/blob/master/examples/pytorch/question-answering/run_qa.py>

If the purpose is to have a good question answering model, you could also use one of the many pretrained models on the hugging face model hub. [Models - Hugging Face](https://huggingface.co/models?sort=downloads&search=squad)

---

<div class="post-metadata">

**Author:** ![aycha](https://avatars.discourse-cdn.com/v4/letter/a/c4cdca/32.png) [@aycha](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Faycha)%5C
**Post date:** [October 10, 2021, 7:29am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fevaluate-question-answering-with-squad-dataset%2F10586%2F3 "2021-10-10T07:29:15Z")

</div>

thanks for your response