# Evaluating the model during the run

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fevaluating-the-model-during-the-run%2F13193%3E%5C
**Category:** Intermediate\
**Created:** [December 29, 2021, 5:26am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fevaluating-the-model-during-the-run%2F13193 "2021-12-29T05:26:24Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![nid989](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/nid989/32/3579_2.png) [@nid989](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fnid989)%5C
**Post date:** [December 29, 2021, 5:26am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fevaluating-the-model-during-the-run%2F13193%2F1 "2021-12-29T05:26:24Z")

</div>

Hi all,  
Actually, I’m implementing a multi-task learning model, using the trainer class in huggingface. Since huggingface trainer as well as dataloader except for one model at a go, thus I needed to modify both the classes, Now I’m just confused, about how to evaluate the running model while the model is training.  
Note I’m using transformers version 2.11.0

I tried using the evaluation\_strategy under trainerarguments but it’s giving some errors.

Also here is the link to a reference colab notebook [here](https://colab.research.google.com/github/zphang/zphang.github.io/blob/master/files/notebooks/Multi_task_Training_with_Transformers_NLP.ipynb)  
Can someone help me with this? thankyou!