# Rouge eval metrics in summarization not computing
**URL:**
**Author:**  [@Jorgeutd](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJorgeutd)%5C
**Post date:** [September 21, 2021, 6:54pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Frouge-eval-metrics-in-summarization-not-computing%2F10191%2F1 "2021-09-21T18:54:28Z")
Hello @philschmid I was trying to fine tune a summarization model with a very small data set (100 samples) and none of the rouge eval metrics are being computed in the training job. Is there size limit in terms of samples that could be causing this?
Thank you.
---
**Author:**  [@philschmid](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fphilschmid)%5C
**Post date:** [September 22, 2021, 7:48am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Frouge-eval-metrics-in-summarization-not-computing%2F10191%2F2 "2021-09-22T07:48:43Z")
Hello @Jorgeutd,
Are you using the `examples/` script? and are you passing the `hyperparameter` → `'predict_with_generate': True,`
> predict\_with\_generate ( `bool` , optional, defaults to `False` ):
> Whether to use generate to calculate generative metrics (ROUGE, BLEU).`
---
**Author:**  [@Jorgeutd](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJorgeutd)%5C
**Post date:** [September 23, 2021, 1:39pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Frouge-eval-metrics-in-summarization-not-computing%2F10191%2F3 "2021-09-23T13:39:19Z")
Thank you @philschmid . I reviewed indeed that the run summ.py script this time.