ignatius/welsh_summarization
Preview • Updated • 84 • 1
How to use ignatius/cyT5-small with Transformers:
# Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("ignatius/cyT5-small")
model = AutoModelForSeq2SeqLM.from_pretrained("ignatius/cyT5-small")cyT5-small is a light-weight (alpha-version) Welsh T5 model extracted from the google/mt5-small model and fine-tuned only on the Welsh summarization dataset.
Citation: Introducing the Welsh Text Summarisation Dataset and Baseline Systems.
@article{ezeani2022introducing,
title={Introducing the Welsh text summarisation dataset and baseline systems},
author={Ezeani, Ignatius and El-Haj, Mahmoud and Morris, Jonathan and Knight, Dawn},
journal={arXiv preprint arXiv:2205.02545},
year={2022}
}
Further developments are ongoing and will update will be shared soon.