Hugging Face's logo

ThePixOne
/
EconBERTa

Fill-Mask
Transformers
PyTorch
roberta
Model card Files
xet
 Community
1
ThePixOne commited on
Commit
9dfce64
·
1 Parent(s): 4e18055

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -1,4 +1,4 @@
1
- EconBERTa - RoBERTa further trained on 4GB of uncompressed text sourced from economics books.
2
 
3
  Example usage for MLM:
4
 
 
1
+ EconBERTa - RoBERTa further trained for 25k steps (T=512, batch_size = 256) on text sourced from economics books.
2
 
3
  Example usage for MLM:
4