# Question about data in datasets

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fquestion-about-data-in-datasets%2F92460%3E%5C
**Category:** 🤗Datasets\
**Created:** [June 16, 2024, 7:15pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fquestion-about-data-in-datasets%2F92460 "2024-06-16T19:15:57Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![TikoTako](https://avatars.discourse-cdn.com/v4/letter/t/cab0a1/32.png) [@TikoTako](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FTikoTako)%5C
**Post date:** [June 16, 2024, 7:15pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fquestion-about-data-in-datasets%2F92460%2F1 "2024-06-16T19:15:57Z")

</div>

Hello,  
I’ve checked 18 gb of corporas (scraped from news, blogs, forums, random sites), all of them contain things like:  
links, ads, the html tags for chars (\> … ), mysql connection errors, etc…

Also some gbs of plain text from ebooks, all of them contain things like:  
index, author and publisher stuff, page numbers, empty lines, weird/wrong formatting, etc…

Is normal to use these as pre-training datasets?

It is just the fine-tune data that have to be precise?