# Random utf-8 errors from dataset

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Frandom-utf-8-errors-from-dataset%2F22134%3E%5C
**Category:** Intermediate\
**Created:** [August 26, 2022, 7:09am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Frandom-utf-8-errors-from-dataset%2F22134 "2022-08-26T07:09:21Z")\
**Posts on this page:** 1\
**Showing post:** 10

<div class="post-metadata">

**Author:** ![sibiakash](https://avatars.discourse-cdn.com/v4/letter/s/87869e/32.png) [@sibiakash](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsibiakash)%5C
**Post date:** [December 8, 2023, 5:30am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Frandom-utf-8-errors-from-dataset%2F22134%2F10 "2023-12-08T05:30:56Z")

</div>

found a fix from here… [UTF-16 for datasets? - #2 by mariosasko](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Futf-16-for-datasets%2F43828%2F2)  
used encoding = ‘UTF-8’ in my load\_dataset and it worked.

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Frandom-utf-8-errors-from-dataset%2F22134)._