# Character level tokenizer with specific order

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcharacter-level-tokenizer-with-specific-order%2F139150%3E%5C
**Category:** 🤗Tokenizers\
**Created:** [February 5, 2025, 2:54pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcharacter-level-tokenizer-with-specific-order%2F139150 "2025-02-05T14:54:36Z")\
**Posts on this page:** 1\
**Showing post:** 6

<div class="post-metadata">

**Author:** ![samirchar](https://avatars.discourse-cdn.com/v4/letter/s/c2a13f/32.png) [@samirchar](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsamirchar)%5C
**Post date:** [February 7, 2025, 4:49pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcharacter-level-tokenizer-with-specific-order%2F139150%2F6 "2025-02-07T16:49:09Z")

</div>

@John6666  
I’m trying this but failing with this error: [Custom Tokenizer Error - Please Help!](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcustom-tokenizer-error-please-help%2F139539)

Any idea?

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcharacter-level-tokenizer-with-specific-order%2F139150)._