# Programmatic way to Tokenization on Custom Text Columns

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fprogrammatic-way-to-tokenization-on-custom-text-columns%2F19679%3E%5C
**Category:** 🤗Tokenizers\
**Created:** [June 27, 2022, 3:13pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fprogrammatic-way-to-tokenization-on-custom-text-columns%2F19679 "2022-06-27T15:13:12Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![courtneysprouse131](https://avatars.discourse-cdn.com/v4/letter/c/50afbb/32.png) [@courtneysprouse131](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fcourtneysprouse131)%5C
**Post date:** [June 27, 2022, 3:13pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fprogrammatic-way-to-tokenization-on-custom-text-columns%2F19679%2F1 "2022-06-27T15:13:12Z")

</div>

I’m having issues with tokenizing in a more programmatic way. I can’t seem to figure out a way to pass multiple arguments to the map function in tokenizers. I also can’t run the map function on a particular column in the dataset. And I can’t use the generic python map function because I can’t figure out how to make it return a transformers dataset object (although that could be my own ignorance). Any thoughts?