# Train model from scratch on own dataset

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftrain-model-from-scratch-on-own-dataset%2F74884%3E%5C
**Category:** Beginners\
**Created:** [February 26, 2024, 9:30pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftrain-model-from-scratch-on-own-dataset%2F74884 "2024-02-26T21:30:37Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![waxef](https://avatars.discourse-cdn.com/v4/letter/w/b77776/32.png) [@waxef](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fwaxef)%5C
**Post date:** [February 26, 2024, 9:30pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ftrain-model-from-scratch-on-own-dataset%2F74884%2F1 "2024-02-26T21:30:37Z")

</div>

Hi folks,  
I’m trying to train a couple of models on a sequence classification task.  
I’ve been following the [tutorial](https://huggingface.co/docs/transformers/en/tasks/sequence_classification) but I still have some questions cause the data is not in text format.

First, my data are already in numeric values, for instance sequences of varying lengths in the following format `{inputs: [01,1,0,1,1,1,0,1,1,0,1,1,0]`, labels: 0}`.

What/How should I use the tokenizer in this case, do I just do padding of sequences?  
Any MWE would be appreciated 🙏

I’ve read in the docs that for this kind of task the bert style of models are more suited, could anyone list a couple of models here to try that would work for this task.

I want to train from scratch and not fine-tune any pretrained model?