# Can I train ELECTRA from scratch using hugging face?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-i-train-electra-from-scratch-using-hugging-face%2F71371%3E%5C
**Category:** Models\
**Created:** [January 31, 2024, 5:37pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-i-train-electra-from-scratch-using-hugging-face%2F71371 "2024-01-31T17:37:52Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![gamster2](https://avatars.discourse-cdn.com/v4/letter/g/bcef8e/32.png) [@gamster2](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fgamster2)%5C
**Post date:** [January 31, 2024, 5:37pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-i-train-electra-from-scratch-using-hugging-face%2F71371%2F1 "2024-01-31T17:37:52Z")

</div>

I can train BERT from scratch using PyTorch code from hugging face GitHub.

However, when it comes to ELECTRA, I just cannot find PyTorch resources.

How can I use get labels of 1 or 0 indicating whether token is replaced or not?

Please somebody help me…