# How can i get the word representation using BERT?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-can-i-get-the-word-representation-using-bert%2F13739%3E%5C
**Category:** Beginners\
**Created:** [January 15, 2022, 10:39pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-can-i-get-the-word-representation-using-bert%2F13739 "2022-01-15T22:39:33Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![toyl](https://avatars.discourse-cdn.com/v4/letter/t/73ab20/32.png) [@toyl](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Ftoyl)%5C
**Post date:** [January 15, 2022, 10:39pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-can-i-get-the-word-representation-using-bert%2F13739%2F1 "2022-01-15T22:39:33Z")

</div>

I need to get the embeddings using BERT for word-level, not sub-word . I got a lot of functions one of them gets the embeddings from the last layers in the model but the results for sub-word . How can I start, please? I hope someone can help . Appreciating your time

---

<div class="post-metadata">

**Author:** ![osanseviero](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/osanseviero/32/38738_2.png) [@osanseviero](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fosanseviero)%5C
**Post date:** [January 16, 2022, 11:00am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-can-i-get-the-word-representation-using-bert%2F13739%2F2 "2022-01-16T11:00:38Z")

</div>

This previous discussion can be useful [Obtaining word-embeddings from Roberta](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fobtaining-word-embeddings-from-roberta%2F7735)

---

<div class="post-metadata">

**Author:** ![BramVanroy](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/bramvanroy/32/47360_2.png) [@BramVanroy](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FBramVanroy)%5C
**Post date:** [January 16, 2022, 11:01am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-can-i-get-the-word-representation-using-bert%2F13739%2F3 "2022-01-16T11:01:26Z")

</div>

This might help: [Generate raw word embeddings using transformer models like BERT for downstream process - #2 by BramVanroy](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fgenerate-raw-word-embeddings-using-transformer-models-like-bert-for-downstream-process%2F2958%2F2)