# How to access tokens embedding layer in BERT?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-access-tokens-embedding-layer-in-bert%2F5474%3E%5C
**Category:** 🤗Transformers\
**Created:** [April 13, 2021, 9:53pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-access-tokens-embedding-layer-in-bert%2F5474 "2021-04-13T21:53:27Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![AlexeyK](https://avatars.discourse-cdn.com/v4/letter/a/9de053/32.png) [@AlexeyK](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FAlexeyK)%5C
**Post date:** [April 13, 2021, 9:53pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-access-tokens-embedding-layer-in-bert%2F5474%2F1 "2021-04-13T21:53:27Z")

</div>

Embeddings in BERT are comprised of three components: token/word embeddings + segment embeddings + positional embedding.

**How do I access word embedding layer and set some of its parameters, e.g. ‘embeddings\_regularizer=’?**