# Bert embeddings

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbert-embeddings%2F13453%3E%5C
**Category:** Beginners\
**Created:** [January 6, 2022, 6:34pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbert-embeddings%2F13453 "2022-01-06T18:34:06Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![ShivaniSri](https://avatars.discourse-cdn.com/v4/letter/s/3ab097/32.png) [@ShivaniSri](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FShivaniSri)%5C
**Post date:** [January 6, 2022, 6:34pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbert-embeddings%2F13453%2F1 "2022-01-06T18:34:06Z")

</div>

I want to multiple bert input embeddings with other tensor and forward it to the encoder of bert  
How can I implement this

# import BERT-base pretrained model

bert = AutoModel.from\_pretrained(‘bert-base-uncased’)

# Load the BERT tokenizer

tokenizer = BertTokenizerFast.from\_pretrained(‘bert-base-uncased’)