# Pass input\_embed to WhisperDecoder

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpass-input-embed-to-whisperdecoder%2F87895%3E%5C
**Category:** 🤗Transformers\
**Created:** [May 22, 2024, 5:40pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpass-input-embed-to-whisperdecoder%2F87895 "2024-05-22T17:40:16Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![aben118](https://avatars.discourse-cdn.com/v4/letter/a/fbc32d/32.png) [@aben118](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Faben118)%5C
**Post date:** [May 22, 2024, 5:40pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpass-input-embed-to-whisperdecoder%2F87895%2F1 "2024-05-22T17:40:16Z")

</div>

In modeling\_whisper.py, the WhisperDecoder can take `input_ids` or `input_embeds` as its input. When I try passing `input_embeds` of dimension `(1, 1500, 384)` it faces an error inside `WhisperPositionalEmbedding` as the max\_context\_length is `448` and I get an error of `RuntimeError}. The size of tensor a (1500) must match the size of tensor b (448) at non-singleton dimension 1`. How to resolve this issue?