# What should be shifted for decoder input for Bart

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhat-should-be-shifted-for-decoder-input-for-bart%2F8175%3E%5C
**Category:** Beginners\
**Created:** [July 8, 2021, 10:31am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhat-should-be-shifted-for-decoder-input-for-bart%2F8175 "2021-07-08T10:31:03Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![zuujhyt](https://avatars.discourse-cdn.com/v4/letter/z/f17d59/32.png) [@zuujhyt](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fzuujhyt)%5C
**Post date:** [July 8, 2021, 10:31am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhat-should-be-shifted-for-decoder-input-for-bart%2F8175%2F1 "2021-07-08T10:31:03Z")

</div>

Hi,  
[In HF’s doc](https://huggingface.co/transformers/model_doc/bart.html), regarding `decoder_input_ids `it says `... create this tensor by shifting the `input_ids` to the right....`.  
Shouldn’t it be shifting the `labels`? because the input is noisy?  
Thank you.

---

<div class="post-metadata">

**Author:** ![sgugger](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sgugger/32/2291_2.png) [@sgugger](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsgugger)%5C
**Post date:** [July 8, 2021, 11:28am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhat-should-be-shifted-for-decoder-input-for-bart%2F8175%2F2 "2021-07-08T11:28:49Z")

</div>

I think this is copy pasted from the causal language modeling doc (for which your labels are your inputs shifted to the right).