# Image captioning for low resource Indian Languages

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fimage-captioning-for-low-resource-indian-languages%2F11764%3E%5C
**Category:** 🤗 Course Projects\
**Created:** [November 15, 2021, 3:33pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fimage-captioning-for-low-resource-indian-languages%2F11764 "2021-11-15T15:33:27Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![seanbenhur](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/seanbenhur/32/20411_2.png) [@seanbenhur](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fseanbenhur)%5C
**Post date:** [November 15, 2021, 3:33pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fimage-captioning-for-low-resource-indian-languages%2F11764%2F1 "2021-11-15T15:33:27Z")

</div>

There are many image captioning systems exist for english language, here in this project we will develop an Image captioning system for an Indian language

If we have time and resource, we can extend this to other languages as well.

**Datasets** :  
Dataset can be created by translating captions of existing Flickr30k or any other image captioning dataset

An example:  
[https://www.amitavadas.com/Image2Tweet.html](https://www.amitavadas.com/Image2Tweet.html)

**Other resources** :  
`Vision encoder Decoder model`: [https://huggingface.co/transformers/model\_doc/visionencoderdecoder.html](https://huggingface.co/transformers/model_doc/visionencoderdecoder.html)

Baseline:

> **[flax-community/image-captioning at main](https://huggingface.co/spaces/flax-community/image-captioning/tree/main)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

### Discord channel

To chat and organise with other people interested in this project, head over to our [Discord](http://xwo7x.mjt.lu/lnk/CAAAAkdkZwAAAAAAAAAAALG-MTEAAYCr4H8AAAAAAAyFyQBhjpnimM4rcE5DT5ibCUtRT96tWwAMh8Y/15/U6BYNMNDksyyGG4jgtzPKQ/aHR0cHM6Ly9odWdnaW5nZmFjZS5jby9qb2luL2Rpc2NvcmQ) and:

- Follow the instructions on the `#join-course` channel
- Join the `#image-captioning` channel

Just make sure you comment here to indicate that you’ll be contributing to this project 🙂

---

<div class="post-metadata">

**Author:** ![sampathweb](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sampathweb/32/3189_2.png) [@sampathweb](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsampathweb)%5C
**Post date:** [November 16, 2021, 2:14pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fimage-captioning-for-low-resource-indian-languages%2F11764%2F2 "2021-11-16T14:14:10Z")

</div>

Hey Sean - Looks really interesting. I am interested. Joined the Discord Channel.

---

<div class="post-metadata">

**Author:** ![krypticmouse](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/krypticmouse/32/1145_2.png) [@krypticmouse](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fkrypticmouse)%5C
**Post date:** [November 17, 2021, 2:32pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fimage-captioning-for-low-resource-indian-languages%2F11764%2F3 "2021-11-17T14:32:18Z")

</div>

Hi Sean, sounds good. Count me in.

---

<div class="post-metadata">

**Author:** ![hlsrekha](https://avatars.discourse-cdn.com/v4/letter/h/df788c/32.png) [@hlsrekha](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fhlsrekha)%5C
**Post date:** [December 20, 2022, 2:16pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fimage-captioning-for-low-resource-indian-languages%2F11764%2F4 "2022-12-20T14:16:42Z")

</div>

Count me in. I would like to work on Image Captioning in Kannada language