# Unable to deploy Qwen2-VL model on SageMaker

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-deploy-qwen2-vl-model-on-sagemaker%2F113624%3E%5C
**Category:** Amazon SageMaker\
**Created:** [October 23, 2024, 3:49pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-deploy-qwen2-vl-model-on-sagemaker%2F113624 "2024-10-23T15:49:44Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [October 23, 2024, 4:06pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-deploy-qwen2-vl-model-on-sagemaker%2F113624%2F2 "2024-10-23T16:06:23Z")

</div>

Could it be a bug in SageMaker?

> [@ValueError: Unsupported model type mllama](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fvalueerror-unsupported-model-type-mllama%2F113593)%3A
>
> I am looking to deploy “meta-llama/Llama-3.2-11B-Vision-Instruct” to AWS SageMaker but getting below error while deploying. Traceback (most recent call last): File "/opt/conda/bin/text-generation-server", line 8, in \<module\> sys.exit(app()) File "/opt/conda/lib/python3.10/site-packages/text\_generation\_server/cli.py", line 118, in serve server.serve( File "/opt/conda/lib/python3.10/site-packages/text\_generation\_server/server.py", line 297, in serve asyncio.run( File "/opt/con…

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-deploy-qwen2-vl-model-on-sagemaker%2F113624)._