# BUG: can't fetch certain GGUFs

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbug-cant-fetch-certain-ggufs%2F133033%3E%5C
**Category:** 🤗Datasets\
**Created:** [December 25, 2024, 11:33pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbug-cant-fetch-certain-ggufs%2F133033 "2024-12-25T23:33:14Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Nafnlaus](https://avatars.discourse-cdn.com/v4/letter/n/a5b964/32.png) [@Nafnlaus](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FNafnlaus)%5C
**Post date:** [December 25, 2024, 11:33pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbug-cant-fetch-certain-ggufs%2F133033%2F1 "2024-12-25T23:33:14Z")

</div>

Seems common with IQ3\_M. Example, go here:

> **[bartowski/Llama-3.3-70B-Instruct-GGUF at main](https://huggingface.co/bartowski/Llama-3.3-70B-Instruct-GGUF/tree/main)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Click on the black gguf viewer icon for the IQ3\_M. Then choose ollama. Look at the download link:

_ollama run [bartowski/Llama-3.3-70B-Instruct-ablated-GGUF · Hugging Face](http://hf.co/bartowski/Llama-3.3-70B-Instruct-ablated-GGUF)_

Note what’s not present: the actual GGUF you’re trying to use. Compare to the links for other quantizations:

---

<div class="post-metadata">

**Author:** ![Nafnlaus](https://avatars.discourse-cdn.com/v4/letter/n/a5b964/32.png) [@Nafnlaus](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FNafnlaus)%5C
**Post date:** [December 25, 2024, 11:33pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbug-cant-fetch-certain-ggufs%2F133033%2F2 "2024-12-25T23:33:48Z")

</div>

_ollama run [hf.co/bartowski/Llama-3.3-70B-Instruct-ablated-GGUF:IQ2\_XXS](http://hf.co/bartowski/Llama-3.3-70B-Instruct-ablated-GGUF:IQ2_XXS)_

Note how the quantization is listed after it.

It’s not just an issue with links. If I manually run:

_ollama run [hf.co/bartowski/Llama-3.3-70B-Instruct-ablated-GGUF:IQ3\_M](http://hf.co/bartowski/Llama-3.3-70B-Instruct-ablated-GGUF:IQ3_M)_

It fails.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/hellohellohello/original/2X/d/de4155eb4aa4108ecb32a1389d7cc37ae69f88b7.png) [@system](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsystem)%5C
**Post date:** [December 25, 2024, 11:34pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbug-cant-fetch-certain-ggufs%2F133033%2F3 "2024-12-25T23:34:05Z")

</div>



---

<div class="post-metadata">

**Author:** ![Nafnlaus](https://avatars.discourse-cdn.com/v4/letter/n/a5b964/32.png) [@Nafnlaus](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FNafnlaus)%5C
**Post date:** [December 25, 2024, 11:34pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbug-cant-fetch-certain-ggufs%2F133033%2F4 "2024-12-25T23:34:37Z")

</div>

This is not an ollama issue - the link physically does not exist, even though the GGUF model exists (and can be downloaded via LFS). If you just do the original link provided, without the gguf name, it doesn’t get the IQ3\_M, it gets the latest Q4.

---

<div class="post-metadata">

**Author:** ![Nafnlaus](https://avatars.discourse-cdn.com/v4/letter/n/a5b964/32.png) [@Nafnlaus](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FNafnlaus)%5C
**Post date:** [December 26, 2024, 1:58am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbug-cant-fetch-certain-ggufs%2F133033%2F5 "2024-12-26T01:58:43Z")

</div>

Okay, I’m confused. Why on Earth did a bug report get flagged as spam?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/hellohellohello/original/2X/d/de4155eb4aa4108ecb32a1389d7cc37ae69f88b7.png) [@system](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsystem)%5C
**Post date:** [January 6, 2025, 10:47am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbug-cant-fetch-certain-ggufs%2F133033%2F6 "2025-01-06T10:47:41Z")

</div>


