Quantization request for https://huggingface.co/hon9kon9ize/CantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged
#2892
by gluestick53A - opened
Please consider creating GGUF and imatrix quants for https://huggingface.co/hon9kon9ize/CantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#CantoneseLLM-v2.0-30B-A3B-Thinking-Chat-Vector-Merged-GGUF for quants to appear.