MaziyarPanahi/Llama-3.2-3B-bf16-GGUF
Text Generation • 3B • Updated • 48 • 2
Edit Models filters
Apps
Inference Providers
Active filters: 2-bit
saviochow/GLM-4.6-mlx-2Bit
Text Generation • 353B • Updated • 12 • 1
kgrabko/JiRackTernary_405b
Text Generation • 108B • Updated • 401 • 4
inferencerlabs/Bonsai-8B-MLX-2.25bit
Text Generation • 0.6B • Updated • 2.05k • 4
avlp12/GLM-5.1-Alis-MLX-Dynamic-2.7bpw
Text Generation • 744B • Updated • 1.98k • 1
spicyneuron/GLM-5.1-MLX-2.9bit
Text Generation • 744B • Updated • 1.2k • 1
avlp12/Qwen3.5-35B-A3B-Alis-MLX-Dynamic-2.6bpw
Text Generation • 35B • Updated • 418 • 1
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation • 7B • Updated • 121k • 135
Ayushnangia/bloom3B-2bit-gptq
Text Generation • Updated • 5
kaitchup/Llama-2-7b-gptq-2bit
Text Generation • 7B • Updated • 9 • 1
nesty/sg-bart-large-4096-gptq-2bit
Updated • 7
Arylwen/instruct-palmyra-20b-gptq-2
Text Generation • Updated • 2
lebe1/opt-125m-2bit
Text Generation • 0.1B • Updated • 11
Sujan42024/dlite-v2-1_5b-2bitQuantization
Text Generation • 2B • Updated • 2
kaitchup/Mistral-7B-v0.1-gptq-2bit
Text Generation • 7B • Updated • 7
kaitchup/Llama-2-13b-hf-gptq-2bit
Text Generation • 13B • Updated • 3
kaitchup/Llama-2-7b-hf-gptq-2bit
Text Generation • 7B • Updated • 544
MaziyarPanahi/phi-2-GGUF
Text Generation • 3B • Updated • 228 • 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation • 7B • Updated • 583 • 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation • 7B • Updated • 547 • 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation • 7B • Updated • 609 • 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation • 7B • Updated • 258 • 3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation • 7B • Updated • 137 • 2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation • 7B • Updated • 107 • 2
MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation • 7B • Updated • 73 • 2
MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation • 7B • Updated • 232 • 1
MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation • 7B • Updated • 112 • 1
MaziyarPanahi/tiledfloor-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation • 7B • Updated • 64 • 1
MaziyarPanahi/Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation • 7B • Updated • 98 • 1
MaziyarPanahi/Commonsense-QA-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation • 7B • Updated • 106 • 1