Inference Providers
Active filters: 2-bit
MaziyarPanahi/Llama-3.2-3B-bf16-GGUF
Text Generation
• 3B • Updated • 48
• 2
saviochow/GLM-4.6-mlx-2Bit
Text Generation
• 353B • Updated • 12
• 1
kgrabko/JiRackTernary_405b
Text Generation
• 108B • Updated • 401
• 4
inferencerlabs/Bonsai-8B-MLX-2.25bit
Text Generation
• 0.6B • Updated • 2.05k
• 4
avlp12/GLM-5.1-Alis-MLX-Dynamic-2.7bpw
Text Generation
• 744B • Updated • 1.98k
• 1
spicyneuron/GLM-5.1-MLX-2.9bit
Text Generation
• 744B • Updated • 1.2k
• 1
avlp12/Qwen3.5-35B-A3B-Alis-MLX-Dynamic-2.6bpw
Text Generation
• 35B • Updated • 418
• 1
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
• 7B • Updated • 121k
• 135
Ayushnangia/bloom3B-2bit-gptq
Text Generation
• Updated • 5
kaitchup/Llama-2-7b-gptq-2bit
Text Generation
• 7B • Updated • 9
• 1
nesty/sg-bart-large-4096-gptq-2bit
Arylwen/instruct-palmyra-20b-gptq-2
Text Generation
• Updated • 2
Text Generation
• 0.1B • Updated • 11
Sujan42024/dlite-v2-1_5b-2bitQuantization
Text Generation
• 2B • Updated • 2
kaitchup/Mistral-7B-v0.1-gptq-2bit
Text Generation
• 7B • Updated • 7
kaitchup/Llama-2-13b-hf-gptq-2bit
Text Generation
• 13B • Updated • 3
kaitchup/Llama-2-7b-hf-gptq-2bit
Text Generation
• 7B • Updated • 544
Text Generation
• 3B • Updated • 228
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 583
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 547
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 609
• 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
• 7B • Updated • 258
• 3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
• 7B • Updated • 137
• 2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 107
• 2
MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 73
• 2
MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 232
• 1
MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 112
• 1
MaziyarPanahi/tiledfloor-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 64
• 1
MaziyarPanahi/Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 98
• 1
MaziyarPanahi/Commonsense-QA-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 106
• 1