Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

mixed-quantization

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15

Base only

Active filters: mixed-quantization

Avifenesh/Hy3-REAP-Layer103p5-bw24

Text Generation • Updated 1 day ago • 1

shieldstackllc/Step-3.5-Flash-REAP-128B-A11B-mlx-mixed-4-6

Text Generation • 121B • Updated Feb 16 • 61

GOBA-AI-Labs/PrunedHub-Qwen3-30B-A3B-EN-80pct-MxMoE

Text Generation • 25B • Updated Feb 23 • 16

GOBA-AI-Labs/PrunedHub-Qwen3-30B-A3B-JP-80pct-MxMoE

Text Generation • 25B • Updated Feb 23 • 8

Phipper/qwen3.5-27b-opus-distilled-proposal-c

Text Generation • 27B • Updated Apr 2 • 10

Asystemoffields/Qwen3-1.7B-PMRA-IQ3XS-budget-GGUF

Text Generation • 2B • Updated Jun 2 • 26

Asystemoffields/gemma-4-E2B-it-PMRA-GGUF

Text Generation • 5B • Updated Jun 2 • 80

andrzejmontano/Qwen3-VL-Embedding-8B-mlx-8bit

Sentence Similarity • 3B • Updated May 14 • 643

Asystemoffields/Huihui-Qwen3.5-4B-Abliterated-PMRA-GGUF

Text Generation • 4B • Updated Jun 2 • 67

Asystemoffields/Ministral-3-8B-Instruct-PMRA-GGUF

Text Generation • 8B • Updated Jun 2 • 57 • 1

Asystemoffields/IBM-granite-4.1-8b-heretic-PMRA-GGUF

Text Generation • 8B • Updated Jun 2 • 37 • 1

andrzejmontano/tmax-27b-MTP-vision-BF16-8bit

Image-Text-to-Text • 15B • Updated 27 days ago • 244 • 1

andrzejmontano/Qwen3.5-9B-MTP-Mixed-8bit

Image-Text-to-Text • Updated 20 days ago • 144

andrzejmontano/gemma-4-12B-it-Mixed-8bit

Image-Text-to-Text • Updated 20 days ago • 288

Alkd/TEA-ASR-1.1-MLX-4bit

Automatic Speech Recognition • 0.4B • Updated 11 days ago • 31