Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,573

Base only

Active filters: quantization

juanginer/Voxtral-Mini-3B-2507-AWQ4-ARG

Automatic Speech Recognition • 5B • Updated 29 days ago • 234

juanginer/Voxtral-Mini-3B-2507-AWQ4-GEN

Automatic Speech Recognition • 5B • Updated 29 days ago • 290 • 1

Tesleum/0xCoder

Text Generation • 12B • Updated 29 days ago • 272 • 3

Litwein/ThinkingCap-Qwen3.6-27B-oQ4e-DWQ-MTP-Vision-MLX

Image-Text-to-Text • 5B • Updated about 1 month ago • 1.43k • 3

Litwein/ThinkingCap-Qwen3.6-27B-oQ4e-DWQ-MTP-MLX

Text Generation • 4B • Updated about 1 month ago • 503 • 1

SC117/Agents-A1-Uncensored-MTP-APEX-GGUF

Text Generation • 36B • Updated 28 days ago • 36.7k • 14

kongbai-84/AnimaInt8Quantizer-Portable

Updated 4 days ago • 1

suayptalha/Turkish-Gemma-9b-T1-1bit

Updated about 1 month ago • 1

paulsaurav/resnet50-inference-optimization

Image Classification • Updated about 1 month ago • 1

w3ss/ideogram-4-gguf-q4_k

Text-to-Image • 19B • Updated about 1 month ago • 168

yasu-oh/gemma-4-26B-A4B-it-qat-NVFP4

Image-Text-to-Text • 26B • Updated 19 days ago • 96

spybyscript/scyllasband

Text-to-Speech • Updated 10 days ago • 233 • 3

VladimirRH/bge-m3-quantized-int8

Feature Extraction • Updated 29 days ago • 2

konic-labs/LFM2.5-8B-A1B-REAP-50-AWQ-INT4

Text Generation • 5B • Updated 28 days ago • 69

leafmoone/RUM-FLUX.2-klein-4B-ConvRot-Quantized

Image-to-Image • Updated 29 days ago • 77 • 1

SearchingMan/FLUX.1-dev-ConvRot

Text-to-Image • Updated 27 days ago • 3

Yigit-Karaman/Cozum-4B-GGUF

Text Generation • 4B • Updated 27 days ago • 1.23k • 1

groxaxo/Nemotron-3-Embed-1B-AWQ-W4A16

Feature Extraction • 1B • Updated 28 days ago • 342 • 1

nota-ai/Solar-Open2-250B-Nota-NVFP4

Text Generation • 145B • Updated 11 days ago • 72.3k • 174

nota-ai/Solar-Open2-250B-Nota-INT4

Text Generation • 41B • Updated 26 days ago • 5.99k • 40

nota-ai/Solar-Open2-250B-Nota-NVFP4-GlobalPruned

Text Generation • 117B • Updated 11 days ago • 554 • 34

nota-ai/Solar-Open2-250B-Nota-INT4-GlobalPruned

Text Generation • 35B • Updated 18 days ago • 1.29k • 43

Bruce001/gemma4-12b-ashq1-4850

Text Generation • 12B • Updated 28 days ago • 72 • 2

weili-0234/Qwen3.5-9B-MXFP4-RTN

6B • Updated 28 days ago • 37

xv0y5ncu/SmolLM3-3B-trellis-3inst-4bpw-kernel

Text Generation • 1.0B • Updated 12 days ago • 1.65k

weili-0234/Qwen3.5-9B-MXFP4-QAD-s1000

Text Generation • 6B • Updated 26 days ago • 109

weili-0234/Qwen3.5-9B-MXFP4-QAD-s2000

Text Generation • 6B • Updated 26 days ago • 110

weili-0234/Qwen3.5-9B-MXFP4-QAD-s3000

Text Generation • 6B • Updated 26 days ago • 107

weili-0234/Qwen3.5-9B-MXFP4-QAD-s4000

Text Generation • 6B • Updated 26 days ago • 113

weili-0234/Qwen3.5-9B-MXFP4-GPTQ

6B • Updated 28 days ago • 5