Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,571

Base only

Active filters: quantization

weili-0234/Qwen3.5-9B-NVFP4-QAD-s2000

Text Generation • 6B • Updated 26 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-s3000

Text Generation • 6B • Updated 26 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-s4000

Text Generation • 6B • Updated 26 days ago

yasu-oh/gemma-4-12B-it-qat-NVFP4

Image-Text-to-Text • 12B • Updated 19 days ago • 441

rdtand/Hy3-295B-A21B-prismaquant-gridbook-2.9bit-vllm

Text Generation • 104B • Updated 20 days ago • 129 • 3

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s1000

Text Generation • 6B • Updated 26 days ago • 6

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s4000

Text Generation • 6B • Updated 26 days ago • 2

kachowtowmater/SuperGLM-5.2-abliterated-MXFP8-NVFP4-NF3-Hybrid

Text Generation • 347B • Updated 27 days ago • 99

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s2000

Text Generation • 6B • Updated 26 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s3000

Text Generation • 6B • Updated 26 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s4000

Text Generation • 6B • Updated 26 days ago • 6

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s1000

Text Generation • 6B • Updated 26 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s2000

Text Generation • 6B • Updated 26 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s3000

Text Generation • 6B • Updated 26 days ago • 2

fanwu103/MiMo-V2.5-Pro-MXFP4v2

Text Generation • 554B • Updated 27 days ago • 27

bogdan-radulescu/gemma-4-26B-A4B-it-asym-GGUF

Text Generation • 27B • Updated 27 days ago • 217

bogdan-radulescu/qwen3.6-35B-A3B-asym-GGUF

Text Generation • 35B • Updated 27 days ago • 165

guideboardlabs/Nanbeige4.2-3B-GGUF

4B • Updated 26 days ago • 933 • 2

vxltxrllc/Qwen3-32B-BA-GGUF

33B • Updated 26 days ago • 118 • 1

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s4000

Text Generation • 6B • Updated 26 days ago • 3

weili-0234/Qwen3.5-9B-NVFP4-QAD-LR1e-5-s4000

Text Generation • 6B • Updated 26 days ago • 5

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s4000

Text Generation • 6B • Updated 26 days ago • 5

FardoX/sasori-qwen3-14b-tq3p

15B • Updated 24 days ago • 119 • 1

weili-0234/Qwen3.5-9B-NVFP4-QAD-LR1e-5-s1000

Text Generation • 6B • Updated 26 days ago

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s3000

Text Generation • 6B • Updated 26 days ago

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s1000

Text Generation • 6B • Updated 26 days ago

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s4000-BF16

Text Generation • 9B • Updated 26 days ago

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s2000

Text Generation • 6B • Updated 26 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-LR1e-5-s2000

Text Generation • 6B • Updated 26 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s1000

Text Generation • 6B • Updated 26 days ago