Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,573

Base only

Active filters: quantization

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s1000

Text Generation • 6B • Updated 26 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s2000

Text Generation • 6B • Updated 26 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s3000

Text Generation • 6B • Updated 26 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-LR1e-5-s3000

Text Generation • 6B • Updated 26 days ago

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s4000-BF16

Text Generation • 9B • Updated 26 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s4000-weight-only

Text Generation • 6B • Updated 26 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s4000-BF16

Text Generation • 9B • Updated 26 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-LR1e-5-s4000-weight-only

Text Generation • 6B • Updated 26 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s4000-BF16

Text Generation • 9B • Updated 26 days ago

weili-0234/Qwen3.5-9B-MXFP4-QAD-s4000-BF16

Text Generation • 9B • Updated 26 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-s4000-BF16

Text Generation • 9B • Updated 26 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-LR1e-5-s4000-BF16

Text Generation • 9B • Updated 26 days ago

weili-0234/Qwen3.5-27B-MXFP4-RTN

Text Generation • 16B • Updated 26 days ago • 6

weili-0234/Qwen3.5-27B-NVFP4-RTN

Text Generation • 17B • Updated 26 days ago • 8

weili-0234/Qwen3.5-27B-NVFP4-RTN-weight-only

Text Generation • 17B • Updated 26 days ago

sarayar/DeepSeek-R1-Distill-Llama-8B-GGUF-Q2_K

8B • Updated 26 days ago • 148

sarayar/Qwen2.5-Coder-7B-Instruct-GGUF-Q3_K_M

8B • Updated 26 days ago • 775

brewbadgertim/Qwen_Image_2512_Quants

Updated 26 days ago

chronarion/GLM-5.2-Vision-MXFP8-NVFP4-NF3-Hybrid

348B • Updated 26 days ago • 63 • 3

QuantNAS/QuantNAS

Updated 26 days ago

urakozz/Ornith-1.0-35B-int4-AutoRound

Text Generation • 3B • Updated 23 days ago • 99

rdtand/Laguna-S-2.1-prismaquant-gridbook-6bit-vllm

Text Generation • 85B • Updated 20 days ago • 658 • 6

weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A4-LR1e-5-s1000

Text Generation • 16B • Updated 25 days ago • 39

mncai/nf4moe

Updated 25 days ago

weili-0234/Qwen3.5-27B-MXFP4-GPTQ

Text Generation • 16B • Updated 25 days ago • 40

weili-0234/Qwen3.5-27B-NVFP4-GPTQ

Text Generation • 17B • Updated 25 days ago • 39

aidendle94/GLM-5.2-MXFP4-Experts-GPTQ

Updated 24 days ago • 118 • 7

rodrigoramosrs/veriloop-coder-e1-gguf

Text Generation • 27B • Updated 25 days ago • 34.8k • 12

0xSero/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid-Vision

Image-Text-to-Text • 348B • Updated 23 days ago • 203 • 7

ajh-code/Mage-Flow-NVFP4-AJH

Text-to-Image • 3B • Updated 24 days ago • 73 • 1