Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

802

Base only

Active filters: modelopt

Ex0bit/OLMo-3-7B-Instruct-NVFP4-1M

Text Generation • 4B • Updated Nov 22, 2025 • 8 • 2

wangqia0309/Captain-Eris_Violet-V0.420-12B-FP8-KV-modelopt

12B • Updated Nov 29, 2025 • 5

rahtml/Qwen3-Coder-30B-A3B-Instruct-NVFP4

16B • Updated Dec 9, 2025 • 5

nvidia/Kimi-K2-Thinking-NVFP4

Text Generation • Updated Feb 10 • 21.7k • 29

zhuyksir/qwen3_30b_a3b_nvfp4_baseline

16B • Updated Dec 4, 2025 • 6

zhuyksir/qwen3_30b_a3b_nvfp4_qat

16B • Updated Dec 10, 2025 • 8

alphatozeta/sglang_glm_4_6_fp4_modelopt

177B • Updated Dec 5, 2025 • 7

ericlewis/Nemotron-Orchestrator-8B-NVFP4

Text Generation • 5B • Updated Dec 9, 2025 • 10

nvidia/Qwen3-Next-80B-A3B-Instruct-NVFP4

Text Generation • Updated Feb 9 • 58.9k • 41

trithemius/Velvet-14B-nvfp4

8B • Updated Dec 11, 2025 • 3

nvidia/Qwen3-Next-80B-A3B-Thinking-NVFP4

Text Generation • Updated Feb 9 • 2.42k • 64

OPENZEKA/Qwen3-4B-Instruct-2507-NVFP4

2B • Updated Dec 25, 2025 • 142

Z841973620/Qwen3-30B-A3B-NVFP4

Text Generation • 16B • Updated Dec 15, 2025 • 103

Z841973620/Qwen3-30B-A3B-FP8

Text Generation • 31B • Updated Dec 15, 2025 • 6

OPENZEKA/Qwen3-Coder-30B-A3B-Instruct-NVFP4

Text Generation • 16B • Updated Jan 13 • 176

josephdowling10/Mixtral-8x7B-Instruct-v0.1-NVFP4

Text Generation • 23B • Updated Dec 16, 2025 • 64

taharmasmaliyev07/Llama-2-7b-hf-fp8

7B • Updated Dec 17, 2025 • 3

OPENZEKA/Qwen3-Coder-480B-A35B-Instruct-NVFP4

241B • Updated Dec 25, 2025 • 10

Shifusen/Llama-3.3-70B-Instruct-abliterated-NVFP4-modelopt

36B • Updated Dec 18, 2025 • 27

taharmasmaliyev07/Mistral-7B-v0.1-fp8

7B • Updated Dec 18, 2025 • 2

taharmasmaliyev07/Llama-3.1-8B-fp8

8B • Updated Dec 18, 2025 • 2

taharmasmaliyev07/gemma-2-9b-it-fp8

9B • Updated Dec 18, 2025 • 3

cybermotaz/qwen3-vl-2b-thinking-nvfp4-w4a16

Image-Text-to-Text • 2B • Updated Dec 18, 2025 • 8 • 1

cybermotaz/qwen3-vl-4b-thinking-nvfp4-w4a16

Image-Text-to-Text • 3B • Updated Dec 18, 2025 • 133 • 1

cybermotaz/qwen3-vl-8b-thinking-nvfp4-w4a16

Image-Text-to-Text • 5B • Updated Dec 18, 2025 • 27 • 2

CedricHwang/qwen2.5-0.5b-modelopt-fp8-pc-pt

Text Generation • 0.5B • Updated Dec 19, 2025 • 42

CedricHwang/qwen2.5-0.5b-modelopt-fp8-pb-wo

0.5B • Updated Dec 19, 2025 • 30

stepnoy/gpt-oss-120b-NVFP4

117B • Updated Dec 20, 2025 • 41

baseten-admin/glm-4.7-fp4

183B • Updated Dec 24, 2025 • 791

Salyut1/GLM-4.7-NVFP4

Text Generation • 177B • Updated Dec 23, 2025 • 440 • 16