squeezebits/Llama-3.1-8B-Instruct-FP8-dynamic
8B • Updated • 1
AI & ML interests
SqueezeBits is building an ecosystem for designing, training, and deploying highly compressed Neural Networks.
Recent Activity
View all activity
models 8
squeezebits/Llama-3.1-8B-Instruct-quantized.w4a16
8B • Updated • 1
squeezebits/Llama-3.1-8B-Instruct-quantized.w4a16.per_channel
8B • Updated • 1
squeezebits/kanana-1.5-2.1b-instruct-2505-mlx
Text Generation • 0.4B • Updated • 1
squeezebits/Qwen3-32B-AWQ
33B • Updated • 1
squeezebits/Qwen3-32B-AWQ-G32
33B • Updated
squeezebits/Qwen-32B-FP8-Dynamic
Text Generation • 33B • Updated • 1
squeezebits/dummy_slm
Text Generation • 13.4M • Updated • 7
datasets 6
squeezebits/synthesized-coding-assistant-dataset
Viewer • Updated • 100 • 317
squeezebits/diffusion-benchmark
Viewer • Updated • 5 • 21
squeezebits/2kBookTitiles
Viewer • Updated • 2k • 15
squeezebits/augmented-json-mode-eval
Viewer • Updated • 300 • 13
squeezebits/dynamic_sonnet_llama2
Viewer • Updated • 4.1k • 42 • 1
squeezebits/dynamic_sonnet_llama3
Viewer • Updated • 4.1k • 48 • 3