turboderp
/

Hy3-exl3

Model card Files Files and versions

EXL3 quants of Hy3

⚠️ Needs ExLlamav3 v1.1.0 or later

3.05 bits per weight

(More bitrates, benchmarks etc. to follow, probably)

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for turboderp/Hy3-exl3

Base model

Quantized

(62)

this model

Collection including turboderp/Hy3-exl3

EXL3 models

63 items • Updated about 12 hours ago • 61