These quantized models have a smaller memory footprint, but acceptable quality.
chicken
Crataco
AI & ML interests
Using my best computers to quantize LLMs for your worst computers
Recent Activity
liked a model about 9 hours ago
PocketDoc/Dans-PersonalityEngine-V1.3.0-12b liked a model about 9 hours ago
PocketDoc/Dans-PersonalityEngine-V1.3.0-24b liked a model 18 days ago
arbazsiddiqui/Ozan-v1-12BOrganizations
None yet