Original model: Cydonia-v4.1-MS3.2-Magnum-Diamond-24B by knifeayumu
Available ExLlamaV3 (release v0.0.16) quantizations
| Type | Size | CLI |
|---|---|---|
| H8-4.0BPW | 13.16 GB | Copy-paste the line / Download the batch file |
| H8-6.0BPW | 18.72 GB | Copy-paste the line / Download the batch file |
| H8-8.0BPW | 24.27 GB | Copy-paste the line / Download the batch file |
Requirements: A python installation with huggingface-hub module to use CLI.