DeathGodlike/Mystic-Matron-12B_EXL3

Original model: Mystic-Matron-12B by Vortex5

---

Available ExLlamaV3 (release v0.0.18) quantizations

Type	Size	CLI
H8-4.0BPW	7.49 GB	Copy-paste the line / Download the batch file
H8-6.0BPW	10.22 GB	Copy-paste the line / Download the batch file
H8-8.0BPW	12.95 GB	Copy-paste the line / Download the batch file

Requirements: A python installation with huggingface-hub module to use CLI.

Licensing

License detected: unknown

The license for the provided quantized models is derived from the original model. For additional information see the original model's page above, or, if unavailable, the files and the page backups below.

---

Backups

Original files

Original page (click to expand)

Mystic-Matron-12B

Overview

Mystic-Matron-12B was created by merging Scarlet-Seraph-12B, Mahou-1.5-Mistral-Nemo-12B, and Chaos-Unknown-12B using a custom method.

Merge configuration

models:
  - model: Vortex5/Scarlet-Seraph-12B
  - model: flammenai/Mahou-1.5-mistral-nemo-12B
  - model: Vortex5/Chaos-Unknown-12b
merge_method: cdrf
parameters:
  strength: 0.92
  route: 0.42
  tau: 3.5
  agree: 0.52
dtype: bfloat16
tokenizer:
  source: Vortex5/Scarlet-Seraph-12B
      

Intended Use

🌒 Storytelling

🎭 Roleplay

✨ Creative Writing