license: apache-2.0
tags:
- test-fixture
Speculative-decoding subfolder test fixture
A tiny, randomly-initialised Llama pair for exercising subfolder loading of a speculative draft model. It exists so inference engines can test the code path in CI without downloading a real checkpoint.
These weights are random. The model produces gibberish. That is the point.
. <- target model, 2 layers, ~4M params
└── DFlash/ <- draft model, 1 layer, ~4M params
Both share the same tokenizer and vocabulary, so the draft is a valid speculator for the target.
Why a subfolder needs engine support
A Hugging Face repo id may contain at most one /, so org/repo/DFlash is
not a valid id and cannot be passed as a single string. A draft bundled inside
its target's repository therefore has to be addressed as a repo id plus a
separate sub-path, which most engines have no parameter for.
This matters in practice: shipping a draft inside its target repo keeps the pair versioned together and downloadable in one fetch, rather than as two repos that can drift apart.
Usage
from huggingface_hub import snapshot_download
snapshot_download("poolside/spec-decoding-subfolder-fixture") # target + draft
snapshot_download("poolside/spec-decoding-subfolder-fixture",
allow_patterns=["DFlash/*"]) # draft only
Engines adding support should accept the draft as
(model="poolside/spec-decoding-subfolder-fixture", subfolder="DFlash").
Provenance
Built with transformers from LlamaConfig (hidden 64, intermediate 128,
4 heads, tied embeddings), torch.manual_seed(0). Tokenizer copied from
hf-internal-testing/llama-tokenizer. No trained parameters, no proprietary
data.