Synthetic Persona Pretraining (SPP): 3B models from the paper.
AI & ML interests
None defined yet.
Recent Activity
1.7B SPP models: bases publish their training trajectory as step-* revisions, plus instruct counterparts.
SP-SFT: the post-training mix that binds the assistant identity to the persona installed during pretraining.
3B SPP models: bases publish their training trajectory as step-* revisions, plus instruct counterparts.
The SPP pretraining corpus: reflections, the corpus selection manifest, safety scores, and verification data. Fully reproducible from public Dolma 3.
ConstitutionEval (in-domain constitution following) and audited AIRiskDilemmas (out-of-distribution value prioritisation and risk-taking).
Synthetic Persona Pretraining (SPP): 3B models from the paper.
3B SPP models: bases publish their training trajectory as step-* revisions, plus instruct counterparts.
1.7B SPP models: bases publish their training trajectory as step-* revisions, plus instruct counterparts.
The SPP pretraining corpus: reflections, the corpus selection manifest, safety scores, and verification data. Fully reproducible from public Dolma 3.
SP-SFT: the post-training mix that binds the assistant identity to the persona installed during pretraining.
ConstitutionEval (in-domain constitution following) and audited AIRiskDilemmas (out-of-distribution value prioritisation and risk-taking).