Leave-1%-out retrain banks and datasets for training-data attribution: measured per-query loss changes, the ground truth for LDS.
AI & ML interests
Large language models, scaling laws, AI Alignment, democratization of DL
Recent Activity
View all activity
Papers
Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs
GPT-NeoX-20B: An Open-Source Autoregressive Language Model
Organization Card
Welcome to EleutherAI's HuggingFace page. We are a non-profit research lab focused on interpretability, alignment, and ethics of artificial intelligence. Our open source models are hosted here on HuggingFace.
You may also be interested in our GitHub, website, or Discord server.
models 973
EleutherAI/gpt2-custom
Text Generation • 0.1B • Updated • 263
EleutherAI/bergson-smollm2-lds-4k
Updated
EleutherAI/bergson-smollm2-scratch-olmo-16k
Updated
EleutherAI/sae-SmolLM2-1.7B-layer17-32x
Updated
EleutherAI/sae-SmolLM2-1.7B-layer17-32x-embedskip
Updated
EleutherAI/bergson-smollm2-lds-32k
Updated
EleutherAI/bergson-smollm2-lds-8k
Updated
EleutherAI/bergson-smollm2-lds-16k
Updated
EleutherAI/gpt-2-wikitext-chunks-epsroot-0-bs64
0.1B • Updated • 8
EleutherAI/gpt-2-wikitext-chunks-epsroot-1e-6-bs64
0.1B • Updated • 11
datasets 281
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-gpt2-medium
Viewer • Updated • 4k • 4
EleutherAI/LDS-retrain-bank-muon-N32k-bs256
Viewer • Updated • 4k • 3
EleutherAI/LDS-retrain-bank-muon-N16k-bs16
Viewer • Updated • 4k • 25
EleutherAI/LDS-retrain-bank-adamw-N32k-bs256
Viewer • Updated • 4k • 8
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-ep4
Viewer • Updated • 4k • 22
EleutherAI/LDS-retrain-bank-muon-N4k-bs256
Viewer • Updated • 2k
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.25
Viewer • Updated • 2.9k
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256
Viewer • Updated • 3.2k
EleutherAI/LDS-retrain-bank-muon-N8k-bs256
Viewer • Updated • 2k • 72
EleutherAI/LDS-retrain-bank-adamw-N8k-bs256
Viewer • Updated • 4.64k