Smol-Data
Collection
Tried and tested mixes for strong pretraining
•
14 items
•
Updated
•
1
AI & ML interests
We release large pre-training datasets to accelerate open LLM development. Part of the Hugging Face Science team (hf.co/science)
Recent Activity
Papers
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
joelniklaus
updated
a
collection
4 days ago
cfahlgren1
submitted
a
paper
to Daily Papers
21 days ago
hynky
updated
a
collection
about 1 month ago
Update README.md
#1 opened about 1 month ago
by
lhoestq
Update README.md
#1 opened about 1 month ago
by
lhoestq
guipenedo
published
a
dataset
about 1 month ago