Multi-Agent Collaborative Data Selection for Efficient LLM Pretraining
Paper
•
2410.08102
•
Published
•
21
This repo contains the trained 1.3 billion parameter LLAMA-2 architecture model checkpoints for the work Multi-Agent Collaborative Data Selection for Efficient LLM Pretraining.