MoEs Collection This collection holds the list of all the first MoE releases from research labs. β’ 14 items β’ Updated 6 days ago β’ 4
kakaocorp/kanana-2-30b-a3b-instruct-2601 Text Generation β’ 31B β’ Updated 26 days ago β’ 766 β’ 52
Running 3.67k The Ultra-Scale Playbook π 3.67k The ultimate guide to training LLM on large GPU Clusters
Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination Paper β’ 2507.10532 β’ Published Jul 14, 2025 β’ 90
To Code, or Not To Code? Exploring Impact of Code in Pre-training Paper β’ 2408.10914 β’ Published Aug 20, 2024 β’ 45