SERE: Similarity-based Expert Re-routing for Efficient Batch Decoding in MoE Models Paper • 2602.07616 • Published 4 days ago
EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models Paper • 2412.07210 • Published Dec 10, 2024
view article Article A Review on the Evolvement of Load Balancing Strategy in MoE LLMs: Pitfalls and Lessons Feb 4, 2025 • 28
🧠Reasoning datasets Collection Datasets with reasoning traces for math and code released by the community • 24 items • Updated May 19, 2025 • 182
MinMo: A Multimodal Large Language Model for Seamless Voice Interaction Paper • 2501.06282 • Published Jan 10, 2025 • 53
NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks Paper • 2410.20650 • Published Oct 28, 2024 • 17