2.8 trillion parameters is not the end: Domestic model Kimi K4 aims for extreme scale, GPUs become bottleneck

Domestic AI model startup Moonshot AI has released Kimi K4, a large language model with reportedly 2.8 trillion parameters, and plans to scale even further. The company states that GPU supply is now the primary bottleneck for training larger models.

Moonshot AI

How to Build the World's Largest Open-Source Model - People's Daily

People's Daily published an article detailing the development of the world's largest open-source model, focusing on the technical challenges and breakthroughs. The model, developed by Moonshot AI, features massive parameter counts and aims to advance AI accessibility.

Moonshot AI