28 trillion tokens is not the limit: Chinese AI model Kimi K4 aims higher, GPUs are the bottleneck

Moonshot AI is developing a new model, Kimi K4, expected to surpass its predecessor Kimi K3 which was trained on 28.8 trillion tokens. The company's CEO indicated that the model's scale is limited by the availability of GPUs, highlighting hardware constraints as a bottleneck.

Moonshot AI

GPT Weekly: China-developed AI large models exceed 10 billion global downloads; US Treasury threatens sanctions on Chinese models, opposed by Silicon Valley; Kimi suspends new subscriptions due to computing power shortage

China's domestically developed AI large language models have surpassed 10 billion cumulative global downloads. The US Treasury Department's threat to sanction Chinese AI models has drawn opposition from Silicon Valley. Additionally, Moonshot AI's Kimi has suspended new user subscriptions due to a shortage of computing power.

Moonshot AI