Baidu Baige Launches 64B World Model on 512 GPUs Without NVLink
Baidu
Baidu has introduced its new Baige platform, capable of running a model with 64 billion parameters on 512 graphics processing units without using NVIDIA's NVLink technology. This demonstrates the company's capabilities in large-scale AI computing.
Chinese company Baidu reported that its Baige platform, designed for large-scale AI computing, successfully launched a model with 64 billion parameters (64B) across 512 graphics processing units. This was achieved without using NVIDIA's NVLink technology, which is typically employed for high-speed GPU interconnects. This accomplishment highlights Baidu's ability to efficiently organize distributed computing for large models, which is particularly important amid restrictions on the supply of advanced chips.
Source: Baidu ERNIE (GNews) —
original