Beating AI News Flash: Musk disclosed that the Memphis supercomputing cluster Colossus 2 plans to deploy approximately 1.2 million Nvidia Blackwell GPUs by the end of the year. Two more facilities will also come online: Gun Range is expected to go live by the end of November with 220,000 GB300s for model training; Spam, converted from a warehouse that originally stored luncheon meat and other food products, plans to deploy approximately 200,000 GB300s dedicated to AI inference.
Currently, Macrohard is equipped with 110,000 GB200s and 220,000 GB300s, while Macroharder and Minihard each have 220,000 GB300s. Adding the 420,000 planned new units, the five clusters total approximately 1.19 million.
Training and inference also have different networking requirements. Macroharder, Minihard, and Gun Range all use 800Gbps network cards, while Spam's inference tasks do not require the same scale of high-speed interconnection. Musk said its network configuration is simpler, requiring less than half the fiber optics of the training facilities.
