Tesla’s New Supercomputer ‘Cortex’ at Giga Texas Boasts 100,000 NVIDIA GPUs for AI Training

At Giga Texas, Elon Musk formally named Tesla's latest supercomputer cluster "Cortex." With 100,000 NVIDIA H100/H200 AI GPUs and "massive storage" for video training its FSD (Full Self-Driving) and Optimus robotics programs, this enormous system will be powered by these GPUs.

Given his leadership positions at SpaceX, Tesla, and X, it is not surprise that Musk announced the supercomputer's new name via a post on X. According to what he said, Cortex will have over 100,000 NVIDIA H100 and H200 AI GPUs, all of which will be used to train the neural networks that drive Optimus robots and FSD.

Musk has highlighted the enormity of the cooling system needed for this cluster of supercomputers, estimating that it will take about 130MW of power just for cooling this year. The demand for this will surge to more than 500MW within the next eighteen months. The installation of the cooling system's fans this week was documented by Joe Tegtmeyer, a Giga Texas (now Cortex) observer, in drone footage.

Four enormous water tanks are also used by the new Cortex supercomputing cluster, which is vital for helping to cool the system. Tesla had to build a special structure on the second story of the building to house this enormous cooling gear.