Within the rush to develop next-generation AI, Elon Musk has assembled a brand new supercomputer working 100,000 Nvidia GPUs in 4 months.On Monday, Musk tweeted that the supercomputer, based mostly in Memphis, Tennessee, is now on-line after the town initially introduced the mission again in June. “From begin to end, it was finished in 122 days,” Musk tweeted, which additionally claims that “Colossus is essentially the most highly effective AI coaching system on this planet.”
This Tweet is at the moment unavailable. It may be loading or has been eliminated.
The supercomputer was constructed utilizing 100,000 Nvidia H100s, a GPU that tech firms worldwide have been scrambling to purchase to coach new AI fashions. The GPU often prices round $30,000, suggesting that Musk spent no less than $3 billion to construct the brand new supercomputer, a facility that may even require important electrical energy and cooling.The Colossus supercomputer will increase over time. In his tweet, Musk stated the ability will “double in measurement to 200k” GPUs in a couple of months when an extra 50,000 Nvidia H200 GPUs, which characteristic upgraded reminiscence, are added to the fold. Musk constructed the ability for xAI, his newest startup, which is concentrated on creating generative AI applied sciences, together with the controversial pro-free speech chatbot Grok. By assembling a whole bunch of 1000’s of GPUs collectively, xAI is aiming to speed up coaching for Grok and different AI initiatives to unlock new capabilities and enhancements.
Beneficial by Our Editors
It’s uncertain Musk’s supercomputer is essentially the most highly effective AI coaching system on this planet since firms together with Meta, Microsoft, and OpenAI are additionally shopping for a whole bunch of 1000’s of Nvidia GPUs for their very own AI coaching initiatives. Nonetheless, Colossus highlights how briskly the trade is constructing new amenities to coach AI. In one other tweet, Musk indicated that xAI had obtained different projections that anticipated it might take 12 to 18 months to deliver the supercomputer on-line. Regardless of the achievement, the arrival of Colossus can also be elevating considerations that the supercomputer will take a toll on Memphis’s setting, water provides, and the electrical energy grid. One native group has additionally known as on the town to analyze whether or not the ability’s generators threat producing air air pollution. Nonetheless, metropolis officers say xAI has pledged to assist enhance the native infrastructure to help the supercomputer.
Get Our Greatest Tales!
Join What’s New Now to get our high tales delivered to your inbox each morning.
This text might include promoting, offers, or affiliate hyperlinks. Subscribing to a e-newsletter signifies your consent to our Phrases of Use and Privateness Coverage. You could unsubscribe from the newsletters at any time.
About Michael Kan
Senior Reporter
I have been with PCMag since October 2017, protecting a variety of subjects, together with client electronics, cybersecurity, social media, networking, and gaming. Previous to working at PCMag, I used to be a international correspondent in Beijing for over 5 years, protecting the tech scene in Asia.
Learn Michael’s full bio
Learn the most recent from Michael Kan
