Tesla is set to turn on its new NVIDIA-based AI-training cluster
NVIDIA
Today, Tesla is turning on its massive new system to advance its Full Self-Driving (FSD) technology. The system has many technicalities, so Tesla enthusiast and investor, Sawyer Merritt, shared insights on X.com.
Tesla uses Graphic Processing Units (GPUs) to train its neural networks that are used to solve AI-based problems. Training Tesla's AI involves using vast amounts of video to teach the system how to operate a vehicle autonomously and safely. NVIDIA, a leading GPU manufacturer, recently released a new chip, the H100, which offers significantly higher performance than its predecessor, the A100. However, the H100 doesn't come cheap. NVIDIA's latest training-focused GPU costs about $30,000, and Tesla needs more than just a handful.
Tesla's new training cluster will be powered by 10,000 H100 NVIDIA GPUs, bringing its cost to hundreds of millions of dollars for the GPUs alone.
However, due to the high demand for this advanced chip, NVIDIA cannot produce enough H100 units to meet Tesla's, and the industry's growing demand.
The Power of Dojo
As a result, Tesla is investing over $1 billion to develop its own supercomputer, Dojo. Dojo will have a custom-designed chip to train Tesla's neural nets that will be leveraged in FSD and Optimus. Elon Musk, Tesla’s CEO, indicated that if NVIDIA could supply enough chips, the creation of Dojo might not have been necessary. Yet, the current situation has made it imperative for Tesla to take matters into its own hands.
Merritt underscored that the computational power required to train Tesla's FSD technology is a significant challenge. However, Tesla is actively addressing this issue. Musk announced that the company plans to invest over $2 billion in 2023 and again in 2024 to enhance its computational capabilities. This investment is necessary to develop FSD technology and signals Tesla’s commitment to innovation and leadership in the automotive industry.
Groundbreaking Data Centers
Tesla is not only developing its own supercomputer but is also in the process of designing what it describes as its "1st of its kind Data Centers." A recent job listing for a Senior Engineering Program Manager in Austin, Texas, where Tesla's Giga Factory operates, reveals the complexity of this initiative.
The establishment of these data centers is integral to Tesla's broader vision. The company’s need for extensive computing resources is paramount, especially when processing and analyzing large amounts of video data for its self-driving software. The Dojo supercomputer is already a testament to their commitment in this area.
Subscribe
Subscribe to our newsletter to stay up to date on the latest Tesla news, upcoming features and software updates.
Tesla Investor Relations has officially confirmed that they will conduct the Robotaxi unveiling event on October 10th in Los Angeles. Event sign-up will be done using a random drawing for Tesla shareholders. The final date for entries is a week from today, on September 17th at midnight, and the selected shareholders will be announced the week of September 23rd.
Sign Up
You’ll need to own Tesla stock ($TSLA) to participate and will be required to verify your shareholder status on the Investor Relations site. The random drawing provides a better opportunity for those who hold lots of Tesla shares, as they’ll have a higher number of entries. You get one entry per confirmed share held.
At the moment, there are no details on the timing of the event, nor anything about +1 attendees. However, one item of note is that event draw winners cannot transfer their tickets to another party – which means if you get a ticket, it's for you and nobody else.
If you’re located in the United States, you can use ‘Say’ – Tesla’s Investor Relations partner – to automatically verify your shareholder status. For those outside of the United States, unless you’re trading with an American bank, you will need to provide an updated statement showing shareholder status for September 2024. Say takes about 3-5 business days to verify statements, so be sure to sign up early.
Robotaxi Event
The Robotaxi event will take place at the Warner Bros. Discovery Studios in LA, and Tesla has been pre-emptively gathering FSD data around the neighborhood. This likely means that the event will include a demonstration of Robotaxi’s capabilities and a reveal of the Robotaxi itself. We’re hoping that attendees will have the opportunity to sit in and experience Robotaxi delivering them from Point A to Point B inside of the Discovery Studios set pieces.
It’s expected to be one of Tesla’s most interesting and notable events, as this is the first reveal of the much-talked-about Robotaxi, which has been Tesla’s goal for its Full Self-Driving software since Elon Musk’s Masterplan I.
Tesla’s latest FSD update, version 2024.27.5 brings some improvements when parking your vehicle. This is another undocumented, but one we’re happy to see.
Most recently, the Cybertruck received the undocumented change for the Hands-Free Frunk opening (video below). The Cybertruck also recently received Vision Park Assist, which included steering wheel guides in the visualization showing the direction the front and rear wheels were turned. However, it turns out this isn’t just for the Cybertruck.
Update: We’ve updated this article to mention that this feature isn’t included in update 2024.32 yet.
Quick video on the auto frunk. It's literally 🧍♂️📐
Due to the Cybertruck’s unique rear-wheel steering and steer-by-wire design, Park Assist in the Cybertruck displayed the path of the front wheels, and how they would swing while reversing.
This enhancement is also coming to every Tesla vehicle in FSD 12.5.2 and later. It’s also expected to be available in a future update for non-FSD vehicles. However, it’s unclear whether it will be a later revision of update 2024.32 or the next major Tesla update. This is a neat little update, as it helps drivers better understand and predict the path their vehicle will take during a turn.
Brandon, going by @teslaflexx on X, originally spotted the new visuals recently on an AMD-based Model Y running 2024.27.5 and FSD V12.5.2.
Any vehicles who are on update 2024.27.5 or 2024.27.20 should have access to this new feature.
Looks like Cybertruck wasn’t the only vehicle to get the new guide visuals with park assist. Much better than the lines! pic.twitter.com/tF9ZsWCcWy
