Tesla participated in Hot Chips 34 and shared a ton of mind-boggling information about their Dojo supercomputer and chip architecture.
The details shared about Dojo in Hot Chips 34 by Tesla’s Emil Talpes, who worked at AMD for about 17 years for Opteron processors, are only about the hardware and capabilities of the tiles and Dojo as a whole. The performance will be discussed at Tesla’s AI Day II on September 30th.
The goal with Dojo is, according to Musk, “to be really good at video training. We have probably the fourth or approaching the third most powerful computing center in the world for AI training. Our first goal with Dojo is to make it competitive and be more effective and neural net training than a whole bunch of GPUs.”
Since Tesla needs a lot of computing power to process the video data from the vehicles in its fleet, it has built a proprietary system-on-wafer solution. According to ServeTheHome, “Each D1 die is integrated onto a tile with 25 dies at 15kW. Beyond the 25 D1 dies, there are also 40 smaller I/O dies.”
All of the power and cooling is integrated directly on the Training Tile, which is capable of 10 TB/s on-tile bisection bandwidth and 36 TB/s off-tile aggregate bandwidth. This architecture allows for the tiles to be scaled with 9TB/s links between them. They can also be plugged in and do not require their own server.
“The defining goal of our application is scalability,” Talpes said at the end of the presentation. “We have de-emphasized several mechanisms that you find in typical CPUs, like coherency, virtual memory, and global lookup directories just because these mechanisms do not scale very well when we scale up to a very large system. Instead, we have relied on a very fast and very distributed SRAM storage throughout the mesh. And this is backed by an order of magnitude higher speed of interconnect than what you find in a typical distributed system.”
The inside look into what Tesla’s building behind the scenes continues to prove how and why Tesla is at the forefront in artificial intelligence and neural net training. It gives the Tesla community an added sense of comfort knowing that Tesla will always have scalability and innovative technology at the forefront of everything the automotive company does.
Watch Anastasi In Tech’s Recap of Tesla’s Hot Chip 34 Presentation
Subscribe
Subscribe to our newsletter to stay up to date on the latest Tesla news, upcoming features and software updates.
FSD’s insatiable appetite for AI compute is taking shape once again at Giga Texas, where Tesla is building out Cortex 2.0 — its second large-scale GPU supercomputer cluster — on the facility’s north side.
This confirmation comes thanks to the detailed research and findings by Giga Texas drone pilot Joe Tegtmeyer, who shared his findings on X.
For months, there has been some speculation on what this new site would be - new storage, the Optimus production line, preparation for the Cybercab’s unboxed assembly process, and more. Now, thanks to permits filed by Tesla, we know that this new area is destined to become the second supercomputer destined for FSD training.
Cortex 2.0
There are some key details we can unpack from what we’ve learned about Cortex 2.0. The new facility will be on the north side of Giga Texas, opposite Cortex 1.0, which is on the south side. The permits explicitly tie the usage of this expansion to Cortex 2.0, namely through the fact that it is a data center.
This is actually a change from Tesla’s original plans - the northern section was intended to be used as a central campus support facility, with three smaller facilities and water storage tanks. Now, it has been redesignated as Cortex 2.0 and is one large structure.
The permits that have been filed have already been approved and cover the foundations, underground water mains, and building itself. The steel structure is actively being put together on the concrete foundations, and about 50% of the roof decking is already complete, bringing the exterior shell closer to completion.
Fueling FSD’s Brain
The deployment of Cortex 2.0 is the latest in Tesla’s massive and ongoing investment in the computational power required to train FSD. While this primarily covers FSD for cars, this will also eventually apply to Optimus, which is powered by the same AI4 computer and also runs a variant of FSD.
This isn’t Tesla’s first foray into large-scale AI infrastructure and won’t be their last. Alongside Dojo, their home-grown AI supercomputer, Tesla has been partnering closely with Nvidia to ensure they have the GPUs necessary to do all the hard work. Cortex 2.0 is the next iteration, and once it's fully online, we can expect that Tesla’s work on FSD will accelerate even further.
Especially since Elon is planning something truly outrageous once again:
Been thinking about the fastest way to bring a terawatt of compute online.
That is roughly equivalent to all electrical power produced in America today.
With European Tesla owners eagerly awaiting any news on FSD in Europe, we’ve seen Tesla tease FSD, and also point out exactly what the barrier has been - regulatory approval. Now, following the latest meeting of UNECE, new regulatory amendments are set to unlock “System-Initiated Maneuvers” (SIM) on highways across participating European nations.
This development, highlighted by Kees Roelandschap on X, notes that the latest documents from the United Nations Economic Commission for Europe (UNECE) center on amendments to UNECE regulation 171. These changes were formally adopted into UNECE during the WP29 World Forum in March 2025.
Now, the amendment that will enable SIM will come into force on September 26, 2025. This six-month period after approval is standard UNECE procedure and allows objections from party states that would halt the implementation. Objections to UNECE amendments are genuinely rare, with 95% of amendments passing without objection once the World Forum adopts them.
What This Means for FSD in Europe
System-initiated maneuvers will allow your Tesla to perform actions autonomously, such as changing lanes on a highway, while the driver remains fully responsible for supervision. This is a substantial step up from current regulatory standards that only allow for suggested maneuvers or require explicit driver initiation for every automated maneuver.
This inches towards the more normal “hands-off, eyes-on” approach that Tesla has taken with FSD Supervised in North America and China. This regulatory change will help to provide the legal frameworks needed to deploy more advanced autonomy capabilities in Europe, at least matching what’s available on highways in North America.
The UNECE regulation will apply to all countries that adopt its standards, including the European Union, Japan, and South Korea - unless they specifically block it. This is a relatively positive development, but there are some hiccups.
This regulation only allows for system-initiated maneuvers on highways, not low-speed roadways. That means the city streets portion of FSD’s capabilities - including handling ‘Start FSD from Park` and reaching your destination’s parking spot - still won’t be available in Europe.
In addition, the UNECE framework has stricter requirements for driver monitoring and attentiveness - which means that some nags, including the dreaded wheel nag, are likely to remain a key portion of the experience.
Progress on autonomous driving regulations in Europe has been fraught with indecision and caution, which has been a source of frustration for many who are watching the everyday progress of FSD in North America, and more recently, in China. Even with individual countries recently approving testing of FSD on public roads, harmonized UNECE regulations are the key to wider, consistent deployment, which will allow everyday customers to use it as well.
While the path to full parity with North America may be long and involve even more regulatory machinations, the upcoming implementation of System-Initiated Maneuvers is a big step forward for Tesla owners in Europe. It is a key piece of the puzzle that will help Tesla bring some more features of FSD to Europe, assuming the September timeline holds.
![Tesla Updates Lane Departure Avoidance, Likely Now Using FSD Stack [Video]](https://www.notateslaapp.com/img/containers/article_images/tesla-screen/lane-departure-warning.webp/bac626b9acadf88ee44775c5ee187c06/lane-departure-warning.jpg)
![Exclusive: A Look Inside the Tesla Diner [PHOTOS]](https://www.notateslaapp.com/img/containers/article_images/2025/diner-seats.jpg/b0b4cb51b80d1f29298c9ca6b9ad2ae8/diner-seats.jpg)
_300w.png)
