A look at Tesla's Dojo supercomputer shared at Hot Chips 34

By Lennon Cihak
Tesla's Dojo training tile
Tesla's Dojo training tile
Tesla/YouTube

Tesla participated in Hot Chips 34 and shared a ton of mind-boggling information about their Dojo supercomputer and chip architecture.

The details shared about Dojo in Hot Chips 34 by Tesla’s Emil Talpes, who worked at AMD for about 17 years for Opteron processors, are only about the hardware and capabilities of the tiles and Dojo as a whole. The performance will be discussed at Tesla’s AI Day II on September 30th.

The goal with Dojo is, according to Musk, “to be really good at video training. We have probably the fourth or approaching the third most powerful computing center in the world for AI training. Our first goal with Dojo is to make it competitive and be more effective and neural net training than a whole bunch of GPUs.”

Since Tesla needs a lot of computing power to process the video data from the vehicles in its fleet, it has built a proprietary system-on-wafer solution. According to ServeTheHome, “Each D1 die is integrated onto a tile with 25 dies at 15kW. Beyond the 25 D1 dies, there are also 40 smaller I/O dies.”

All of the power and cooling is integrated directly on the Training Tile, which is capable of 10 TB/s on-tile bisection bandwidth and 36 TB/s off-tile aggregate bandwidth. This architecture allows for the tiles to be scaled with 9TB/s links between them. They can also be plugged in and do not require their own server.

“The defining goal of our application is scalability,” Talpes said at the end of the presentation. “We have de-emphasized several mechanisms that you find in typical CPUs, like coherency, virtual memory, and global lookup directories just because these mechanisms do not scale very well when we scale up to a very large system. Instead, we have relied on a very fast and very distributed SRAM storage throughout the mesh. And this is backed by an order of magnitude higher speed of interconnect than what you find in a typical distributed system.”

The inside look into what Tesla’s building behind the scenes continues to prove how and why Tesla is at the forefront in artificial intelligence and neural net training. It gives the Tesla community an added sense of comfort knowing that Tesla will always have scalability and innovative technology at the forefront of everything the automotive company does.

Watch Anastasi In Tech’s Recap of Tesla’s Hot Chip 34 Presentation

Tesla FSD V12.5 to Enable Sunglasses-Friendly, Nag-Free FSD

By Karan Singh
Not a Tesla App

Tesla has made some significant improvements with FSD 12.4, primarily, the removal of the steering wheel nag under certain conditions. However, there’s a caveat – you can’t wear sunglasses.

According to Elon Musk, FSD v12.5 will introduce support for nag-free FSD, even if you’re wearing sunglasses.

FSD V12.5 is an Upgrade

Ashok Elluswamy, Director of Autopilot Software, also took to X recently to mention that v12.5 is a big improvement to FSD v12.4. While he didn’t mention any specific details, this lines up with some of Musk’s previous comments that each FSD v12 iteration will see major improvements to the FSD model.

Elon also mentioned that while Tesla has a massive fleet of cars, their laser focus on making FSD work, rather than touting every daily achievement – has been their key to making generalized self-driving cars work.

FSD v12 has been pretty much a complete rewrite of the FSD city streets software stack, with drastic improvements over FSD v11. However, certain parts of the software stack haven’t been updated yet. Some features, like the updated highway stack are expected to be in FSD v12.5, which Musk confirmed recently. However, other features such as Park Seek and Banish Autopark, which were expected to arrive with FSD V12.4 are still up in the air.

What about V12.4?

FSD V12.4.3 is currently out to about 5% of the fleet (about 20-25% of FSD users) and hasn’t been pushed out again since about July 10th. Our new auto updating statistics pages can help break this down for folks who are curious.

Update 2024.15.15

FSD Supervised 12.4.3
Installed on 5.4% of fleet
6 Installs today
Last updated: Jul 22, 5:45 pm UTC

Given that it’s been some time since any new vehicles have received V12.4.3, it seems the rollout has been stopped. There could be any number of reasons for this – including software bugs, or a lack of confidence with FSD. Additionally, it could just halted in favor of focusing resources on V12.5.

While we’d love to see more vehicles get v12.4.3, we’re likely to see v12.4.4 or v12.5 being the next big waves of deployments to customers. Either way, early-access testers and Tesla ADAS testers will receive these updates first, and then they’ll roll out to the vast majority of customers once Tesla feels confident there aren’t any major issues. Tesla does all this testing in the name of safety, and it's essential that bug-free versions of FSD are the versions that are rolled out wide.

So, for now, leave your sunglasses on and hang tight for the next FSD update.

Tesla Aims To Launch Cybertruck in Canada After Transport Canada Makes Exception for Steer-by-Wire

By Karan Singh
Not a Tesla App

Tesla has confirmed that they’re aiming to launch the Cybertruck in Canada later this year. Transport Canada recently granted Tesla and the Cybertruck a unique exemption to allow steer-by-wire functionality (h/t Sawyer Merritt).

Steer-By-Wire Exemption

We previously reported that the Cybertruck was facing delays due to a steer-by-wire regulatory issue with Transport Canada. On Friday, July 19th, Transport Canada issued a message stating that they would exempt the Cybertruck, for all its models, from part of Canada’s Motor Vehicle Safety Act, which currently doesn’t permit the usage of steer-by-wire systems.

The period that the exemption begins seems to be immediate – July 19th, 2024, and will last through July 18th, 2029, whereafter regulation should supersede the exemption. In the meantime, Tesla will provide a semi-annual incident report, beginning on January 18th, 2025, including information on steering system malfunctions or failures, as well as corrective measures and customer complaints.

It seems that Transport Canada will also have to be notified every time Cybertruck’s steering software is provided with an OTA update, which could result in some update delays in Canada.

Canadian Cybertruck Soon?

With all this information, it sounds like Tesla is aiming to launch the Cybertruck to Canadian customers sometime relatively soon, as they stated they’re still aiming by the end of the year. There is a good chance that they may begin converting pre-orders to orders once Tesla. Tesla hasn’t commented on which model will be available in Canada, but it wouldn’t surprise us if it’s limited to the Foundation series in Canada in the initial release.

We could expect the first customer Cybertrucks (Roshel Defence and a few private importers notwithstanding), to be on Canadian roads in just a couple of months.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

More Tesla News

Subscribe

Subscribe to our weekly newsletter.

Sponsors

Find out how to become a sponsor and have your site listed here.

Although we share official Tesla release notes, we are not affiliated with Tesla Motors. We are Tesla fans and supporters.

Tesla Videos

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter.