Tesla is creating San Francisco in a simulation to help train Autopilot/FSD

Tesla is creating San Francisco in a simulation to help train Autopilot

Tesla

Tesla may be ramping up how it uses simulation to train its Autopilot system. A report by Electrek asserts that it has sources claiming that the company is concentrating on a reproduction of San Francisco. The article includes an image of the recreation and states that Tesla is working with Real Engine on its simulation.

According to Electrek, the image below is part of Tesla's simulation of San Francisco.

An image of Tesla's San Francisco simulation that was obtained by Electrek

Electrek

Tesla gave the world a look at how it uses simulation to advance the Autopilot program during the first AI Day in August of 2021 (recap).

AI Day

At the first AI Day Tesla talked about the use of using simulations to help train Autopilot. The video below is cued up to where they discuss a simulation.

Ashok Elluswamy, the Director of the Autopilot Program, showed a video that, at first glance, looked real other than an appearance by a Cybertruck. “I may say so myself. It looks very pretty,” said Elluswamy. He explained that the company is investing heavily in using simulation. “It helps when data is difficult to source. As large as our fleet is (FSD Beta users), it can still be hard to get some crazy scenes,” the director explained while showing a rendering of two people and a dog running in the middle of a busy highway. “This is a rare scene, but it can happen, and Autopilot still needs to handle it when it happens,” said Elluswamy.

It appears that Tesla has jumped on Fortnite’s Battle Bus by teaming up with Epic Games and its development platform — Unreal Engine. Fortnite is one of the most popular games of all time, with 80 million subscribers and 4 million daily users, and it was created with Unreal Engine. Epic flexed its creative muscles when it gathered experts to create The Matrix Awakens: An Unreal Engine 5 Experience. The goal was to “blur the boundaries between cinematic and game, inviting us to ask — what is real?” The project spotlight on Unreal Engine shows just how incredibly realistic a simulation can be.

After Elluswamy explained that the company is investing in simulation, it makes sense that Tesla would be hiring several positions with simulation in the job description. Electrek pointed out one posting for Autopilot Rendering Engineer. The posting states the successful candidate “will contribute to the development of Autopilot simulation by enabling and supporting the creation of photo-realistic 3D scenes that can accurately model the driving experience in a wide range of locales and conditions.” Tesla prefers the candidates have experience working with Unreal Engine.

While not new, this does show that Tesla is doubling down on efforts to improve Autopilot. It has recently rolled out Full Self Driving to 60,000 more users, bringing the FSD Beta program to 160,000 in North America.

We can only guess how many thousands of simulations the Autopilot team is conducting to add to the data the Beta testers are collecting. It seems unlikely that Tesla has only created the City by the Bay in its simulations. Perhaps Elluswamy will show more renderings at the second AI Day on September 30th.

Tesla Increases Price of Model S; Starts Offering Free Lifetime Supercharging

Not a Tesla App

For the first time in quite a while, Tesla has increased the price of one of its vehicle offerings. The Model S Long Range and the Model S Plaid have both received a hefty price increase. However, not all is bad - as Tesla also added a new benefit for buyers.

Price Increase

The price increase for the Model S is $5,000 - currently only in the United States. This price increase will likely impact other markets, including Canada, in the coming days.

The Model S Long Range now starts at $79,990, while the Model S Plaid now starts at $94,990. The Model S and Model X now have the same starting price. Interestingly, that’s also the same pricing point for the Cybertruck AWD and Cyberbeast Trimotor non-Foundation Series. 

The vehicle configuration does not appear to have changed, so the new pricing is simply an increase rather than the addition or removal of features. Tesla previously cut the price of the Model S and Model X by 15% in 2023, so this could simply be an adjustment to ensure that the vehicle pricing stays in line with inflation and other factors.

Free Lifetime Supercharging

For those on the fence about ordering a Model S, Tesla has brought back Free Lifetime Supercharging when you order a new Model S on or after December 13, 2024. As always, Free Lifetime Supercharging is restricted to the buyer’s Tesla account and to that specific vehicle. It cannot be transferred to another vehicle or another owner after ownership transfer. It’s worth noting, that it also doesn’t exclude the owner from receiving Supercharger idle fees or congestion fees. There is currently no end date for this promotion.

There are currently no changes to the Model X, neither a price increase nor the addition of Lifetime Superchargering. However, when Tesla makes changes to one of their premium vehicles, it usually affects the other one as well. So be on the lookout for potential changes to the Model X offering in the coming days.

We’ve seen Tesla value Lifetime Supercharging at $5,000, so this falls in line with the price increase we’re seeing. It’s possible that Tesla will begin to bring back Lifetime Supercharging as a perk for buying into their more premium Model S and Model X cars, or this could be another temporary promotion to get buyers who are on the fence to go ahead and make their purchase while this promotion lasts.

Follow

Follow

Follow

Tesla’s Optimus Robot Learns to Walk Without Vision [VIDEO]

Optimus Falls - but catches itself!

Not a Tesla App

Tesla recently showed off a demo of Optimus, its humanoid robot, walking around in moderately challenging terrain—not on a flat surface but on dirt and slopes. These things can be difficult for a humanoid robot, especially during the training cycle.

Daily walks help clear your mind pic.twitter.com/dUsW58trS6

— Tesla Optimus (@Tesla_Optimus) December 9, 2024

A Look Behind the Curtain

Most interestingly, Milan Kovac, VP of Engineering for Optimus, clarified what it takes to get Optimus to this stage. Let’s break down what he said.

Optimus is Blind

Optimus is getting seriously good at walking now - it can keep its balance over uneven ground - even while walking blind. Tesla is currently using just the sensors, all powered by a neural net running on the embedded computer. 

Essentially, Tesla is building Optimus from the ground up, relying on as much additional data as possible while it trains vision. This is similar to how they train FSD on vehicles, using LiDAR rigs to validate the vision system’s accuracy. While Optimus doesn’t have LiDAR, it relies on all those other sensors on board, many of which will likely become simplified as vision takes over as the primary sensor.

Today, Optimus is walking blind, but it’s able to react almost instantly to changes in the terrain underneath it, even if it falls or slips. 

What’s Next?

Next up, Tesla AI will be adding vision to Optimus - helping complete the neural net. Remember, Optimus runs on the same overall AI stack as FSD - in fact, Optimus uses an FSD computer and an offshoot of the FSD stack for vision-based tasks.

Milan mentions they’re planning on adding vision to help the robot plan ahead and improve its walking gait. While the zombie shuffle is iconic and a little bit amusing, getting humanoid robots to walk like humans is actually difficult.

There’s plenty more, too - including better responsiveness to velocity and direction commands and learning to fall and stand back up. Falling while protecting yourself to minimize damage is something natural to humans - but not exactly natural to something like a robot. Training it to do so is essential in keeping the robot, the environment around it, and the people it is interacting with safe.

We’re excited to see what’s coming with Optimus next because it is already getting started in some fashion in Tesla’s factories.

Follow

Follow

Follow