Owner Finds Tesla Is Already Using Vision to Replace Ultrasonic Sensors

Tesla detecting distance without ultrasonic sensors

salvagEV's/YouTube

Tesla owner and EV mechanic Occupy Mars shared a video of their salvaged 2018 Tesla Model 3 detecting distances without its ultrasonic sensors (USS).

Occupy Mars shared a 10.5-minute video explaining how they discovered this anomaly. Even though the vehicle was running version 2022.28.2, which was released in September 2022, the vehicle managed to measure distances without the use of USS.

Occupy Mars moved the vehicle out of their garage without the front bumper and confirmed that all ultrasonic sensors were disconnected. However, they noticed that their Model 3 was accurately detecting a vehicle next to it and displaying the appropriate distances on the screen. This appears to confirm that Tesla is testing Tesla Vision to detect nearby objects and display distances, but only on vehicles with USS.

Confirming Camera Detection

Interestingly, Occupy Mars' vehicle only detected the distances while in reverse, although a lot of the car is taken apart, so this could have been due to early software or hardware issues. When pulling up closer to the garage, Occupy Mars noticed the Model 3 was not showing the distance between the car and the garage. Instead, it was detecting objects at the corners of the vehicle. This would make sense given the blindspot in front of the vehicle where cameras can not see.

To confirm that the vehicle was using its cameras to determine distances, Occupy Mars covered the front-facing and B-pillar cameras with tape. Once the vehicle's cameras were covered, the car immediately stopped displaying the arcs and distances from nearby objects.

Occupy Mars went a step further to rule out radar use and physically unplugged the vehicle's radar and with the cameras uncovered, the vehicle continued to detect objects and display distances.

Video Showing USS-like Detection Using Vision

The video below by Occupy Mars shows their vehicle detecting distances without utilizing any ultrasonic sensors or radar.

Running Vision in Shadow Mode

What appears to be happening is that Tesla is actively testing and collecting data from vehicles that are equipped with ultrasonic sensors, and it appears they've been doing so for several months. Previously, the USS were fully responsible for detecting distances for nearby objects, but it appears Tesla is now using an updated version of Tesla Vision in shadow mode. This lets Tesla run code in the background to assess its accuracy before having the vehicle or driver rely on it. Tesla then uses the vision-detected distances and compares those values to the output of the vehicle's ultrasonic sensors, letting them assess the new system's accuracy before releasing it publicly.

The Removal of Ultrasonic Sensors

On October 4th, 2022, Tesla announced that they were removing ultrasonic sensors from their vehicles and beginning the transition into their own proprietary “Tesla Vision.” According to Tesla’s announcement, Model 3 and Model Y vehicles built in October 2022 and beyond no longer included the USS. Later, Tesla removed USS from the Model S and Model X as well.

This came as a bit of a shock to drivers and automotive experts, namely the team from Munro Live. The USS are standard in modern vehicles. They’re used to detect distances in tight spaces to enhance the safety of the vehicle. But Tesla believes they can maintain a similar level of safety and accuracy without the USS, despite some outcry from the Tesla community and experts.

Savings Due to the Removal of Ultrasonic Sensors

Tesla is saving an estimated $114 per vehicle by removing the USS, equating to roughly 100 million dollars per year based on Tesla’s volume, per Munro Live. This effort makes sense as Tesla is revamping its Model 3 to cut costs so prospective buyers can take advantage of the new federal tax credit.

Front Blindspot

Will Teslas have a blind spot directly in front of the vehicle?

Munro Live

As pointed out in the Munro Live video, there is a three-foot blindspot in the front of the vehicle. Tesla’s rumored solution for the three-foot blindspot is to have the vehicle remember what it sees when driving toward an object. But if the vehicle is parked for an extended period and something is placed in front of it, how will the vehicle know where it’s placed or if it has moved?

Tesla could continue processing camera data while parked as they do in Sentry Mode, but this would cause significant battery usage over time.

Tesla may also just leave out the ability to detect objects in front of the vehicle when the vehicle is first started.

Upcoming Update

More recently Tesla owner and hacker GreenTheOnly found code of Tesla testing vision-based USS-type detection in update 2022.40, so it's clear that Tesla plans to address the lack of USS, but it appears the fix is taking longer than expected. Although nothing has been officially communicated by Tesla, we could be close to receiving the long-awaited update that restores USS-type detection.

Tesla Increases Price of Model S; Starts Offering Free Lifetime Supercharging

Not a Tesla App

For the first time in quite a while, Tesla has increased the price of one of its vehicle offerings. The Model S Long Range and the Model S Plaid have both received a hefty price increase. However, not all is bad - as Tesla also added a new benefit for buyers.

Price Increase

The price increase for the Model S is $5,000 - currently only in the United States. This price increase will likely impact other markets, including Canada, in the coming days.

The Model S Long Range now starts at $79,990, while the Model S Plaid now starts at $94,990. The Model S and Model X now have the same starting price. Interestingly, that’s also the same pricing point for the Cybertruck AWD and Cyberbeast Trimotor non-Foundation Series. 

The vehicle configuration does not appear to have changed, so the new pricing is simply an increase rather than the addition or removal of features. Tesla previously cut the price of the Model S and Model X by 15% in 2023, so this could simply be an adjustment to ensure that the vehicle pricing stays in line with inflation and other factors.

Free Lifetime Supercharging

For those on the fence about ordering a Model S, Tesla has brought back Free Lifetime Supercharging when you order a new Model S on or after December 13, 2024. As always, Free Lifetime Supercharging is restricted to the buyer’s Tesla account and to that specific vehicle. It cannot be transferred to another vehicle or another owner after ownership transfer. It’s worth noting, that it also doesn’t exclude the owner from receiving Supercharger idle fees or congestion fees. There is currently no end date for this promotion.

There are currently no changes to the Model X, neither a price increase nor the addition of Lifetime Superchargering. However, when Tesla makes changes to one of their premium vehicles, it usually affects the other one as well. So be on the lookout for potential changes to the Model X offering in the coming days.

We’ve seen Tesla value Lifetime Supercharging at $5,000, so this falls in line with the price increase we’re seeing. It’s possible that Tesla will begin to bring back Lifetime Supercharging as a perk for buying into their more premium Model S and Model X cars, or this could be another temporary promotion to get buyers who are on the fence to go ahead and make their purchase while this promotion lasts.

Follow

Follow

Follow

Tesla’s Optimus Robot Learns to Walk Without Vision [VIDEO]

Optimus Falls - but catches itself!

Not a Tesla App

Tesla recently showed off a demo of Optimus, its humanoid robot, walking around in moderately challenging terrain—not on a flat surface but on dirt and slopes. These things can be difficult for a humanoid robot, especially during the training cycle.

Daily walks help clear your mind pic.twitter.com/dUsW58trS6

— Tesla Optimus (@Tesla_Optimus) December 9, 2024

A Look Behind the Curtain

Most interestingly, Milan Kovac, VP of Engineering for Optimus, clarified what it takes to get Optimus to this stage. Let’s break down what he said.

Optimus is Blind

Optimus is getting seriously good at walking now - it can keep its balance over uneven ground - even while walking blind. Tesla is currently using just the sensors, all powered by a neural net running on the embedded computer. 

Essentially, Tesla is building Optimus from the ground up, relying on as much additional data as possible while it trains vision. This is similar to how they train FSD on vehicles, using LiDAR rigs to validate the vision system’s accuracy. While Optimus doesn’t have LiDAR, it relies on all those other sensors on board, many of which will likely become simplified as vision takes over as the primary sensor.

Today, Optimus is walking blind, but it’s able to react almost instantly to changes in the terrain underneath it, even if it falls or slips. 

What’s Next?

Next up, Tesla AI will be adding vision to Optimus - helping complete the neural net. Remember, Optimus runs on the same overall AI stack as FSD - in fact, Optimus uses an FSD computer and an offshoot of the FSD stack for vision-based tasks.

Milan mentions they’re planning on adding vision to help the robot plan ahead and improve its walking gait. While the zombie shuffle is iconic and a little bit amusing, getting humanoid robots to walk like humans is actually difficult.

There’s plenty more, too - including better responsiveness to velocity and direction commands and learning to fall and stand back up. Falling while protecting yourself to minimize damage is something natural to humans - but not exactly natural to something like a robot. Training it to do so is essential in keeping the robot, the environment around it, and the people it is interacting with safe.

We’re excited to see what’s coming with Optimus next because it is already getting started in some fashion in Tesla’s factories.

Follow

Follow

Follow