Owner Finds Tesla Is Already Using Vision to Replace Ultrasonic Sensors

By Lennon Cihak
Tesla detecting distance without ultrasonic sensors
Tesla detecting distance without ultrasonic sensors
salvagEV's/YouTube

Tesla owner and EV mechanic Occupy Mars shared a video of their salvaged 2018 Tesla Model 3 detecting distances without its ultrasonic sensors (USS).

Occupy Mars shared a 10.5-minute video explaining how they discovered this anomaly. Even though the vehicle was running version 2022.28.2, which was released in September 2022, the vehicle managed to measure distances without the use of USS.

Occupy Mars moved the vehicle out of their garage without the front bumper and confirmed that all ultrasonic sensors were disconnected. However, they noticed that their Model 3 was accurately detecting a vehicle next to it and displaying the appropriate distances on the screen. This appears to confirm that Tesla is testing Tesla Vision to detect nearby objects and display distances, but only on vehicles with USS.

Confirming Camera Detection

Interestingly, Occupy Mars' vehicle only detected the distances while in reverse, although a lot of the car is taken apart, so this could have been due to early software or hardware issues. When pulling up closer to the garage, Occupy Mars noticed the Model 3 was not showing the distance between the car and the garage. Instead, it was detecting objects at the corners of the vehicle. This would make sense given the blindspot in front of the vehicle where cameras can not see.

To confirm that the vehicle was using its cameras to determine distances, Occupy Mars covered the front-facing and B-pillar cameras with tape. Once the vehicle's cameras were covered, the car immediately stopped displaying the arcs and distances from nearby objects.

Occupy Mars went a step further to rule out radar use and physically unplugged the vehicle's radar and with the cameras uncovered, the vehicle continued to detect objects and display distances.

Video Showing USS-like Detection Using Vision

The video below by Occupy Mars shows their vehicle detecting distances without utilizing any ultrasonic sensors or radar.

Running Vision in Shadow Mode

What appears to be happening is that Tesla is actively testing and collecting data from vehicles that are equipped with ultrasonic sensors, and it appears they've been doing so for several months. Previously, the USS were fully responsible for detecting distances for nearby objects, but it appears Tesla is now using an updated version of Tesla Vision in shadow mode. This lets Tesla run code in the background to assess its accuracy before having the vehicle or driver rely on it. Tesla then uses the vision-detected distances and compares those values to the output of the vehicle's ultrasonic sensors, letting them assess the new system's accuracy before releasing it publicly.

The Removal of Ultrasonic Sensors

On October 4th, 2022, Tesla announced that they were removing ultrasonic sensors from their vehicles and beginning the transition into their own proprietary “Tesla Vision.” According to Tesla’s announcement, Model 3 and Model Y vehicles built in October 2022 and beyond no longer included the USS. Later, Tesla removed USS from the Model S and Model X as well.

This came as a bit of a shock to drivers and automotive experts, namely the team from Munro Live. The USS are standard in modern vehicles. They’re used to detect distances in tight spaces to enhance the safety of the vehicle. But Tesla believes they can maintain a similar level of safety and accuracy without the USS, despite some outcry from the Tesla community and experts.

Savings Due to the Removal of Ultrasonic Sensors

Tesla is saving an estimated $114 per vehicle by removing the USS, equating to roughly 100 million dollars per year based on Tesla’s volume, per Munro Live. This effort makes sense as Tesla is revamping its Model 3 to cut costs so prospective buyers can take advantage of the new federal tax credit.

Front Blindspot

Will Teslas have a blind spot directly in front of the vehicle?
Will Teslas have a blind spot directly in front of the vehicle?
Munro Live

As pointed out in the Munro Live video, there is a three-foot blindspot in the front of the vehicle. Tesla’s rumored solution for the three-foot blindspot is to have the vehicle remember what it sees when driving toward an object. But if the vehicle is parked for an extended period and something is placed in front of it, how will the vehicle know where it’s placed or if it has moved?

Tesla could continue processing camera data while parked as they do in Sentry Mode, but this would cause significant battery usage over time.

Tesla may also just leave out the ability to detect objects in front of the vehicle when the vehicle is first started.

Upcoming Update

More recently Tesla owner and hacker GreenTheOnly found code of Tesla testing vision-based USS-type detection in update 2022.40, so it's clear that Tesla plans to address the lack of USS, but it appears the fix is taking longer than expected. Although nothing has been officially communicated by Tesla, we could be close to receiving the long-awaited update that restores USS-type detection.

Ordering a New Tesla?

Consider using our referral code (nuno84363) to get up to $1,000 off your new Tesla.

New Tesla Model Y Adds 4D Radar; Calls 911 If Child Left Behind, Increases Safety

By Karan Singh
Not a Tesla App

Tesla’s refreshed Model Y is currently being manufactured as Tesla prepares for its first deliveries next month. While we’ve already seen quite a few cool new features, there’s more that has yet to be revealed. A recent video interview with Tesla’s engineering team hosted by Tesla Owners Silicon Valley reveals that the vehicle includes a new 4D cabin radar.

4D Radar

While Tesla has included an in-cabin radar since 2022, this appears to be a new, more capable radar. The current cabin radar is used to verify seat occupancy, but Tesla plans to add more functionality to this new system.

This updated radar will be used to provide a lot more detail than the current radar or cabin camera can provide today. The radar is located in the same location as the current version, directly above the rearview mirror.

Classify Passenger Size

This new radar has several new safety-focused features, and they’re all quite exceptional. First off, the radar will detect and classify passenger size to determine which airbags to deploy dynamically. That means that if a shorter individual is sitting up front, the dashboard airbag may not activate - but the curtain airbag will.

That will reduce injuries in impacts from airbag activation while also reducing repair costs by not activating unnecessary airbags. By having a better idea of the passenger’s size, height, and weight, the vehicle can also better determine when to activate the airbag.

Children Left in Car

But that’s not all - because of that classification system, the radar can differentiate an adult passenger from a baby or child sitting in the second row - and automatically make the necessary dynamic safety adjustments.

The cabin radar will also detect heart rate and breathing, and Tesla will automatically send a reminder through the Tesla app if it detects a child is left unattended in the vehicle. If this occurs, the vehicle will perform a variety of functions, the first being to turn on the HVAC system and send you a reminder. And if that’s not enough - in the case of an emergency, your vehicle will automatically call emergency services for you and report its location.

It’s important to note that while vehicles outside North America have eCall capabilities, in North America, they cannot call 911 unless a phone is connected to the vehicle via Bluetooth. We hope that Tesla can contact 911 via an alternative method or add eCall capabilities to these vehicles.

In late 2023, Tesla added the ability for the vehicle to call 911 over Bluetooth when the vehicle is involved in a crash.

The cabin radar in the 2024 Model Y
The cabin radar in the 2024 Model Y
Not a Tesla App

Coming Soon

While the refreshed Model Y will be shipping in March, this new radar and its associated features won’t be available immediately. Tesla intends to activate these new safety features in Q3 2025 - so sometime in late summer or early fall. We’ll dive into this new feature once it’s available later this year.

Tesla Confirms Update Issue for FSD V13.2.2; Fix Coming

By Karan Singh
Not a Tesla App

A member of Tesla’s AI development team, Kalena Brown, took to X to mention that an update is on its way for AI 4 vehicles on older FSD V13.2 builds.

It seems that Tesla has caught an issue that has been preventing vehicles from safely updating from FSD V13.2.2 to newer builds such as FSD V13.2.4 or V13.2.6.

The Bug

Tesla usually catches these issues early in testing, but sometimes, they make their way out into the wild, necessitating a stop to a rollout. In this case, the rollout was likely halted to prevent this issue from spreading to other vehicles.

There have been a lot of comments on social media that users haven’t seen an update since late December or early January. While that’s not completely abnormal, this update, version 2024.45.25.5 includes an issue that prevents it from being updated.

The Fix

Brown says that Tesla is aware of the issue and is working hard to get a build with the fix released soon. It may be a couple of weeks before it’s ready, but you can expect Tesla to roll this one out slowly to make sure the issue is addressed.

The issue appears to be specific to FSD V13.2.2, so anyone on another update should not be affected. Keep an eye out on our feeds - and we’ll let you know once the update is released.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Tesla Videos

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter