Tesla Vision Park Assist: Bringing Back Distance Measurements for Cars without Ultrasonic Sensors

By Kevin Armstrong
Tesla restores Park Assist using vision for vehicles without ultrasonic sensors
Tesla restores Park Assist using vision for vehicles without ultrasonic sensors
Tesla

Tesla has taken another significant step forward in its commitment to vision-based technology by introducing Tesla Vision Park Assist. This new feature reinstates the Park Assist distance measurements for Tesla vehicles without ultrasonic sensors (USS).

In October 2022, Tesla removed USS from Model 3, Model Y, and later, Model S and Model X, as part of the shift to its camera-based Autopilot system, Tesla Vision. However, the accompanying software to measure distances to nearby objects wasn't ready at the time, leaving owners of cars without USS to estimate their distance to surrounding things while parking.

The Latest Update Gets Even Bigger

The wait for a solution is finally over with the release of software version 2022.45.11, which includes the latest FSD Beta v11.3.2. As confirmed by well-known Tesla hacker @greentheonly, Tesla Vision Park Assist has been added to this update for vehicles without USS.

Improvements Over Ultrasonic Sensors

Although Tesla's vision-based approach is expected to not be as accurate as having ultrasonic sensors, at least initially, it does offer one improvement for the hardware-based solution.

The vision-based Park Assist system not only measures distances to objects at the front and rear of the car but also detects objects on the sides where there is no USS, providing 360° coverage around the vehicle.

It's not clear whether Tesla plans to add vision-based object detection to the sides of vehicles that have ultrasonic sensors in a future update.

The current release is limited to cars testing FSD Beta without USS, while vehicles with USS continue to operate with their sensors enabled. Although it might take some time for the feature to be deployed fleet-wide, Tesla Vision Park Assist demonstrates Tesla's progress in refining vision-based technology for parking assistance.

Who Will Get It

According to @greentheonly, the new Park Assist system is currently only available to customers in the United States and Canada who have purchased FSD and applied for access to the FSD Beta program. It is also currently limited to the Model 3 and Model Y. However, with visual and audio alerts of surrounding objects and the use of the occupancy network to predict high-definition outlines of objects around the vehicle, the vision-based system could eventually prove superior to Tesla's previous USS-based solution.

The release notes for Park Assist in 2022.45.11 state:

Tesla Vision Park Assist provides visual and audio alerts of surrounding objects. This feature uses the occupancy network to predict high-definition outlines of objects 360 degrees around the car.

Note: Tesla Vision Park Assist is for guidance purposes only and is not a substitute for an aware driver. Please be attentive and avoid obstacles as required.

Last year, Tesla's shift to a vision-only approach resulted in temporarily limiting or disabling some features, such as Summon, Smart Summon, Autopark, and Park Assist. Park Assist, which alerts drivers to nearby objects when traveling at less than five mph, appeared to be the easiest to implement. Now that Tesla has released Park Assist for vision-only vehicles, it is likely that Autopark, Summon, and Smart Summon will follow suit for Teslas without ultrasonic sensors in due course.

With Tesla Vision Park Assist, Tesla owners without ultrasonic sensors can now enjoy improved parking assistance, making it easier and safer to navigate tight parking spaces. As the feature continues to roll out and improve, Tesla demonstrates its dedication to advancing its vision-based technology for the benefit of its customers.

Tesla Preparing to Expand Robotaxi Geofence As Validation Vehicles Spotted

By Karan Singh
Not a Tesla App

Tesla appears to be preparing to expand its Robotaxi geofence in Austin, Texas, with numerous engineering vehicles taking to the road. One of the most interesting sights, between the short and tall LiDAR rigs, was a Cybertruck validation vehicle, which we don’t often see.

Tesla’s expansion is moving the Robotaxi Network into downtown Austin, a dense urban environment that is currently outside the geofence. It appears Tesla is content with the latest builds of Robotaxi FSD and is ready to take on urban traffic.

The inclusion of a Cybertruck in the validation fleet is noteworthy, as the rest of the vehicles are Model Ys. This suggests that Tesla may be addressing two challenges simultaneously: expanding its service area while also addressing the FSD gap between the Cybertruck and other HW4 Tesla vehicles.

Using LiDAR

Recent sightings have shown a fleet of Tesla vehicles, equipped with rooftop validation sensor rigs, running routes throughout downtown Austin and across the South Congress Bridge. While these rigs include LiDAR, it’s not a sign that Tesla is abandoning its vision-only approach.

Instead, Tesla uses the high-fidelity data from the LiDAR as a ground truth measurement to validate and improve the performance of its cameras. In short, it essentially uses the LiDAR measurements as the actual distances and then compares the distances determined in vision-only to the LiDAR measurements. This allows Tesla to tweak and improve its vision system without needing LiDAR.

Additionally, the validation vehicles are likely scouting for the new, pre-determined, selectable pick-up locations that have just rolled out as part of the Robotaxi app.

Expanding the Geofence

This data collection in a new, complex environment right outside the Robotaxi geofence is an indicator that plans to expand the geofence. Tesla has previously indicated that they intend to roll out more vehicles and expand the geofence slowly. Given that their operational envelope includes the entire Austin Metro Area, we can expect more locations to open up gradually.

Once they expand the operational radius to include downtown Austin, they will likely also have to considerably increase the number of Robotaxis active in the fleet at any given time. Early-access riders are already saying that the wait time for a Robotaxi is too long, with them sometimes having to wait 15 minutes to be picked up.

With a larger service area, we expect Tesla to also increase the number of vehicles and the number of invited riders to try out the service.

After all, Tesla’s goal is to expand the Robotaxi Network to multiple cities within the United States by the end of 2025. Tesla has already been running an employees-only program in California, and we’ve seen validation vehicles as far away as Boston and New Jersey, on the other side of the country.

Cyber FSD Lagging Behind

One of the most significant details from these recent sightings is the presence of a Cybertruck. Cybertruck’s FSD builds have famously lagged behind the builds available on the rest of Tesla’s HW4 fleet. Key features that were expected never fully materialized for the Cybertruck, and the list of missing features is quite extensive.

  • Start FSD from Park

  • Improved Controller

  • Reverse on FSD

  • Actually Smart Summon

It may not look like a lot, but if you drive a Cybertruck on FSD and then hop in any of the rest of Tesla’s HW4 vehicles, you’ll notice a distinct difference. This is especially evident on highways, where the Cybertruck tends to drift out of the lane, often crossing over the lane markings.

We previously released an exclusive mentioning that a well-positioned internal source confirmed with us that a new FSD build for the Cybertruck was upcoming, but we never ended up receiving that particular build, only a point release to V13.2.9. The AI team’s focus had clearly shifted to getting the latest Robotaxi builds running and validated, and while a flagship, the Cybertruck fleet was small and new, and really a secondary task.

The Cybertruck’s larger size, steer-by-wire, rear-wheel steering, and different camera placements likely present a bigger set of challenges for FSD. Deploying it now as a validation vehicle in a complex environment like downtown Austin suggests that Tesla is finally gathering the specific data needed to bring the Cybertruck’s capabilities up to par. This focused effort is likely the necessary step to refine FSD’s handling of the Cybertruck before they begin rolling out new public builds.

When?

Once Tesla’s validation is complete, we can probably expect the Robotaxi Network to expand its borders for the first time in the coming days or weeks. However, we’ll likely see more signs of the expansion, such as Robotaxi vehicles driving themselves around the area, before the expansion actually happens.

Hopefully, the Cybertruck will also learn from its older siblings and receive the rest of its much-needed FSD features, alongside an FSD update for the entire fleet.

Tesla Updates Robotaxi App: Adds Adjustable Pick Up Locations, Shows Wait Time and More [VIDEO]

By Karan Singh
Nic Cruz Patane

Tesla is rolling out a fairly big update for its iOS and early-access-only Robotaxi app, delivering a suite of improvements that address user feedback from the initial launch last month. The update improves the user experience with increased flexibility, more information, and overall design polish.

The most prominent feature in this update is that Tesla now allows you to adjust your pickup location. Once a Robotaxi arrives at your pickup location, you have 15 minutes to start the ride. The app will now display the remaining time your Robotaxi will wait for you, counting down from 15:00. The wait time is also shown in the iOS Live Activity if your phone is on the lock screen.

How Adjustable Pickups Work

We previously speculated that Tesla had predetermined pickup locations, as the pickup location wasn’t always where the user was. Now, with the ability to adjust the pickup location, we can clearly see that Tesla has specific locations where users can be picked up.

Rather than allowing users to drop a pin anywhere on the map, the new feature works by having the user drag the map to their desired area. The app then presents a list of nearby, predetermined locations to choose from. Once a user selects a spot from this curated list, they hit “Confirm.” The pickup site can also be changed while the vehicle is en route.

This specific implementation raises an interesting question: Why limit users to predetermined spots? The answer likely lies in how Tesla utilizes fleet data to improve its service.

Release Notes

While the app is still only available on iOS through Apple’s TestFlight program, invited users can download and update the app.

Tesla included these release notes in update 25.7.0 of the Robotaxi app:

  • You can now adjust pickup location

  • Display the remaining wait time at pickup in the app and Live Activity

  • Design improvements

  • Bug fixes and stability improvements

Nic Cruz Patane

Why Predetermined Pick Up Spots?

The use of predetermined pickup points is less of a limitation and more of a feature. These curated locations are almost certainly spots that Tesla’s fleet data has identified as optimal and safe for an autonomous vehicle to perform a pickup or drop-off.

This suggests that Tesla is methodically “mapping” its service area not just for calibration and validation of FSD builds but also to help perform the first and last 50-foot interactions that are critical to a safe and smooth ride-hailing experience.

An optimal pickup point likely has several key characteristics identified by the fleet, including:

  • A safe and clear pull-away area away from traffic

  • Good visibility for cameras, free of obstructions

  • Easy entry and exit paths for an autonomous vehicle

This change to pick-up locations reveals how Tesla’s Robotaxi Network is more than just Unsupervised FSD. There are a lot of moving parts, many of which Tesla recently implemented, and others that likely still need to be implemented, such as automated charging.

Frequent Updates

This latest update delivers a much-needed feature for adjusting pickup locations, but it also gives us a view into exactly what Tesla is doing with all the data it is collecting with its validation vehicles rolling around Austin, alongside its Robotaxi fleet.

Tesla is quickly iterating on its app and presumably the vehicle’s software to build a reliable and predictable network, using data to perfect every aspect of the experience, from the moment you hail the ride to the moment you step out of the car.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

More Tesla News

Tesla Videos

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter