Tesla to Start Using Audio and Vision in FSD V13.4

By Karan Singh
Whole Mars Catalog

With FSD V13.2.1 finally rolling out to HW4/AI4 vehicle owners this week, we’ve been super excited to see all the new features, including Park, Unpark, and Reverse in action for the first time.

However, that’s not everything - more is coming soon. We previously reported that Tesla is collecting audio input to build neural networks for audio, and now we’re learning that that capability will arrive in FSD V13.4.

Better Audio Handling

Ashok Elluswamy, Tesla’s VP of AI, mentioned that better handling of audio inputs is coming as part of FSD V13.4. That’ll be an interesting change, as the current handling of emergency vehicles on V13.2.1 is already pretty good.

However, we’re sure that being able to recognize emergency vehicles audibly will improve detection speed and reliability. Similarly to vision, FSD will start analyzing all the sounds it hears, and look for signs of emergency vehicles.

FSD will be able to make a reasonable determination on whether the sound of the siren is approaching or just echoing off of nearby terrain or buildings using the Doppler effect. It’s a simple mathematical principle where the frequency of a sound wave increases as the source moves towards the observer and decreases as it moves away. 

Interestingly, Tesla will be using the internal microphone for this task - as there are no external microphones on any Teslas… yet. This microphone is sufficient for one simple reason - sirens are made loud enough for humans to hear them inside a moving car.

Better Than a Human

Some users have wondered how the vehicle will be able to distinguish between sirens on the radio and in real life. While I’m sure we’re not the only ones to have ever been fooled by a siren on the radio, Teslas won’t be as easily fooled.

Tesla could actually take the audio going out to the radio and remove it from the sounds captured by the microphone, effectively removing sirens from the captured audio. In addition to being able to measure the intensity and direction of the sound, your vehicle should be able to accurately recognize emergency vehicles, even before a human can.

Opt-In Audio Sharing

Tesla is now allowing FSD users to opt-in to sharing audio data. The prompt for sharing audio data is on FSD V12.5.6.4, V13.2 and V13.2.1. It’s also expected to be in the upcoming Hardware 3 version of FSD 12.6.

However, it’s worth noting that Tesla’s release notes between V13.2 and V13.2.1 changed slightly for audio sharing. Tesla initially mentioned that the vehicle would capture 10-second audio clips when a siren is heard.

In FSD V13.2.1, Tesla updated the data sharing feature, letting users know that audio recordings are now said to be captured when the vehicle detects an emergency vehicle instead of detecting a siren. The audio clip is also not limited to 10 seconds anymore.

Opting into audio sharing will share microphone recordings alongside all the other data that Tesla regularly collects as part of its FSD training. Of course, if you're uncomfortable with that, you’ll be able to opt out of just the audio portion. Tesla’s privacy policy also discloses that they anonymize and sanitize the data during collection and processing.

While vision plays a much larger role, expect Tesla to deal with the capturing and analyzing of audio data in a very similar manner.

We’ve already seen improved handling for school buses on V13.2, so we’re excited to see what else Tesla does in the next few months. Perhaps handling school zones would be the next big item to tackle.

Tesla Introduces ‘Pay Later’ Option for Tesla Service Invoices in North America

By Karan Singh
@TESLA_winston

Tesla recently introduced Buy Now, Pay Later (BNPL) payment options in the United States and Canada for items in the Tesla Shop, letting owners pay later for new vehicle accessories.

However, with Tesla app update 4.46, they’re expanding support to a much more critical area — Tesla Service. Qualifying owners in the U.S. and Canada will now be able to use Pay Later options for service performed by Tesla, which includes maintenance or repairs.

Services are provided by Affirm and Klarna, as per Mark Fonte, a Senior Software Engineer working on the Tesla app.

Tesla app update 4.46 also added improvements to Tesla Assist, Wall Connector details, Tesla Energy ownership changes, and added visualizations for the updated Model S and Model X.

How It Works

The new feature is seamlessly integrated into the existing service workflow within the Tesla app.

On the Service Estimate, before work on the vehicle begins, you will see a new message on the estimate screen: Pay over time - see if you qualify.

Tapping this link opens the payment calculator, which allows you to view potential payment structures and monthly costs. This provides a clear picture of what a payment plan would look like before you commit to servicing your vehicle.

Additionally, after service is complete and you are ready to pay, the final payment screen will present Affirm and Klarna (region-dependent) as selectable payment methods, alongside the usual options of Tesla Credit or your primary payment card.

Tapping Affirm or Klarna here will reopen the payment calculator, and a confirmation prompt will appear before selecting either BNPL option.

Service Now, Pay Later

Overall, the integration of BNPL providers for service is a thoughtful one for vehicle owners. The terms can vary widely, so it’s important to compare them to other payment options you may have access to. The additional financial flexibility, when faced with a large repair bill, allows more owners to get their vehicle professionally and properly serviced by Tesla.

For those getting larger work done, such as high-voltage battery pack replacements, this is an excellent option to spread payments over a longer period, helping reduce the burden of vehicle repair.

Tesla Robotaxi: A Breakdown of Its New FSD Abilities

By Karan Singh
Not a Tesla App

With the launch of Tesla’s Robotaxi Network, we didn't just get a peek into the future of transportation—we got a detailed look at the next version of FSD.

Videos from early access riders revealed some additional capabilities over current public FSD builds, showing off how it handles emergency vehicles and more.

Safety First for First Responders

One of the biggest changes in FSD’s capabilities is its improved handling of emergency vehicles. During a ride in Austin, Robotaxi is seen identifying an approaching ambulance using a combination of visual and audio data, activating its turn signal, and smoothly pulling over to the side of the road to let the ambulance by (video below).

This is a driving task that requires more than simple awareness of laws. It requires reasoning skills to determine where to move the vehicle to create a safe path, as well as the ability to quickly identify an ambulance or another emergency service vehicle with its sirens and lights activated. Understanding the context and executing a safe and predictable maneuver is crucial, as a wrong maneuver could actually make matters worse.

For FSD and Robotaxi to gain both public trust and regulatory approval, this skill is non-negotiable, and Tesla demonstrated its advancements right here. It’s not surprising Tesla added this ability before Robotaxis made it to public roads.

This is a feature that Tesla previously mentioned would arrive as part of future updates to FSD V13, so expect it in future customer builds as well.

Automated Camera Cleaning

How does a fleet of Robotaxis keep its eyes clean without constant human intervention? Well, a clever new feature that Tesla has previously hinted at in their FSD release notes provides the answer. Robotaxi can now trigger a specific wiper and washer fluid sequence designed to clean the main front-facing cameras.

This might seem like a small detail, but it’s a brilliant solution to one of Tesla’s primary challenges - maintaining sensor clarity. While the vehicle could simply wipe the windshield multiple times, this is a clever solution to clean the most important area of the windshield as thoroughly as possible by focusing extra wiper fluid and wipes on that area.

Complex Maneuvers

Two areas where current builds of FSD V13.2.9 sometimes show hesitation are U-turns and navigating busy parking lots. The latest Robotaxi build appears to improve on both of these areas.

This first video shows a Robotaxi performing a flawless U-turn with no hesitation, and then smoothly switching lanes to take a turn.

Another video on X shows FSD’s updated confidence in navigating a complex parking lot for a precise drop-off. Today’s builds can sometimes struggle in parking lots, being slow and overly cautious when not needed, or too confident elsewhere. This appears to have been improved in these Robotaxi FSD builds with improved path planning and confidence.

We’re also likely to see FSD begin to handle more complex destination options, including parking garages and driveways, which have been promised features for almost a year. The Robotaxi FSD build has also gained the ability to safely pull over on a road, similar to the ambulance example above, but it uses this capability to drop off and pick up passengers. This is a feature that was mentioned in FSD v13.2’s Upcoming Improvements section.

Better Nighttime Performance

Driving at night presents additional challenges, including headlight glare and reduced visibility. The latest version of FSD appears to handle it with almost the same grace as it does during the day. Remember that Tesla’s Robotaxis are available up until midnight.  Early access riders mentioned that FSD is far smoother and is a step up from the behavior of current FSD builds.

Human Support

Now, what happens when a passenger feels unsafe or has a critical question? Tesla has placed two key buttons on the rear screen for just those purposes. Users are given control over the ability to Call Support, which almost instantly connects them with a real human agent at Tesla’s Robotaxi Operations Center via video call.

While it isn’t a fundamental driving feature, it does mean that Tesla’s team can provide support to Robotaxi vehicles remotely, like issuing directive commands to have a vehicle proceed straight, rather than attempting to turn through a gated community.

The other option, Pull Over, allows a rider to immediately request the vehicle to safely pull over, which it will do when it can find a safe and open location. At this point, you can either continue your trip or get out of the Robotaxi.

Both options prompt you with an “Are You Sure?” button before letting you continue, which means you won’t have your Robotaxi ride come to an abrupt stop if you tap the ‘Pull Over’ button by accident.

What This Means for Tesla Owners

These features are likely to be included in future FSD builds. This is essentially the new benchmark by which to judge FSD, at least once it begins rolling out to customer vehicles.

Many of the core driving improvements, such as the more confident maneuvering and emergency vehicle response, will make their way to the wider fleet in upcoming FSD updates.

Remember - Robotaxi isn’t just a service, it is also a preview of Tesla’s driverless FSD builds.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

More Tesla News

Tesla Videos

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter