Tesla Finally Launches FSD V12.4.2 to Customers with Vision-Monitoring Changes

By Karan Singh
Tesla releases FSD 12.4.2
Tesla releases FSD 12.4.2
Not a Tesla App

After a month-long delay, Tesla sent FSD v12.4.2 to employees yesterday with update 2024.15.10. After just a few hours of the update going out to employees, Tesla started sending it to OG testers as well, who were already on FSD v12.4.1.

Issues Behind Delay

On X, Elon Musk broke down some of the details behind the delays. He mentioned that part of the issues behind the V12.4.2 delays were based on training. Tesla was seeing fewer interventions with FSD v12.4, but the release suffered from driving smoothness, which ironically was supposed to be one of the key features of this release.

Musk explained that part of the issue was due to too much focus on interventions, and not enough on normal driving. He compared it to training a doctor on emergency room patients, versus training on regular preventative care.

Vision-Based Attention Monitoring Changes

With FSD update 12.4.2, Tesla changed some of the language used for its Vision-Based Attention Monitoring in the release notes. Here’s a breakdown of some of the key points in the language. The changes to the release notes are below. Phrases or words that were removed are crossed out, while those added are in bold.

“When Full Self-Driving (Supervised) is enabled, the driver monitoring system now primarily relies on the cabin camera to determine driver attentiveness. This enhancement is available on vehicles equipped with a cabin camera and only when the cabin camera has clear and continuous visibility of the driver's eyes Cabin camera must have clear visibility (e.g., the camera is not occluded, eyes, arms are visible, there is sufficient cabin illumination, and the driver is looking forward at the road ahead and not wearing sunglasses, a hat with a low brim without sunglasses, or other objects covering the their eyes). Outside of these In other circumstances, the driver monitoring system will continue to primarily rely on a combination of torque-based (steering wheel) and vision-based monitoring to detect driver attentiveness. When the cabin camera is actively monitoring driver attentiveness, a green dot appears next to the steering wheel icon on the touchscreen.

If the cabin camera detects inattentiveness the driver to be inattentive, a warning will appear. The warning can be dismissed by the driver immediately reverting their attention back to the road ahead. Warnings will escalate depending on the nature and frequency of detected inattentiveness, with continuous inattention leading to a Strikeout.

Cabin camera images do not leave the vehicle itself, which means the system cannot save or transmit information unless you enable data sharing.

Arms Need to be Visible and Other Changes

There are various interesting changes here. While some of the changes are just improved wording to make the feature clearer, there are others that are worth highlighting which could point at changes to Tesla’s vision-based monitoring.

The first is the addition of “arms are visible.” Apparently, Tesla now wants to be able to see your arms to better detect attentiveness. Tesla may want to see that your arms are on the steering wheel, or they maybe they want to make sure your arms are moving so that someone isn’t able to post a static photo in front of the cabin camera to circumvent the attention monitoring. The reason isn’t clear, but looks like having your arms visible is now a requirement.

There are other small changes like the removal of a “hat with a low brim,” which was replaced by more generic wording that says the driver’s eyes must be visible.

However, near the end, Tesla removed the portion that said the driver monitoring system will rely on a combination of torque-based (steering wheel) and vision-based monitoring. This was changed to simply say that Tesla will rely primarily on torque-based (steering wheel) monitoring when vision-based monitoring is unavailable. It’s not clear whether this is just semantics and the wording now better describes how the vision-monitoring feature works, or if Tesla made changes so that the vehicle is simply either doing vision monitoring or steering wheel torque detection, and it doesn’t try to combine the two sources to detect whether the driver is paying attention.

Even more interestingly, the last line that says “cabin camera images do not leave the vehicle itself, which means the system cannot save or transmit information unless you enable data sharing,” has been removed. This could point to Tesla saving images of the cabin camera to improve its AI training model.

Tesla will display a green dot on the screen whenever its using its vision-based monitoring system.

Release Date

Either way, we’re glad to finally see FSD v12.4.2 going out to employees and early-access owners. The release is expected to have far fewer interventions and improve vehicle smoothness during braking and acceleration. If there are no major issues found, this update could go wide to all customers with FSD and on update 2024.14 or lower in the coming weeks.

A Closer Look at Tesla's Updated Energy App - What's Changed

By Karan Singh
Not a Tesla App

One of the big undocumented changes in Tesla’s 2024 Holiday Update was the changes to the Energy app. While the Model S, Model X, and Cybertruck received the Consumption tab in the Energy app for the first time, the changes made for those models also carried over to Model 3 and Model Y.

The Consumption tab lets you view your vehicle’s consumption over recent trips as well as view projected range estimates based on historical usage, but it now offers different options.

Sadly, legacy Model S and Model X vehicles produced before the 2021 refresh still don’t have access to the Energy app at this time.

Energy App

Tesla’s Energy App previously let you view a lot of in-vehicle data on what is consuming energy and how to improve your energy consumption. It was previously refreshed in 2022 and brought Drive, Park, and Consumption tabs to help compare actual vehicle energy consumption versus what you’d expect from the EPA ratings.

The old Energy App's consumption page.
The old Energy App's consumption page.
Not a Tesla App

Key Changes

The Energy App has seen a lot of changes - mostly in the name of simplicity and reducing confusion. Some changes reduce functionality, but others bring even more. All of these changes impact the Consumption tab - the Park and Drive sections are unchanged.

Distance

Previously, you were able to switch the graph on the Consumption tab to show the last 5, 15, or 30 miles. Instead, it is now a static display of the last 200 miles (or 300km). This means your last 200 miles of driving - whether it's a single trip or multiple trips. Your range prediction and energy usage are now based on 200 miles of driving instead of the previous selectable distance.

This allows for a more reasonable range prediction as small bursts of high-energy usage, such as time spent accelerating to highway speeds from an offramp, are now less of an impact and are instead averaged out by regular driving.

However, for those who love to take their Teslas to the track or tow regularly, this makes the consumption significantly less useful because you can no longer see your actual energy usage for the type of driving you’re doing. This could be fixed with a reset button or by adding the ability to select your distance — similar to before.

Projected Range and Average Wh/mi

Unfortunatley, the Instant Range button has been removed, and the graph is now locked on what was previously the Average Range. Essentially, you cannot view your real-time range based on current instantaneous consumption - but you can view the overall projected range.

Additionally, average Wh/mi and projected range are still displayed - but in different areas compared to before. The projected range is displayed on the center-left side of the graph, while the average Wh/mi is now displayed at the top of the screen.

Not a Tesla App

Compare Vs EPA

Another new feature is that the average range is now compared to the EPA estimated range in terms of wh/mi. You’ll be able to see whether your driving style and conditions put you over or under the EPA estimate in a pretty quick way, which is helpful.

This new comparison is located just under your average Wh/mi.

Small and minor adjustments to your driving style - like not taking off like an electric lightning bolt at every red light - will make a big difference to your range. Don’t worry - we know its hard, we love doing it too! Other things - such as driving downhill versus uphill, will have an impact that you can’t necessarily avoid unless you’re old enough that you went to school uphill both ways.

Total Vehicle Consumption

The final new feature is a total vehicle consumption number at the bottom left, under the chart. It will tell you how much energy you’ve consumed over the distance you’ve driven so far. This is a convenient way of seeing exactly how much energy you’ve used.

Bug

There’s currently a bug in the way the Y-axis is labeled. The yellow area of the graph means the vehicle is using energy, while green means the vehicle is generating energy through regenerative braking. However, the Y-axis is currently mislabeled and shows generated energy as using about 100-200 Wh/mi.

The confusion appears to be due to the dark gray line, which looks like “0” on the Y-axis but actually represents the vehicle’s rated range. We would expect this to be Y-axis 0, since above the line the graph is yellow, and underneath it, the graph is green. However, this line is at about the 240 Wh/mi mark but will vary depending on the vehicle.

Due to this bug, it’s currently not possible to see how much energy is being generated.

Dynamic Y-Axis

The Y-axis in the Consumption tab is now dynamic - it will expand and contract automatically based on the driving data. We’ve seen it go from 400 Wh/mi all the way up to 800 Wh/mi. You likely need to be in a Model S Plaid or Cyberbeast with Launch Mode to see numbers much higher than that.

We’re sad to see the X-axis get locked to 200 miles, but being able to see total vehicle consumption and comparing average consumption against what’s rated is equally, if not even more valuable.

Overall, the new and improved Consumption tab is simpler and doesn’t require user input. While it takes away some features, it makes it easier for drivers who may not use it regularly. The most important piece is the projected range, which is now easier to see and understand unless you're towing and need the historical usage erased because it’s now irrelevant to your current drive. Hopefully, Tesla will allow you to scrub the graph horizontally in the future, adding the ability for the user to adjust the X-axis dynamically.

Tesla Smart Voice Assistant Coming - Vehicle Responds for First Time

By Karan Singh
Not a Tesla App

If you hop into your Tesla and say ‘Hi’ or ‘Hello’ after pressing the Voice Command button, there is a good chance it’ll reply with “Hello!” This is the newest and most interesting piece of news pointing us to the conclusion that a Tesla voice assistant is on the way.

Previously, if you tried this, it would simply return “Command not understood.” This is the first time the vehicle is responding and interacting with the user.

Experience It Yourself

You’ll need to have your vehicle language set to English. Once that’s done, you can use the voice command button on your steering wheel or yoke - for the Model 3 and Model Y, push the right wheel button, and for the Model S, Model X, and Cybertruck, press the button. Then go ahead and say Hi or Hello.

The Hello! response may even have regional differences. For a German Tesla owner, after setting his language to English, the response came back as “Hallo.” We’re interested to see what the responses may be in other regions, so let us know if you notice anything interesting.

We’ve tried a few other basic things, but it seems that, for now, the vehicle only replies to a simple greeting. Asking it what time it is or the $TSLA stock price doesn’t seem to do much yet - unless you’re in China with the updated Smart Assistant.

Not a Tesla App

Server-Side Update

This update appears to be happening over Tesla’s voice system backend and doesn’t require the Holiday Update. Users who aren’t on the Holiday Update are reporting that they’re getting this new response as well.

We already know that Tesla interprets speech remotely, and the driver’s voice is not processed in the vehicle. Instead, the voice snippet is transmitted to Tesla’s servers, where Tesla processes it and sends a response back to the vehicle so that the vehicle can interpret it. This is unlikely to change with a smart assistant, as Elon Musk has already said that Grok will still process data server-side instead of on-device.

Many users recently also noticed significant improvements to voice commands, saying that the system understands them better and that responses now come back faster.

All of these things point to a new backend system for voice processing that Tesla is testing. It’s not unusual for a company to switch to a new backend process but keep the capabilities the same as the legacy system until it’s ready to roll out the new features. At that point, it’s simply a flip of a switch to allow the new capabilities.

The new smart assistant that was rolled out in China is mostly a backend change, with the in-vehicle experience largely remaining the same. The activation method (button press) and user interface remain the same. What changed is the response that comes back from the server, and the assistant gained a voice. The new voice we receive with a smart assistant could very well be the new voice users are experiencing in the navigation system in newer vehicles.

Below is a video of the voice assistant in China:

Vehicle Support - Intel?

When China received the Smart Assistant, it was locked to cars equipped with AMD Ryzen processors only. Shortly after its initial launch, it became available to older cars with Intel Atom processors as well.

However, we’re not sure whether it would apply to legacy Model S and Model X owners. A legacy vehicle owner had their vehicle report “Command not understood” when they tried the ’Hi’ voice command.

Grok for Tesla

Elon has previously mentioned that Tesla vehicles would receive Grok AI. Grok, as of yet, still doesn’t have live speech support like other LLM models such as OpenAI’s ChatGPT or Google’s Gemini. However, a major update to Grok just brought massively improved image generation via a new model called Aurora.

xAI has been hard at work improving Grok, and we’re sure that live speech support is on its way soon. Once that feature arrives on X, Tesla will likely be well-positioned to enable a Grok-powered smart assistant fleet-wide with a flick of a switch.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

More Tesla News

Tesla Videos

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter