Tesla Finally Launches FSD V12.4.2 to Customers with Vision-Monitoring Changes
After a month-long delay, Tesla sent FSD v12.4.2 to employees yesterday with update 2024.15.10. After just a few hours of the update going out to employees, Tesla started sending it to OG testers as well, who were already on FSD v12.4.1.
Issues Behind Delay
On X, Elon Musk broke down some of the details behind the delays. He mentioned that part of the issues behind the V12.4.2 delays were based on training. Tesla was seeing fewer interventions with FSD v12.4, but the release suffered from driving smoothness, which ironically was supposed to be one of the key features of this release.
Musk explained that part of the issue was due to too much focus on interventions, and not enough on normal driving. He compared it to training a doctor on emergency room patients, versus training on regular preventative care.
Vision-Based Attention Monitoring Changes
With FSD update 12.4.2, Tesla changed some of the language used for its Vision-Based Attention Monitoring in the release notes. Here’s a breakdown of some of the key points in the language. The changes to the release notes are below. Phrases or words that were removed are crossed out, while those added are in bold.
“When Full Self-Driving (Supervised) is enabled, the driver monitoring system now primarily relies on the cabin camera to determine driver attentiveness. This enhancement is available on vehicles equipped with a cabin camera and only when the cabin camera has clear and continuous visibility of the driver's eyes Cabin camera must have clear visibility (e.g., the camera is not occluded, eyes, arms are visible, there is sufficient cabin illumination, and the driver is looking forward at the road ahead and not wearing sunglasses, a hat with a low brim without sunglasses, or other objects covering the their eyes). Outside of these In other circumstances, the driver monitoring system will continue to primarily rely on a combination of torque-based (steering wheel) and vision-based monitoring to detect driver attentiveness. When the cabin camera is actively monitoring driver attentiveness, a green dot appears next to the steering wheel icon on the touchscreen.
If the cabin camera detects inattentiveness the driver to be inattentive, a warning will appear. The warning can be dismissed by the driver immediately reverting their attention back to the road ahead. Warnings will escalate depending on the nature and frequency of detected inattentiveness, with continuous inattention leading to a Strikeout.
Cabin camera images do not leave the vehicle itself, which means the system cannot save or transmit information unless you enable data sharing.”
Arms Need to be Visible and Other Changes
There are various interesting changes here. While some of the changes are just improved wording to make the feature clearer, there are others that are worth highlighting which could point at changes to Tesla’s vision-based monitoring.
The first is the addition of “arms are visible.” Apparently, Tesla now wants to be able to see your arms to better detect attentiveness. Tesla may want to see that your arms are on the steering wheel, or they maybe they want to make sure your arms are moving so that someone isn’t able to post a static photo in front of the cabin camera to circumvent the attention monitoring. The reason isn’t clear, but looks like having your arms visible is now a requirement.
There are other small changes like the removal of a “hat with a low brim,” which was replaced by more generic wording that says the driver’s eyes must be visible.
However, near the end, Tesla removed the portion that said the driver monitoring system will rely on a combination of torque-based (steering wheel) and vision-based monitoring. This was changed to simply say that Tesla will rely primarily on torque-based (steering wheel) monitoring when vision-based monitoring is unavailable. It’s not clear whether this is just semantics and the wording now better describes how the vision-monitoring feature works, or if Tesla made changes so that the vehicle is simply either doing vision monitoring or steering wheel torque detection, and it doesn’t try to combine the two sources to detect whether the driver is paying attention.
Even more interestingly, the last line that says “cabin camera images do not leave the vehicle itself, which means the system cannot save or transmit information unless you enable data sharing,” has been removed. This could point to Tesla saving images of the cabin camera to improve its AI training model.
Tesla will display a green dot on the screen whenever its using its vision-based monitoring system.
Release Date
Either way, we’re glad to finally see FSD v12.4.2 going out to employees and early-access owners. The release is expected to have far fewer interventions and improve vehicle smoothness during braking and acceleration. If there are no major issues found, this update could go wide to all customers with FSD and on update 2024.14 or lower in the coming weeks.
![Andrej Karpathy considers returning to Tesla to work on Optimus [video]](https://www.notateslaapp.com/images/news/2022/karpathy-podcast_300w.jpg)
