Tesla adds Driver Monitoring System, DMS to Model 3 and Model Y cars with a cabin camera

By Nuno Cristovao

Tesla Autopilot has always required and will require full driver attention for the foreseeable future. Tesla enforced this by detecting whether torque was being applied to the steering wheel.

Tesla's DMS

Tesla has relied on this method since the introduction of Autopilot, but unfortunately there have been several flaws with it for years.

Since Tesla is looking for a certain amount of force to be applied to the steering wheel, sometimes the car can ask for the driver’s attention even when the driver is attentive and their hands are on the steering wheel. The interval that the car checks for active participation has changed over the years, but with it being somewhere around 30-60 seconds, it can sometimes become an annoyance to drivers.

The second reason that detecting torque on the steering wheel doesn’t work well as a driver monitoring system is that it is easily defeated. There have been numerous devices that mimic the force of hands on the steering wheel and let's face it, it doesn’t lead to anything good for the driver or Tesla.

Tesla's Driver Monitoring System

Yesterday we saw the first vehicles to introduce a true driver monitoring system. For vehicles with a cabin camera, which include all Model 3 and Model Y vehicles, Tesla will be able to turn on their camera-based driver monitoring system (DMS). It appears that the feature is currently limited to the US and only for radar-less cars, but we expect this to change in the future. The release notes for 2021.4.15.11 state that:

Update: With the release of update 2021.32.5, Tesla has started to roll out driver monitoring to vehicles with radar as well. It is also expanding the feature to outside of the US.

The cabin camera above your rearview mirror can now detect and alert driver inattentiveness while Autopilot is engaged. Camera data does not leave the car itself, which means the system cannot save or transmit information unless data shared is enabled. To change your data settings, tap Controls > Safety & Security > Data Sharing on your car's touchscreen.

Much like Tesla implements FSD, the cabin camera will be recording and analyzing the video stream and attempting to detect several objects and driver attributes. Each attribute then gets a probability assigned to it. If the threshold is high enough for any given attribute that Tesla deems as the driver not paying attention, then the car can take additional action from there such as turn off Autopilot, pull over or ask the driver to pay attention.

According to GreenTheOnly on Twitter, the camera will be detecting whether the driver is looking down or to the side and tracking eye movement and detecting other things as well such as whether the driver is wearing sunglasses and how well the camera can see. Although Tesla is looking for a variety of distractions, it looks like they are only currently triggering alerts when the driver is on their phone and not looking at the road.

The first cars have started rolling out with this feature enabled and it hasn't replaced Tesla’s steering wheel torque detection, but is providing another layer of protection. We hope as Tesla expands its capability in the future it may one day replace having your hands on the Tesla wheel completely.

Tesla has also recently rolled out detecting whether there is a driver in the driver’s seat during the use of Autopilot. It’s possible Tesla will create an algorithm with all of these attributes and ultimately decide whether the driver is paying attention or not. This could greatly reduce the amount of times the driver is asked to pay attention when they already are and also increase safety by reminding us when we’re not.

Ordering a New Tesla?

Consider using our referral code (nuno84363) to help support our site. Order today and get 3 months free of FSD.

Tesla Expected to Release 'Actually Smart Summon' and 'Tap to Park' Updates Next Month

By Not a Tesla App Staff
Smart summon in April update
Smart summon in April update

Elon Musk announced that Tesla will finally reintroduce Smart Summon and Autopark to its vehicles. According to the CEO, these features are scheduled for release in April. Tesla removed ultrasonic sensors (USS) from their vehicles in 2022, and with it removed several features, including Autopark, Smart Summon and Park Assist. However, since then, they’ve added High Fidelity Park Assist, a feature that recreates the surrounding environment in 3D. Although, it’s currently only available to vehicles without USS, that’s expected to change in the near future, and could also come bundled in with the new Autopark feature.

This update in April is not only expected bring these features back to vehicles without ultrasonic sensors, but Tesla is also expected to release drastically improved versions of these features, known as Actually Smart Summon and Tap to Park.

Major improvements coming for Summon & Banish (Autopark) next month - Elon Musk

Improved Autopark

Greentheonly, who regularly decompiles Tesla firmware, has indicated that Tesla's latest software, version 2024.8, already contains the code necessary for these new features, but they need to be remotely activated by Tesla. Additionally, Green says the new Autopark system will offer users the choice between parallel and perpendicular parking options. The new Autopark is expected to let drivers visually select a parking spot, exit the vehicle, and let it park itself.

New ‘Tap to Park’ Feature

With the introduction of High Fidelity Park Assist, Tesla laid the groundwork for more sophisticated features like "Tap to Park."

Tap to Park builds on the original concept of Park Seek, a feature discussed by Tesla in October 2022 that aimed to automate the parking spot search process. While the initial vision for Park Seek suggested a vehicle could autonomously search for parking, "Tap to Park" simplifies this idea.

With the deployment of FSD Beta v12.3 going to more users this weekend, the company continues to leverage AI to reduce code in favor of neural networks trained with real-world driving data.

Just last week, Musk posted on X: "Really cool stuff coming both this month and next." Since that post, FSD beta version 12.3 has started going to more users, and now it seems two other long overdue and highly anticipated updates are coming with Actually Smart Summon and Tap to Park. Still no word on auto wiper improvements.

Tesla Expands FSD Beta v12.3; Autopilot Director Confirms Ability to Reverse is Coming Soon

By Kevin Armstrong
FSD Beta v12 is living up to hype
FSD Beta v12 is living up to hype

Tesla's latest Full Self-Driving (FSD) Beta v12 is reaching users after an extended rollout over the weekend. This update is not just another iteration; it represents a leap in self-driving technology, primarily due to its integration of end-to-end neural networks for vehicle control. So far, it seems to be living up to the hype.

A Neural Network Driven Approach

At the core of FSD v12 is a shift from traditional programming to neural network-based decision-making. This allows the vehicle to process raw camera footage and vehicle kinematics directly into driving actions, mimicking human cognitive processes more closely than ever before. Ashok Elluswamy, Director of Autopilot Software at Tesla, highlighted the monumental effort to surpass the capabilities of the previous v11, setting a new standard for FSD's future.

Ability to Reverse Is Coming

The release has garnered widespread acclaim, with tech leaders like Michael Dell praising its capabilities and likening the car to human-like driving proficiency. Many in the Tesla community have been posting their weekend drivers, including Chuck Cook, who was amazed during one point of his drive, referring to a move as “Robo-taxi navigation.” Cook believed he was in too tight of a spot to pull a U-turn, but his Tesla pulled it off. Elluswamy commented: “Reverse coming soon when the Actually Smart Summon and the FSD models merge together over the next few releases.”

There were numerous examples of v12.3 navigating complex driving scenarios easily, showcasing significant improvements over earlier versions.

“Reverse coming soon when the Actually Smart Summon and the FSD models merge together over the next few releases.” - Ashok Elluswamy

Next-Level Capabilities on the Horizon

Elon Musk has teased that v12.4 will introduce even more advanced features, emphasizing the continuous improvement in training compute constraints. In fact, he was so thrilled with the next update that he said it could be called version 13. He posted that “V12.4 is another big jump in capabilities. Our constraint in training compute is much improved.”

Update 2023.44.30.25

FSD 12.3
Installed on 4% of vehicles
17 Installs today
Last updated: Mar 19, 6:30 am

Tesla’s FSD trajectory seems to be hitting a new level, as it appears to be headed toward approval of use on roadways in Europe. While it is taking longer than initially believed, the dream of autonomous driving seems to be getting closer to reality.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

More Tesla News

Subscribe

Subscribe to our weekly newsletter.

Sponsors

Find out how to become a sponsor and have your site listed here.

Although we share official Tesla release notes, we are not affiliated with Tesla Motors. We are Tesla fans and supporters.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter.