Tesla Autopilot has always required and will require full driver attention for the foreseeable future. Tesla enforced this by detecting whether torque was being applied to the steering wheel.
Tesla has relied on this method since the introduction of Autopilot, but unfortunately there have been several flaws with it for years.
Since Tesla is looking for a certain amount of force to be applied to the steering wheel, sometimes the car can ask for the driver’s attention even when the driver is attentive and their hands are on the steering wheel. The interval that the car checks for active participation has changed over the years, but with it being somewhere around 30-60 seconds, it can sometimes become an annoyance to drivers.
The second reason that detecting torque on the steering wheel doesn’t work well as a driver monitoring system is that it is easily defeated. There have been numerous devices that mimic the force of hands on the steering wheel and let's face it, it doesn’t lead to anything good for the driver or Tesla.
Yesterday we saw the first vehicles to introduce a true driver monitoring system. For vehicles with a cabin camera, which include all Model 3 and Model Y vehicles, Tesla will be able to turn on their camera-based driver monitoring system (DMS). It appears that the feature is currently limited to the US and only for radar-less cars, but we expect this to change in the future. The release notes for 2021.4.15.11 state that:
The cabin camera above your rearview mirror can now detect and alert driver inattentiveness while Autopilot is engaged. Camera data does not leave the car itself, which means the system cannot save or transmit information unless data shared is enabled. To change your data settings, tap Controls > Safety & Security > Data Sharing on your car's touchscreen.
Much like Tesla implements FSD, the cabin camera will be recording and analyzing the video stream and attempting to detect several objects and driver attributes. Each attribute then gets a probability assigned to it. If the threshold is high enough for any given attribute that Tesla deems as the driver not paying attention, then the car can take additional action from there such as turn off Autopilot, pull over or ask the driver to pay attention.
According to GreenTheOnly on Twitter, the camera will be detecting whether the driver is looking down or to the side and tracking eye movement and detecting other things as well such as whether the driver is wearing sunglasses and how well the camera can see. Although Tesla is looking for a variety of distractions, it looks like they are only currently triggering alerts when the driver is on their phone and not looking at the road.
The first cars have started rolling out with this feature enabled and it hasn't replaced Tesla’s steering wheel torque detection, but is providing another layer of protection. We hope as Tesla expands its capability in the future it may one day replace having your hands on the Tesla wheel completely.
Tesla has also recently rolled out detecting whether there is a driver in the driver’s seat during the use of Autopilot. It’s possible Tesla will create an algorithm with all of these attributes and ultimately decide whether the driver is paying attention or not. This could greatly reduce the amount of times the driver is asked to pay attention when they already are and also increase safety by reminding us when we’re not.
Elon Musk announced that Tesla will finally reintroduce Smart Summon and Autopark to its vehicles. According to the CEO, these features are scheduled for release in April. Tesla removed ultrasonic sensors (USS) from their vehicles in 2022, and with it removed several features, including Autopark, Smart Summon and Park Assist. However, since then, they’ve added High Fidelity Park Assist, a feature that recreates the surrounding environment in 3D. Although, it’s currently only available to vehicles without USS, that’s expected to change in the near future, and could also come bundled in with the new Autopark feature.
This update in April is not only expected bring these features back to vehicles without ultrasonic sensors, but Tesla is also expected to release drastically improved versions of these features, known as Actually Smart Summon and Tap to Park.
Major improvements coming for Summon & Banish (Autopark) next month - Elon Musk
Improved Autopark
Greentheonly, who regularly decompiles Tesla firmware, has indicated that Tesla's latest software, version 2024.8, already contains the code necessary for these new features, but they need to be remotely activated by Tesla. Additionally, Green says the new Autopark system will offer users the choice between parallel and perpendicular parking options. The new Autopark is expected to let drivers visually select a parking spot, exit the vehicle, and let it park itself.
New ‘Tap to Park’ Feature
With the introduction of High Fidelity Park Assist, Tesla laid the groundwork for more sophisticated features like "Tap to Park."
Tap to Park builds on the original concept of Park Seek, a feature discussed by Tesla in October 2022 that aimed to automate the parking spot search process. While the initial vision for Park Seek suggested a vehicle could autonomously search for parking, "Tap to Park" simplifies this idea.
With the deployment of FSD Beta v12.3 going to more users this weekend, the company continues to leverage AI to reduce code in favor of neural networks trained with real-world driving data.
Just last week, Musk posted on X: "Really cool stuff coming both this month and next." Since that post, FSD beta version 12.3 has started going to more users, and now it seems two other long overdue and highly anticipated updates are coming with Actually Smart Summon and Tap to Park. Still no word on auto wiper improvements.
Tesla's latest Full Self-Driving (FSD) Beta v12 is reaching users after an extended rollout over the weekend. This update is not just another iteration; it represents a leap in self-driving technology, primarily due to its integration of end-to-end neural networks for vehicle control. So far, it seems to be living up to the hype.
A Neural Network Driven Approach
At the core of FSD v12 is a shift from traditional programming to neural network-based decision-making. This allows the vehicle to process raw camera footage and vehicle kinematics directly into driving actions, mimicking human cognitive processes more closely than ever before. Ashok Elluswamy, Director of Autopilot Software at Tesla, highlighted the monumental effort to surpass the capabilities of the previous v11, setting a new standard for FSD's future.
Ability to Reverse Is Coming
The release has garnered widespread acclaim, with tech leaders like Michael Dell praising its capabilities and likening the car to human-like driving proficiency. Many in the Tesla community have been posting their weekend drivers, including Chuck Cook, who was amazed during one point of his drive, referring to a move as “Robo-taxi navigation.” Cook believed he was in too tight of a spot to pull a U-turn, but his Tesla pulled it off. Elluswamy commented: “Reverse coming soon when the Actually Smart Summon and the FSD models merge together over the next few releases.”
This clip blew my mind, next level for FSDBeta v12.3 in finding its way out of a bad situation. Nice work @Tesla_AIpic.twitter.com/9cDccpr2uO
There were numerous examples of v12.3 navigating complex driving scenarios easily, showcasing significant improvements over earlier versions.
“Reverse coming soon when the Actually Smart Summon and the FSD models merge together over the next few releases.” - Ashok Elluswamy
Next-Level Capabilities on the Horizon
Elon Musk has teased that v12.4 will introduce even more advanced features, emphasizing the continuous improvement in training compute constraints. In fact, he was so thrilled with the next update that he said it could be called version 13. He posted that “V12.4 is another big jump in capabilities. Our constraint in training compute is much improved.”
Tesla’s FSD trajectory seems to be hitting a new level, as it appears to be headed toward approval of use on roadways in Europe. While it is taking longer than initially believed, the dream of autonomous driving seems to be getting closer to reality.
TeslaFi logs your drives and charging sessions, letting you keep a log of your vehice's activity. We highly recommend checking them out if you use your car for business trips and would like to keep track of reimbursements, if you like to see how much you spend on charging or if you just love statistics. Visit their site and see everything they have to offer!
Tesla Android Project enables you to run Android apps in your Tesla. The platform is Open Source and you can deploy it on your own Raspberry Pi 4. Consider supporting the initiative by donating or purchasing the Compute Module 4 Bundle that delivers the best experience. Get $20 off by using the code: NotATeslaApp
The official Tesla app only notifies you if your car is broken into. By installing Sentry Pro on your phone, you will be notified for all Sentry Mode events. Stay connected and avoid potential surprises by receiving notifications. Stop constantly checking the cameras to ensure safety. Check only when necessary, save battery and get peace of mind. Get a 7 day free trial here!
Stay organized, connected, and stylish with Cyberbackpack — the #1 backpack, luggage & travel accessories for Tesla owners. We highly recommend checking them out if you commute or travel and would like a backpack or luggage that is sleek, secure and durable. View their products page and see everything they have to offer!