Tesla's Autopilot and AI team must be burning the 3 am oil again. Elon Musk took to Twitter to tell the world the expectations for his team on some significant projects. He tweeted: Note, Autopilot/AI team is also working on Optimus and (actually smart) summon/autopark, which have end of month deadlines.
The end of the month is not too far away, so time is ticking down to complete these extraordinarily complex and revolutionary projects. Optimus, the highly anticipated humanoid robot, will be revealed at Tesla's AI Day on September 30.
If that's not enough, the team has to improve two aspects of the Autopilot system. Clearly, the CEO is not impressed with the program. It is called Smart Summon, but Musk must not think the title is too accurate as he states "actually smart" in his tweet. In addition, users have pointed out that their Teslas can struggle in parking lots. But, to be fair, who hasn't struggled in parking lots?
When using Smart Summon, Tesla uses your phone's GPS as a target destination. Users can also put in a location; the vehicle is supposed to navigate to that point by steering around obstacles. Smart Summon is to work when the user is within 20 feet of the car. However, the manual states, "You must maintain a clear line of sight between you and Model (S, 3, X, Y) and closely monitor the vehicle and its surroundings at all times."
In addition, the same webpage has six warnings and one caution to users. These include details such as the cameras must be clean, it must be used on paved surfaces, it may not stop for all objects, and it currently needs adequate cell service and GPS data.
Autopark also has several warnings on its user manual webpage. This program assists the driver in finding parking, both perpendicular and parallel. However, unlike Smart Summon, the user must be in the car before letting the Tesla take over.
Navigate without Maps
Musk previously hinted at a major improvement that's coming: the ability for FSD beta to navigate roads with no map data. The vehicle will be able to navigate to a specific GPS point or pinned location (ex: rural roads), says Musk.
Dead Reckoning Navigation (Navigating without GPS)
Elon has also alluded to the fact that Tesla is working on the AI’s ability to complete 'dead reckoning' navigation (navigating only on “inertial measurements, wheel movement & vision”).
Elon gave underground parking garages as an example of where FSD would need this ability to navigate without GPS, map data or cell service. The car will be able to do this by using its last known GPS location and then determining its future location using only a compass, wheel movement and speed.
Many Twitter users were trying to figure out what Musk referred to with these programs. Will the car drop off its passengers and park itself (reverse summon will offer three options)? How will it navigate difficult parking lots with unpredictable pedestrians and drivers?
Elon Musk announced that Tesla will finally reintroduce Smart Summon and Autopark to its vehicles. According to the CEO, these features are scheduled for release in April. Tesla removed ultrasonic sensors (USS) from their vehicles in 2022, and with it removed several features, including Autopark, Smart Summon and Park Assist. However, since then, they’ve added High Fidelity Park Assist, a feature that recreates the surrounding environment in 3D. Although, it’s currently only available to vehicles without USS, that’s expected to change in the near future, and could also come bundled in with the new Autopark feature.
This update in April is not only expected bring these features back to vehicles without ultrasonic sensors, but Tesla is also expected to release drastically improved versions of these features, known as Actually Smart Summon and Tap to Park.
Major improvements coming for Summon & Banish (Autopark) next month - Elon Musk
Improved Autopark
Greentheonly, who regularly decompiles Tesla firmware, has indicated that Tesla's latest software, version 2024.8, already contains the code necessary for these new features, but they need to be remotely activated by Tesla. Additionally, Green says the new Autopark system will offer users the choice between parallel and perpendicular parking options. The new Autopark is expected to let drivers visually select a parking spot, exit the vehicle, and let it park itself.
New ‘Tap to Park’ Feature
With the introduction of High Fidelity Park Assist, Tesla laid the groundwork for more sophisticated features like "Tap to Park."
Tap to Park builds on the original concept of Park Seek, a feature discussed by Tesla in October 2022 that aimed to automate the parking spot search process. While the initial vision for Park Seek suggested a vehicle could autonomously search for parking, "Tap to Park" simplifies this idea.
With the deployment of FSD Beta v12.3 going to more users this weekend, the company continues to leverage AI to reduce code in favor of neural networks trained with real-world driving data.
Just last week, Musk posted on X: "Really cool stuff coming both this month and next." Since that post, FSD beta version 12.3 has started going to more users, and now it seems two other long overdue and highly anticipated updates are coming with Actually Smart Summon and Tap to Park. Still no word on auto wiper improvements.
Tesla's latest Full Self-Driving (FSD) Beta v12 is reaching users after an extended rollout over the weekend. This update is not just another iteration; it represents a leap in self-driving technology, primarily due to its integration of end-to-end neural networks for vehicle control. So far, it seems to be living up to the hype.
A Neural Network Driven Approach
At the core of FSD v12 is a shift from traditional programming to neural network-based decision-making. This allows the vehicle to process raw camera footage and vehicle kinematics directly into driving actions, mimicking human cognitive processes more closely than ever before. Ashok Elluswamy, Director of Autopilot Software at Tesla, highlighted the monumental effort to surpass the capabilities of the previous v11, setting a new standard for FSD's future.
Ability to Reverse Is Coming
The release has garnered widespread acclaim, with tech leaders like Michael Dell praising its capabilities and likening the car to human-like driving proficiency. Many in the Tesla community have been posting their weekend drivers, including Chuck Cook, who was amazed during one point of his drive, referring to a move as “Robo-taxi navigation.” Cook believed he was in too tight of a spot to pull a U-turn, but his Tesla pulled it off. Elluswamy commented: “Reverse coming soon when the Actually Smart Summon and the FSD models merge together over the next few releases.”
This clip blew my mind, next level for FSDBeta v12.3 in finding its way out of a bad situation. Nice work @Tesla_AIpic.twitter.com/9cDccpr2uO
There were numerous examples of v12.3 navigating complex driving scenarios easily, showcasing significant improvements over earlier versions.
“Reverse coming soon when the Actually Smart Summon and the FSD models merge together over the next few releases.” - Ashok Elluswamy
Next-Level Capabilities on the Horizon
Elon Musk has teased that v12.4 will introduce even more advanced features, emphasizing the continuous improvement in training compute constraints. In fact, he was so thrilled with the next update that he said it could be called version 13. He posted that “V12.4 is another big jump in capabilities. Our constraint in training compute is much improved.”
Tesla’s FSD trajectory seems to be hitting a new level, as it appears to be headed toward approval of use on roadways in Europe. While it is taking longer than initially believed, the dream of autonomous driving seems to be getting closer to reality.
TeslaFi logs your drives and charging sessions, letting you keep a log of your vehice's activity. We highly recommend checking them out if you use your car for business trips and would like to keep track of reimbursements, if you like to see how much you spend on charging or if you just love statistics. Visit their site and see everything they have to offer!
Tesla Android Project enables you to run Android apps in your Tesla. The platform is Open Source and you can deploy it on your own Raspberry Pi 4. Consider supporting the initiative by donating or purchasing the Compute Module 4 Bundle that delivers the best experience. Get $20 off by using the code: NotATeslaApp
The official Tesla app only notifies you if your car is broken into. By installing Sentry Pro on your phone, you will be notified for all Sentry Mode events. Stay connected and avoid potential surprises by receiving notifications. Stop constantly checking the cameras to ensure safety. Check only when necessary, save battery and get peace of mind. Get a 7 day free trial here!
Stay organized, connected, and stylish with Cyberbackpack — the #1 backpack, luggage & travel accessories for Tesla owners. We highly recommend checking them out if you commute or travel and would like a backpack or luggage that is sleek, secure and durable. View their products page and see everything they have to offer!