Tesla Full Self-Driving to Recognize Hand Gestures in Upcoming Update, According to Employee

By Karan Singh
Tesla has been improving its FSD features since introducing it in 2016
Tesla has been improving its FSD features since introducing it in 2016
Tesla

Previously, the Tesla X account shared a video where FSD V12 appeared to consider a pedestrian’s hand gestures when navigating. Elon Musk also confirmed on X that hand gesture recognition would be improved in V12.4, and even better by V12.5.

Tesla has had plans for gesture recognition for many years, with Musk mentioning hand gesture recognition in 2021. FSD is supposed to be able to adapt to new and unique circumstances in a safe manner, whether following instructions from a police officer, or understanding the hand signals from a cyclist.

Boris Johnson and FSD

Boris Johnson, the ex-Prime Minister of the UK, recently got to experience FSD V12 in the crowded streets of LA, with his wife and child in the backseat. Tesla provided a vehicle and assistant for his self-driven experience through 5-road intersections, heavy traffic, and pedestrians.

At the end of about 45 minutes I feel like a driving test examiner – except that I want to tell the car that it has passed, with flying colours. -Boris Johnson

Gestures coming soon

Johnson had a single experience with hand gestures in his drive – being waved at a hotel. While the car didn’t recognize the gesture – even on FSD V12.3.6 – the Tesla official in the vehicle confirmed that “‘It doesn’t yet recognise that gesture, but we are fixing it for the next iteration. It should be done next month.”.

It’s not immediately clear whether the Tesla employee is referring to FSD v12.4, which is expected to start rolling out to the public later this week, or Tesla’s next major FSD release, V12.5. According to Musk, V12.5 is expected to handle much more complicated situations and even start vehicle-to-fleet communication.

Solving FSD

When you’re tackling a problem like FSD, which has never been solved before, you sometimes have to pivot and realize there’s a better approach. That’s what Tesla has done with FSD and AI. Just a few years ago where people thought cars would need to be able to read signs to achieve autonomy, but with the latest approach, there’s no need to. As long as the vehicle has seen a specific sign before and has enough examples, it’s already trained on what humans do when such a sign is found. The same will be true for hand gestures, the vehicle won’t need to know what each hand gesture means, it’ll just recognize that when a current gesture is made, this is how the vehicle should react.

Tesla does this by feeding it millions of examples of very specific situations and AI recognizes patterns. This is an example where Tesla leverages fleet data. They can easily capture millions of examples of hand gestures and how humans reacted, and feed that to their AI training model.

As Tesla processes more video, FSD will continue to improve. Tesla is expected to spend $10 billion on AI this year alone, most of it going toward improving FSD.

Tesla Is Now Offering Cybertruck Test Drives [List of Locations]

By Karan Singh
@brandonhd

Tesla has begun to reach out to customers in the United States and is offering demo drives of the Cybertruck on an invite-only basis. @brandonhd on X shared the first invite image, and it looks like it's going out quite quickly to multiple locations that have Cybertrucks on display.

Up until now, display vehicles have been for just that – looking, but no touching. Some Tesla delivery centers and showrooms have also allowed viewers to take a seat inside and open it up, but most are still locked away behind the velvet rope.

It’s exciting to see that Tesla has begun to demo them – and it can only be so long until demo drives open up to everyone.

Advisor-led Demo

This Demo Drive is led by a Tesla Advisor – while you’re driving, the advisor will be in the passenger seat, walking you through the experience. They’ll explain steer-by-wire, off-road controls, and will introduce new-to-Tesla buyers to all the features that are currently available.

Once FSD V12.5 comes to the Cybertruck, we’re sure they’ll be demoing its capabilities FSD capabilities as well.

Locations

The list of locations so far for demo drives appears to be fairly limited, but we will hopefully see demo drives roll out throughout the United States, and eventually Canada too. Here is the current list of city/state locations that have seen demo drive invites.

  • Manhasset, New York

  • West Covina, California

  • Los Angeles, California

  • Houston, Texas

  • Orlando, Florida

  • Westmont, Illinois

  • Tucson, Arizona

  • Phoenix, Arizona

  • Delaware

Musk Confirms 'Actually Smart Summon' is Coming in a Revision of FSD V12.5

By Karan Singh
Not a Tesla App

Actually Smart Summon, the successor to Tesla’s Smart Summon feature, has been confirmed to be coming as soon as next month as per Elon Musk. Colloquially known as “ASS”, Actually Smart Summon is supposed to improve on the regular Smart Summon capabilities, which have historically used ultrasonic sensors (USS) to navigate parking lots.

We’re looking forward to Actually Smart Summon, and we’re quite excited about what other features will be unlocked once it finally shows up at our doorstep.

Vision-based Improvements

ASS is supposed to bring Smart Summon to vehicles that don’t have USS – using Tesla Vision. Most recently, Tesla has brought Autopark to vehicles without USS, and Vision-based Autopark has been a huge success. It is faster, more reliable, and smoother than the older USS-based solution. It can also park and maneuver in tighter locations.

Just recently, Tesla returned the Model X’s self-presenting doors, using Tesla Vision. Vision has seen some fantastic improvements, and many people are waiting for ASS to bring forth these improvements to Smart Summon.

Smart Summon Today

Today, Smart Summon is sometimes useful at best, usually a party trick, or downright dangerous at worst. It’s excellent and best used in straight lines, where you have a clear line of sight of the vehicle, and can stop it if doesn’t see an obstacle.

I used Smart Summon today, just before writing this article – my 2022 Model Y (with USS) – did manage to show up just fine – in a straight-line location from where I was parked, after exiting the parking spot fairly cleanly. However, I’ve previously used Smart Summon and have had the vehicle turn towards obstacles, such as cart returns or curbs. Overall, it’s a sometimes-useful feature that has a lot of drawbacks right now.

Smart Summon is also restricted to a certain distance – and it's pretty small. The max distance is shorter than most parking lots, being only about 215 ft (65m). If you’re lucky enough to park close, it's very useful to bring your car right to you.

Actually Smart Summon

ASS will bring FSD V12-like capabilities to Smart Summon – the vehicle will primarily use Vision to drive toward you (or the location you’ve indicated). ASS has been supposed to be coming since about September 2022 and has seen many delays – we’re almost at the 2-year point today.

We’re looking forward to Actually Smart Summon being able to bring the vehicle – safely – right to you. ASS is also one of the key steps towards bringing some other cool features that Elon Musk has previously mentioned – Park Seek and Banish Autopark.

We’re also hopeful that Actually Smart Summon will increase the maximum range a vehicle can be summoned, because the current range is fairly small. Alongside Park Seek and Banish Autopark, we’re closing in on a Robotaxi-based future.

Park Seek and Banish Autopark

When the FSD v12.4 showed up, Elon also mentioned that going forward, vehicles would automatically park themselves when arriving in a parking lot – Park Seek – and that if you got out of the car at the entrance to a business, you could get it to automatically park itself in the parking lot – Banish Autopark. These are two features that are needed for Robotaxi to work – which itself is delayed to October 10th of this year. We’re looking quite forward to them – as in combination with Actually Smart Summon, Tesla has reached the cusp of vehicle autonomy.

A vehicle that arrives, driverless, at the location you’re at, then drives somewhere, parks itself there, and waits for you – is the definition of a Robotaxi.

While we’re likely to have to wait for Banish Autopark and Park Seek just a bit longer, Actually Smart Summon being around the corner is exciting! Gone will be the days of having to run out to your car when you forgot your umbrella – your car will just come right to you instead.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

More Tesla News

Subscribe

Subscribe to our weekly newsletter.

Sponsors

Find out how to become a sponsor and have your site listed here.

Although we share official Tesla release notes, we are not affiliated with Tesla Motors. We are Tesla fans and supporters.

Tesla Videos

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter.