Tesla Releases 'Actually Smart Summon': Features & Videos [Now Includes HW3]

AIDRIVR

Early this morning Tesla released FSD v12.5.3 with Actually Smart Summon. The update is version 2024.27.20 and while the FSD release notes remain the same, we now have the long-awaited Actually Smart Summon feature (cute acronym here).

While this release is currently limited to hardware 4 (AI4) vehicles, it’ll be the first time that any type of Summon is available on vehicles without ultrasonic sensors. When Tesla removed ultrasonic sensors in the Model 3 and Model Y in October of 2022, those vehicles also lost access to features such as Summon (regular and smart), Autopark and Park Assist.

Tesla then rewrote the software for these features to remove its reliance on ultrasonic sensors and use only vision. Park Assist was publicly reintroduced for USS-less vehicles in March 2023 and later enhanced with High-Fidelity Park Assist. Autopark was reintroduced in March 2024, and now Smart Summon has finally arrived.

Rollout

The rollout of FSD v12.5.3 and Actually Smart Summon is currently going out to early-access customers, which mostly consists of popular influencers. However, it’s only going out to vehicles with AI4, and it’s not clear when it’ll be supported on HW3. When Tesla first rolled out FSD 12.5 to HW4 vehicles, it took about a month before it became available on HW3 cars. Since the hard work of porting the new FSD model to HW3 vehicles is already done, we don’t expect a huge delay in getting the improved Summon feature available on HW3.

Like all other Tesla rollouts, FSD 12.5.3 will be gradual. The recent rollout of FSD 12.5.1.5 was stopped, likely in favor of this version. Keep an eye on our rollout pages for FSD 12.5.3 to see when this update goes out to additional customers.

Update: Tesla has now begun rolling out the update to HW3 vehicles!

Actually Smart Summon Features

Actually Smart Summon includes several new features over the previous version of Smart Summon that was available on vehicles with USS. First, its capabilities seem to be greatly improved over its predecessor since it now leverages the newest FSD model in FSD v12 and uses end-to-end AI, instead of relying on hand-coded features to control the vehicles.

Tesla is now also providing a live camera view in the app as expected after an app update showed evidence of live camera feeds. When you open the Summon view from the app, you’ll be shown a matrix of four live camera views in the app.

Actually Smart Summon test #2 (Roundabout)

I'm officially impressed pic.twitter.com/GbiWcdFYpB

— ΛI DRIVR (@AIDRIVR) September 3, 2024

While using Smart Summon, you’ll be presented with a live video of the vehicle’s front camera, giving you even better access to the vehicle’s surroundings.

With the updated Summon, you have two choices. You can use the original summon, “Dumb Summon,” which only allows you to move your vehicle in a straight line — forward or back. Or you can use the new Smart Summon which allows you to have the vehicle go to your current location or a different spot you pick on the map.

To use Summon, you’ll need to hold down the “Come to Me” or “Go to Target” buttons. Whenever you let go of the button, the vehicle will stop. This lets you easily stop the vehicle when you notice an obstacle the vehicle may have missed.

Future Features

In the release notes, Tesla points out that there will be additional features coming to Smart Summon in the future. These features include HomeLink and MyQ garage support, which will allow the vehicle to open a garage door before it starts moving. It’s worth noting that this feature was available in the previous version of Summon, but Summon just didn’t work well enough to trust the vehicle to open the garage door before it started moving. Actually Smart Summon (just called Smart Summon in the app), will be a huge improvement, but whether you’ll want to trust it with opening and closing your garage door is still to be determined.

Tesla also says that it’ll improve the summoning experience by not requiring you to hold down the buttons in the app and that it’ll also support longer ranges in a future update. The current version of Summon is limited to about 65 meters (213 feet). While Tesla doesn’t specify the range of Actually Smart Summon, it’s expected to be about the same as the previous version with an even longer range coming in the future.

ASS (Actually Smart Summon) test #1 pic.twitter.com/qHLJ4Pvrdg

— ΛI DRIVR (@AIDRIVR) September 3, 2024

Eligibility & Regions

Actually Smart Summon is currently limited to users with FSD on the latest FSD update (2024.27.20). This update is expected to go out to additional customers with HW4 and FSD in North America, but it’s also expected to support HW3 soon.

Actually Smart Summon will be available outside of North America and to customers with Enhanced Autopilot or FSD in the future. However, this won’t happen until FSD 12.5.3 is stable and becomes a part of the regular Tesla updates. Tesla currently includes FSD 12.3.6 with the non-FSD specific updates. As we saw with Autopark, Actually Smart Summon is expected to roll out to North America first, then gradually roll out to additional countries. Autopark was first released in North America on an FSD-specific update in March 2024 and then became available in Europe in late June.

Robotaxi Event

This weekend we shared the news that Tesla will be holding its Robotaxi event at an outdoor, city-like movie studio where they’re expected to show off the Robotaxi in action and even let attendees ride along in the vehicle. Tesla also started gathering additional data in some of the public areas of the movie studio to help improve Robotaxi performance at the event (Robotaxi concept designs).

Actually Smart Summon could be one of the reasons the Robotaxi event was moved from August 8th to October 10th. We’re now only a little over a month away from this event now, and Actually Smart Summon may be our first glimpse into what the Robotaxi will be capable of.

My first time sitting in the back seat while FSD drives me around in my new Model 3 Performance $TSLA pic.twitter.com/OM9qnntpj8

— Whole Mars Catalog (@WholeMarsBlog) September 3, 2024

Follow

Follow

Follow

Tesla’s Optimus Robot Learns to Walk Without Vision [VIDEO]

Optimus Falls - but catches itself!

Not a Tesla App

Tesla recently showed off a demo of Optimus, its humanoid robot, walking around in moderately challenging terrain—not on a flat surface but on dirt and slopes. These things can be difficult for a humanoid robot, especially during the training cycle.

Daily walks help clear your mind pic.twitter.com/dUsW58trS6

— Tesla Optimus (@Tesla_Optimus) December 9, 2024

A Look Behind the Curtain

Most interestingly, Milan Kovac, VP of Engineering for Optimus, clarified what it takes to get Optimus to this stage. Let’s break down what he said.

Optimus is Blind

Optimus is getting seriously good at walking now - it can keep its balance over uneven ground - even while walking blind. Tesla is currently using just the sensors, all powered by a neural net running on the embedded computer. 

Essentially, Tesla is building Optimus from the ground up, relying on as much additional data as possible while it trains vision. This is similar to how they train FSD on vehicles, using LiDAR rigs to validate the vision system’s accuracy. While Optimus doesn’t have LiDAR, it relies on all those other sensors on board, many of which will likely become simplified as vision takes over as the primary sensor.

Today, Optimus is walking blind, but it’s able to react almost instantly to changes in the terrain underneath it, even if it falls or slips. 

What’s Next?

Next up, Tesla AI will be adding vision to Optimus - helping complete the neural net. Remember, Optimus runs on the same overall AI stack as FSD - in fact, Optimus uses an FSD computer and an offshoot of the FSD stack for vision-based tasks.

Milan mentions they’re planning on adding vision to help the robot plan ahead and improve its walking gait. While the zombie shuffle is iconic and a little bit amusing, getting humanoid robots to walk like humans is actually difficult.

There’s plenty more, too - including better responsiveness to velocity and direction commands and learning to fall and stand back up. Falling while protecting yourself to minimize damage is something natural to humans - but not exactly natural to something like a robot. Training it to do so is essential in keeping the robot, the environment around it, and the people it is interacting with safe.

We’re excited to see what’s coming with Optimus next because it is already getting started in some fashion in Tesla’s factories.

Follow

Follow

Follow

Is Tesla Close to Licensing FSD? GM Quits Cruise, BMW Praises Tesla

Not a Tesla App

In a relatively surprising move, GM announced that it is realigning its autonomy strategy and prioritizing advanced driver assistance systems (ADAS) over fully autonomous vehicles.

GM is effectively closing Cruise (autonomous) and focusing on its Super Cruise (ADAS) feature. The engineering teams at Cruise will join the GM teams working on Super Cruise, effectively shuttering the fully autonomous vehicle business.

End of Cruise

GM cites that “an increasingly competitive robotaxi market” and “considerable time and resources” are required for scaling the business to a profitable level. Essentially - they’re unable to keep up with competitors at current funding and research levels, putting them further and further behind.

Cruise has been offering driverless rides in several cities, using HD mapping of cities alongside vehicles equipped with a dazzling array of over 40 sensors. That means that each cruise vehicle is essentially a massive investment and does not turn a profit while collecting data to work towards Autonomy.

Cruise has definitely been on the back burner for a while, and a quick glance at their website - since it's still up for now - shows the last time they officially released any sort of major news packet was back in 2019. 

Competition is Killer

Their current direct competitor - Waymo, is funded by Google, which maintains a direct interest in ensuring they have a play in the AI and autonomy space.

Interestingly, this news comes just a month after Tesla’s We, Robot event, where they showed off the Cybercab and the Robotaxi network, as well as plans to begin deployment of the network and Unsupervised FSD sometime in 2025. Tesla is already in talks with some cities in California and Texas to launch Robotaxi in 2025.

GM Admits Tesla Has the Right Strategy

As part of the business call following the announcement, GM admitted that Tesla’s end-to-end and Vision-based approach towards autonomy is the right strategy. While they say Cruise started down that path, they’re putting aside their goals towards fully autonomous vehicles for now and focusing on introducing that tech in Super Cruise instead.

NEWS: GM just admitted that @Tesla’s end-to-end approach to autonomy is the right strategy.

“That’s where the industry is pivoting. Cruise had already started making headway down that path. We are moving to a foundation model and end-to-end approach going forward.” pic.twitter.com/ACs5SFKUc3

— Sawyer Merritt (@SawyerMerritt) December 10, 2024

With GM now focusing on Super Cruise, they’ll put aside autonomy and instead focus solely on ADAS features to relieve driver stress and improve safety. While those are positive goals that will benefit all road users, full autonomy is really the key to removing the massive impact that vehicle accidents have on society today.

In addition, Super Cruise is extremely limited, cannot brake for traffic controls, and doesn’t work in adverse conditions - even rain. It can only function when lane markings are clear, there are no construction zones, and there is a functional web connection. 

The final key to the picture is that the vehicle has to be on an HD-mapped and compatible highway - essentially locking Super Cruise to wherever GM has time to spend mapping, rather than being functional anywhere in a general sense, like FSD or Autopilot.

Others Impressed - Licensing FSD

Interestingly, some other manufacturers have also weighed into the demise of Cruise. BMW, in a now-deleted post, said that a demo of Tesla’s FSD is “very impressive.” There’s a distinct chance that BMW and other manufacturers are looking to see what Tesla does next. 

BMW chimes in on a now-deleted post. The Internet is forever, BMW!

Not a Tesla App

It seems that FSD has caught their eyes after We, Robot - and that the demonstrations of FSD V13.2 online seem to be the pivot point. At the 2024 Shareholder Meeting earlier in the year, Elon shared the fact that several manufacturers had reached out, looking to understand what was required to license FSD from Tesla.

There is a good chance 2025 will be the year we’ll see announcements of the adoption of FSD by legacy manufacturers - similar to how we saw the surprise announcements of the adoption of the NACS charging standard.

Follow

Follow

Follow