Musk Shares Details on FSD Beta v11: Neural Nets to Be Used for Vehicle Control

Elon Musk says we may get FSD Beta v11.3 as early as this week

Not a Tesla App

Elon Musk has provided further guidance on Tesla's next major release of FSD Beta, v11.3. Last week Musk said that v11.3 would be ready in about 'two weeks' and would contain many major improvements.

We've heard these two-week estimates before, but it's reassuring that Musk is being specific with details on this upcoming release.

Now just seven days after his last tweet, Elon Musk is giving us more details on this significant upgrade.

Timeline

Musk said he expects FSD Beta v11.3 to start rolling out to some customers later this week, or next week at the latest. This matches up with his initial two weeks estimate a week ago.

Elon Musk's estimates are known to be overly optimistic, but given the number of details he's releasing, it sounds like Tesla may be close to releasing this next build.

FSD Beta v11.3 will likely roll out to Tesla employees first and then go out to select FSD Beta testers, possibly the original OG group. Since this is a major milestone and includes major improvements, expect a slow and gradual rollout. Although we may get our first glimpse into FSD Beta v11 this week, it may be several weeks or more before the majority of customers have access to this beta.

Neural Nets for Vehicle Behavior

A week ago Musk said this upgrade will include 'many major improvements.' Last night Musk revealed some additional details. He said there will be "many small things," one of which will be that Tesla will begin to use neural nets for vehicle navigation and control, instead of just vision.

Today Tesla uses neural networks to determine the vehicle's surroundings, where objects are, what they are, and their distances from the vehicle to create a 3D environment known as 'vector space.' With this information, the vehicle can then plan a path and navigate around these objects toward its destination.

However, based on Musk's comment, it sounds like Tesla is currently only using neural nets to determine its environment and not for controlling the vehicle. This means that how the vehicle behaves, how it finds a path, and how it moves is still a process that is coded traditionally.

In the same way that Tesla uses millions of images to determine what a stop sign or traffic cone is, it sounds like Tesla will now use a large number of examples to determine how to best control the vehicle in various situations.

That could mean that Tesla will take millions of quality examples of how to gradually accelerate or slow down, based on real driving behavior to determine how the vehicle should accelerate in different situations.

This could be applied to every driving characteristic such as turning, slow downing, driving around a parked vehicle, etc.

If Tesla starts leveraging neural nets to aid vehicle control we may soon see drastic improvements to vehicle behavior, making it much smoother and human-like.

New Features

Although Elon Musk didn't specifically mention new features coming to FSD Beta v11.3, there are several that have been talked about in the past that could show up in this major full self-driving update.

Reverse Creep

Reverse Creep has been a feature that has been talked about as far back as FSD Beta 10.13. This feature would allow the vehicle to go into reverse to move out of the way of danger or adjust its trajectory. Right now FSD Beta will only ever move forward, so this improvement would be a giant step toward achieving human-like behavior.

A good use case for this is when the vehicle moves forward for better visibility. There may be times when the vehicle sees a car coming after moving creeping forward. In these cases, it'd be smart to let the vehicle reverse back to its previous position if it is now in the path of traffic.

Navigating Without Map Data & GPS

In the past Musk also alluded to the fact that Tesla is working on the neural networks' ability to complete 'dead reckoning' navigation, which is navigating based only on inertial measurements such as speed, direction and wheel movement.

He gave underground parking garages as an example of where FSD would need the ability to navigate without GPS or map data.

The car will be able to do this by using its last known GPS location and then determine its future location using only a compass, wheel movement and speed.

FSD Beta v11

FSD Beta v11 has always been expected to be a big leap forward, and as we get closer, that hasn't changed. This update is expected to be a huge improvement to what is currently available to customers. Although Musk's timelines have usually shifted and features have typically taken longer than initially planned, it looks like we may be getting close to the next major release for FSD Beta.

Although we're still years away from true full self-driving, Tesla's mission inches closer with every update. 

Recently there was also a leak revealing some details of Tesla's upcoming cameras in hardware 4.0, which are expected to include a fan and heater for select cameras.

Tesla Is Now Offering Cybertruck Test Drives [List of Locations]

@brandonhd

Tesla has begun to reach out to customers in the United States and is offering demo drives of the Cybertruck on an invite-only basis. @brandonhd on X shared the first invite image, and it looks like it's going out quite quickly to multiple locations that have Cybertrucks on display.

Up until now, display vehicles have been for just that – looking, but no touching. Some Tesla delivery centers and showrooms have also allowed viewers to take a seat inside and open it up, but most are still locked away behind the velvet rope.

It’s exciting to see that Tesla has begun to demo them – and it can only be so long until demo drives open up to everyone.

Advisor-led Demo

This Demo Drive is led by a Tesla Advisor – while you’re driving, the advisor will be in the passenger seat, walking you through the experience. They’ll explain steer-by-wire, off-road controls, and will introduce new-to-Tesla buyers to all the features that are currently available.

Once FSD V12.5 comes to the Cybertruck, we’re sure they’ll be demoing its capabilities FSD capabilities as well.

Locations

The list of locations so far for demo drives appears to be fairly limited, but we will hopefully see demo drives roll out throughout the United States, and eventually Canada too. Here is the current list of city/state locations that have seen demo drive invites.

• Manhasset, New York

• West Covina, California

• Los Angeles, California

• Houston, Texas

• Orlando, Florida

• Westmont, Illinois

• Tucson, Arizona

• Phoenix, Arizona

• Delaware

Follow

Follow

Follow

Musk Confirms 'Actually Smart Summon' is Coming in a Revision of FSD V12.5

Not a Tesla App

Actually Smart Summon, the successor to Tesla’s Smart Summon feature, has been confirmed to be coming as soon as next month as per Elon Musk. Colloquially known as “ASS”, Actually Smart Summon is supposed to improve on the regular Smart Summon capabilities, which have historically used ultrasonic sensors (USS) to navigate parking lots.

We’re looking forward to Actually Smart Summon, and we’re quite excited about what other features will be unlocked once it finally shows up at our doorstep.

Vision-based Improvements

ASS is supposed to bring Smart Summon to vehicles that don’t have USS – using Tesla Vision. Most recently, Tesla has brought Autopark to vehicles without USS, and Vision-based Autopark has been a huge success. It is faster, more reliable, and smoother than the older USS-based solution. It can also park and maneuver in tighter locations.

Just recently, Tesla returned the Model X’s self-presenting doors, using Tesla Vision. Vision has seen some fantastic improvements, and many people are waiting for ASS to bring forth these improvements to Smart Summon.

Smart Summon Today

Today, Smart Summon is sometimes useful at best, usually a party trick, or downright dangerous at worst. It’s excellent and best used in straight lines, where you have a clear line of sight of the vehicle, and can stop it if doesn’t see an obstacle.

I used Smart Summon today, just before writing this article – my 2022 Model Y (with USS) – did manage to show up just fine – in a straight-line location from where I was parked, after exiting the parking spot fairly cleanly. However, I’ve previously used Smart Summon and have had the vehicle turn towards obstacles, such as cart returns or curbs. Overall, it’s a sometimes-useful feature that has a lot of drawbacks right now.

Smart Summon is also restricted to a certain distance – and it's pretty small. The max distance is shorter than most parking lots, being only about 215 ft (65m). If you’re lucky enough to park close, it's very useful to bring your car right to you.

Actually Smart Summon

ASS will bring FSD V12-like capabilities to Smart Summon – the vehicle will primarily use Vision to drive toward you (or the location you’ve indicated). ASS has been supposed to be coming since about September 2022 and has seen many delays – we’re almost at the 2-year point today.

We’re looking forward to Actually Smart Summon being able to bring the vehicle – safely – right to you. ASS is also one of the key steps towards bringing some other cool features that Elon Musk has previously mentioned – Park Seek and Banish Autopark.

We’re also hopeful that Actually Smart Summon will increase the maximum range a vehicle can be summoned, because the current range is fairly small. Alongside Park Seek and Banish Autopark, we’re closing in on a Robotaxi-based future.

Park Seek and Banish Autopark

When the FSD v12.4 showed up, Elon also mentioned that going forward, vehicles would automatically park themselves when arriving in a parking lot – Park Seek – and that if you got out of the car at the entrance to a business, you could get it to automatically park itself in the parking lot – Banish Autopark. These are two features that are needed for Robotaxi to work – which itself is delayed to October 10^th of this year. We’re looking quite forward to them – as in combination with Actually Smart Summon, Tesla has reached the cusp of vehicle autonomy.

A vehicle that arrives, driverless, at the location you’re at, then drives somewhere, parks itself there, and waits for you – is the definition of a Robotaxi.

While we’re likely to have to wait for Banish Autopark and Park Seek just a bit longer, Actually Smart Summon being around the corner is exciting! Gone will be the days of having to run out to your car when you forgot your umbrella – your car will just come right to you instead.

Follow

Follow

Follow