Musk Shares Details on FSD Beta v11: Neural Nets to Be Used for Vehicle Control

By Nuno Cristovao
Elon Musk says we may get FSD Beta v11.3 as early as this week
Elon Musk says we may get FSD Beta v11.3 as early as this week
Not a Tesla App

Elon Musk has provided further guidance on Tesla's next major release of FSD Beta, v11.3. Last week Musk said that v11.3 would be ready in about 'two weeks' and would contain many major improvements.

We've heard these two-week estimates before, but it's reassuring that Musk is being specific with details on this upcoming release.

Now just seven days after his last tweet, Elon Musk is giving us more details on this significant upgrade.

Timeline

Musk said he expects FSD Beta v11.3 to start rolling out to some customers later this week, or next week at the latest. This matches up with his initial two weeks estimate a week ago.

Elon Musk's estimates are known to be overly optimistic, but given the number of details he's releasing, it sounds like Tesla may be close to releasing this next build.

FSD Beta v11.3 will likely roll out to Tesla employees first and then go out to select FSD Beta testers, possibly the original OG group. Since this is a major milestone and includes major improvements, expect a slow and gradual rollout. Although we may get our first glimpse into FSD Beta v11 this week, it may be several weeks or more before the majority of customers have access to this beta.

Neural Nets for Vehicle Behavior

A week ago Musk said this upgrade will include 'many major improvements.' Last night Musk revealed some additional details. He said there will be "many small things," one of which will be that Tesla will begin to use neural nets for vehicle navigation and control, instead of just vision.

Today Tesla uses neural networks to determine the vehicle's surroundings, where objects are, what they are, and their distances from the vehicle to create a 3D environment known as 'vector space.' With this information, the vehicle can then plan a path and navigate around these objects toward its destination.

However, based on Musk's comment, it sounds like Tesla is currently only using neural nets to determine its environment and not for controlling the vehicle. This means that how the vehicle behaves, how it finds a path, and how it moves is still a process that is coded traditionally.

In the same way that Tesla uses millions of images to determine what a stop sign or traffic cone is, it sounds like Tesla will now use a large number of examples to determine how to best control the vehicle in various situations.

That could mean that Tesla will take millions of quality examples of how to gradually accelerate or slow down, based on real driving behavior to determine how the vehicle should accelerate in different situations.

This could be applied to every driving characteristic such as turning, slow downing, driving around a parked vehicle, etc.

If Tesla starts leveraging neural nets to aid vehicle control we may soon see drastic improvements to vehicle behavior, making it much smoother and human-like.

New Features

Although Elon Musk didn't specifically mention new features coming to FSD Beta v11.3, there are several that have been talked about in the past that could show up in this major full self-driving update.

Reverse Creep

Reverse Creep has been a feature that has been talked about as far back as FSD Beta 10.13. This feature would allow the vehicle to go into reverse to move out of the way of danger or adjust its trajectory. Right now FSD Beta will only ever move forward, so this improvement would be a giant step toward achieving human-like behavior.

A good use case for this is when the vehicle moves forward for better visibility. There may be times when the vehicle sees a car coming after moving creeping forward. In these cases, it'd be smart to let the vehicle reverse back to its previous position if it is now in the path of traffic.

Navigating Without Map Data & GPS

In the past Musk also alluded to the fact that Tesla is working on the neural networks' ability to complete 'dead reckoning' navigation, which is navigating based only on inertial measurements such as speed, direction and wheel movement.

He gave underground parking garages as an example of where FSD would need the ability to navigate without GPS or map data.

The car will be able to do this by using its last known GPS location and then determine its future location using only a compass, wheel movement and speed.

FSD Beta v11

FSD Beta v11 has always been expected to be a big leap forward, and as we get closer, that hasn't changed. This update is expected to be a huge improvement to what is currently available to customers. Although Musk's timelines have usually shifted and features have typically taken longer than initially planned, it looks like we may be getting close to the next major release for FSD Beta.

Although we're still years away from true full self-driving, Tesla's mission inches closer with every update. 

Recently there was also a leak revealing some details of Tesla's upcoming cameras in hardware 4.0, which are expected to include a fan and heater for select cameras.

Will Tesla Launch a 'Robotaxi' Network With Tesla Drivers?

By Not a Tesla App Staff

During Tesla’s Q1 earnings call, Tesla talked about its plan for its upcoming robotaxi network and even showed off a design for the app that would allow customers to request vehicles, much like Uber and Lyft.

While Tesla plans to unveil the robotaxi, officially now called CyberCab this August, a true autonomous taxi is at the very least, a couple of years away. So why is Tesla so eager to show off an app and start offering a Tesla taxi service?

in 2023 Uber had a revenue of 37.28 billion, while Lyft had a much smaller revenue of 4.4 billion. For comparison, Tesla’s revenue last year was 96.77 billion. A taxi service, even one operated by humans can be incredibly lucrative. While Tesla’s ultimate goal may be an automated taxi service, they may be itching to get into the space.

Tesla’s robotaxi was initially supposed to be a taxi service owners would lend their vehicles to. While that’s still the plan, Tesla wants their own vehicles to be a part of the service as well.

Will the Robotaxi Service Start With Tesla Drivers?

Tesla comparing themselves to Airbnb and Uber during their earnings call is intriguing. While Tesla can start producing robotaxis almost whenever they want, it’d likely be smart to wait until autonomy is solved so they’re not limiting themselves to current FSD hardware.

While full autonomy is likely several years away, Tesla seems to be eager to make this push toward a Tesla-owned service. Is Tesla thinking about operating their own Uber-like service? Tesla could be thinking about releasing their future robotaxi app and service in “beta,” letting current Tesla owners operate their own vehicles on the service.

This could result in several benefits for Tesla, not only letting them test their service but also opening up another revenue stream. This would allow Tesla to start operating their robotaxi network as soon as this year, and then slowly replace drivers and owner vehicles with Tesla-owned robotaxis.

Tesla Shows Off Robotaxi App

Tesla showed off it's robotaxi app
Tesla showed off it's robotaxi app

At the earnings call, Tesla also showed off a design of their robotaxi app. While it feels early to design an app for a service that could be years away, Tesla appears to be preparing itself for the future and getting customers excited about the prospect.

Tesla showed off five screens of the app, essentially showing how you’d request a robotaxi, how you can view its progress, and control certain features of the vehicle. Through the various screens, you can see most of Tesla’s Autopilot features coming to fruition in terms of autonomy, such as summon, self-driving and eventually Autopark.

Summon - Much like Tesla has re-thought the interior of a car and so many features, you can see the same mechanics applied to the app. To request a vehicle, you simply hold down a summon button and you’ll be presented with an estimate of when a vehicle will arrive.

Set Preferences and Destination - On the second screen, you can see the vehicle’s current location on a 3D map, possibly alluding to future FSD visualizations. It also lets you set your destination and set the climate temperature to your preference.

Trip Progress - While you’re traveling in the vehicle, you’ll be able to view trip information as well as set entertainment options.

Recap

Tesla had a lot to talk about during their earnings call and specifically about the Robotaxi — more information was revealed than ever before.

While there are various things at play to make a service like this come together, we can easily separate them out into separate components.

There’s the robotaxi itself, which Musk recently said would be similar to Tesla’s next-gen vehicle without a steering wheel. However, during this earnings call, he revealed that Tesla will save its new “unboxed” manufacturing process for the robotaxi and use a more traditional method for their next vehicle.

Then there’s FSD itself, while it’s crucial to operating a driverless robotaxi network, it’s not necessary to start a Tesla taxi service.

The last piece is the ride-hailing component itself and how it’s managed, and Tesla was happy to show this off, which makes us believe that it may be closer to reality than many think. While Tesla needs all three of these components to come together to operate a true robotaxi network, they piece them together separately, much like they’ve done with Autopilot. Initially, Tesla only released auto-steer then slowly added on summon, Autopark and city driving.

When we look back at Tesla five years from now, we may very well look back to this earnings call and say this was the pivotal moment when Tesla started transitioning to a services company.

Tesla Reveals Robotaxi App and Names the Robotaxi the CyberCab

By Cláudio Afonso

Tesla has invested billions of dollars over the years toward vehicle autonomy. The mission continues as Elon Musk and Tesla now prepare to unveil their ride-hailing product, Robotaxi this August. Or, as Musk called it on Tuesday, Tesla CyberCab.

Early Days

Five years ago, during Tesla’s Autonomy Investor Day in April 2019, Elon Musk said he felt “very confident predicting autonomous robotaxis for Tesla in the following year [2020]”. At the time, Musk added a bolder claim, predicting that Tesla wouldn’t even make cars with steering wheels or pedals by 2022. While timeliness may not be Musk’s strong suit, he has a track record for getting things done that others were unwilling to try or thought were impossible. Musk later admitted he can be overly optimistic and said “sometimes I am not on time, but I get it done.” 

Now, 5 years later, we have the robotaxi unveiling scheduled for August 8th. After the release of FSD v12, it’s clear that we’re much closer to autonomy than we were in 2019, although FSD v12 is still a far cry from full autonomy.

While Tesla still has the robotaxi unveiling scheduled for August, Tesla announced yesterday that it’d be prioritizing a simpler “next-gen” model that could be released by early 2025.

Latest Updates

On the conference call, Musk added that Tesla now has over 300 million miles driven with FSD v12 since it was launched just last month. He added that it's becoming “very clear that the vision-based approach with end-to-end neural networks is the right solution for scalable autonomy”.

Tesla said it has been investing in the hardware and software ecosystems necessary to achieve vehicle autonomy and a ride-hailing service. The company is confident that it can establish a scalable and profitable autonomous driving business by employing a vision-only architecture.

think of it [Tesla] as combination of Airbnb and Uber meaning that there will be some number of cars that Tesla owns itself and operates

Tesla = Uber + AirBnb

Later on, Elon Musk unveiled that the new service will operate and result in a mix between Uber and Airbnb where the Tesla driver decides if and when he wants his Tesla to be used and by whom. Tesla stated:

“We believe the Tesla software experience is best-in-class across all our products, and plan to seamlessly layer ride-hailing into the Tesla App.”

Tesla’s CEO clarified that the owners will be able to add or remove their car from the fleet “whenever they want” adding that it will be up to them to decide if they want to only let the car be used “by friends and family or only by five-star users or by anyone at any time”. The flexible program will, just like Airbnb, allow the owners to take the car out of the market when they want.

The upcoming ride-hailing service will enable users to easily request a Tesla vehicle, control the car's temperature, monitor its real-time location, and adjust the audio system. The only question is when.

View All Upcoming Features

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

More Tesla News

Subscribe

Subscribe to our weekly newsletter.

Sponsors

Find out how to become a sponsor and have your site listed here.

Although we share official Tesla release notes, we are not affiliated with Tesla Motors. We are Tesla fans and supporters.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter.