Tesla FSD will be pure vision and not rely on radar use

By Nuno Cristovao

Elon tweeted that v9 of the FSD beta would remove its reliance on radar completely and instead determine decisions based purely on vision. Humans don’t have radar after all, so it seems like a logical solution and tells us Tesla is feeling much more confident in their vision AI.

Tesla Vision AI

Radar and vision each have their advantages, but radar has thus far been much more reliable in detecting objects and determining speed. If you’ve ever noticed your Tesla being able to detect two vehicles in front of you when you can only see the one directly ahead of you, that’s radar at work.

In this situation the radio waves from the radar sensor are bouncing underneath the car in front of you and are able to continue traveling and detect that there is another object ahead even though it could never “see” it.

It really is one of those wow moments where you can feel the future and the ability for AI-powered cars to drive better than humans one day. It’s baby steps and slowly we’ll see more and more of these situations where the vehicle simply sees or does something we could never do.

There’s no doubting that more sensors could provide a more reliable and accurate interpretation of the real world as they each have their own advantages. In an ideal world a vehicle with radar, lidar, vision, ultrasonic sensors and even audio processing would provide the best solution. However, more sensors and systems come at a price, resulting in increased vehicle cost and system complexity.

After all humans are relatively safe drivers with two “cameras” and vision alone. If Tesla can completely solve vision, they’ll easily be able to achieve superhuman driving capabilities. Teslas have eight cameras, facing in all directions. They’re able to analyze all of them concurrently and make much more accurate interpretations then we ever could in the same amount of time.

Tristan on Twitter recently had some great insight into Tesla vision AI and how they’re going to replace radar. Here’s what Tristan had to say:

"We recently got some insight into how Tesla is going to replace radar in the recent firmware updates + some nifty ML model techniques

From the binaries we can see that they've added velocity and acceleration outputs. These predictions in addition to the existing xyz outputs give much of the same information that radar traditionally provides (distance + velocity + acceleration).

For autosteer on city streets, you need to know the velocity and acceleration of cars in all directions but radar is only pointing forward. If it's accurate enough to make a left turn, radar is probably unnecessary for the most part.

How can a neural network figure out velocity and acceleration from static images you ask?

They can't!

They've recently switched to something that appears to be styled on an Recurrent Neural Network.

Net structure is unknown (LSTM?) but they're providing the net with a queue of the 15 most recent hidden states. Seems quite a bit easier to train than normal RNNs which need to learn to encode historical data and can have issues like vanishing gradients for longer time windows.

The velocity and acceleration predictions is new, by giving the last 15 frames (~1s) of data I'd expect you can train a highly accurate net to predict velocity + acceleration based off of the learned time series.

They've already been using these queue based RNNs with the normal position nets for a few months presumably to improve stability of the predictions.

This matches with the recent public statements from Tesla about new models training on video instead of static images.

To evaluate the performance compared to radar, I bet Tesla has run some feature importance techniques on the models and radar importance has probably dropped quite a bit with the new nets. See tools like https://captum.ai for more info.

I still think that radar is going to stick around for quite a while for highway usage since the current camera performance in rain and snow isn't great.

NoA often disables in mild rain. City streets might behave better since the relative rain speed is lower.

One other nifty trick they've recently added is a task to rectify the images before feeding them into the neural nets.

This is a common in classical CV applications so surprised it only popped up in the last couple of months.

This makes a lot of sense since it means that the nets don't need to learn the lens distortion. It also likely makes it a lot easier for the nets to correlate objects across multiple cameras since the movement is now much more linear.

For more background on LSTMs (Long Short-Term Memory) see https://towardsdatascience.com/illustrated-guide-to-lstms-and-gru-s-a-step-by-step-explanation-44e9eb85bf21

They're tricky to train because they need to encode history which is fed into future runs. The more times you pass the state, the more the earlier frames is diluted hence "vanishing gradients".

Tesla’s FSD beta v9 will be a big improvement forward from what FSD beta users have been using where the system was still relying on radar. And it’ll be an even bigger leap from what non-beta testers currently have access to. We can’t wait. Now where’s that button?

Tesla FSD in Europe: June Update

By Karan Singh
Not a Tesla App

The road to bringing FSD to Europe has been a long and complex one and filled with regulatory and bureaucratic hurdles. Elon Musk, as well as other members of Tesla’s AI team, have previously voiced their grievances with the regulatory approval process on X.

However, it appears that there is finally some progress in getting things moving with recent changes to upcoming autonomy regulations, but the process still seems slow.

Waiting on the Dutch

Elon commented on X recently, stating that Tesla is waiting for approval from Dutch authorities and then the EU to start rolling out FSD in Europe. Tesla is focusing on acquiring approvals from the Dutch transportation authority, which will provide them with the platform they need to gain broader acceptance in Europe. Outside of the Netherlands, Tesla is also conducting testing in Norway, which provides a couple of avenues for them to obtain national-level approval.

The frustration has been ongoing, with multiple committee meetings bringing up autonomy regulation but always pulling back at the last second before approving anything. The last meeting on Regulation 157, which governs Automated Lane Keeping Systems, concluded with authorities from the UK and Spain requesting additional time to analyze the data before reaching a conclusion.

Tesla, as well as Elon, have motioned several times for owners to reach out to their elected representatives to move the process forward, as it seems that Tesla’s own efforts are being stymied. 

This can seem odd, especially since Tesla has previously demoed FSD working exceptionally smoothly on European roads - and just did it again in Rome when they shared the video below on X.

DCAS Phase 3

While the approval process has been slow, Kees Roelandschap pointed out that there may be a different regulatory step that could allow FSD to gain a foothold in Europe.

According to Kees, the European Commission is now taking a new approach to approving ADAS systems under the new DCAS Phase 3 regulations. The Commission is now seeking data from systems currently operational in the United States that can perform System-Initiated Maneuvers and don’t require hands-on intervention for every request.

This is key because those are two of the core functionalities that make FSD so usable, and it also means that there may not be a need to wait years for proper regulations to be written from scratch. Now, the Commission will be looking at real-world data based on existing, deployed technology, which could speed up the process immensely.

What This Means

This new, data-driven regulatory approach could be the path for Tesla to reach its previous target of September for European FSD. While the cogs of bureaucracy are ever slow, sometimes all it takes is a little data to have them turn a bit faster in this case.

Alongside specific countries granting approval for limited field testing with employees, there is some light at the end of the tunnel for FSD in Europe, and hopes are that a release will occur by the end of 2025. With Europe now looking to North America for how FSD is performing, Tesla’s Robotaxi results could also play a role.

Tesla Launches 'TeslaVision' Contest With Big Prizes — See Last Year’s Winner [VIDEO]

By Karan Singh
Not a Tesla App

Tesla’s marketing has always been relatively unconventional, relying on word-of-mouth rather than traditional advertising. The passion of the owner’s community is always massive, but it is especially high now with the launch of the Robotaxi network just around the corner.

Tesla is now tapping into that spring of fan creativity and announced the TeslaVision video contest, with some seriously impressive prizes up for grabs.

The Contest

The core of the contest is simple. Create a video that shows how your Tesla gives you more in life. Tesla is looking for submissions that highlight themes of freedom, safety, fun, and convenience.

Prizes

The prizes definitely make this contest worth entering if you’re good with a camera and have some basic video editing abilities.

For North America, the prizes include a brand new Model Y AWD Long Range, alongside an all-expenses-paid trip to Austin for a tour of Giga Texas. The grand prize winner will also be able to custom order their Model Y, allowing them to select their preferred wheels and color.

The two runners-up won’t get a Model Y, but they’ll also enjoy an all-expenses-paid trip to Giga Texas for a tour of the factory.

The travel and tour include lodging in Austin for 2 nights, as well as economy-class round-trip tickets from anywhere in North America. Tesla will also provide a vehicle for use during the trip.

Hopefully, these winners will also have the opportunity to experience the Robotaxi network while they’re in Austin, as it’s expected to be opened to the public later this month.

Project Loveday

For long-time followers of Tesla, this contest may feel familiar. The contest is a direct throwback to the 2017 Project Loveday contest, which was inspired by a letter to Tesla from a 10-year-old aspiring marketer. That contest was won by MKBHD, with his submission below:

How to Enter

If you’re ready to start filming, here are the key pieces of information you’ll need to know:

  • Video must be 90 seconds or less

  • Video must be uploaded to YouTube with a public URL

  • Make a post on X and Instagram tagging “@Tesla” and include the words “TeslaVision contest” in the post.

  • Provide links to both social media posts in your submission to Tesla’s form

  • Provide your personal details in the form

  • You have until July 17th, 2025, or until Tesla receives 10,000 entries, whichever comes first.

You can find the official submission form and all region-specific details on Tesla's website.

View All Upcoming Features

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

More Tesla News

Tesla Videos

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter