Tesla has expanded its Full Self-Driving Beta program by releasing the first public version of FSD Beta 12.1.2, update 2023.44.30.12 to a select group of Tesla owners. This version is notable for its use of an end-to-end neural network, which is expected to greatly improve Tesla's advanced driver assist system (ADAS). The neural network, trained on millions of video clips, replaces much of the previous explicit C++ coding, improving the system's capability to handle complex driving situations. While Elon Musk had suggested that version 12 would see FSD coming out of beta, the release notes still label it as beta.
Tesla previously released FSD Beta v12 internally, including v12, v12.1, and v12.1.1, but v12.1.2 is the first to be available to non-employees. OG FSD Beta tester, and Tesla influencer, @WholeMarsBlog received this newest release last night and has already published his video (below).
Early Feedback & Tempering Expectations
Early reports say that FSD Beta v12 is more intuitive and drives more human-like. The feedback appears to be overwhelmingly positive, although it’s not uncommon for owners to get excited about such a monumental release that we’ve been looking forward to for many months. We may need to temper our expectations as this release alone won’t get us to level 4 or even level 3 autonomy, but it could be a significant step in the right direction. It could be as significant to vehicle control as when Tesla first transitioned to using AI for Autopilot.
Early reports say that there is a noticeable improvement in how the vehicle handles urban driving scenarios. The smoother transitions and quicker response times appear to contribute to a more comfortable and human-like driving experience. This shouldn’t be unexpected, as vehicle control is now trained on videos of humans driving instead of engineer-written code.
New Pull-Over Feature
A notable feature of FSD Beta v12.1.2 is its ability to pull over to the side of the road autonomously, a functionality showcased in Musk's live stream. At the end of a drive, the vehicle will now pull over to the site of the road instead of simply stopping. WholeMarsBlog shows off this feature in action in his video below:
For such a milestone release, Tesla hasn’t provided much information in the way of release notes. Each FSD Beta release normally contains a long list of technical release notes, which often need to be translated for everyone to understand. However, this time we get a single sentence that describes FSD Beta v12. The release notes simply state:
“FSD Beta v12 upgrades the city-streets driving stack to a single end-to-end neural network trained on millions of video clips, replacing over 300k lines of explicit C++ code.”
Road Ahead and Release Date
A clearer picture of FSD Beta v12.1.2 and its real-world performance will emerge as more Tesla owners receive the update and share their feedback. It will be interesting to see how the system handles diverse driving conditions, especially in areas with heavy precipitation, a scenario Elon Musk mentioned needing more training.
While this public release is monumental, the release to additional owners is expected to be a gradual and slow process. It could be months before most owners have access to this latest update. Tesla will likely gather feedback with this release and issue additional v12 betas to ignore other issues and improve the system.
While Tesla continues to innovate and refine its FSD technology, it is crucial to remember that the software is still in beta. The transition to full autonomy is a complex and gradual process, requiring rigorous testing and validation. However, with each update like v12.1.2, Tesla moves closer to realizing its vision of fully autonomous vehicles.
One of the big undocumented changes in Tesla’s 2024 Holiday Update was the changes to the Energy app. While the Model S, Model X, and Cybertruck received the Consumption tab in the Energy app for the first time, the changes made for those models also carried over to Model 3 and Model Y.
The Consumption tab lets you view your vehicle’s consumption over recent trips as well as view projected range estimates based on historical usage, but it now offers different options.
Sadly, legacy Model S and Model X vehicles produced before the 2021 refresh still don’t have access to the Energy app at this time.
Energy App
Tesla’s Energy App previously let you view a lot of in-vehicle data on what is consuming energy and how to improve your energy consumption. It was previously refreshed in 2022 and brought Drive, Park, and Consumption tabs to help compare actual vehicle energy consumption versus what you’d expect from the EPA ratings.
The old Energy App's consumption page.
Not a Tesla App
Key Changes
The Energy App has seen a lot of changes - mostly in the name of simplicity and reducing confusion. Some changes reduce functionality, but others bring even more. All of these changes impact the Consumption tab - the Park and Drive sections are unchanged.
Distance
Previously, you were able to switch the graph on the Consumption tab to show the last 5, 15, or 30 miles. Instead, it is now a static display of the last 200 miles (or 300km). This means your last 200 miles of driving - whether it's a single trip or multiple trips. Your range prediction and energy usage are now based on 200 miles of driving instead of the previous selectable distance.
This allows for a more reasonable range prediction as small bursts of high-energy usage, such as time spent accelerating to highway speeds from an offramp, are now less of an impact and are instead averaged out by regular driving.
However, for those who love to take their Teslas to the track or tow regularly, this makes the consumption significantly less useful because you can no longer see your actual energy usage for the type of driving you’re doing. This could be fixed with a reset button or by adding the ability to select your distance — similar to before.
Projected Range and Average Wh/mi
Unfortunatley, the Instant Range button has been removed, and the graph is now locked on what was previously the Average Range. Essentially, you cannot view your real-time range based on current instantaneous consumption - but you can view the overall projected range.
Additionally, average Wh/mi and projected range are still displayed - but in different areas compared to before. The projected range is displayed on the center-left side of the graph, while the average Wh/mi is now displayed at the top of the screen.
Not a Tesla App
Compare Vs EPA
Another new feature is that the average range is now compared to the EPA estimated range in terms of wh/mi. You’ll be able to see whether your driving style and conditions put you over or under the EPA estimate in a pretty quick way, which is helpful.
This new comparison is located just under your average Wh/mi.
Small and minor adjustments to your driving style - like not taking off like an electric lightning bolt at every red light - will make a big difference to your range. Don’t worry - we know its hard, we love doing it too! Other things - such as driving downhill versus uphill, will have an impact that you can’t necessarily avoid unless you’re old enough that you went to school uphill both ways.
Total Vehicle Consumption
The final new feature is a total vehicle consumption number at the bottom left, under the chart. It will tell you how much energy you’ve consumed over the distance you’ve driven so far. This is a convenient way of seeing exactly how much energy you’ve used.
Bug
There’s currently a bug in the way the Y-axis is labeled. The yellow area of the graph means the vehicle is using energy, while green means the vehicle is generating energy through regenerative braking. However, the Y-axis is currently mislabeled and shows generated energy as using about 100-200 Wh/mi.
The confusion appears to be due to the dark gray line, which looks like “0” on the Y-axis but actually represents the vehicle’s rated range. We would expect this to be Y-axis 0, since above the line the graph is yellow, and underneath it, the graph is green. However, this line is at about the 240 Wh/mi mark but will vary depending on the vehicle.
Due to this bug, it’s currently not possible to see how much energy is being generated.
Dynamic Y-Axis
The Y-axis in the Consumption tab is now dynamic - it will expand and contract automatically based on the driving data. We’ve seen it go from 400 Wh/mi all the way up to 800 Wh/mi. You likely need to be in a Model S Plaid or Cyberbeast with Launch Mode to see numbers much higher than that.
We’re sad to see the X-axis get locked to 200 miles, but being able to see total vehicle consumption and comparing average consumption against what’s rated is equally, if not even more valuable.
Overall, the new and improved Consumption tab is simpler and doesn’t require user input. While it takes away some features, it makes it easier for drivers who may not use it regularly. The most important piece is the projected range, which is now easier to see and understand unless you're towing and need the historical usage erased because it’s now irrelevant to your current drive. Hopefully, Tesla will allow you to scrub the graph horizontally in the future, adding the ability for the user to adjust the X-axis dynamically.
If you hop into your Tesla and say ‘Hi’ or ‘Hello’ after pressing the Voice Command button, there is a good chance it’ll reply with “Hello!” This is the newest and most interesting piece of news pointing us to the conclusion that a Tesla voice assistant is on the way.
Previously, if you tried this, it would simply return “Command not understood.” This is the first time the vehicle is responding and interacting with the user.
Experience It Yourself
You’ll need to have your vehicle language set to English. Once that’s done, you can use the voice command button on your steering wheel or yoke - for the Model 3 and Model Y, push the right wheel button, and for the Model S, Model X, and Cybertruck, press the button. Then go ahead and say Hi or Hello.
The Hello! response may even have regional differences. For a German Tesla owner, after setting his language to English, the response came back as “Hallo.” We’re interested to see what the responses may be in other regions, so let us know if you notice anything interesting.
We’ve tried a few other basic things, but it seems that, for now, the vehicle only replies to a simple greeting. Asking it what time it is or the $TSLA stock price doesn’t seem to do much yet - unless you’re in China with the updated Smart Assistant.
Not a Tesla App
Server-Side Update
This update appears to be happening over Tesla’s voice system backend and doesn’t require the Holiday Update. Users who aren’t on the Holiday Update are reporting that they’re getting this new response as well.
We already know that Tesla interprets speech remotely, and the driver’s voice is not processed in the vehicle. Instead, the voice snippet is transmitted to Tesla’s servers, where Tesla processes it and sends a response back to the vehicle so that the vehicle can interpret it. This is unlikely to change with a smart assistant, as Elon Musk has already said that Grok will still process data server-side instead of on-device.
Many users recently also noticed significant improvements to voice commands, saying that the system understands them better and that responses now come back faster.
All of these things point to a new backend system for voice processing that Tesla is testing. It’s not unusual for a company to switch to a new backend process but keep the capabilities the same as the legacy system until it’s ready to roll out the new features. At that point, it’s simply a flip of a switch to allow the new capabilities.
The new smart assistant that was rolled out in China is mostly a backend change, with the in-vehicle experience largely remaining the same. The activation method (button press) and user interface remain the same. What changed is the response that comes back from the server, and the assistant gained a voice. The new voice we receive with a smart assistant could very well be the new voice users are experiencing in the navigation system in newer vehicles.
Below is a video of the voice assistant in China:
Vehicle Support - Intel?
When China received the Smart Assistant, it was locked to cars equipped with AMD Ryzen processors only. Shortly after its initial launch, it became available to older cars with Intel Atom processors as well.
However, we’re not sure whether it would apply to legacy Model S and Model X owners. A legacy vehicle owner had their vehicle report “Command not understood” when they tried the ’Hi’ voice command.
Grok for Tesla
Elon has previously mentioned that Tesla vehicles would receive Grok AI. Grok, as of yet, still doesn’t have live speech support like other LLM models such as OpenAI’s ChatGPT or Google’s Gemini. However, a major update to Grok just brought massively improved image generation via a new model called Aurora.
xAI has been hard at work improving Grok, and we’re sure that live speech support is on its way soon. Once that feature arrives on X, Tesla will likely be well-positioned to enable a Grok-powered smart assistant fleet-wide with a flick of a switch.