Tesla to Update FSD Visualizations

By Nuno Cristovao

Every Tesla shows some form of visualizations on the screen that help the driver understand what the car is mapping. The car will map major elements such as lane markings, cones and other vehicles. If your car is equipped with FSD HW 3.0 then you’ll see even more objects mapped such as trash cans, arrows on the road, traffic lights and quite a bit more.

The FSD beta for city streets includes many more car visualizations since the car needs to understand so much more about the real world to help it traverse city streets. However the visualizations are not what we are normally used to. They’re Matrix-like outlines that display stationary and moving obstacles on the screen in different colors to help the driver understand what the car is able to understand. It's important to understand that the on screen visualizations are simplified and what the car is actual "seeing" is actually an object and assigning probabilities to what it may be. The visualizations likely display the object that has the highest probablity at the time. The visualizations are there more for debug purposes and troubleshooting than anything else.

We knew that this type of visualization would not be in the final product of the FSD beta. Elon has now mentioned that there is a new FSD rendering approach coming that will better represent what the neural networks see. This could mean brand new renderings to the on screen visualizations and bring us closer to what the final product will be.

Tesla UI prototype

If you take Elon’s tweet along with some recently shown off video from a former Tesla UI designer, you can get a feel for what the new visualizations will look like.

The look and feel of the new visualizations are very similar to what non-FSD beta users see today, but they now display a lot more elements in greater detail. The environment visualizations still have that sketch-book-like effect, which helps communicate that the renders are interpretations of the real world and are not to be taken as exact renditions.

The video, which can be seen below, shows off intersections for the first time in addition to crosswalks and traffic light poles. The video goes on to show slightly different car animations when you open your hood or trunk, but these animations do not likely represent what is to come, but instead depict what this designer had envisioned at the time. From the menu at the bottom of the screen you can tell this is not from Tesla’s v11 update.

We now have even more of a reason to look forward to that ‘Download FSD beta’ button as there’s a good likelihood that these new visualizations will be included in that release as well.

Tesla will also be releasing a FSD subscription in May 2021.

Update: Tesla released 'Mind of Car' visualizations in FSD update 9.0. Check out our list of all the visualizations included in the latest FSD betas.

Tesla Is Removing Steam Gaming in New Model S and Model X Vehicles

By Karan Singh

Tesla is no longer including Steam support in any of its newer Model S and Model X vehicles, according to messages received by customers who are awaiting deliveries of the flagship vehicles.

Tesla previously introduced the Steam beta to newer versions of the Model S and Model X refreshes which had 16GB of RAM as part of the 2022 Holiday Update. This update didn’t support slightly older vehicles with only 8GB of RAM, but a retrofit was available for $2,000 USD.

Tesla No Longer Supporting Dedicated GPUs?

The Cybertruck also did not receive a dedicated graphic processing unit (GPU), with many people noting that they did not have access to Steam on their Foundation-series Cybertrucks and GreenTheOnly later confirmed the Cybertruck did not include a GPU. The Cybertruck also shipped with only 8GB of RAM, matching the Model 3 and Model Y MCU 3 versions based on AMD Ryzen chips.

This could be an indication that Tesla is phasing out the GPUs, as well as the larger RAM packages that came bundled with their top-end vehicles, likely due to cost-cutting, hardware streamlining, and optimization.

Tesla is removing Steam support on newer vehicles
Tesla is removing Steam support on newer vehicles
Randall

Future of Steam Support

While the AMD Ryzen RDNA-2 APUs that are built into every Tesla MCU are quite powerful and very capable of rendering 3D or 2D graphics when in mobile configurations, there has been a distinct lack of Steam support on other vehicles, due to the 8GB of RAM.

Given the removal of GPUs from the flagship vehicles, there is also a chance that the RAM on newer Model S and X vehicles will also be facing a reduction similar to the Cybertruck. The Steam Beta could very well be on its way out.

The other possible alternative would be an updated Steam Beta that supports 8GB of RAM, and does not require a powerful GPU, as people may not do too much hardcore gaming on their vehicles.

Gaming Alternatives

Some gaming applications still live on in Tesla’s Arcade Mode, including the ever-popular Cuphead, Sky Force Reload, and Vampire Survivors. We previously discussed Tesla’s lack of Google Casting and Apple Airplay, but a fantastic alternative would be providing HDMI pass-through support on the Glovebox USB-C port.

Imagine being able to connect your phone to Tesla’s displays and gaming on a much larger 19” screen (screen size comparison) as seen on the Cybertruck.

The Future of Tesla Compute

Elon Musk mentioned in the 2024 Tesla Earnings Call that the unused compute power of Tesla vehicles not being driven was equivalent to a larger computing system like Amazon’s AWS. One idea floated by Musk was to use the computers of parked vehicles to conduct inference, data processing, and other tasks – selling the compute capabilities of vehicles to external organizations, while also paying back the owner.

Tesla Releases FSD v12.4: New Vision Attention Monitoring, Improved Strike System With Update 2024.9.5

By Not a Tesla App Staff

Tesla has just rolled out its latest FSD software, v12.4 to employees. Elon Musk announced that this update would be available to employees this past weekend, with plans to release it to the public in small numbers later this week.

Surprisingly, the new update is version 2024.9.5, which is likely based on the earlier 2024.8 branch and not Tesla's latest 2024.14. The spring update (2024.14) brings various new features such as a new media player, a new parked visualization, Audible support, and a Preview of Sentry Mode events, among others.

However, FSD v12.4 brings its own excitement with two new major changes.

Vision-Based Attention Monitoring

The release notes show a new Vision-Based Attention Monitoring feature that replaces the steering wheel nag as Musk previously mentioned.

However, as we predicted, Tesla will still leverage the steering wheel to detect attentiveness when the cabin camera is inconclusive.

The car can only rely on the vehicle's cabin camera, and therefore remove the steering wheel nag under certain conditions:

  • the camera is not occluded

  • there is sufficient lighting

  • the driver is looking forward

  • the driver is not wearing sunglasses

  • the driver is not wearing a low-brim hat or another object that covers their eyes

If any of these situations occur, or if the vehicle doesn't have a cabin camera, then the vehicle will continue to use the steering wheel to determine driver attention.

Tesla is careful to state that images and video from the cabin camera are not saved or transmitted unless you enable data sharing.

Updated Strike System

With FSD v12.4, Tesla has also updated its Autopilot Suspension feature which is designed to enforce the responsible use of FSD.

The current system lets the driver receive up to five strikes (three strikes for vehicles without a cabin camera) before Autopilot and FSD become unavailable. If that happens, then FSD is unavailable for one week. Strikes are only removed once the driver has accrued five strikes, or when Tesla wipes out strikes for everyone, which happens about twice a year.

The new system is more gracious about removing strikes. The vehicle will continue to issue strikes whenever the driver isn't paying attention, however, now the vehicle will gradually remove strikes for the driver after a certain period of time.

Tesla states that one strike will be removed for each 7-day period the driver goes without receiving a strike. So if FSD gets disabled due to strikes, the driver will still go one week without FSD, although now strikes are removed on an ongoing basis. This new strike system is expected to apply to vehicles with and without a cabin camera.

Other New Features

Other new features are expected in FSD 12.4 as well, which we outlined in our look at Tesla's FSD v12.4 article.

They include a focus on improved driver comfort by reducing the amount of hard braking, automatically seeking a parking spot when arriving at a destination and more. Driver interventions are also expected to be drastically reduced with Musk stating that Tesla expects to see a 5-10x improvement in interventions.

Eligibility

Unfortunately, due to FSD v12.4 being on branch 2024.9, it's expected to only be available to owners on update 2024.8 and below, which includes everyone currently on update 2024.3.25.

If no major issues are found with FSD v12.4, we could see it start to roll out to the public later this week.

View All Upcoming Features

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

More Tesla News

Subscribe

Subscribe to our weekly newsletter.

Sponsors

Find out how to become a sponsor and have your site listed here.

Although we share official Tesla release notes, we are not affiliated with Tesla Motors. We are Tesla fans and supporters.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter.