Tesla now dynamically resizes vehicle models in latest FSD Beta

Tesla's early FSD Betas included driving visualizations that used simple wireframe boxes to represent vehicles and lane markings were made up of individual dots.

Tesla adds scalable vehicle models to the latest FSD Beta

The visualizations were a great look into some of the information that is provided to Autopilot, but even then only a fraction of the information Autopilot uses was actually displayed onscreen.

In reality, Autopilot is creating a 3D representation of every object it tracks. Each object detected then has various attributes. For example, a detected vehicle will have attributes for how fast it's going, how far away it is, the type of vehicle, its predicted path, and more.

Tesla's visualizations in early FSD Betas

The car visualizations are an important part of FSD because they help us better understand what the car is capable of seeing and reacting to. However, the information and visualization Autopilot needs is drastically different than what humans need.

In order for Tesla to achieve FSD, they essentially need to be able to build a highly accurate video game that represents the real world, in real-time.

The car wants access to as much information about each object as possible. Meanwhile, humans want a visualization that closely resembles the real world.

With the introduction of FSD Betas 9.x, Tesla released a more human consumable visualization. One that included proper 3D models of general vehicle types, road pylons, and solid lane markers.

The road edges and lane markings are more distinguished lines, 3D models have working brake lights, and other objects such as speed bumps, bike lanes, and crosswalks are depicted using visualizations that match the real world.

In order for Tesla to achieve FSD, they essentially need to be able to build a highly accurate video game that represents the real world, in real-time.

However, something that has been missing is visualizations is dynamic vehicle sizing. The 3D vehicle models that Tesla has been using have a static size. When the vehicle sees a bus, it calculates its length, width, and height in addition to a bunch of other metrics. However, the 3D model that is shown onscreen is a predefined size, meaning that it does not actually match what the vehicle saw.

This is why you may have seen a tractor-trailer shift forward and backward or you may have seen two vehicles on top of each other. One is signifying the start of the vehicle and since the vehicle is so much longer than the model, it's adding another vehicle to the end to signify the end of the vehicle.

Scalable Vehicle Models

However, in the latest 10.10.2 FSD update, we are now seeing Tesla scale individual vehicle models so that they represent the calculated size of surrounding vehicles. Contextually this could be helpful in better understanding our car’s situation in the world.

In 10.10.2, the car shrinks or stretches the 3D vehicle models in each dimension so that the 3D model matches the calculated dimensions for each vehicle. This is especially apparent in longer vehicles such as buses, trucks, and tractor-trailers, where the vehicle lengths are more likely to vary, but you can also see it scale other vehicle models such as very small cars.

In this example below, you'll see that Tesla is now able to accurately represent buses of different sizes. Tesla only has a model for a full length bus, but in this case, Tesla detected that the length of one of the buses is considerably shorter than the vehicle model so it chose to reduce the length of the bus to the length Autopilot had calculated. In the image below you can see how the same bus model is shown in two different sizes.

Tesla can now accurate render vehicles of different sizes

It's important to realize the difference between the visualizations and what Autopilot uses. The visualizations are there merely to help us better understand what Autopilot can see. The FSD computer itself has always been taking note of the size of surrounding objects and various other data points. Trajectory, approach velocity, proximity, and so forth have also been a part of this, but this update helps Tesla achieve visualizations that provide a more accurate representation of reality.

It's not only buses and trucks that are scaled up or down. Tesla resized a bobcat down to a vehicle that is about half the length of its normal sedan model.

Tesla can now accurate render vehicles of different sizes

Models are adjusted in all three dimensions. We witnessed some truck models that were stretched to become taller while also having their length reduced. It's not perfect because you're scaling all components of the truck at the same rate, but it produces a much more accurate representation of the vehicle and the amount of space it takes up.

Vehicles are resized in three dimensions to better match the vehicle's length, width and height

Tesla has come a long way in a short period with how many objects they're able to detect, but obviously, when you compare the environment the car sees today, there is still a lot missing.

In the short term, we'd like to see more objects visualized. Objects that are commonly encountered while driving, such as trailers and gates.

We'd also like to see other common objects added, such as additional traffic light configurations, crosswalks, mailboxes, and maybe even a generic object that lets us know the vehicle sees something it needs to maneuver around, but it may not know exactly what it is.

In the future, I think we'll see Tesla display a rich, fuller 3D environment that will display static and moving objects that are important for the vehicle to avoid, objects such as barriers, buildings, trees, sidewalks, and more. Today Tesla is one step closer to achieving this goal.

Be sure to check out our full list of every visualization in Tesla's latest FSD Beta.

Follow

Follow

Follow

Tesla Adds Ability to Swipe Left and Right in Browser

Not a Tesla App

Tesla has made a spate of improvements to its vehicle software recently, starting with the big Spring Update, and then the Summer Update more recently. While we see most of the updates mentioned in the release notes, Tesla often also adds smaller quality-of-life improvements along the way.

Browser Controls

When using the Tesla Browser in the vehicle, you can now swipe left and right to go back or forward a page in your browser history. When you start swiping on the screen, Tesla’s Chromium-based browser will now display an arrow that slides out from the left or right. The circular icon is initially white, meaning that the action won’t be executed, but if you continue moving to the left/right, the icon will eventually turn blue. The blue icon means that the action will be executed once you let go of the screen.

This is a simple quality-of-life improvement that makes using the built-in browser easier.

We’re happy to see updates like these come to the browser, whose last major feature was the full-screen button that was added in update 2024.14.

Future Browser Improvements

While we’re on the topic, let’s look at some future Tesla web browser improvements we’d love to see.

Access to the Mic

Full access to the vehicle microphone isn’t allowed through the web browser right now. That means if you want to get into a Discord, Slack, or Teams call, you’ll only be able to listen – not speak. All of these apps fully function in the Tesla browser for sending messages, but are fairly limited for meetings.

Better Bookmarks

Tesla’s current bookmark system is simple and barebones. You can bookmark a page and give it a name. Once you visit a bookmarked page enough, it’ll show up as an icon in the center of the browser when you go to the homepage.

However, it's difficult to keep a larger set of bookmarks since there aren’t any organizational tools provided. A better bookmark system or the ability to sync bookmarks would be a welcomed feature.

Custom Homepage

Tesla’s current homepage in its browser is simply just a Tesla logo in black or white, depending on whether your car is in dark mode or not. A custom homepage that provides widgets with basic local news, stock information or other details would be fantastic. We’d ask for weather too, but the recent Summer update shows weather at the top of your screen.

If you’ve got more ideas for the fairly barebones Tesla web browser, let us know.

Follow

Follow

Follow

Tesla Updates FSD Package, Can Now Only Buy FSD Supervised

Not a Tesla App

Tesla has changed how they advertise and sell Full Self-Driving on their website. Although the text changes are small, this change could have greater implications in the future.

Previously, customers were offered the option to purchase “Full Self-Driving Capability,” with text saying that FSD will “continuously improve”. This specific text is no longer offered, and instead, customers can now only purchase “Full Self Driving (Supervised),” which no longer mentions continuous improvement.

You can view the old text on the Web Archive page (photo below) for the Model Y. This change comes right before the upcoming Robotaxi event, so we’re not quite sure what to make of it. Let’s look at what else has changed on Tesla’s website on FSD before we dive into the wording changes.

This news comes hot on the heels that Tesla recently pulled its blog pages for Elon Musk’s Masterplan Part II, which mentioned that all future Tesla vehicles would be Robotaxi capable. However, this has since turned out to be part of regular website trimming and maintenance. However, this FSD change is more intentional.

The previous FSD option you could buy from Tesla (left), and the new one (right)

Not a Tesla App

Definition Changes

These text changes are pretty broad, but that’s not all. There are a few other items that changed, including the removal of the following text:

The activation and use of these features are dependent on achieving reliability far in excess of human drivers as demonstrated by billions of miles of experience, as well as regulatory approval, which may take longer in some jurisdictions. As these self-driving features evolve, your car will be continuously upgraded through over-the-air software updates.

This has now been changed to say:

The activation and use of these features are dependent on development and regulatory approval, which may take longer in some jurisdictions.

That’s a pretty big difference overall, so let’s dig in.

Can Only Buy FSD (Supervised)

Tesla is now only offering the purchase of “Full Self-Driving (Supervised)”, instead of “Full Self-Driving Capability." This has a bit of an implication for the many people who have paid for FSD in the past, expecting their vehicles to become fully autonomous, without supervision being required. With the specific terms on Tesla’s website today, that promise doesn’t seem to be in place for future sales of Full Self-Driving.

Instead, future customers should expect that they may only receive Full Self-Driving (Supervised), which will always require some form of supervision. Tesla no longer states full autonomy on this page, but on the other hand, the Autopilot/FSD Support Page still contains the text for full autonomy.

This seems to be a legal wording change to prevent Tesla from making promises it may not be able to fulfill. On the other hand, Tesla has recently had a fantastic spate of updates this year, with the huge upgrade from FSD V11 to FSD V12. However, they’ve more recently had more trouble with moving on from FSD V12.3.6, which is what most vehicles are still on today. Tesla initially pushed FSD V12.4 and its subversions to early access testers but quickly halted that push. They moved on to FSD V12.5, and V12.5.3 with Actually Smart Summon will begin going out wide sometime next week, to both Hardware 3 and AI4 vehicles.

What Does This Mean for Customers?

For future customers, this likely means that Tesla is intending on only offering Full Self Driving (Supervised), rather than Full Self Driving. This could mean that Tesla will launch a new package for Full Self Driving (Unsupervised) for commercial entities or that it could only be available for Robotaxi vehicles.

For older customers – those who have purchased “Full Self-Driving Capability”, as the feature was previously called, we’re not quite sure whether Tesla will include you in this new ‘Supervised’ description, or if you’ll be offered Full Self-Driving (Unsupervised) when that ultimately becomes available. As for subscribers, Tesla can change their offerings at any point since you’re only paying for what’s available for that month.

Today, we’re not quite sure what to make of this change, especially since that same change hasn’t been reciprocated elsewhere on Tesla’s website. The changes could be anywhere from a protective legal change, to Tesla offering a new FSD (Unsupervised) package in the future, or fully autonomous FSD being something that Tesla will not commit a date or price to.

Let us know what you think in the forums.

Follow

Follow

Follow