Tesla's FSD hardware 4.0 to use cameras with LED flicker mitigation

By Nuno Cristovao

At Tesla's AI Day event last summer, Elon answered some questions during the Q&A portion of the event that revealed Tesla's plans for FSD hardware.

Elon informally announced that Tesla is already researching the next major hardware revision for full self-driving.

Tesla's camera housing
Tesla's camera housing

Elon said that he expects the current hardware in today's vehicles to be capable of "super-human" driving, but Tesla will continue to update their cars to have the most powerful hardware available.

Elon guessed that Tesla may release FSD hardware 4.0 with the introduction of the Cybertruck. Since the Cybertruck won't be released until the end of this year at the earliest, we may even see new hardware before its arrival, although this is unlikely.

In another question related to new hardware, Elon also said that Tesla is looking into new cameras. He was clear that the current cameras aren't a hindrance, but if Tesla can do better, then they will.

Elon didn't go into details about whether the new cameras would be tied to the Cybertruck or hardware 4.0. He also didn't mention specifically whether the new cameras would be higher resolution, contain larger sensors, or possibly even be placed in different locations.

Tesla currently utilizes three separate front-facing cameras in the housing at the top of the windshield. The camera unit contains wide-angle, standard, and narrow view lenses with three separate CMOS sensors.

Each sensor has a resolution of 1280x960 or about 1.2 megapixels.

New Camera

According to Chris Zheng on Twitter, who has connections with some Tesla suppliers, Tesla is planning to use Sony's new IMX490 automotive sensor in their upcoming hardware 4.0 revision.

Wide-angle camera comparison
Wide-angle camera comparison

This new sensor offers many benefits over the current sensors that Tesla uses in their vehicles.

The new sensors support a much higher resolution of 2896x1876. That's 5.4 megapixels compared to the 1.2 megapixels that Tesla's current front-facing cameras support.

At more than four times the resolution of current sensors, these new sensors will allow Tesla to more accurately detect objects that are required for FSD.

Detecting road edges and lane markings that are further away are especially difficult. Due to the angle of the road and the current image resolution, Tesla often has to make assumptions based on just a few pixels.

The increased resolution will offer a more detailed image and should improve the accuracy in these situations.

The new wide-angle sensor may also allow Tesla to drop the number of cameras used in the front-facing module. Due to the higher resolution in these sensors, Tesla may be able to use this wide-angle sensor to interpret objects that previously required the use of the standard or telephoto lenses before. This may allow Tesla to reduce the number of cameras that are required in the front of the vehicle from three down to two or even a single lens.

The new camera sensor also supports HDR shooting at 10 bit and 40 FPS, offering better contrast and richer colors. It's not clear whether Tesla would take advantage of HDR as it would require more power to process, but it's something Tesla may consider depending on the compute power available.

LED flicker mitigation
LED flicker mitigation

More importantly, the new sensor will also support LED flicker mitigation. Camera sensors often have a hard time capturing the light emitted from LED lights in a constant fashion. Since LEDs are widely used in electronic signs and traffic lights this will be an important feature and should make it easier for Tesla to interpret such signs.

Tesla is working closely with Samsung to produce their next-generation chips that will be used in FSD hardware 4.0. Tesla will likely launch updated cameras at the same time they introduce a new FSD computer.

It makes sense for Tesla to introduce this new hardware in a new model first before retrofitting new camera modules into existing models.

Writers Wanted

We're looking for a freelance writer who loves Tesla as much as we do. If that's you, we'd love to hear from you! Find out more.

Latest Tesla app will now display any recalls for your vehicle

By Alex Jones
The Tesla app can now displayed vehicle recalls
The Tesla app can now displayed vehicle recalls

Like other automakers, Tesla issues vehicle recalls (many involving minor software tweaks) when a vehicle feature or hardware needs to be changed.

With the release of their latest app update (version 4.9), Twitter user Tesla_App_iOS, noticed that Tesla added a new API that could potentially show vehicle recall information.

It didn't appear that the Tesla app was yet using this new API, but just a couple days later it can now be seen in the Service area of the app.

The service section of the app is loaded via a webview, which is essentially a webpage that the app loads when the user navigates to that section.

This allows Tesla to make changes to that section without requiring an app update to display new information.

Tesla, along with other car manufacturers, maintains a database of applicable recalls based on the VIN of each respective vehicle, so Tesla already has all the information needed in order to display recalls for your specific vehicle.

In the App

The Tesla app can now displayed vehicle recalls
The Tesla app can now displayed vehicle recalls

Upon navigating to the Service section, Tesla will list any recalls available for your vehicle.

Tapping an individual recall will give you additional information.

Tesla also has a Learn More button that links off to Tesla's site, where they display detailed information about the given recall.

Notifications

Since the feature appears to just have gone live recently, it's not clear yet whether Tesla will send a push notification to the owner when there is a new recall issued.

A notification could prompt the user to schedule service for critical recalls.

What is currently unknown is if software recalls will also be included in the app, or if it'll be limited to recalls that require Tesla service.

Some software-based recalls, like the removal of Boombox while in drive are displayed in the vehicle's release notes.

This is a welcome new feature to the Tesla app that makes managing recalls simple and convenient.

You can now easily look at or confirm if there are any outstanding recalls with just a few taps.

The feature is available on iOS and Android.

It looks like this feature may not be available in every region yet, as some users like TeslaChinaRider are not seeing it available in the app yet.

Tesla has a history of testing new features in select markets before releasing it broadly. Hopefully that's the case with this feature as well.

Writers Wanted

We're looking for a freelance writer who loves Tesla as much as we do. If that's you, we'd love to hear from you! Find out more.

New FSD Beta 10.12 visualizations: new car models, open doors and turn signals

By Nuno Cristovao
New car models used in FSD Beta 10.12 visualization
New car models used in FSD Beta 10.12 visualization
mariapazz000/Twitter

The first signs of Tesla's FSD Beta 10.12 finally surfaced yesterday as Tesla employees started receiving the internal beta.

The internal beta initially had a version of 2022.12.3.10, but it looks like Tesla has aleady issued an update with version 2022.12.3.15 (FSD Beta 10.12.1).

It's not clear yet whether this will be the exact version that will be rolled out to public testers or if additional updates will be made.

If Tesla finds any major issues, they'll want to fix them before rolling out the update to external testers.

New Car Models

New car models
New car models
WholeMarsBlog/Twitter

FSD Beta 10.12 introduces new vehicle models for almost every vehicle type.

Some of the vehicles have been completely redesigned and are more detailed and realistic looking than the previous models.

For example, a sedan now has wheels, windows and a glass roof, instead of the previous simplistic look that resembled a Model S keyfob.

New Brake Lights

Although brakes lights were already displayed as of beta 9.0, Tesla is now displaying the third brake light as well, which has been required in the US since 1986.

Open Doors

FSD Beta 10.12 will now display open doors
FSD Beta 10.12 will now display open doors
WholeMarsBlog/Twitter

FSD Betas have been able to detect and stop or go around vehicles with open doors for a while now, but Tesla will now show open doors in the visualization.

When a surrounding vehicle's door is open, the 3D model will also show the open door and highlight the door in orange.

Turn Signals

FSD Beta now displays turn signals
FSD Beta now displays turn signals
BLKMDL3/Twitter

Elon said back in the summer of 2021 that Tesla will detect and respond to vehicle turn signals, hand gestures and more in the future.

With this release, FSD Beta now detects and visualizes turn signals in addition to brake lights.

The car will reportedly react to turn signals it has detected as well, which should help understand the intentions of other vehicles.

Two Steps Forward, One Step Back

The last major FSD Beta release was version 10.11, which was first seen more than two months ago.

Tesla has been working on beta 10.12 for a while now and the amount of changes included in this update are huge according to Elon.

Musk said that due to the amount of changes in this beta, we can expect two steps forward and one step back.

This is a big one! Expect some two steps forward, one step back situations. These will be great ironed in point releases, hence ~10.12.2 or 10.13 for wider beta release.

- Elon Musk

There will be some issues, and in certain situations FSD may have regressed.

Tesla plans to fix any issues that arise with minor revisions to this release. Expect to see additional FSD Beta 10.12 releases such as 10.12.1 and 10.12.2 in the coming weeks.

Current Beta Testers

As we have seen with other recent betas, it may be a while until all current beta testers receive this latest beta.

With beta 10.11, we saw two revisions before the majority of testers received the beta. We may see a similar situation with this update, given the amount of changes that were made.

If you're a current beta tester, you may be waiting a couple weeks before getting this updated FSD Beta.

Additional Testers

There haven't been any signs of Tesla adding additional beta testers in the US since late 2021.

Elon has previously said that he hopes that Tesla will be able to add more testers who have opted in to the beta and have a Safety Score of 95 or greater in later revisions of beta 10.12.

Update 2022.12.3.15

FSD 10.12.1
Installed on 0% of cars
0 install(s) today
Last updated: May 24, 1:16 am

Interpretation of Beta 10.12 Release Notes

We have the technical releases notes for FSD Beta 10.12, but Reddit user asimo3089 did a great job at interpreting the release notes to give us a better understanding of what Tesla has improved in this update.

1. Your car better understands what is and is not drivable space. This makes it more confident in easy situations, and more capable in tricky situations. Your car can also now use medians for difficult left turns, and accelerates quicker to complete turns.

2. Your car now has a better idea of objects blocking camera views. Creeping should be less scary.

3. Improved path predictions of where other others on the road will be. This gives your car better decision making for turns.

4. Sounds like: Your car will drive itself to safety much more smoothly if your car finds itself in a place it shouldn't be. Better problem solving?

5. Your car should better see the lanes on the road, and how many of them there are, thanks to new data. This gives better turn confidence and path planning during a turn.

6. Your car is now trained on 180,000 new clips related to what lanes look like.

7. Your car is less likely to panic brake in a yellow light scenario, and has a better understanding of lane guidance when going through an intersection.

8. Road edges and road lines are now more accurate.

9. Your car now better understands visibility from the cameras, thanks to 30,000 new video clips of training data.

10. Speeds of motorcycles, pedestrians and cyclists is now more accurate. Plus, your car now better predicts which direction a pedestrian is walking.

11. Your car is now less likely to confuse a parked car and an idling car thanks to 41,000 new clips of training data. This should result in fewer "phantom brakes" or silly lane changes.

12. Your car now better understands objects that are far away from you.

13. Your car will plan a better path around vehicles with car doors open.

14. Objects that are not pedestrians, cyclists, etc, should have more accurate speed predictions.

15. When changing into an adjacent lane, your car will look further ahead at vehicle speeds. If somebody up ahead is braking, your car will handle it more comfortably.

16. Your car used to only predict acceleration (Not speed) for objects moving adjacently. Now your car will predict acceleration of all moving objects including objects accelerating across your path.

17. New 3D models for vehicles on your screen. You'll also be shown vehicles with their doors open.

18. Tesla retired a few old systems and gained 2 frames per second, per camera, resulting in better performance while self driving.

FSD Beta 10.12 is currently only available to employees, but we may see a wider release in the next couple days that includes public testers.

However, it could be several weeks before all current testers receive this update.

More details will surely be uncovered about this beta in the next few days. Stay tuned for more.

Writers Wanted

We're looking for a freelance writer who loves Tesla as much as we do. If that's you, we'd love to hear from you! Find out more.

Upcoming Release

View the release notes for the upcoming version 2022.16.0.2.

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Days Until Next Release

30

Estimated days until version 2022.20 is released.

Subscribe to be notified when new software is released.

Subscribe

Subscribe to be notified when new software is released.

Sponsors

Find out how to become a sponsor and have your site listed here.

Although we share official Tesla release notes, we are not affiliated with Tesla Motors. We are Tesla fans and supporters.

Upcoming Release

View the release notes for the upcoming version 2022.16.0.2.

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Days Until Next Release

30

Estimated days until version 2022.20 is released.

Subscribe to be notified when new software is released.

Subscribe

Subscribe to be notified when new software is released.