Tesla Makes Improvements to Camera Clarity [Video] [Update: Now in update 2023.32]

Updated: September 10, 2023

By Kevin Armstrong

FSD Beta 11.4.7 includes improved processing for camera feeds

Tesla has recently released the FSD Beta version 11.4.7 to a broader range of customer testers, and many Tesla owners are already observing notable enhancements in the side repeater cameras. The interesting twist to the story is that many believed the new images that were surfacing were produced by newer vehicles equipped with HW4's higher resolution cameras, but that is not the case.

Musk Confirms Enhancement

@WholeMarsBlog questioned Elon Musk on whether advanced post-processing was integrated into the improved camera views in FSD Beta 11.4.7 (release notes). During a conversation on X Spaces, Musk confirmed that software had been employed to enhance the camera previews. The FSD 11.4.7 update brought with it refined post-processing, resulting in a more precise white balance, color balance and much sharper images when drivers view the side cameras while on the road. This is a marked improvement compared to the previous FSD Beta 11.4.6 version.

Before & After Video Comparison

Everything Looks Better with Update

Mike, a Tesla enthusiast from CyberOwners.com, underscored the substantial improvements he noticed in his 2019 Model 3 after updating to FSD beta 11.4.7. He enthusiastically described the update as an “amazing improvement” in the performance of the turn signal cameras compared to the earlier version.

Although Mike did not review the dashcam, he mentioned that the rear camera performance, which was already satisfactory, has been further refined. “Rear looks great... of course, rear already looked good compared to the repeaters,” Mike stated during a discussion on platform X. He also lauded the software update for rectifying the “proper color balance,” a recurrent issue with the older cameras.

This progress is especially significant considering Mike’s Model 3 is a 2019 version equipped with older cameras, notorious for their “light bleed at night.” Tesla has since rectified this hardware issue in recent models. This suggests that Tesla’s software development team concentrates on enhancing new models and is dedicated to optimizing the performance of older vehicles.

Chuck Cook, another tester, also demonstrated the camera enhancements of FSD beta 11.4.7. While acknowledging that the locations and lighting in his comparison were slightly different, Cook noted additional processing was evident.

This is an incredible software enhancement for cameras that have a resolution of 1.2 megapixels. The new cameras are 5 megapixels, which means that advanced hardware mixed with the new software will make for crystal clear images. This makes sense. The car must have the best visual inputs, considering that Tesla is moving toward “nothing but nets” FSD, relying solely on what the car sees and not how it is coded.

Update: A big question on everyone's mind was whether these camera feed improvements would roll out to non-FSD updates. Since they weren't explicitly related to FSD Beta, it would be likely that they would eventually be merged into Tesla's main branches, but the question remained — when? We're now seeing several reports that these camrea improvements are included in Tesla's latest update, version 2032.32.1.

Tesla to Eliminate the Steering Wheel Nag in FSD v12.4; Vehicles Supported and Release Date

May 9, 2024

By Not a Tesla App Staff

In a recent interaction on X, Elon Musk confirmed that the long-standing steering wheel nag, designed to ensure driver attentiveness, would be removed in FSD v12.4.

Musk initially replied to a user on X claiming that FSD v12.4 would fix the steering wheel nag. However, it wasn't clear what Musk meant by fixed until user, Farzard, created another post stating that Musk insinuated that the nag would be removed in FSD v12.4, to which Musk replied with “Yes.”

Tesla's removal of the steering wheel nag isn't surprising, as Tesla's camera-based driver monitoring system in the vehicle can in theory do a much better job monitoring the driver's attentiveness. So before NHTSA has a heart attack with Musk's comment, it's important to understand that Tesla is likely improving cabin camera monitoring in this same update to the point that the steering wheel nag becomes redundant.

How Tesla Uses the Cabin Camera

Tesla uses the cabin camera to detect whether a driver is paying attention to the road by detecting whether their eyes are open, which way their head is facing, and even whether the driver is using their phone.

Thanks to Tesla hacker Greentheonly, we know Tesla uses the vehicle’s interior camera output and AI to determine the likelihood of each scenario they're looking for. For example, Tesla runs neural networks that look at the video feed of the cabin camera and determine whether the driver is looking up at the road, looking off to the side, or looking down.

This Won't be the End of the Steering Wheel Nag

While Musk's statement implies the removal of the steering wheel nag, Tesla will probably retain it as a fallback measure, at least in early iterations of the suspected improved camera-based monitoring system.

The steering wheel nag may still be used when the cabin camera can't confidently determine whether the driver is paying attention. This could be caused by sunglasses, hats, glare, or even driving at night. Newer Teslas include interior infrared lights that help the camera see in the dark, although not all Teslas on the road include infrared lights.

Will It Also Remove It For Basic Autopilot?

While Musk says Tesla will remove the steering wheel nag in FSD v12.4, the need to detect driver attentiveness isn’t unique to FSD. Tesla detects for driver attentiveness in all their Autopilot packages, including Basic Autopilot, Enhanced Autopilot, and FSD. It’s not clear whether Tesla plans to only remove the nag in FSD, but it looks like Tesla will at least start there and the feature will likely work its way down to Enhance Autopilot and Basic Autopilot as well.

Vehicles Supported

The only Teslas expected to take advantage of the “nag-less” improvements in FSD v12.4 are those with cabin cameras, which include the Model 3, Model Y, Cybertruck, and the redesigned Model S and Model X. However, the newest vehicles with infrared lights near the cabin camera will likely benefit the most.

FSD v12.4 Release Date and Features

Elon Musk indicated that FSD v12.4 could start rolling out as early as next week. Musk doesn't usually reveal what's in each FSD update, but he did talk about what we should expect in FSD v12.4, disclosing that the update will largely focus on refining passenger comfort by addressing concerns such as abrupt acceleration and braking.

Musk went on to tease some of the improvements to expect in subsequent versions like v12.5 and v12.6, but the primary focus of v12.4 seems to be delivering a smoother and better driving experience.

Musk Shares What to Expect in FSD v12.4 Next Week; Talks About Abilities of FSD v12.5 and v12.6

May 8, 2024

By Not a Tesla App Staff

Less than two weeks since its last FSD update, Tesla is getting ready to release FSD v12.4, with CEO Elon Musk hinting at significant improvements. The current version, 12.3.6, introduced Autopark and High Fidelity Park Assist for vehicles equipped with ultrasonic sensors in the U.S. and Canada, along with minor fixes for FSD.

Just an hour ago, Musk shed some light on Tesla's next FSD update. Through his X account, Musk teased the imminent release of v12.4, stating, "Probably start rolling out 12.4 next week." Moreover, he provided insights into the development process and the features users can expect in the upcoming 12.4 version, as well as v12.5 and v12.6.

What to Expect in FSD v12.4

Musk says that FSD 12.4 has extensive retraining of AI models that particularly focuses on refining the comfort of passengers by addressing concerns around abrupt acceleration or braking. Musk previously commented on the next versions of FSD saying that FSD v12.4 and 12.5 would be major improvements, and while v12.4 may be a major step forward, it looks like its main focus will be on being more natural and smoother.

"Probably start rolling out 12.4 next week."

FSD v12.5 and v12.6 to Handle More Complex Scenarios

Looking ahead, Tesla is already laying the groundwork for future updates according to Musk. The CEO previously stated that Tesla is constantly working on FSD updates that are three to six months ahead of what’s in production, so they have a good idea of what the software will be able to handle in the future.

Today on X, Musk said that there's ongoing testing for FSD versions 12.5 and 12.6, which involves tackling complex scenarios. Musk says this includes navigating narrow, one-way roads and handling unexpected road closures, requiring the vehicle to reverse and find alternate routes.

Actually Smart Summon in v12.5?

Tesla’s Autopilot lead, Ashok Elluswamy, previously talked about how FSD would gain the ability to go in reverse when Tesla is ready to release Actually Smart Summon. If the ability to reverse is still tied to some of the abilities of Actually Smart Summon, then, it’s possible we may see Tesla’s better summon implementation in version 12.5 or 12.6.

Vehicles to be Able to Communicate with Fleet

Musk also gives us some insight into vehicle communication, saying vehicles will need to be able to communicate with the fleet so that you "don't get a whole bunch of Teslas stuck down a road."

Instead of vehicle-to-vehicle communication, Tesla will likely have vehicles report back to the "mothership," where Tesla can aggregate data and report it to nearby vehicles. This is similar to how vehicles report traffic today, instead of talking directly to each other.

Spending on AI

Tesla's commitment to advancing its AI capabilities is evident through its substantial investments. Musk recently emphasized the company's dedication to spending around $10 billion throughout 2024 on training and inference AI. Musk said that any company that isn’t spending billions on AI this year just won’t be able to compete.

Expansion of FSD

Tesla appears ready to start the expansion of FSD, and it looks like China may be up first. Musk's recent visit to Beijing to discuss a potential FSD rollout and data sharing shows that Tesla is ready and serious about FSD's expansion.

While FSD's rollout in China appears promising, Musk remains cautiously optimistic about expanding into other markets. He believes that FSD v12 is ready for supervised FSD in left-hand drive (LHD) countries, while right-hand drive (RHD) markets like the UK and Australia may require additional time.