At Tesla's AI Day event last summer, Elon answered some questions during the Q&A portion of the event that revealed Tesla's plans for FSD hardware.
Elon informally announced that Tesla is already researching the next major hardware revision for full self-driving.
Tesla's camera housing
Elon said that he expects the current hardware in today's vehicles to be capable of "super-human" driving, but Tesla will continue to update their cars to have the most powerful hardware available.
Elon guessed that Tesla may release FSD hardware 4.0 with the introduction of the Cybertruck. Since the Cybertruck won't be released until the end of this year at the earliest, we may even see new hardware before its arrival, although this is unlikely.
In another question related to new hardware, Elon also said that Tesla is looking into new cameras. He was clear that the current cameras aren't a hindrance, but if Tesla can do better, then they will.
Elon didn't go into details about whether the new cameras would be tied to the Cybertruck or hardware 4.0. He also didn't mention specifically whether the new cameras would be higher resolution, contain larger sensors, or possibly even be placed in different locations.
Tesla currently utilizes three separate front-facing cameras in the housing at the top of the windshield. The camera unit contains wide-angle, standard, and narrow view lenses with three separate CMOS sensors.
Each sensor has a resolution of 1280x960 or about 1.2 megapixels.
New Camera
According to Chris Zheng on Twitter, who has connections with some Tesla suppliers, Tesla is planning to use Sony's new IMX490 automotive sensor in their upcoming hardware 4.0 revision.
Wide-angle camera comparison
This new sensor offers many benefits over the current sensors that Tesla uses in their vehicles.
The new sensors support a much higher resolution of 2896x1876. That's 5.4 megapixels compared to the 1.2 megapixels that Tesla's current front-facing cameras support.
At more than four times the resolution of current sensors, these new sensors will allow Tesla to more accurately detect objects that are required for FSD.
Detecting road edges and lane markings that are further away are especially difficult. Due to the angle of the road and the current image resolution, Tesla often has to make assumptions based on just a few pixels.
The increased resolution will offer a more detailed image and should improve the accuracy in these situations.
The new wide-angle sensor may also allow Tesla to drop the number of cameras used in the front-facing module. Due to the higher resolution in these sensors, Tesla may be able to use this wide-angle sensor to interpret objects that previously required the use of the standard or telephoto lenses before. This may allow Tesla to reduce the number of cameras that are required in the front of the vehicle from three down to two or even a single lens.
The new camera sensor also supports HDR shooting at 10 bit and 40 FPS, offering better contrast and richer colors. It's not clear whether Tesla would take advantage of HDR as it would require more power to process, but it's something Tesla may consider depending on the compute power available.
LED flicker mitigation
More importantly, the new sensor will also support LED flicker mitigation. Camera sensors often have a hard time capturing the light emitted from LED lights in a constant fashion. Since LEDs are widely used in electronic signs and traffic lights this will be an important feature and should make it easier for Tesla to interpret such signs.
Tesla is working closely with Samsung to produce their next-generation chips that will be used in FSD hardware 4.0. Tesla will likely launch updated cameras at the same time they introduce a new FSD computer.
It makes sense for Tesla to introduce this new hardware in a new model first before retrofitting new camera modules into existing models.
Like other automakers, Tesla issues vehicle recalls (many involving minor software tweaks) when a
vehicle feature or hardware needs to be changed.
With the release of their latest
app update (version 4.9), Twitter user Tesla_App_iOS, noticed that Tesla added a new API that could potentially show vehicle recall information.
It didn't appear that the Tesla app was yet using this new API, but just a couple days later it can
now be seen in the Service area of the app.
The service section of the app is loaded via a webview, which is essentially a webpage that the app
loads when the user navigates to that section.
This allows Tesla to make changes to that section without requiring an app update to display new
information.
Tesla, along with other car manufacturers, maintains a database of applicable recalls based on the
VIN of each respective vehicle, so Tesla already has all the information needed in order to
display recalls for your specific vehicle.
In the App
The Tesla app can now displayed vehicle recalls
Upon navigating to the Service section, Tesla will list any recalls available for your vehicle.
Tapping an individual recall will give you additional information.
Tesla also has a Learn More button that links off to Tesla's site, where they display detailed
information about the given recall.
Notifications
Since the feature appears to just have gone live recently, it's not clear yet whether Tesla will send
a push notification to the owner when there is a new recall issued.
A notification could prompt the user to schedule service for critical recalls.
What is currently unknown is if software recalls will also be included in the app, or if it'll be
limited to recalls that require Tesla service.
Some software-based recalls, like the removal of Boombox while in drive are displayed in the
vehicle's release notes.
This is a welcome new feature to the Tesla app that makes managing recalls simple and convenient.
You can now easily look at or confirm if there are any outstanding recalls with just a few taps.
The feature is available on iOS and Android.
It looks like this feature may not be available in every region yet, as some users like TeslaChinaRider are not seeing it available in the app yet.
Tesla has a history of testing new features in select markets before releasing it broadly. Hopefully that's the case with this feature as well.
New car models used in FSD Beta 10.12 visualization
mariapazz000/Twitter
The first signs of Tesla's FSD Beta 10.12 finally surfaced
yesterday as Tesla employees started receiving the internal beta.
The internal beta initially had a version of 2022.12.3.10, but
it looks like Tesla has aleady issued an update with version 2022.12.3.15 (FSD Beta 10.12.1).
It's not clear yet whether this will be the exact version that
will be rolled out to public testers or if additional updates will be made.
If Tesla finds any major issues, they'll want to fix them before
rolling out the update to external testers.
New Car Models
New car models
WholeMarsBlog/Twitter
FSD Beta 10.12 introduces new vehicle models for almost every
vehicle type.
Some of the vehicles have been completely redesigned and are
more detailed and realistic looking than the previous models.
For example, a sedan now has wheels, windows and a glass roof,
instead of the previous simplistic look that resembled a Model S keyfob.
New Brake Lights
Although brakes lights were already displayed as of beta 9.0, Tesla is now displaying the third brake light as well, which
has been required in the US since 1986.
Open Doors
FSD Beta 10.12 will now display open doors
WholeMarsBlog/Twitter
FSD Betas have been able to detect and stop or go around
vehicles with open doors for a while now, but Tesla will now show open doors in the
visualization.
When a surrounding vehicle's door is open, the 3D model will
also show the open door and highlight the door in orange.
With this release, FSD Beta now detects and visualizes turn
signals in addition to brake lights.
The car will reportedly react to turn signals it has detected as
well, which should help understand the intentions of other vehicles.
Two Steps Forward, One Step Back
The last major FSD Beta release was version 10.11, which was
first seen more than two months ago.
Tesla has been working on beta 10.12 for a while now and the
amount of changes included in this update are huge according to Elon.
Musk said that due to the amount of changes in this beta, we can
expect two steps forward and one step back.
This is a big one! Expect some two steps forward, one step back
situations. These will be great ironed in point releases, hence ~10.12.2 or 10.13 for wider beta release.
- Elon Musk
There will be some issues, and in certain situations FSD may
have regressed.
Tesla plans to fix any issues that arise with minor revisions to
this release. Expect to see additional FSD Beta 10.12 releases such as 10.12.1 and 10.12.2 in the coming
weeks.
Current Beta Testers
As we have seen with other recent betas, it may be a while until
all current beta testers receive this latest beta.
With beta 10.11, we saw two revisions before the majority of
testers received the beta. We may see a similar situation with this update, given the amount of changes
that were made.
If you're a current beta tester, you may be waiting a couple
weeks before getting this updated FSD Beta.
Additional Testers
There haven't been any signs of Tesla adding additional beta
testers in the US since late 2021.
Elon has previously said that he hopes that Tesla will be able
to add more testers who have opted in to the beta and have a Safety Score of 95 or greater in later revisions of beta 10.12.
We have the technical releases notes for FSD Beta 10.12, but
Reddit user asimo3089 did a great job at interpreting the release notes to give us a better
understanding of what Tesla has improved in this update.
1. Your car better understands what is and is not drivable space.
This makes it more confident in easy situations, and more capable in tricky situations. Your car can
also now use medians for difficult left turns, and accelerates quicker to complete turns.
2. Your car now has a better idea of objects blocking camera views.
Creeping should be less scary.
3. Improved path predictions of where other others on the road will
be. This gives your car better decision making for turns.
4. Sounds like: Your car will drive itself to safety much more
smoothly if your car finds itself in a place it shouldn't be. Better problem solving?
5. Your car should better see the lanes on the road, and how many
of them there are, thanks to new data. This gives better turn confidence and path planning during a turn.
6. Your car is now trained on 180,000 new clips related to what
lanes look like.
7. Your car is less likely to panic brake in a yellow light
scenario, and has a better understanding of lane guidance when going through an intersection.
8. Road edges and road lines are now more accurate.
9. Your car now better understands visibility from the cameras,
thanks to 30,000 new video clips of training data.
10. Speeds of motorcycles, pedestrians and cyclists is now more
accurate. Plus, your car now better predicts which direction a pedestrian is walking.
11. Your car is now less likely to confuse a parked car and an
idling car thanks to 41,000 new clips of training data. This should result in fewer "phantom brakes" or
silly lane changes.
12. Your car now better understands objects that are far away from
you.
13. Your car will plan a better path around vehicles with car doors
open.
14. Objects that are not pedestrians, cyclists, etc, should have
more accurate speed predictions.
15. When changing into an adjacent lane, your car will look further
ahead at vehicle speeds. If somebody up ahead is braking, your car will handle it more
comfortably.
16. Your car used to only predict acceleration (Not speed) for
objects moving adjacently. Now your car will predict acceleration of all moving objects including
objects accelerating across your path.
17. New 3D models for vehicles on your screen. You'll also be shown
vehicles with their doors open.
18. Tesla retired a few old systems and gained 2 frames per second,
per camera, resulting in better performance while self driving.
FSD Beta 10.12 is currently only available to employees, but we
may see a wider release in the next couple days that includes public testers.
However, it could be several weeks before all current testers
receive this update.
More details will surely be uncovered about this beta in the
next few days. Stay tuned for more.
TeslaFi is a service that logs your drives and charging sessions so that you can later refer back to them. We highly recommend checking them out if you use your car for business trips and would like to keep track of reimbursements, if you like to see how much you spend on charging or if you just love statistics. View their about us page and see everything they have to offer!
DIMO is building a web3, user-owned network dedicated to supporting the next generation of mobility infrastructure. As a user, you can start today by accessing the best connected vehicle experience via the DIMO Mobile App. It works for nearly any vehicle and across any OEM; users are in control of their data and their DIMO wallet is a conduit to other apps and services, saving time and money. Learn more
Find out how to become a sponsor and have your site listed here.
Although we share official Tesla release notes, we are not affiliated with Tesla Motors. We are Tesla fans and supporters.
_300w.png)
