AI Day: Tesla FSD Hardware 4.0

Tesla spent a good part of AI Day talking about their big improvements in vision and AI where they’ve been making amazing progress as shown with some of the latest FSD Betas. They also talked about Dojo, their new supercomputer used for AI which will become operational next year. They even announced a humanoid robot, Tesla Bot.

However, one thing that wasn’t part of the official event, but we were able to find out more in the questions and answers portion of the event is Tesla’s FSD hardware 4.0 computer.

Tesla released FSD hardware 2.5 in 2017 and hardware version 3.0 was introduced in 2019. So we’ve been expecting an updated version of the FSD computer for a little while now.

All of Tesla’s vehicles today include Tesla’s hardware 3.0 computer, including the newly designed Model S. Normally, you’d see companies shy away from talking about new hardware that wasn’t part of the event, but Tesla had no problem answering questions about a possible new FSD computer.

When asked if there was a new FSD computer on the horizon, Elon Musk said that he expects the current hardware to be capable of autonomous driving safer than a human, but of course Tesla wants to continue expanding and improving so they’re always developing more powerful computers.

Elon guessed that we may see hardware 4.0 next year with the introduction of the Cybertruck. He hinted at hardware 4.0 providing about 4x the compute power of hardware 3.0. For those of you with Cybertruck reservations, this makes that vehicle even more exciting.

In another question related to new hardware, Elon also said that Tesla is looking into new cameras. He was clear that the current cameras aren’t a hindrance, but if they can think they can do better, then they would. He didn’t go into details whether this would be tied to the Cybertruck or hardware 4.0, but it seems likely. He also didn’t mention specifically whether they would be higher resolution, larger sensors, or possibly even better placement on the vehicle.

It’s been shown before that although the current camera placement on Teslas today allow for human-like capabilities and provide a similar view as a human being in the driver seat, it could be further improved by having cameras placed near the headlights looking off to the side.

Although it could be disappointing for some to see new hardware announced so soon after they bought a hardware 3 equipped vehicle, Tesla needs to continue advancing and new hardware may not necessarily provide new capabilities, but introduce a higher level of safety.

Follow

Follow

Follow

Tesla is Creating a Voice Assistant to Replace Voice Commands [Example of Voice]

It looks like Tesla may soon be replacing its archaic voice commands with something much more useful — a voice assistant.

Greentheonly, who often takes deep dives into Tesla software by decompiling the firmware and looking for changes, has now found the early integration of a voice assistant.

Voice Assistant Already Available in China

Tesla has already replaced its voice commands in China with a voice assistant that can not only control certain aspects of the vehicle using more natural language but can also answer common knowledge questions such as the current weather, stock quotes and more (video below).

Tesla Creating Own Assistant

According to Green's findings, it looks like Tesla may be rolling its own solution instead of integrating something like Amazon Alexa like Rivian has. Tesla created their own solution in China by using some of their own technology and several existing software solutions. However, some of them are only available in China so they don’t scale to support additional regions.

Grōk

The first thought that comes to mind is Tesla leaning on AI efforts by Grōk and xAI, which could help it support common knowledge questions and search the web for answers. However, that only gets Tesla partly there, as Alexa and Google Assistant already support a large ecosystem, one that may not be available if Tesla creates their own voice assistant. With Tesla’s solution, a driver may be limited to what devices they can control through the voice assistant, at least initially. Either way, just a more natural way to activate certain vehicle solutions will be an improvement over what’s available today. The ability to ask the assistant common questions will be the icing on top.

Wake Word

According to Green, the source code hinted at the voice assistant using a wake word, which would replace the need to press the scroll wheel on the steering wheel. Tesla has begun to use the left scroll wheel button for additional things lately such as wiper controls and a multi-function mode, so this may fit in with their plan.

It’s fun to speculate what the wake word would be or whether Tesla would add the ability to create your own. It could be something as simple as ‘Hey, Tesla’, ‘Grok’, or something more humorous as Tesla has a knack for. Unfortunately, there weren't any hints on what the actual wake word would be, but being able to set a destination, play a specific song or ask the assistant for the weather will be a much-needed improvement.

Supported Models

It's not clear which models Tesla would support a voice assistant, but with the release of software v12 with update 2024.14.3, Tesla is starting to leave more features out of older Intel-based vehicles. While a voice assistant may not necessarily be computationally heavy, it may depend on Tesla's implementation and whether voice commands are transcribed on device or carried over the internet for transcription.

Voice Model

In the software, there are references to Microsoft's text-to-speech technology and specifically to a voice named “Jenny Neutral.”

The “Jenny Neutral” voice seems like an acceptable voice, bringing a natural-sounding voice to Tesla's voice assistant, although it doesn't differ much from what you find on other assistants. You can view an example of Microsoft’s “Jenny Neutral” voice in the video below.

Tesla has been more mindful lately about adding information for unreleased features to its software to help prevent leaks, so by the time something like this is found by Green, it usually doesn't take long before it becomes available, although this could also make for an exciting Christmas present.

Follow

Follow

Follow

Tesla Hints at Support for Amazon Music Streaming in Update 2024.14.3

Thanks to Tesla hacker Greentheonly, it looks like Tesla will soon offer a native experience for Amazon Music in their cars.

Green decompiled Tesla's latest update, version 2024.14.3, and found references to Amazon's music service, Amazo Music.

In this same update, Tesla added Audible playback, the audiobook service Amazon bought back in 2008.

For Tesla to add support for these music services, they need to have access to APIs that are provided by the music provider. Like everything else, there's likely a deal Tesla and Amazon struck, not only for Audible which was released in this update, but also for Amazon's other services. Given that there are already references to Amazon Music in 2024.14.3, it may not be long before we see the service launch in an upcoming update.

Prime Video 

Although Green doesn't mention any references to Amazon Prime Video specifically, it's possible we may see that service added as well. Tesla's Theater "apps," are essentially links to a browser without the user interface, so detecting references for Amazon Prime Video would be more difficult to discover in Tesla's source code. Since Tesla already implemented Audible and there are now hints of Amazon Music, it’s looking like we may see support for Amazon Prime Video as well.

Not the First Time Tesla Has Hinted at Amazon Music

Back in 2020, we saw Tesla add hints of supporting Amazon Music, although the code was scrapped in a later revision. The same source code in 2020 had references to Pandora, Audible and Apple Music. Since then we've seen Tesla add support for two of those services, with Pandora being the only one left out.

Top Music Services in the World

According to Exploding Topics, Amazon Music is the fourth most popular music service in the world as of February 2024 with a 13.3% share of the market. Number one is not surprisingly Spotify, with Apple Music and Tencent (Chinese music service) taking the second and third spots respectively.

Who Will Get Access

Amazon Music will actually be a great addition, especially if you don't pay for a separate music service like Spotify or Apple Music, but have Amazon Prime.

In the U.S., LiveOne, previously known as Slacker is the default music service that comes for free with Tesla — although Premium Connectivity is still required to listen while driving. Tesla simply calls it "Streaming" in the vehicle since this was named before Tesla had support for multiple music services. Tesla currently supports LiveOne, Spotify, Apple Music, TIDAL, TuneIn and SiriusXM on the Model S and Model X.

Although LiveOne is free, it has several limitations on audio quality, music curation and song selection. It also doesn’t allow you to jump to certain parts of a song.

Amazon Music offers a much more robust solution, so it's expected to be a nice upgrade for owners who already have access to the music service.

If you subscribe to Amazon Prime and get the free version of Amazon Music, it's expected that you'll have access to it in your vehicle without any additional charges, just like you do on your phone and other devices.

Amazon also offers a premium plan for $10 per month that includes higher-quality audio and access to a larger music library. However, we don't believe the premium plan will be required to use the service in the vehicle.

Tesla update 2024.14.3 is currently rolling out to customers around the world, although it could be several weeks before most customers have access.

Follow

Follow

Follow