Tesla's Blueprint for Autonomy: Redundancy, Teleoperators, Hubs

By Karan Singh
Not a Tesla App

Tesla’s ambitions extend far beyond electric vehicles, with the company recently saying its goal is sustainable abundance. However, solving vehicle autonomy and deploying a large-scale Robotaxi network are key steps toward that goal.

Today, FSD Supervised offers a glimpse into what an autonomous vehicle will be capable of, but the journey to truly autonomous vehicles involves several interconnected pillars that are in development.

The FSD Journey

The foundation of Tesla’s ambitions is in FSD, which has been on a long, iterative journey. The end goal for FSD is to power both autonomous vehicles, as well as Optimus, Tesla’s humanoid robot.

FSD’s journey began with FSD Beta, an initial phase of real-world testing and extensive data gathering with real users. The first batch of users were influencers on Twitter and YouTube. Tesla eventually opened up FSD Beta to more owners with their Safety Scores in the United States, and then the program rolled out to Canada. Shortly afterward, the Safety Score requirement was removed, and Tesla offered FSD Beta to anyone who purchased FSD or subscribed to FSD. This process took place over several years.

In Spring of 2024, Tesla removed the Beta label and formally introduced FSD (Supervised). FSD Supervised dropped the vast majority of Tesla’s hand-written code and adopted an approach that relied on end-to-end AI networks. This was an important architectural shift, where AI took over most input and output, meaning that AI was controlling the brake and accelerator for the first time.

With the launch of FSD v12.5, FSD also became a hands-free experience with vehicles with a cabin camera. The steering wheel nag was finally gone.

FSD Unsupervised

Now, Tesla is focused on the Robotaxi - with the ultimate objective of deploying a functional version of FSD (Unsupervised). Tesla is already using FSD Unsupervised for logistical tasks, such as moving vehicles from the production line to the outbound delivery lots at Fremont and Giga Texas. 

Tesla has also been testing FSD Unsupervised in California and Texas, albeit with safety drivers - ahead of the upcoming launch of the Robotaxi Network in Austin. While some reports from analysts like Adam Jonas have mentioned that Tesla intends to remotely supervise the fleet with teleoperators, we expect that the teleoperation will be limited to getting vehicles out of precarious situations and evaluating fleet performance.

FSD’s entire evolutionary process is fuelled by the vast amounts of data gathered from millions of Tesla vehicles on the road, enabling the AI to continuously learn and improve from an unparalleled diversity of real-world encounters. Tesla takes massive swathes of data and then automatically annotates them with key labeling parameters to prioritize for its learning suite.

Computational Hardware

Training and executing these increasingly sophisticated AI models demands immense computing power, both within the vehicles themselves and within Tesla’s growing data centers. In the car, FSD hardware has jumped from HW3 to the current AI4. 

However, with V13 already pushing AI4 to its limits due to the increasingly intensive demands of larger and more complex AI models, the upcoming AI5 hardware is expected to further improve in-vehicle processing by increasing memory and compute power. That’s not to say AI4 won’t be able to achieve autonomy, but AI5 is expected to be safer in the long term due to its increased processing power.

Parallel to in-vehicle hardware is Tesla’s multi-billion dollar investments in its own supercomputing infrastructure. This includes Dojo, Tesla’s custom-built supercomputer specifically designed for machine learning and processing massive amounts of video data. Alongside the still-in-prototype phase Dojo, Tesla has already deployed Cortex 1.0 on the south side of Giga Texas, with Cortex 2.0 just recently announced for the north side. These two facilities are both large-scale GPU clusters and will be responsible for FSD development for the foreseeable future.

Everything Needed for a Robotaxi Network

For a Robotaxi service to be successful and widely adopted, the experience from opening the app to stepping out at your destination must be as seamless as possible for users and highly efficient for fleet operations. This necessitates building an entire ecosystem around the autonomous vehicle and the network.

A core component of this will be inside the Tesla App, in the Robotaxi section. We’ve previously seen some glimpses into the details, including user interaction, ride-hailing, and managing journey preferences. 

Minimizing human interaction and maximizing fleet uptime is key. Robotaxis must be able to sustain themselves effectively - and wireless charging is Tesla’s go-to solution. With the addition of wireless charging to V4 Superchargers in the future, Unsupervised autonomy will be able to expand even further than the current limits - which are based around network hubs that provide two key services - charging and cleaning.

That second key service - cleaning - is another big item. Users won’t mind a less luxurious vehicle if it’s cheaper, but it needs to be clean. Tesla has already shown off its robotaxi cleaning robot, which will be deployed at those network hubs. While this may seem like an ideal job for Optimus, Tesla needs to get its network rolling today - and a single robotic arm specialized to the task could be cheaper and faster than employing a humanoid robot. Although, you can bet that Tesla is already thinking about Optimus for such a role in the future.

Beyond the user-facing aspects, Tesla will need to have a sophisticated fleet management and operational logistics hub. For Tesla, this means intelligent dispatch algorithms, utilizing real-time fleet monitoring, predictive scheduling for times of use, charging, and maintenance, as well as a degree of teleoperation or supervision for critical incidents.

The Vehicle

The physical vehicle itself is, of course, a critical element in this entire plan. The vehicle itself needs specific attributes that can enable safe and reliable autonomous operation. Tesla has remained steadfast in their vision-only approach, and have demonstrated that processing data from cameras, much like the human eyes, is the most scalable path to achieving general autonomy.

For Unsupervised autonomy, especially in a commercial robotaxi service, robust hardware redundancy is non-negotiable. While today’s Teslas already offer backup solutions for many critical systems such as braking and steering, redundant FSD computer nodes can help to make sure the vehicle can maintain control or even pull over to reach a safe area in the event of a critical incident.

While Tesla intends to begin its Robotaxi pilot with the Model Y, the upcoming Cybercab is expected to host two AI4 FSD computers, which will increase FSD’s redundancy and improve the safety margin. The Cybercab, unlike many other Robotaxi-esque vehicles, is being engineered from the ground up specifically around Tesla’s Robotaxi service. It’s optimized for low-cost manufacturing, high utilization, and durability while also being easy to maintain, charge, and clean.

Regulation and Trust

Solving autonomy extends far beyond just software or engineering innovations. It also involves navigating a complex and evolving regulatory landscape. Gaining approvals for fully autonomous commercial operations from authorities like the National Highway Traffic Safety Administration (NHTSA) at the federal level, as well as various state and local bodies, is a significant and ongoing challenge for Tesla.

Winds have changed in the United States for autonomy with new federal autonomous vehicle frameworks looking to standardize the rules and regulations for autonomous vehicles. These frameworks are just the start to actually getting laws in-place that will allow for the operation of Robotaxis outside of smaller jurisdictions.

Equally important is building public trust and acceptance. While people who use FSD swear by it, the average vehicle owner in North America will still be utterly awestruck or panic when they see a Tesla being Summoned from its parking spot to the curb. 

Building trust is essential - because nobody will step into a vehicle without a driver and without any means of controlling it unless Tesla can demonstrate consistent safety. That consistent safety must be drastically better than human drivers, and Tesla must be transparent with how it reaches its safety milestones in order to encourage the adoption of autonomous ride-hailing.

Tesla’s approach to autonomy is a vertically integrated strategy that touches every aspect of the challenge - from the fundamental AI software and custom silicon that powers it to the massive processing infrastructure, the physical vehicle hardware, and the entire operational ecosystem required for a future Robotaxi service.

While there will no doubt be challenges, this June, Tesla starts its journey toward an autonomous future.

Tesla Launches New Monthly Extended Service Agreement With Longer Coverage

By Karan Singh
Not a Tesla App

Tesla has introduced a new, more flexible and affordable way for owners to get peace of mind after their factory warranty ends. This new service is a monthly subscription that replaces the previous Extended Service Agreement (ESA) in the United States.

The new subscription model makes it more appealing to owners, as it avoids a large upfront payment. This new subscription also offers better coverage terms than before.

Longer Coverage, Better Flexibility

The biggest upgrade in this new format of the ESA is the length of the coverage. The old prepaid ESA was limited to just two years or 25,000 miles beyond the factory warranty, for a total of up to 75,000 miles.

The new monthly program doubles the potential coverage period, offering protection for up to four additional years beyond the factory warranty, or until the vehicle reaches 100,000 miles, whichever comes first. Coming from a basic vehicle warranty of 4 years or 50,000 miles, this is a huge jump up in customer protection.

Pricing & Deductible

The monthly price is simple, but it varies depending on the model. The Model 3 is the most affordable at just $50 per month, while the Model X is the most expensive at $150 per month.

  • Model 3: $50 / month

  • Model Y: $60 / month

  • Model S: $125 / month

  • Model X: $150 / month

However, Tesla will also charge a $100 deductible for each service visit that covers an included repair, on top of the monthly subscription fee.

Exclusions

The ESA is an exclusionary warranty, meaning it covers the repair or replacement needed to correct a failure of most parts manufactured or supplied by Tesla. However, there are some parts not covered under the ESA, which include:

  • High Voltage Battery

  • Drive Unit

  • 12V/16V Low Voltage Battery

  • Bodywork

  • Paint

  • Glass

  • Charging Equipment

  • Wear & Tear Items (cabin air filters, brake pads, tires, etc.)

  • Issues arising from accidents, modifications, or environmental damage

Essentially, the ESA is designed to cover the components other than the drivetrain. That includes the touchscreen, computers, heat pumps, suspension, or other non-drivetrain electronics that aren’t covered after the 4-year basic warranty.

Tesla vehicles come with an extensive battery and drivetrain warranty that covers these items for up to 8 years. The maximum mileage varies by model. RWD Model 3 and Model Ys are covered for the first 100k miles, while Long Range Model 3s and Ys are covered up to 120k miles. The Model S and Model X are covered for up to 150,000 miles or 8 years.

Eligibility and Sign-Up

Eligibility for the new ESA subscription is pretty clear-cut.

Your vehicle must be within its 4-year / 50,000-mile Basic Vehicle Limited Warranty. Tesla will send customers whose basic warranty is about to expire a notification approximately 3 months before the time-based expiry.

The subscription is not available for leased vehicles or vehicles that were purchased used. Tesla plans to offer eligibility to customers who purchase their vehicle at the end of a lease by the end of 2025, and for used vehicle customers in the near future.

The Cybertruck, due to its relatively newness to the market, doesn’t have access to the ESA quite yet - but it will be coming “in the near future.” For Canada and Mexico in particular, the ESA is not yet available, but Tesla has confirmed plans to bring this subscription to other regions soon.

Subscribing is done through the Tesla App. Tap Upgrades > Service Plans > Extended Service Agreement. Once you review the terms and the monthly fee, you can then hit Subscribe and confirm your payment information.

If the ESA is not visible, your vehicle is not eligible for the subscription.

Payments for the ESA only begin once your original warranty has expired. However, you can sign up at any time, and payments will automatically start when your factory warranty expires.

Other Service Plans

Tesla also offers a Windshield Protection Plan and a Wheel and Tire Protection Plan, if you didn’t already know. Both of these plans are subscription-based and are currently only available in the United States. However, Tesla has indicated that it plans to expand to other regions in the near future.

Tesla Sends Out Robotaxi Ride Invites — Robotaxi App, Safety Monitor and More Details

By Not a Tesla App Staff
@ItsKimJava

Tesla is officially opening up its long-anticipated Robotaxi service — but only for a select, invite-only group. Invitations have gone out to influencers to experience the first autonomous rides this Sunday, June 22, in Austin. Dubbed an “early access” program, this marks the official launch of Tesla’s Robotaxi service and the new Robotaxi app.

Invitation Details

Tesla is taking a cautious approach to its initial rollout. Only invited users — largely influencers and carefully selected individuals — will get to hail a ride using the new Robotaxi app. These early testers will be among the first to experience what Tesla describes as a fully autonomous ride, although not entirely without human oversight.

The invitations were sent out early this morning and offered plenty of new details about the Robotaxi service, the app and ride restrictions.

Human Safety Monitors

Elon Musk previously stated that there would be “no occupant in the driver seat,” and while that’s technically accurate, it’s not exactly what we expected. These Robotaxi rides will have a Tesla employee seated in the front passenger seat. This “safety monitor” will oversee the ride but not intervene unless necessary.

Interestingly, the documents shared with influencers indicate that these safety monitors will be subject to the same restrictions as Tesla owners with FSD Supervised. The cabin camera will monitor their gaze to make sure they’re paying attention and presumably warn them if they stare off to the side for too long.

Teleoperators

While there will be safety monitors in the vehicle, there are also expected to be teleoperators. Although Tesla doesn’t explicitly mention teleoperators, it does note that the cabin camera will only be used in the event of a support request or if “operator assistance” is required in an emergency.

Teleoperators aren’t a surprise at all, as all autonomous vehicles use them today when a vehicle needs help. While in the case of a Model Y, it’s possible for the safety monitor to take over the vehicle, Tesla is preparing for the future when there won’t be a safety monitor in the vehicle and the vehicle doesn’t have a steering wheel like the Cybercab.

Cabin Camera and Mic: Off By Default

Passenger privacy appears to be a priority. Tesla confirms that the cabin camera and microphone will be off by default during the ride. These features will only activate if the rider opts in, requests assistance, or in the case of an emergency. This appears to contradict what Tesla mentions about the cabin camera monitoring the safety driver, but it’s possible Tesla means that these features will be off by default when there isn’t a safety monitor in the vehicle.

Similar to Tesla vehicles today, Tesla will show green and orange dots on the display whenever the cabin camera or microphone is being used.

Tesla says that after the ride, the camera may be temporarily activated to check for cleanliness or forgotten items before the vehicle continues to its next destination.

Will React to Emergency Vehicles

While we know that these vehicles will be equipped with a newer version of FSD, it’s not yet clear exactly which version it's. However, it appears that this version will now feature sound detection, allowing it to detect and react to emergency vehicles.

Tesla says the vehicles will use the vehicle’s microphone to recognize sirens or other road alerts. If a safety event is detected, the vehicle will reduce media volume and notify users on screen.

Like Tesla’s vision processing, all audio is processed in the vehicle and not transmitted unless explicitly enabled by the rider.

Recording and Sharing Encouraged

Tesla is allowing invited guests to bring one additional guest with them to experience the Robotaxi network. Tesla will be allowing the recording and sharing of photos and videos, so we should have plenty of new details on the Robotaxi soon.

Tesla is also asking users to rate their experience via the Robotaxi app, likely trying to identify any trouble points.

Restrictions for Robotaxi Rides

Tesla’s Robotaxi service will operate within a geofenced area of Austin and will be available between 6:00 AM and 12:00 AM. So, essentially, there are only six hours when Robotaxis won’t be available. Tesla states that users will be able to see the geofence area within the app; however, we currently don’t know the size of this area.

Airport rides are not allowed, presumably due to more complicated scenarios. Tesla also states that the Robotaxi service can be paused at any point due to inclement weather; however, the forecast for Austin over the next week is clear and sunny, so this is unlikely to be an issue.

Pricing and Fees

Tesla’s agreement states that all rides will be priced in U.S. dollars and may include tolls, airport fees, and other regulatory charges. It’s not clear whether invited guests will need to pay for rides, but since Tesla is mentioning prices and doesn’t explicitly state that these rides are free, they’ll likely have to.

We may soon find out what Tesla will charge for Robotaxi rides and compare it to other services, such as Uber and Lyft. However, like all other Tesla pricing, these will likely change over time as well.

Tesla reserves the right to charge users for damages or litter left in the vehicle, according to documents shared with influencers.

Robotaxi App, Not the Tesla App

One of the more surprising revelations is that Tesla is not using the Tesla app for this service. Instead, riders will be required to download a new Robotaxi app. While code related to Robotaxi features has been found in Tesla’s main app, it now appears that the Robotaxi app will serve ride-hailing passengers.

The Robotaxi details we’ve seen in the Tesla app may be for future support when owners start adding their vehicles to the Robotaxi fleet. This way, an owner can open up the Tesla app and know the status of their vehicle.

The Robotaxi app won’t be publicly available on the App Store yet. Instead, invitees will receive a separate download invitation, likely through a service like TestFlight, which allows users to test unreleased apps. Tesla emphasizes that only the original invitee can download and use the app, but hopefully, we’ll have our first look at the Robotaxi app soon.

What’s Next

While this represents a soft launch for Tesla’s Robotaxi service, it offers our first glimpse at what the service will be like in terms of restrictions, geo-fenced areas, price, and, of course, a look at the Robotaxi app. Like all things Tesla, they’ll iterate and improve the app, service, and process over time.

We should have a lot more details and the first ride-along videos soon.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

More Tesla News

Tesla Videos

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter