Sentry Mode, Tesla's camera-based car alarm and surveillance system, allows the vehicle to detect potential threats near the vehicle.
When Sentry Mode is enabled it records from four different cameras when the vehicle detects someone near the vehicle or an intrusion.
Although the feature is fantastic and has caught many situations when damage has been done to the vehicle, it can also lead to dozens of recordings when there is no threat at all. This is especially true if its raining, which can trigger Sentry Mode events, or if the vehicle is parked on a busy street with a lot of foot traffic.
With update 2022.44.2 Tesla is introducing two new features to Sentry Mode in some markets. Depending on your region, you'll either get the ability to disable camera-based detection or the ability to disable camera-based detection and the ability to adjust the length of each clip.
Camera-Based Detection
The first is the ability to turn off camera-based detection so that Sentry Mode will only save recordings that are triggered by intrusion, such as a glass breaking, a door opening, or the vehicle's tilt sensor being triggered (only available in some markets).
Turning off Sentry Mode recording when the cameras detect someone near the vehicle will greatly reduce the number of recordings, however, it could also lead to some threats going undetected.
Sentry Mode Clip Length
Tesla is adding improvements to Sentry Mode
Not a Tesla App
The second new feature of Sentry Mode is the ability to adjust the length of a recorded event. Once a potential threat is detected, Sentry Mode will record for the next several minutes unless additional threats are detected. The number of minutes that Sentry Mode records after a threat has been static up until now. With 2022.44.2, you'll now be able to adjust the length of each Sentry Mode clip.
This feature is currently limited to many parts of Europe. Tesla's release notes for those receiving both Sentry Mode improvements read as follows:
Sentry Mode now allows for even greater customization, including:
- Camera-Based Detection, which allows users to disable use of cameras to detect threats.
- Sentry Mode Clip Length, which allows users to specify the length of the clip when a potential threat is detected.To adjust these Sentry Mode settings, tap Controls > Safety > Sentry Mode.
Other Improvement Coming?
Two other Sentry Mode features have been rumored in the past when Elon Musk responded to users on Twitter.
While there is no guarantee that these features will be implemented, in general, it does show that Elon Musk thinks they're a good idea and he'll likely share them with the team. The outcome of whether these features get added largely depends on the feasibility of implementing such features, Tesla's roadmap, and the effort required to develop them.
Also in 2020, Elon replied to a user on Twitter suggesting that Tesla would allow an 'incognito' Sentry Mode. The goal is to not let perpetrators know that they're being recorded, although there could be potential legal ramifications to adding such a feature.
In update 2022.24 Tesla added the ability to disable Sentry Mode sounds when an intrusion is detected. This could have been Tesla's compromise when trying to create an incognito mode. Although the car will no longer make any audible noise, it will still flash its lights and display the Sentry Mode logo on the screen letting individuals know that they're being recorded.
Tesla recently added Sentry Mode support in Israel and expanded the countries where Sentry Mode Live Access is available. The feature is now available to users in Hong Kong, Taiwan, Australia, New Zealand, South Korea and Singapore.
While we haven’t even seen AI5, Tesla is already thinking about its next set of chips that will power Tesla’s future FSD computers. In a set of posts on X, Elon Musk outlined the future of Tesla’s AI hardware, stating that its “strategic importance is hard to overstate.” He also revealed that Samsung, the current manufacturer of Tesla’s AI4 chip, will produce the next-generation AI6 chip at a new, dedicated fabrication facility in Texas.
While AI4 is already used in Tesla’s Robotaxis, which are practically driving autonomously, it’s hard to imagine where the company will be with a computer that’s many more times as powerful. Things like the recent video of a Tesla stopping at a toll booth, waiting for the driver to pay, and then taking off will become commonplace, not only at booths but also in various nuanced scenarios, such as someone waving you by, or stopping for a friendly neighbor that waves you down.
Samsung’s giant new Texas fab will be dedicated to making Tesla’s next-generation AI6 chip. The strategic importance of this is hard to overstate.
Samsung currently makes AI4.
TSMC will make AI5, which just finished design, initially in Taiwan and then Arizona.
To understand the need and brilliance behind why Tesla is doing what it's doing with AI6, we need to take a look at the problem it is being engineered to eliminate. Currently, Tesla, like many others, faces a real two-language problem in its AI development.
The vast majority of its AI training is done on a supercomputer cluster, Cortex, which is built around Nvidia’s powerful H200 GPUs. However, the vehicles that run the software use Tesla’s custom-designed hardware - HW3/AI3 or HW4/AI4. This means that every time the AI model is improved - whether the vision neural nets or the ones that determine distance, or any of the many little parts that come together to build FSD as a whole - there’s a whole second step. It must be developed and validated on Nvidia’s architecture, then rebuilt and re-validated to run on Tesla’s own AI hardware.
Tesla runs AI4 chips side-by-side with the H200 GPUs in Cortex to minimize this, but that still means there is a step in between the training getting completed and the actual model being able to run on a vehicle. This slows down the feedback loop from training to deployment, even if Tesla has built a Universal Translator to help move FSD from one piece of hardware to another.
AI6 Solution: One Chip to Rule Them All
AI6 is the definitive solution to this problem. While the upcoming AI5 chip (to be made by TSMC) represents a performance leap over AI4, AI6 will be a transformative leap in architecture.
The key innovation of AI6 is the direct integration of Tesla’s Dojo Supercomputer chip architecture into the same hardware that will be in Tesla’s vehicles and Optimus. The goal is to closely integrate the training and vehicle hardware.
By having the same Dojo architecture in the data center for training and in the vehicle for inference, Tesla will have a single, unified hardware pipeline. The two-language problem vanishes, drastically simplifying Tesla’s development process and enabling a much faster pace of innovation and updates.
Manufacturing Collaboration
The plan for AI6 goes beyond just chip design. Elon’s announcement revealed that Tesla plans to build a strong manufacturing partnership with Samsung. After all, much of Tesla’s expertise is focused on the machines that build the machines.
Samsung has agreed to allow Tesla to assist in maximizing manufacturing efficiency at the new Texas fab. It’s unusual to see this kind of relationship between the fabricator and the client. Elon doubled down on this - he wants to walk the fab lines to personally accelerate the pace of progress.
Samsung agreed to allow Tesla to assist in maximizing manufacturing efficiency.
This is a critical point, as I will walk the line personally to accelerate the pace of progress. And the fab is conveniently located not far from my house 😃
Tesla isn’t just designing the chip, but helping to make sure it’s made in the most efficient and optimal way possible, all while leveraging Tesla’s experience and Samsung’s fab skills in one facility.
Fully Integrated
Tesla’s AI6 announcements come as a surprise since Tesla is still a year out from releasing AI5, but it shows that Tesla plans to integrate even more of its AI stack. From influencing the manufacturing process of the chip itself to designing a unified hardware architecture for both training and inference, Tesla is building a self-reinforcing ecosystem.
This approach will create a feedback loop that allows for rapid improvement. While AI5 will be a big step up from the current generation, AI6 is revolutionary as it becomes Tesla’s major AI platform.
At the recent X Takeover event this past weekend, two of Tesla’s most important leaders gave in-depth interviews that provided a unique view into Tesla’s path forward and how everything comes together internally.
An interview with Elon Musk laid out the grand vision for Tesla and his other companies, focusing on the ambitious “what and why.” Later, Head of Vehicle Engineering Lars Moravy provided the more grounded, engineering-focused “how,” detailing the immense work it takes to turn the vision into a reality.
What emerged from these conversations was a clearer picture of Tesla’s strategy: a relentless, long-term vision for the future of transportation, AI, robotics, and energy, supported by a world-class engineering team capable of developing the processes to turn these products into a reality.
Robotaxi & Cybercab
For years, the concept of Unsupervised FSD, as well as Robotaxis, has been the focal point of Tesla’s future. In his interview, Elon provided fresh details on the way they expect the business model to work. Tesla plans to operate a fleet where some vehicles are company-owned, while others are owned by customers. This is essentially a combination of Uber and Airbnb, taking a bit of a hybrid approach between the two different styles.
He also went on to confirm that the purpose-built, two-seater Cybercab would complement, but not replace, Tesla’s existing models. This is key, because many have thought that Tesla would end their consumer vehicle sales or drastically reduce them as they transitioned to an AI services company, and became less of a car company. Now, it seems we know that they’ll have a lasting stake in personal car ownership.
The Cybercab, which is a revolutionary vehicle without driver controls, requires an equally revolutionary process to build it. In his interview, Lars Moravy provided the answer and detailed the unboxed manufacturing process that Tesla has been developing.
The unboxed method challenges a century of established automotive assembly by breaking the vehicle down into smaller, parallel sub-assemblies, allowing more work to be done simultaneously. The goal is to drastically shorten the main assembly line, enabling vehicle sections to be built in parallel and come together at the end.
Lars also noted that Tesla has already done the initial batch of crash testing for the Cybercab prototypes, and the vehicle has passed with flying colors. This isn’t surprising for Tesla, which integrates vehicle safety right into the structure of the vehicle, building castings that transfer force away from occupants.
The Semi
While Elon’s interview focused on some of his grander ambitions like Mars colonization, Lars provided some tangible updates on two of Tesla’s most anticipated vehicles.
On the Tesla Semi, Lars confirmed that progress is well underway at the Semi factory in Reno, Nevada. After years of focusing on engineering prototypes to ensure the reliability of a commercial workhorse vehicle, Tesla is now expected to ramp up production by the end of 2025, continuing through into early 2026. The business case for the Semi is crystal clear - build a no-brainer choice for shipping and logistics companies, who need to weigh the initial buy-in and infrastructure costs against operating costs per mile.
The Semi, just like other EVs, absolutely trumps diesel trucks in cost per mile, due to lower energy costs and less maintenance. However, the somewhat hidden advantage here is that truck drivers drastically prefer to drive the Tesla Semi over other diesel trucks, citing things such as better visibility, a smoother ride, and easier driving. These are advantages that could lead to improved employee retention and easier driver recruitment.
Meanwhile, the Semi simply needs to have infrastructure installed at the starting and ending locations for major delivery companies, enabling end-to-end supply chain handover.
The Roadster
Lars also talked about Tesla’s upcoming Roadster, confirming that it’s still in development, with the team preparing for a mind-blowing demo sometime soon. Elon previously hinted at this demo during a visit to the Tesla Design Studio, where he said a mind-blowing demo would be coming by the end of the year.
The goal for Tesla is to make it the last, best driver’s car before the world begins transitioning to full autonomy. Lars also touched on one of the biggest challenges with the Roadster. There is an immense engineering challenge being taken on now - and it's the SpaceX package. This package is set to use cold-gas thrusters to push the Roadster past what is conventionally possible. In fact, just as Elon has previously mentioned, the Roaster may be able to “fly a little.”
Last, best driver’s car
Lars Moravy
You can watch the full interview below. Lar’s portion on the Roadster starts at 26:30.
Optimus: Sustainable Abundance
One of the most ambitious parts of Elon’s vision is the Optimus humanoid robot. He has stated his belief many times that the robotics business could be many times more valuable than Tesla’s entire automotive business, and if it works as planned, it definitely will be.
The current Optimus V3 design is intended for volume production, with Elon foreseeing a future market of billions of humanoid robots - not made just by Tesla, but the market as a whole. That many units could simply eliminate human poverty and usher in an age of sustainable abundance.
That grand vision is built on top of the manufacturing and automation expertise that Lars’ team is pioneering every day. With volume production of Optimus to begin next year, and real work already being done in Tesla’s factories, we may see humanoid robots making a real impact on the lifestyle and livelihood of people within the next few years.
The Unfair Advantage: Getting Sh*t Done
All of these ambitious ideas and products are enabled what what is perhaps Tesla’s true sauce - its unique internal culture of getting sh*t done. Lars’ interview provided us with a rare look inside to see just how it all comes together.
He described working with Elon as unique - the discussions are grounded in physics, and Elon trusts his teams to turn his dreams and ambitions into reality. This, in turn, creates a culture of mutual respect and high expectations.
The collaborative spirit extends to the relationship between engineering and design, which Lars described as highly unusual for the auto industry. Rather than the two teams being hostile to each other, they work together to make bold design and engineering choices, like the Cybertruck, into reality.
Underpinning all of this is what Lars himself calls Tesla’s superpower: in-house automation and manufacturing engineering teams. These teams work to design the machine that builds the machines - innovating and solving problems at a level and speed that is simply not possible when relying on external vendors.
This combination of a relentless long-term vision, alongside a first-principles engineering culture, allows Tesla to take big risks and make big plays that define its future path. While all of Tesla’s timelines are ambitious, these interviews make it clear that the ambitious vision is paired with a concrete and innovative plan for execution.