Tesla is creating San Francisco in a simulation to help train Autopilot
Tesla
Tesla may be ramping up how it uses simulation to train its Autopilot system. A report by Electrek asserts that it has sources claiming that the company is concentrating on a reproduction of San Francisco. The article includes an image of the recreation and states that Tesla is working with Real Engine on its simulation.
According to Electrek, the image below is part of Tesla's simulation of San Francisco.
An image of Tesla's San Francisco simulation that was obtained by Electrek
Electrek
Tesla gave the world a look at how it uses simulation to advance the Autopilot program during the first AI Day in August of 2021 (recap).
AI Day
At the first AI Day Tesla talked about the use of using simulations to help train Autopilot. The video below is cued up to where they discuss a simulation.
Ashok Elluswamy, the Director of the Autopilot Program, showed a video that, at first glance, looked real other than an appearance by a Cybertruck. “I may say so myself. It looks very pretty,” said Elluswamy. He explained that the company is investing heavily in using simulation. “It helps when data is difficult to source. As large as our fleet is (FSD Beta users), it can still be hard to get some crazy scenes,” the director explained while showing a rendering of two people and a dog running in the middle of a busy highway. “This is a rare scene, but it can happen, and Autopilot still needs to handle it when it happens,” said Elluswamy.
It appears that Tesla has jumped on Fortnite’s Battle Bus by teaming up with Epic Games and its development platform — Unreal Engine. Fortnite is one of the most popular games of all time, with 80 million subscribers and 4 million daily users, and it was created with Unreal Engine. Epic flexed its creative muscles when it gathered experts to create The Matrix Awakens: An Unreal Engine 5 Experience. The goal was to “blur the boundaries between cinematic and game, inviting us to ask — what is real?” The project spotlight on Unreal Engine shows just how incredibly realistic a simulation can be.
After Elluswamy explained that the company is investing in simulation, it makes sense that Tesla would be hiring several positions with simulation in the job description. Electrek pointed out one posting for Autopilot Rendering Engineer. The posting states the successful candidate “will contribute to the development of Autopilot simulation by enabling and supporting the creation of photo-realistic 3D scenes that can accurately model the driving experience in a wide range of locales and conditions.” Tesla prefers the candidates have experience working with Unreal Engine.
While not new, this does show that Tesla is doubling down on efforts to improve Autopilot. It has recently rolled out Full Self Driving to 60,000 more users, bringing the FSD Beta program to 160,000 in North America.
We can only guess how many thousands of simulations the Autopilot team is conducting to add to the data the Beta testers are collecting. It seems unlikely that Tesla has only created the City by the Bay in its simulations. Perhaps Elluswamy will show more renderings at the second AI Day on September 30th.
Tesla appears to be planning an ambitious project to build a private 5G network. This initiative would revolutionize connectivity for its vehicles and the robot, Optimus, as well as any other plans the company is likely to develop in the future.
Innovative Job Posting Reveals Big Plans
Although now removed, a recently spotted job posting for a Cellular Systems Integration Engineer on Tesla's career page shed light on the company's intentions. The role demands expertise to elevate Tesla's vehicle and Optimus robot connectivity, promising to push the boundaries of low latency and high data rates.
Tesla's journey from 3G to the anticipated 5G upgrade will bring about ultra-reliable communication and high-speed data transfer, crucial for over-the-air software updates, autonomous driving features, and real-time data analytics. These communications could be product to product, such as vehicles communicating with each other or with other products such as Optimus. However, the job posting also talks about products being able to communicate with Tesla’s internal 5G network. It’s not clear whether the private network would be internal such as at a Gigafactory, or a broader network out in the world.
Tesla is pursuing an internal 5G network for product communication
The Strategic Role of Private 5G Networks
Deploying its private 5G network, Tesla aims to create a seamlessly connected environment in its manufacturing facilities, research labs, and outdoor spaces. This infrastructure is not just about enhancing vehicle connectivity; it's also pivotal for the operational efficiency of the Optimus robot in various scenarios, including warehouse operations.
Tesla's foray into private 5G networking places it in an advantageous position in the automotive and tech industries. This strategic move aligns with the global trend towards adopting private 5G networks, which promise to revolutionize industries with their reliability and speed. Tesla's efforts to develop a private 5G protocol stack that integrates with any cellular infrastructure globally will set new industry standards.
With 5G, Tesla vehicles and Optimus robots will benefit from significantly reduced latency, offering under 5 milliseconds compared to the 60-98 milliseconds of 4G networks. This technological advancement is expected to enhance the functionality and responsiveness of Tesla's products, paving the way for advanced autonomous driving capabilities and efficient robot operations.
Tesla's interest in developing a private 5G network is a logical step. By building an infrastructure that supports the fastest connectivity standards, Tesla is preparing for its vehicles and laying the groundwork for sophisticated robotics applications. This endeavor reflects Tesla's ongoing commitment to innovation and its role in shaping the future of transportation and automation.
Italy has been discussing with Tesla about potentially establishing a factory producing electric trucks and vans. This information came to light in an Italian media outlet, Il Sole 24 Ore, which reported that the Ministry of Business and Made in Italy (Mimit) spearheaded talks to secure Tesla's investment.
Tesla and Italy: A Strategic Dialogue
Since last summer, Italy has broadened its industrial horizons by engaging in talks with Tesla, alongside negotiations with prominent Chinese manufacturers such as BYD, Great Wall Motors, and Chery Automobile. Notably, the discussions with Tesla have centered around producing electric commercial vehicles, highlighting a departure from conventional car manufacturing and reflecting the evolving demands of the global market.
Under the leadership of Minister Adolfo Urso, Italy aims to invigorate its automotive sector by encouraging the presence of multiple manufacturers. This approach is designed to stabilize the national components sector, which faces challenges due to the shift towards electric vehicles. Italy aims to produce 1.3 million vehicles annually, including a significant contribution from a new yet-to-be-determined manufacturer.
A Geopolitical and Industrial Balancing Act
Italy's engagement with Tesla occurs amidst a delicate phase of negotiations with Stellantis for increased vehicle production within the country. This strategic dialogue with Tesla, alongside discussions with Chinese competitors, is a pivotal element in Italy's industrial and geopolitical maneuvering.
A multipurpose van is the next logical step for Tesla to produce once the less expensive next-gen platform is released (code name Redwood). However, engineers seem to be busy perfecting the next-gen Roadster, and the van has had little discussion. Given the company's leaks, if a van were in the works, you would think we would’ve heard about it. Perhaps this is the nudge Tesla needs to get the van into production.
As Italy endeavors to become a key player in the electric vehicle industry, its negotiations with Tesla signify a promising development. The possibility of Tesla establishing a facility for electric trucks and vans in Italy underscores the country's commitment to sustainable transportation and positions Italy as an attractive destination for automotive innovation.
TeslaFi logs your drives and charging sessions, letting you keep a log of your vehice's activity. We highly recommend checking them out if you use your car for business trips and would like to keep track of reimbursements, if you like to see how much you spend on charging or if you just love statistics. Visit their site and see everything they have to offer!
Tesla Android Project enables you to run Android apps in your Tesla. The platform is Open Source and you can deploy it on your own Raspberry Pi 4. Consider supporting the initiative by donating or purchasing the Compute Module 4 Bundle that delivers the best experience. Get $20 off by using the code: NotATeslaApp
The official Tesla app only notifies you if your car is broken into. By installing Sentry Pro on your phone, you will be notified for all Sentry Mode events. Stay connected and avoid potential surprises by receiving notifications. Stop constantly checking the cameras to ensure safety. Check only when necessary, save battery and get peace of mind. Get a 7 day free trial here!
Stay organized, connected, and stylish with Cyberbackpack — the #1 backpack, luggage & travel accessories for Tesla owners. We highly recommend checking them out if you commute or travel and would like a backpack or luggage that is sleek, secure and durable. View their products page and see everything they have to offer!