Tesla's FSD hardware 4.0 to use cameras with LED flicker mitigation

By Nuno Cristovao

At Tesla's AI Day event last summer, Elon answered some questions during the Q&A portion of the event that revealed Tesla's plans for FSD hardware.

Elon informally announced that Tesla is already researching the next major hardware revision for full self-driving.

Tesla's camera housing
Tesla's camera housing

Elon said that he expects the current hardware in today's vehicles to be capable of "super-human" driving, but Tesla will continue to update their cars to have the most powerful hardware available.

Elon guessed that Tesla may release FSD hardware 4.0 with the introduction of the Cybertruck. Since the Cybertruck won't be released until the end of this year at the earliest, we may even see new hardware before its arrival, although this is unlikely.

In another question related to new hardware, Elon also said that Tesla is looking into new cameras. He was clear that the current cameras aren't a hindrance, but if Tesla can do better, then they will.

Elon didn't go into details about whether the new cameras would be tied to the Cybertruck or hardware 4.0. He also didn't mention specifically whether the new cameras would be higher resolution, contain larger sensors, or possibly even be placed in different locations.

Tesla currently utilizes three separate front-facing cameras in the housing at the top of the windshield. The camera unit contains wide-angle, standard, and narrow view lenses with three separate CMOS sensors.

Each sensor has a resolution of 1280x960 or about 1.2 megapixels.

New Camera

According to Chris Zheng on Twitter, who has connections with some Tesla suppliers, Tesla is planning to use Sony's new IMX490 automotive sensor in their upcoming hardware 4.0 revision.

Wide-angle camera comparison
Wide-angle camera comparison

This new sensor offers many benefits over the current sensors that Tesla uses in their vehicles.

The new sensors support a much higher resolution of 2896x1876. That's 5.4 megapixels compared to the 1.2 megapixels that Tesla's current front-facing cameras support.

At more than four times the resolution of current sensors, these new sensors will allow Tesla to more accurately detect objects that are required for FSD.

Detecting road edges and lane markings that are further away are especially difficult. Due to the angle of the road and the current image resolution, Tesla often has to make assumptions based on just a few pixels.

The increased resolution will offer a more detailed image and should improve the accuracy in these situations.

The new wide-angle sensor may also allow Tesla to drop the number of cameras used in the front-facing module. Due to the higher resolution in these sensors, Tesla may be able to use this wide-angle sensor to interpret objects that previously required the use of the standard or telephoto lenses before. This may allow Tesla to reduce the number of cameras that are required in the front of the vehicle from three down to two or even a single lens.

The new camera sensor also supports HDR shooting at 10 bit and 40 FPS, offering better contrast and richer colors. It's not clear whether Tesla would take advantage of HDR as it would require more power to process, but it's something Tesla may consider depending on the compute power available.

LED flicker mitigation
LED flicker mitigation

More importantly, the new sensor will also support LED flicker mitigation. Camera sensors often have a hard time capturing the light emitted from LED lights in a constant fashion. Since LEDs are widely used in electronic signs and traffic lights this will be an important feature and should make it easier for Tesla to interpret such signs.

Tesla is working closely with Samsung to produce their next-generation chips that will be used in FSD hardware 4.0. Tesla will likely launch updated cameras at the same time they introduce a new FSD computer.

It makes sense for Tesla to introduce this new hardware in a new model first before retrofitting new camera modules into existing models.

Tesla Advances with 5G: A Future of Enhanced Connectivity for Cars and Robotics

By Kevin Armstrong
Tesla building 5G private network
Tesla building 5G private network

Tesla appears to be planning an ambitious project to build a private 5G network. This initiative would revolutionize connectivity for its vehicles and the robot, Optimus, as well as any other plans the company is likely to develop in the future.

Innovative Job Posting Reveals Big Plans

Although now removed, a recently spotted job posting for a Cellular Systems Integration Engineer on Tesla's career page shed light on the company's intentions. The role demands expertise to elevate Tesla's vehicle and Optimus robot connectivity, promising to push the boundaries of low latency and high data rates.

Tesla's journey from 3G to the anticipated 5G upgrade will bring about ultra-reliable communication and high-speed data transfer, crucial for over-the-air software updates, autonomous driving features, and real-time data analytics. These communications could be product to product, such as vehicles communicating with each other or with other products such as Optimus. However, the job posting also talks about products being able to communicate with Tesla’s internal 5G network. It’s not clear whether the private network would be internal such as at a Gigafactory, or a broader network out in the world.

Tesla is pursuing an internal 5G network for product communication
Tesla is pursuing an internal 5G network for product communication

The Strategic Role of Private 5G Networks

Deploying its private 5G network, Tesla aims to create a seamlessly connected environment in its manufacturing facilities, research labs, and outdoor spaces. This infrastructure is not just about enhancing vehicle connectivity; it's also pivotal for the operational efficiency of the Optimus robot in various scenarios, including warehouse operations.

Tesla's foray into private 5G networking places it in an advantageous position in the automotive and tech industries. This strategic move aligns with the global trend towards adopting private 5G networks, which promise to revolutionize industries with their reliability and speed. Tesla's efforts to develop a private 5G protocol stack that integrates with any cellular infrastructure globally will set new industry standards.

With 5G, Tesla vehicles and Optimus robots will benefit from significantly reduced latency, offering under 5 milliseconds compared to the 60-98 milliseconds of 4G networks. This technological advancement is expected to enhance the functionality and responsiveness of Tesla's products, paving the way for advanced autonomous driving capabilities and efficient robot operations.

Tesla's interest in developing a private 5G network is a logical step. By building an infrastructure that supports the fastest connectivity standards, Tesla is preparing for its vehicles and laying the groundwork for sophisticated robotics applications. This endeavor reflects Tesla's ongoing commitment to innovation and its role in shaping the future of transportation and automation.

Tesla Is in Talks To Produce Electric Vans in Italy According to Report

By Kevin Armstrong
Van rendering
Van rendering

Italy has been discussing with Tesla about potentially establishing a factory producing electric trucks and vans. This information came to light in an Italian media outlet, Il Sole 24 Ore, which reported that the Ministry of Business and Made in Italy (Mimit) spearheaded talks to secure Tesla's investment.

Tesla and Italy: A Strategic Dialogue

Since last summer, Italy has broadened its industrial horizons by engaging in talks with Tesla, alongside negotiations with prominent Chinese manufacturers such as BYD, Great Wall Motors, and Chery Automobile. Notably, the discussions with Tesla have centered around producing electric commercial vehicles, highlighting a departure from conventional car manufacturing and reflecting the evolving demands of the global market.

Under the leadership of Minister Adolfo Urso, Italy aims to invigorate its automotive sector by encouraging the presence of multiple manufacturers. This approach is designed to stabilize the national components sector, which faces challenges due to the shift towards electric vehicles. Italy aims to produce 1.3 million vehicles annually, including a significant contribution from a new yet-to-be-determined manufacturer.

A Geopolitical and Industrial Balancing Act

Italy's engagement with Tesla occurs amidst a delicate phase of negotiations with Stellantis for increased vehicle production within the country. This strategic dialogue with Tesla, alongside discussions with Chinese competitors, is a pivotal element in Italy's industrial and geopolitical maneuvering.

A multipurpose van is the next logical step for Tesla to produce once the less expensive next-gen platform is released (code name Redwood). However, engineers seem to be busy perfecting the next-gen Roadster, and the van has had little discussion. Given the company's leaks, if a van were in the works, you would think we would’ve heard about it. Perhaps this is the nudge Tesla needs to get the van into production.

As Italy endeavors to become a key player in the electric vehicle industry, its negotiations with Tesla signify a promising development. The possibility of Tesla establishing a facility for electric trucks and vans in Italy underscores the country's commitment to sustainable transportation and positions Italy as an attractive destination for automotive innovation.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

More Tesla News

Subscribe

Subscribe to our weekly newsletter.

Sponsors

Find out how to become a sponsor and have your site listed here.

Although we share official Tesla release notes, we are not affiliated with Tesla Motors. We are Tesla fans and supporters.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter.