A Friday night cruise with Elon Musk has shown the world just how far Tesla’s Full Self-Driving has advanced and gave viewers a preview of real-world problems. To take a line from Rob Zombie, the latest iteration of FSD may be "More Human Than Human," which could be an issue.
"Nothing but net!" proclaimed Musk as he live-streamed to X.com, a video with more than 42 million views. The Tesla CEO referred to neural nets, the technology underpinning Version 12 of FSD. Tesla is removing 300,000-plus lines of code running the current FSD and is now relying on the car's neural networks to drive the car in V12.
Driving through Palo Alto, California, Musk, with Ashok Elluswamy, Tesla’s Director of Autopilot Software, sitting shotgun, picked random places for the Model S to drive to, and it did so smoothly and almost perfectly.
Technology Behind FSD
The test drive started with a construction zone, which was easily handled, but interestingly, at the end of the cones, the car wasn’t jerking over to find a lane immediately. Instead, like a confident human driver, it easily made its way to the lane with no oncoming traffic. We also watched as it effortlessly navigated speed bumps, roundabouts, pedestrians, bicyclists, and, of course - traffic.
For those who have had successful drives with FSD, you may be thinking, what's the big deal? Musk underscored that this version of FSD does not rely on hard-coded programming or a constant internet connection to function. All necessary inference occurs locally, a significant departure from previous versions.
“This is all nets, baby, nothing but net,” Musk exclaimed, emphasizing the vehicle’s dependency on machine learning rather than programmed instructions. The software operates at full frame rate, taking eight cameras at 36 frames per second to decide what to do. No line of code tells the car what to do at an intersection, on the highway or around other vehicles.
The software was impressive to watch, with its countless improvements over the current V11 version of FSD. Musk's vehicle kept a reasonable speed throughout the drive, even though Autopilot was set to a maximum speed of 85 mph.
When Musk reached his destination, the vehicle also automatically pulled over to the side of the road to park itself instead of just stopping in the middle of the road like it does today.
The Real-World, Real Person Challenge
Instead, Tesla has shown the car countless videos of real-world driving so that it will learn what to do in those situations. But that has caused a problem. As the car noticeably did not come to full stops, Musk explained the challenge posed by the fact that less than 0.5% of drivers come to a complete stop at stop signs.
This makes it incredibly difficult to program the vehicle with such sparse data on people obeying the law. This lack of data highlights Tesla's obstacles in training its AI systems to operate in real-world scenarios where human drivers frequently do not adhere to the rules.
Musk's FSD V12 Stream in 10 Minutes
Watch the highlights of Musk's 45-minute video stream below.
Regulatory Hurdles
This appeared in a few other instances where the car behaved like a confident driver, not endangering anyone but technically breaking the rules of the road. FSD suddenly went from the nervous teenager learning to drive to a good driver. But we know how the NHTSA feels about Tesla not following the rules.
In February, the watchdog issued a recall stating that Tesla was acting too human — I mean not following the rules. It cited FSD Beta software:
Traveling or turning through certain intersections during a stale yellow traffic light;
The perceived duration of the vehicle’s static position at certain intersections with a stop sign, particularly when the intersection is clear of any other road users;
Adjusting vehicle speed while traveling through certain variable speed zones, based on detected speed limit signage and/or the vehicle’s speed offset setting that is adjusted by the driver.
Yes, I’m sure we all stop at every yellow light, come to a complete stop at every stop sign, and never go over the speed limit.
Kudos to Tesla and Musk for this real-world demonstration, and if there was any speculation that it was rigged, Musk did have to intervene at an advanced left-hand signal. This small glitch, Musk reassured, could be addressed with further training and data collection. There will be a lot of training announced Tesla’s commitment to invest $4 billion over the next two years in training computing, signaling the company's dedication to perfecting this groundbreaking technology.
Subscribe
Subscribe to our newsletter to stay up to date on the latest Tesla news, upcoming features and software updates.
Tesla has begun to reach out to customers in the United States and is offering demo drives of the Cybertruck on an invite-only basis. @brandonhd on X shared the first invite image, and it looks like it's going out quite quickly to multiple locations that have Cybertrucks on display.
Up until now, display vehicles have been for just that – looking, but no touching. Some Tesla delivery centers and showrooms have also allowed viewers to take a seat inside and open it up, but most are still locked away behind the velvet rope.
It’s exciting to see that Tesla has begun to demo them – and it can only be so long until demo drives open up to everyone.
Advisor-led Demo
This Demo Drive is led by a Tesla Advisor – while you’re driving, the advisor will be in the passenger seat, walking you through the experience. They’ll explain steer-by-wire, off-road controls, and will introduce new-to-Tesla buyers to all the features that are currently available.
The list of locations so far for demo drives appears to be fairly limited, but we will hopefully see demo drives roll out throughout the United States, and eventually Canada too. Here is the current list of city/state locations that have seen demo drive invites.
Actually Smart Summon, the successor to Tesla’s Smart Summon feature, has been confirmed to be coming as soon as next month as per Elon Musk. Colloquially known as “ASS”, Actually Smart Summon is supposed to improve on the regular Smart Summon capabilities, which have historically used ultrasonic sensors (USS) to navigate parking lots.
We’re looking forward to Actually Smart Summon, and we’re quite excited about what other features will be unlocked once it finally shows up at our doorstep.
Vision-based Improvements
ASS is supposed to bring Smart Summon to vehicles that don’t have USS – using Tesla Vision. Most recently, Tesla has brought Autopark to vehicles without USS, and Vision-based Autopark has been a huge success. It is faster, more reliable, and smoother than the older USS-based solution. It can also park and maneuver in tighter locations.
Today, Smart Summon is sometimes useful at best, usually a party trick, or downright dangerous at worst. It’s excellent and best used in straight lines, where you have a clear line of sight of the vehicle, and can stop it if doesn’t see an obstacle.
I used Smart Summon today, just before writing this article – my 2022 Model Y (with USS) – did manage to show up just fine – in a straight-line location from where I was parked, after exiting the parking spot fairly cleanly. However, I’ve previously used Smart Summon and have had the vehicle turn towards obstacles, such as cart returns or curbs. Overall, it’s a sometimes-useful feature that has a lot of drawbacks right now.
Smart Summon is also restricted to a certain distance – and it's pretty small. The max distance is shorter than most parking lots, being only about 215 ft (65m). If you’re lucky enough to park close, it's very useful to bring your car right to you.
Actually Smart Summon
ASS will bring FSD V12-like capabilities to Smart Summon – the vehicle will primarily use Vision to drive toward you (or the location you’ve indicated). ASS has been supposed to be coming since about September 2022 and has seen many delays – we’re almost at the 2-year point today.
We’re looking forward to Actually Smart Summon being able to bring the vehicle – safely – right to you. ASS is also one of the key steps towards bringing some other cool features that Elon Musk has previously mentioned – Park Seek and Banish Autopark.
We’re also hopeful that Actually Smart Summon will increase the maximum range a vehicle can be summoned, because the current range is fairly small. Alongside Park Seek and Banish Autopark, we’re closing in on a Robotaxi-based future.
Park Seek and Banish Autopark
When the FSD v12.4 showed up, Elon also mentioned that going forward, vehicles would automatically park themselves when arriving in a parking lot – Park Seek – and that if you got out of the car at the entrance to a business, you could get it to automatically park itself in the parking lot – Banish Autopark. These are two features that are needed for Robotaxi to work – which itself is delayed to October 10th of this year. We’re looking quite forward to them – as in combination with Actually Smart Summon, Tesla has reached the cusp of vehicle autonomy.
A vehicle that arrives, driverless, at the location you’re at, then drives somewhere, parks itself there, and waits for you – is the definition of a Robotaxi.
While we’re likely to have to wait for Banish Autopark and Park Seek just a bit longer, Actually Smart Summon being around the corner is exciting! Gone will be the days of having to run out to your car when you forgot your umbrella – your car will just come right to you instead.
TeslaFi logs your drives and charging sessions, letting you keep a log of your vehice's activity. We highly recommend checking them out if you use your car for business trips and would like to keep track of reimbursements, if you like to see how much you spend on charging or if you just love statistics. Visit their site and see everything they have to offer!
Tesla Android Project enables you to run Android apps in your Tesla. The platform is Open Source and you can deploy it on your own Raspberry Pi 4. Consider supporting the initiative by donating or purchasing the Compute Module 4 Bundle that delivers the best experience. Get $20 off by using the code: NotATeslaApp
The official Tesla app only notifies you if your car is broken into. By installing Sentry Pro on your phone, you will be notified for all Sentry Mode events. Stay connected and avoid potential surprises by receiving notifications. Stop constantly checking the cameras to ensure safety. Check only when necessary, save battery and get peace of mind. Get a 7 day free trial here!
Stay organized, connected, and stylish with Cyberbackpack — the #1 backpack, luggage & travel accessories for Tesla owners. We highly recommend checking them out if you commute or travel and would like a backpack or luggage that is sleek, secure and durable. View their products page and see everything they have to offer!
Enhance Auto’s innovative products elevate your Tesla experience. The customizable S3XY Buttons and Knob offer seamless control over vehicle features with a simple press or turn. Visit enhauto.com to explore their full range of products and transform your driving experience today!
Find out how to become a sponsor and have your site listed here.
Although we share official Tesla release notes, we are not affiliated with Tesla Motors. We are Tesla fans and supporters.
![Tesla Is Now Offering Cybertruck Test Drives [List of Locations]](https://www.notateslaapp.com/img/containers/article_images/cybertruck/cybertruck-demo.jpg/1356c877fb90cc7beb02335e757420ca/cybertruck-demo.jpg)
![Tesla Adds HEPA Filter to New Model 3, Will it Get Bioweapon Defense Mode? [Update: Tesla Edits Post]](https://www.notateslaapp.com/images/news/2023/new-model-3-hepa-filter_300w.jpg)
