I'd honestly do the same. It isn't just about the fact that FSD speeds; it is also about how often it gets speed limits plainly wrong, especially when it comes to school zones or other time-sensitive restrictions.
For a while now I've been going down a particular road where the speed limit suddenly goes from 40 MPH to 30 MPH within 1 mile. I've driven this road multiple times with all the different speed profiles, and each time it reacts differently. If I go into it on Standard, FSD will slowly go down in speed until it is only 5 MPH over the limit, but other times it will just continue at 40 MPH. If I enter the same section of road in Chill, FSD will practically slam on the brakes to get down to 32 MPH since it never goes more than 2 MPH over the posted limit, and the same for Sloth, except it goes the exact speed limit. On both Hurry and Mad Max, it is basically a toss-up on what FSD will do; sometimes it will continue to go 40 MPH, while other times it will even go up to 50 MPH.
To say that is an acceptable way to treat speed limits and other road signs when owners and users of FSD are on the hook for what the car does with Tesla taking zero responsibility is truly unacceptable. If any user input is seen as an "error" or "anti-pattern," then why are you making FSD users have more input by constantly having to adjust speed profiles or even take over when FSD gets it wrong?
That isn't even the worst of it when it comes to FSD and speeds. Even after the recent map updates and multiple FSD dot releases, there is still a 10+ mile stretch of road that FSD thinks is 30 MPH when in reality it is 40 MPH. And this is even after passing multiple speed limit signs that are clear as day and easily viewable through the camera preview. Ironically, this is also the same stretch of road where I posted my recent Cybercab spotting video. This means that if I'm on the Chill speed profile, the car will go only 32 MPH; if I put it in Standard or Hurry, then the car can go too fast, up to 50 MPH.
Needless to say, as much as I love using FSD and understand how difficult of a problem autonomous driving is to solve, this is easily the thing I hate most about it in its current state. Forget pothole avoidance (though that is still important), get speed limits right, and work correctly at the very least 99% of the time.