Given how many people treat speed limits as suggestions, at best, having your vehicle obey the limit would turn some people off of them.
The major roads are already nigh impossible to walk across. Finding a way to raise the speed just makes it harder to be a pedestrian in yet more places.
I, too, love the idea of networked autonomous swarm agents behaving in an even more efficient setup. The problem is that if the only focus is on moving cars faster at the cost of people’s comfort, access, energy, and walkable anything we lose out on reasons to ever be outside of the car at all.
More cars and faster cars in our cities makes the city worse, even if they’re self driving.