New research shows driverless car software is significantly more accurate with adults and light skinned people than children and dark-skinned people.
this is misleading. if you read the study, you’ll see the aggregate miss rate is much worse for dark skinned people and children, but that’s weighted by the models that haven’t been trained specifically for use with pedestrian detection. the pedestrian detection models, i.e. the ones people actually are going to use, were within 1% as accurate for skin tone, and were about 10% worse at detecting kids. since kids are already harder to see for human drivers, that seems much more similar to human performance.
the other thing it doesn’t mention is how bad they are at detecting people in general. the best one misses people roughly 5% of the time, which seems pretty high for something that’s supposed to be driving a car
Statistically there are going to be some things they will do worse at but is it significant?
Researchers ran more than 8,000 images through the software and found that the self-driving car systems were nearly 20% better at detecting adult pedestrians than kids, and more than 7.5% better at detecting light-skinned pedestrians over dark-skinned ones. The AI were even worse at spotting dark-skinned people in low light and low settings, making the tech even less safe at night.
I’d say a 20% difference is pretty significant.
I would say that’s not actually at all a relevant question, but a form of whataboutism, since this is looking at just driverless programs and comparing how they are with themselves, and what problems with programming and training models could result in that difference.
Great, self-driving cars can be childfree and racist, just like some human drivers!
This seems like a big deal.