Robert Williams wrongly arrested in front of family due to a false facial recognition match; 30hrs detained. As a black man accosted by police the outcome could have been fatal & still the consequences of face misidentification are indelible& irreversible https://www.nytimes.com/2020/06/24/technology/facial-recognition-arrest.html
What we must keep in mind is just like when we see instances of police brutality this example cannot be reduced to a case of one bad algorithm. Instead what we are seeing is just a glimpse of how systemic racism can be encoded and reflected in AI systems.
For more on why we must fight face surveillance to protect black lives read: https://onezero.medium.com/we-must-fight-face-surveillance-to-protect-black-lives-5ffcd0b4c28a