AI facial recognition: Man describes wrongful arrest by Jacksonville Beach Police

Our Take

Credit to First Coast News for putting a face and a name to what's usually an abstract debate. Robert Dillon's story is exactly what happens when police departments treat AI facial recognition output as probable cause instead of a lead that needs real human verification. A machine says 'match,' an officer stops asking questions, and someone ends up in handcuffs for a crime they didn't commit. That's not a hypothetical civil liberties concern anymore — it's a lawsuit with a name attached.

This is the same pattern we track with automated license plate readers: a network of cameras and algorithms quietly generates 'hits,' and too often those hits get treated as verified fact rather than a starting point for actual investigation. Flock Safety and similar systems are being installed across the country with little public debate about accuracy, oversight, or what happens when the system is wrong. Facial recognition misidentifications hit Black men at dramatically higher rates in study after study, and ALPR misreads have already led to guns drawn on innocent drivers. Different tech, same failure mode: outsourcing judgment to a black box and letting officers act on faith.

If your town has cameras like this, you deserve to know it. Check our camera map to see what's already watching your streets, and visit our take-action page if you want to push back on surveillance systems that are moving faster than the accountability meant to check them.