The coded gaze: why AI often fails to see you
In short: When a facial recognition system fails to detect a person until they put on a white mask, the technology isn't broken—it is biased by design. Joy Buolamwini’s discovery of the "coded gaze" reveals how narrow datasets create invisible barriers for marginalized identities.
Joy Buolamwini first identified the 'coded gaze' while conducting research as a graduate student at MIT. She discovered that facial analysis software frequently failed to detect her face because the developers had not included a diverse range of skin tones and facial structures in the training data. The software only recognized her features once she wore a white mask, a moment that served as a catalyst for her work in algorithmic justice.
Her research into major companies' software revealed systemic racial and gender disparities. She noted that iconic figures like Michelle Obama, Serena Williams, and Oprah Winfrey were either misclassified or not detected at all by these systems. These errors occur because AI models are often built on 'default' datasets that do not represent the breadth of human diversity. Beyond academic errors, these biases lead to tangible real-world harms, such as the wrongful arrests of individuals like Portia Woodruff, who was falsely arrested while eight months pregnant, and Robert Williams, who was misidentified in front of his daughters.
Buolamwini, a computer scientist and poet, founded the Algorithmic Justice League to advocate for accountability in machine learning. Her work emphasizes that technology is not neutral; it reflects the priorities and omissions of its creators. By combining research findings with personal narrative and poetry, she argues for a shift toward 'compassion through computation,' ensuring that as algorithms take over more aspects of life, they do so with transparency and equity for all people.
theme-case-kebab-case perspective mood reflective difficulty
2 topics [ algorithmic-bias
artificial-intelligence facial-recognition
Opens the Intellect+ feed with this card first. Swipe up for the next one.
Sources
- Summary by Intellect · source: How I'm fighting bias in algorithms | Joy Buolamwini
- Also: Dr. Joy Buolamwini on Algorithmic Bias and AI Justice | Sanford School of Public Policy
To cite this card, link to https://intellectplus.co.uk/app/ideas-how-i-m-fighting-bias-in-algorithms-joy-buolamwini.
How we source, check and correct cards: Editorial standards.
General information, not professional advice. Spotted an error? Flag the card or see corrections and complaints.
Intellect Plus is a visual educational discovery platform for exploring fascinating facts and ideas. Brain Food, Not Brain Rot. What is Intellect Plus?
Related
More in Artificial intelligence · More in Ideas & Philosophy · Latest · A–Z · All topics
