Logo
    Search

    Why Tech Companies Are Limiting Police Use of Facial Recognition

    en-usFebruary 18, 2021

    Podcast Summary

    • Facial recognition technology's imperfections and concernsDespite benefits, facial recognition tech lacks regulations, prone to mistakes, and can disproportionately affect certain demographics, raising privacy and discrimination concerns.

      Facial recognition technology, though convenient, is imperfect and unregulated. It's used in various settings from unlocking phones to law enforcement, but its lack of federal regulations and potential for bias has raised concerns. Facial recognition systems can make mistakes, and these errors can disproportionately affect certain demographics. The technology is used in one-to-many searches, comparing suspects or surveillance footage to massive databases of images, and its use in law enforcement has been criticized for privacy violations and potential discrimination. Despite its benefits in solving crimes and identifying suspects, the lack of regulations and evidence of bias highlights the need for careful consideration and oversight in its use.

    • IBM, Amazon, and Microsoft limit use of facial recognition for law enforcement due to bias concernsTech giants IBM, Amazon, and Microsoft respond to bias concerns in facial recognition technology by exiting the business (IBM), implementing a moratorium (Amazon), or refusing to sell (Microsoft) to law enforcement.

      Tech companies IBM, Amazon, and Microsoft have recently announced limitations on their use of facial recognition technology for law enforcement due to concerns of algorithmic bias. MIT researcher Joy Buolamwini's groundbreaking work in 2018 highlighted the issue of bias in facial recognition software, leading to a national dialogue about the technology's use. IBM has decided to exit the facial recognition software business altogether, while Amazon and Microsoft have implemented a moratorium and refusal to sell to law enforcement respectively. Natalia Conde, an advocate for regulation changes in tech, expresses relief and optimism at these developments. These actions could potentially lead to the implementation of strong national laws that prioritize human rights protections in facial recognition technology.

    • Facial recognition technology and bias against dark-skinned facesFacial recognition technology can reflect bias due to biased training data, disproportionately impacting marginalized communities with false positives and false negatives.

      Facial recognition technology, while making significant strides, is not yet free from bias, particularly when it comes to recognizing dark-skinned faces. This issue arises due to the way these systems learn, through a process called machine learning, which relies on large amounts of training data. However, if this data is biased itself, as it often is with a lack of representation of people of color, the technology will reflect that bias. For instance, a study by researchers Joy Buolamwini and Timnit Gebru revealed that two common facial recognition datasets were predominantly composed of lighter-skinned individuals. This can lead to false positives and false negatives, which can disproportionately impact marginalized communities, potentially leading to wrongful accusations, arrests, and more. As Mutale pointed out, words alone are not enough to address this issue. It requires action to ensure that facial recognition technology is developed and trained on diverse data to reduce bias and ensure fairness for all.

    • Facial recognition technology's bias against underrepresented groupsFacial recognition technology often fails to accurately recognize individuals from underrepresented racial and gender backgrounds due to lack of diversity in training sets. Researchers like Metale, Buolamwini, and Gebru have highlighted this issue and created inclusive datasets to prevent biases.

      Facial recognition technology, which relies on diverse training data to function effectively, often fails to recognize and accurately classify individuals from underrepresented racial and gender backgrounds. This issue stems from the lack of diversity in the training sets used to develop these algorithms. In her research, Metale highlighted this problem, emphasizing the importance of having a diverse team and inclusive training data to prevent biases. Joy Buolamwini and Timnit Gebru addressed this issue by creating their own dataset, using images from the top 10 national parliaments with women in power, specifically focusing on African and European nations. Their findings revealed significant discrepancies along gender and racial lines, with darker-skinned faces being misclassified the most. Another study by the National Institute of Standards and Technology (NIST) further confirmed these biases, with some algorithms producing up to 100 times more false positives for African and Asian faces compared to Eastern European ones. The mislabeling of black women with Afros as men due to their short hair is another example of this issue. This research not only exposed the biases in facial recognition technology but also sparked further studies, legislation, and awareness on the importance of diversity and inclusion in technology development.

    • Facial recognition technology can exhibit significant demographic biasDespite benefits, facial recognition tech can misidentify and perpetuate systemic inequalities, raising ethical concerns for its use in law enforcement

      Facial recognition technology, despite its potential benefits, can exhibit significant demographic bias, particularly against American Indians, African Americans, and Asians. This bias raises ethical concerns, as these groups are already disproportionately affected by implicit bias within the criminal justice system. Critics argue that relying on biased AI systems for policing is counterproductive. Facial recognition is not infallible and can misidentify individuals, which can lead to wrongful arrests and perpetuate systemic inequalities. Mutale, a tech ethicist, advocates for a ban on facial recognition in law enforcement due to these concerns. She has previously advocated for legislation against discrimination in technology but is now seeing more support for her cause. In her own words, "Technology should be an empowering force for all people."

    • Targeted attack against journalists at the Capitol GazetteThe importance of a free press and the risks they face in bringing the truth to light was highlighted in the unique targeted attack against journalists at the Capitol Gazette.

      The world we live in today is marked by increasing instances of violence and intolerance, as seen in the rising number of mass shootings. However, an incident that occurred on June 28, 2018, stood out for its uniqueness - it was not a random act of violence but a targeted attack against journalists at the Capitol Gazette. This incident serves as a stark reminder of the importance of a free press and the risks they face in bringing the truth to light. Meanwhile, in the realm of investing, Larry Fink, the chairman and CEO of BlackRock, discusses the challenges investors face in areas such as retirement and the role global capital markets can play in finding solutions. These two seemingly unrelated stories underscore the significance of resilience and adaptability in the face of adversity. Listen to NPR's Embedded series about the Capitol Gazette survivors and The Bid podcast from BlackRock for more insights.

    Recent Episodes from Short Wave

    Researchers Are Figuring Out How African Ancestry Can Affect Certain Brain Disorders

    Researchers Are Figuring Out How African Ancestry Can Affect Certain Brain Disorders
    Black Americans have been underrepresented in most genomic studies of neurological disorders. As a result, scientists don't know much about whether African ancestry affects a person's risk for these disorders or their response to a particular treatment. To help close this gap, the Lieber Institute for Brain Development, African American community leaders in Baltimore, and researchers from Duke University and Morgan State University created the African Ancestry Neuroscience Research Initiative in 2019. The team found that genes associated with African ancestry appear to affect certain brain cells in ways that could increase the risk of Alzheimer's disease and stroke.

    Read science correspondent Jon Hamilton's full story here.

    Curious about brain science? Email us at shortwave@npr.org.

    Learn more about sponsor message choices: podcastchoices.com/adchoices

    NPR Privacy Policy
    Short Wave
    en-usJuly 03, 2024

    Could '3 Body Problem's Aliens Exist? The Science Behind Netflix's New Hit

    Could '3 Body Problem's Aliens Exist? The Science Behind Netflix's New Hit
    Before the '3 Body Problem' became a bestselling book and a smash TV show ... it was a physics concept, with big implications for how we understand planetary orbits. In this episode, we learn about the science behind the screen. Plus, why it's plausible a nearby, mysterious planet could hold life.

    This story is part of Short Wave's Space Camp series about all the weird, wonderful things happening in the universe —check out the full series.

    Curious about other science behind the things you love? Email us at shortwave@npr.org.

    Learn more about sponsor message choices: podcastchoices.com/adchoices

    NPR Privacy Policy
    Short Wave
    en-usJuly 02, 2024

    Want Juicy Barbecue This Fourth Of July? Cook Low And Slow

    Want Juicy Barbecue This Fourth Of July? Cook Low And Slow
    Perfecting your grilling technique ahead of the Fourth of July? Chefs will tell you that cooking is not just an art — it's a science. And the spirit of summer barbecues, NPR science correspondent Sydney Lupkin brings us this encore piece about how understanding the chemistry of cooking meat can help you perfect your barbeque. It's all about low and slow cooking.

    This story was originally reported for NPR by Gisele Grayson. Read her reporting.

    Curious about other science powering the things you love? Email us at shortwave@npr.org.

    Learn more about sponsor message choices: podcastchoices.com/adchoices

    NPR Privacy Policy
    Short Wave
    en-usJuly 01, 2024

    Move Over Norse Mythology, There's A New Loki In Town — A Dinosaur

    Move Over Norse Mythology, There's A New Loki In Town — A Dinosaur
    A brand new species of ceratops, or horned dinosaur, was recently discovered in northern Montana. The dinosaur is called Lokiceratops rangiformis, after the Norse god Loki, and is believed to have lived roughly eighty million years ago. The bones of the plant-eating dinosaur were found on private land in an area well known for its large amount of fossils, and at first, researchers thought the bones belonged to another species of dinosaur!

    Want to hear more about dinosaurs or other paleontological discoveries? Email us at shortwave@npr.org to let us know. We'd love to hear from you!

    Learn more about sponsor message choices: podcastchoices.com/adchoices

    NPR Privacy Policy
    Short Wave
    en-usJune 28, 2024

    The Human Brain Is Hardwired To Recognize Faces. But What If You Can't?

    The Human Brain Is Hardwired To Recognize Faces. But What If You Can't?
    Humans are hardwired to see faces — even in inanimate objects. We have a lima bean-shaped part of our brains dedicated to facial recognition. But this process isn't always straightforward. Science journalist Sadie Dingfelder is one of 10 million Americans who are face blind, or struggle to recognize the faces of people they know. In her new book, Do I Know You? she dives into this, as well as the science of memory and imagination.

    Want more episodes on the wonder of the human brain? Email us at shortwave@npr.org.

    Learn more about sponsor message choices: podcastchoices.com/adchoices

    NPR Privacy Policy
    Short Wave
    en-usJune 26, 2024

    Some Stars Explode As They Die. We Look At Their Life Cycle

    Some Stars Explode As They Die. We Look At Their Life Cycle
    This summer, scientists have their eyes and telescopes trained on the small constellation system T Coronae Borealis. They think it will explode as part of a periodic nova — a once-in-a-lifetime event according to NASA scientists. And so, with the help of astrophysicist Sarafina El-Badry Nance, we continue our journey farther and deeper into spacetime with a look at the stars: How they're born and how they die. Sarafina has always been drawn to one particular star: Betelgeuse, a red supergiant in the shoulder of the constellation Orion that is nearing the end of its life. What stages of life did Betelgeuse — or any star — go through before it reached this moment?

    This episode is part of our series Space Camp — all abut the weird, wonderful phenomena in our universe. Check it out here: https://npr.org/spacecamp

    Curious about the night sky? Email us at shortwave@npr.org — we'd love to hear from you!

    Learn more about sponsor message choices: podcastchoices.com/adchoices

    NPR Privacy Policy
    Short Wave
    en-usJune 25, 2024

    Earth Is More Than A Planet With Life On It. It's A "Living Planet"

    Earth Is More Than A Planet With Life On It. It's A "Living Planet"
    About ten years ago, science writer Ferris Jabr started contemplating Earth as a living planet rather than a planet with life on it. It began when he learned that the Amazon rainforest doesn't simply receive the rain that defines it; rather, it helps generate that rain. The Amazon does that by launching bits of biological confetti into the atmosphere that, in turn, seed clouds. After learning this, he began looking for other ways life changes its environment. That led to his new book Becoming Earth: How Our Planet Came to Life. He talks to host Regina G. Barber about examples of life transforming the planet — from changing the color of the sky to altering the weather.

    Have a story about the environment you'd like us to cover? Email us at shortwave@npr.org.

    Learn more about sponsor message choices: podcastchoices.com/adchoices

    NPR Privacy Policy
    Short Wave
    en-usJune 24, 2024

    We're In For A Brutal Hurricane Season, According To Predictions

    We're In For A Brutal Hurricane Season, According To Predictions
    The National Oceanic and Atmospheric Administration is predicting a record number of hurricanes this season, which began on June 1 and runs through Nov. They're forecasting anywhere from 17 to 25 storms in the Atlantic basin, including at least four major hurricanes. Scientists think this storm activity could be due to strong winds, warmer ocean temperatures and a scientific mystery unfolding in the Atlantic.

    Questions about hurricanes or other weather disasters? Email us at shortwave@npr.org — we'd love to consider it for a future episode!

    Learn more about sponsor message choices: podcastchoices.com/adchoices

    NPR Privacy Policy
    Short Wave
    en-usJune 21, 2024

    What 'Inside Out 2' Got Right About Anxiety, Per A Psychologist

    What 'Inside Out 2' Got Right About Anxiety, Per A Psychologist
    Pixar's new movie, Inside Out 2 came out Friday. It's the sequel to the 2015 movie Inside Out, which follows the life of 11-year-old Riley and her family as they move to San Francisco. In Inside Out 2, Riley is 13 and thriving in her new city. She has friends and is a star on her hockey team. But when puberty hits one night, four new emotions come into play: Envy, Ennui, Embarrassment and most of all, Anxiety.

    Clinical psychologist and Inside Out 2 consultant Lisa Damour says the movie is surprisingly accurate when it comes to experiencing anxiety and puberty. Plus, she offers some guidance to help make the most of our anxiety.

    Have other pop culture science you want us to decode? Email us at shortwave@npr.org — we'd love to consider it for a future episode!

    Learn more about sponsor message choices: podcastchoices.com/adchoices

    NPR Privacy Policy
    Short Wave
    en-usJune 19, 2024

    Pluto Isn't A Planet — But It Gives Us Clues For How The Solar System Formed

    Pluto Isn't A Planet — But It Gives Us Clues For How The Solar System Formed
    Pluto hasn't been a planet for almost 20 years. In the early 2000s, scientists discovered several objects of a similar size to Pluto. So, during the summer of 2006, members of the International Astronomical Union convened in Prague to reconsider what counts as a planet in our solar system. IAU members decided that there were three criteria to be a planet — and Pluto did meet all of them.

    But planetary scientist Wladymir Lyra says that even though it was downgraded to a dwarf planet, Pluto still has much to teach us about planet formation. This episode, he also lays out his case for Pluto — and many other objects in the solar system — to be considered a planet.

    This episode is part of Short Wave's space camp series about all the weird, wonderful things happening in the universe. Check out the full series.

    Questions about the state of our universe or smaller happenings here on planet Earth? Email us at shortwave@npr.org — we'd love to consider it for a future episode!

    Learn more about sponsor message choices: podcastchoices.com/adchoices

    NPR Privacy Policy
    Short Wave
    en-usJune 18, 2024

    Related Episodes

    Tech Companies Are Limiting Police Use of Facial Recognition. Here's Why

    Tech Companies Are Limiting Police Use of Facial Recognition. Here's Why
    Earlier this month, IBM said it was getting out of the facial recognition business. Then Amazon and Microsoft announced prohibitions on law enforcement using their facial recognition tech. There's growing evidence these algorithmic systems are riddled with gender and racial bias. Today on the show, Short Wave speaks with AI policy researcher Mutale Nkonde about algorithmic bias — how facial recognition software can discriminate and reflect the biases of society.

    Learn more about sponsor message choices: podcastchoices.com/adchoices

    NPR Privacy Policy

    Mini Episode: More Facial Recognition, Racism in Academia, and the latest in Commercial AI

    Mini Episode: More Facial Recognition, Racism in Academia, and the latest in Commercial AI

    Our fourth audio roundup of last week's noteworthy AI news!

    This week, we look at recent progress in curtailing the development of facial recognition technology, a recent call for attention to racism in academia, and recent news from OpenAI and Boston Dynamics. 

    Check out all the stories discussed here and more at www.skynettoday.com

    Theme: Deliberate Thought by Kevin McLeod (incompetech.com)

    Licensed under Creative Commons: By Attribution 3.0 License

    Toni Townes-Whitley (Microsoft) - The Ethics of Innovation

    Toni Townes-Whitley (Microsoft) - The Ethics of Innovation
    How often do entrepreneurs and corporate leaders think about issues like fairness, accessibility or unseen biases in the technologies they invent and advance? That’s the challenge for companies leading the digital transformation that’s disrupting every aspect of society, says Toni Townes-Whitley, Corporate Vice President of Worldwide Public Sector and Industry at Microsoft, in this talk about innovating strategically and responsibly.

    The importance of values in regulating emerging technology to protect human rights with Ed Santow

    The importance of values in regulating emerging technology to protect human rights with Ed Santow

    In today’s episode no. 25, Edward Santow, Australia’s Human Rights Commissioner speaks to Reimagining Justice about one of many projects he is responsible for, namely the Commission’s Human Rights and Technology project.

    Whether you know a little or a lot about human rights or artificial intelligence, you will gain something from listening to our conversation about the most extensive consultation into AI and Human Rights anywhere in the world. Ed explains exactly what human rights are and why they should be protected, how technology is both enhancing and detracting from human rights and the best approach to take in regulating emerging technology in the future.

    We talked about protecting the rights of the most marginalized people, automated decision making and how to combat bias and something I found particularly fascinating, the tension between the universality of human rights, ubiquitous technology and how differing cultural contexts and historical experiences are shaping the principles that will guide both the development and application of technology.

    Ed Santow has been Human Rights Commissioner at the Australian Human Rights Commission since August 2016 and leads the Commission’s work on technology and human rights; refugees and migration; human rights issues affecting LGBTI people; counter-terrorism and national security; freedom of expression; freedom of religion; and implementing the Optional Protocol to the Convention Against Torture (OPCAT).

    Andrea Perry-Petersen – LinkedIn - Twitter @winkiepp – andreaperrypetersen.com.au

    Twitter - @ReimaginingJ

    Facebook – Reimagining Justice group