Logo
    Search

    Why Are Migrants Becoming AI Test Subjects? With Petra Molnar

    enJune 20, 2024

    Podcast Summary

    • Advanced surveillance at bordersAdvanced surveillance technologies, including AI, drones, robo-dogs, social media monitoring, biometric data collection, and carceral technologies, are being used at borders, creating inhumane conditions for refugees

      Borders around the world are becoming laboratories for advanced surveillance technologies, with the US-Mexico border serving as a unique testing ground. Refugee journeys, often perilous and ending at closed borders or detention centers, are being monitored using AI, drones, robo-dogs, and other high-tech tools. Petra Molnar, an immigration lawyer and author, argues that while the stated goal is to secure borders and make immigration easier, the result has been anything but humane. The use of these technologies begins even before refugees cross borders, with social media and online data being monitored, and continues throughout their journey with biometric data collection, carceral technologies, and voice printing for refugee status determinations. It's essential to pay attention to these developments and consider the impact on individuals and human rights.

    • Border technology and ethicsRapid deployment of advanced border surveillance technology raises concerns for opacity, discretion, bias, and human rights violations, creating a lucrative 'border industrial complex'.

      The rapid deployment of advanced surveillance technology at borders, driven by the perceived need for greater security and efficiency, raises serious concerns. These technologies, which are often highly discriminatory and operate in a largely unregulated environment, can exacerbate existing problems with opacity, discretion, and bias in border decision-making. Instead of addressing the root causes of migration or improving the fairness and efficiency of immigration systems, these technologies may create new problems and contribute to a lucrative "border industrial complex." This complex, which includes both large and small companies, can present significant challenges to ethical and legal norms, particularly in the context of human rights and privacy. It is crucial that we engage in open and informed public debate about the role of technology in border control and migration management, and work to ensure that these technologies are used in a transparent, accountable, and human-rights compliant manner.

    • Technology and marginalized communitiesLack of interaction between innovators and marginalized communities can result in harmful or discriminatory technologies, especially in border technology context, which can eventually spread beyond borders and impact broader society, as seen with CODIS and its potential for a discriminatory genetic panopticon.

      The lack of lived experience and interaction between innovators and marginalized communities can lead to the development and deployment of technologies that may be harmful or discriminatory. This is particularly evident in the context of border technology, where companies and governments invest heavily in developing and implementing advanced surveillance systems. However, these technologies do not remain contained at the border. They often diffuse into broader society, leading to their use against protesters, in sports stadiums, and other public spaces. One example of this is the use of CODIS (Combined DNA Index System), a genetic database that moves the US closer to a discriminatory genetic panopticon, which could potentially encompass everyone within the United States, including ordinary citizens who have not been convicted or even suspected of criminal conduct. It is crucial to understand the potential consequences of these technologies and to consider the ethical implications of their use.

    • Border technology misuseThe use of advanced border control technologies, such as biometrics, DNA collection, and predictive analytics, raises ethical concerns, particularly when they are used to target specific groups and can eventually be turned against citizens. It's essential to regulate these technologies to prevent misuse.

      As border control technologies continue to evolve, there is a growing concern that what begins as border enforcement can eventually be turned against citizens. The use of biometrics, DNA collection, and predictive analytics are examples of this trend. This is particularly concerning in the context of the global rise of far-right politics, which often justifies the use of such technologies to deal with immigration and then extends their use to other areas. Israel is a notable example of this, with Palestine serving as a testing ground for technologies that are then exported for border enforcement in other countries. The EU's experimentation with AI lie detection at borders is another example of this trend and raises ethical concerns. While there are ongoing conversations about regulating these technologies, it is crucial to be aware of their potential implications and to take collective action to prevent their misuse.

    • AI lie detectors and surveillance technologiesThese technologies, marketed as advanced and objective, can be ineffective and harmful, failing to account for cultural differences, trauma, and complexities of human behavior. They can be weaponized against vulnerable populations and may have significant consequences, including loss of life.

      The use of AI lie detectors and surveillance technologies, such as those discussed in relation to a failed lie detector pilot project in Europe, raises significant concerns. These technologies, which are often marketed as advanced and objective, can be ineffective and even harmful. They may fail to account for cultural differences, trauma, and the complexities of human behavior. Moreover, they can be weaponized against vulnerable populations, including refugees and humanitarian workers. The incentives for countries to engage in such surveillance and securitization efforts are often economic and political, further complicating the issue. The potential consequences of these technologies, including the loss of life, underscore the need for critical reflection and ethical consideration in their development and implementation.

    • Border control and surveillance capitalismThe intersection of border control and surveillance capitalism raises ethical concerns, particularly regarding the collection and use of data, which disproportionately affects marginalized groups, and diverts resources from addressing core issues.

      The intersection of border control and surveillance capitalism raises significant ethical concerns, particularly regarding the collection and use of data. The arms race for new technology solutions at the edges of borders draws resources and attention away from addressing issues at the core. Data, referred to as the "new oil," is at the heart of this issue, with the potential for exploitation and normalization of data collection disproportionately affecting marginalized groups. The role of international organizations, such as the UN, in this ecosystem is complex, as they set the agenda for data collection but exist in a legal gray area, making governance and regulation challenging. An example of the potential consequences of these issues is the unintended sharing of sensitive refugee data with the very governments they were fleeing from, as seen with Rohingya refugees in Bangladesh.

    • Technology and Ethics in Refugee ManagementThe use of technology in managing refugees and borders raises complex ethical issues, requiring transparency, accountability, and the involvement of those directly impacted to uphold human rights and dignity.

      The use of technology in managing refugees and borders raises complex ethical and humanitarian issues. The power dynamics at play, particularly in refugee camps, make consent a challenging concept. Mistakes made by organizations like the United Nations High Commissioner for Refugees highlight the need for greater transparency and accountability in data collection and sharing practices. The rapid advancement of technology in this area necessitates ongoing conversations about red lines and moratoriums or even bans on certain technologies. It's crucial to involve those directly impacted in these discussions and to recognize the potential positive contributions of technology, such as education technology for mobile children. Ultimately, the goal should be to uphold human rights and dignity for all, especially as the number of people on the move is expected to increase due to climate change and other factors.

    • Addressing the root causes of migrationInstead of solely focusing on border security and deterrence, addressing the root causes of migration through investment in resources and stabilizing countries is crucial for long-term solutions. Empathy and understanding the desires of migrants are also essential.

      Instead of focusing solely on border security and deterrence to address the issue of migration, it's crucial to consider long-term solutions. The root causes of migration should be addressed by investing in resources and stabilizing countries, rather than developing advanced technologies like robo-dogs and AI lie detectors. It's essential to remember that the majority of people on the move are not doing so voluntarily. They are forced to leave their homes. Therefore, prevention should be prioritized through resources distribution and addressing the underlying causes. It's also important to ensure that those impacted by migration have a seat at the table in discussions and decision-making processes. Petra Molnar, author of "The Walls Have Eyes," emphasizes the importance of empathy and understanding the desires of migrants, who want to be home and live fulfilling lives. The conversation highlights the need for a more compassionate and long-term approach to addressing migration.

    Recent Episodes from Your Undivided Attention

    Why Are Migrants Becoming AI Test Subjects? With Petra Molnar

    Why Are Migrants Becoming AI Test Subjects? With Petra Molnar

    Climate change, political instability, hunger. These are just some of the forces behind an unprecedented refugee crisis that’s expected to include over a billion people by 2050. In response to this growing crisis, wealthy governments like the US and the EU are employing novel AI and surveillance technologies to slow the influx of migrants at their borders. But will this rollout stop at the border?

    In this episode, Tristan and Aza sit down with Petra Molnar to discuss how borders have become a proving ground for the sharpest edges of technology, and especially AI. Petra is an immigration lawyer and co-creator of the Migration and Technology Monitor. Her new book is “The Walls Have Eyes: Surviving Migration in the Age of Artificial Intelligence.”

    RECOMMENDED MEDIA

    The Walls Have Eyes: Surviving Migration in the Age of Artificial Intelligence

    Petra’s newly published book on the rollout of high risk tech at the border.

    Bots at the Gate

    A report co-authored by Petra about Canada’s use of AI technology in their immigration process.

    Technological Testing Grounds

    A report authored by Petra about the use of experimental technology in EU border enforcement.

    Startup Pitched Tasing Migrants from Drones, Video Reveals

    An article from The Intercept, containing the demo for Brinc’s taser drone pilot program.

    The UNHCR

    Information about the global refugee crisis from the UN.

    RECOMMENDED YUA EPISODES

    War is a Laboratory for AI with Paul Scharre

    No One is Immune to AI Harms with Dr. Joy Buolamwini

    Can We Govern AI? With Marietje Schaake

    CLARIFICATION:

    The iBorderCtrl project referenced in this episode was a pilot project that was discontinued in 2019

    Former OpenAI Engineer William Saunders on Silence, Safety, and the Right to Warn

    Former OpenAI Engineer William Saunders on Silence, Safety, and the Right to Warn

    This week, a group of current and former employees from Open AI and Google Deepmind penned an open letter accusing the industry’s leading companies of prioritizing profits over safety. This comes after a spate of high profile departures from OpenAI, including co-founder Ilya Sutskever and senior researcher Jan Leike, as well as reports that OpenAI has gone to great lengths to silence would-be whistleblowers. 

    The writers of the open letter argue that researchers have a “right to warn” the public about AI risks and laid out a series of principles that would protect that right. In this episode, we sit down with one of those writers: William Saunders, who left his job as a research engineer at OpenAI in February. William is now breaking the silence on what he saw at OpenAI that compelled him to leave the company and to put his name to this letter. 

    RECOMMENDED MEDIA 

    The Right to Warn Open Letter 

    My Perspective On "A Right to Warn about Advanced Artificial Intelligence": A follow-up from William about the letter

     Leaked OpenAI documents reveal aggressive tactics toward former employees: An investigation by Vox into OpenAI’s policy of non-disparagement.

    RECOMMENDED YUA EPISODES

    1. A First Step Toward AI Regulation with Tom Wheeler 
    2. Spotlight on AI: What Would It Take For This to Go Well? 
    3. Big Food, Big Tech and Big AI with Michael Moss 
    4. Can We Govern AI? with Marietje Schaake

    Your Undivided Attention is produced by the Center for Humane Technology. Follow us on Twitter: @HumaneTech_

    War is a Laboratory for AI with Paul Scharre

    War is a Laboratory for AI with Paul Scharre

    Right now, militaries around the globe are investing heavily in the use of AI weapons and drones.  From Ukraine to Gaza, weapons systems with increasing levels of autonomy are being used to kill people and destroy infrastructure and the development of fully autonomous weapons shows little signs of slowing down. What does this mean for the future of warfare? What safeguards can we put up around these systems? And is this runaway trend toward autonomous warfare inevitable or will nations come together and choose a different path? In this episode, Tristan and Daniel sit down with Paul Scharre to try to answer some of these questions. Paul is a former Army Ranger, the author of two books on autonomous weapons and he helped the Department of Defense write a lot of its policy on the use of AI in weaponry. 

    RECOMMENDED MEDIA

    Four Battlegrounds: Power in the Age of Artificial Intelligence: Paul’s book on the future of AI in war, which came out in 2023.

    Army of None: Autonomous Weapons and the Future of War: Paul’s 2018 book documenting and predicting the rise of autonomous and semi-autonomous weapons as part of modern warfare.

    The Perilous Coming Age of AI Warfare: How to Limit the Threat of Autonomous Warfare: Paul’s article in Foreign Affairs based on his recent trip to the battlefield in Ukraine.

    The night the world almost almost ended: A BBC documentary about Stanislav Petrov’s decision not to start nuclear war.

    AlphaDogfight Trials Final Event: The full simulated dogfight between an AI and human pilot. The AI pilot swept, 5-0.

    RECOMMENDED YUA EPISODES

    1. The AI ‘Race’: China vs. the US with Jeffrey Ding and Karen Hao
    2. Can We Govern AI? with Marietje Schaake
    3. Big Food, Big Tech and Big AI with Michael Moss
    4. The Invisible Cyber-War with Nicole Perlroth

    Your Undivided Attention is produced by the Center for Humane Technology. Follow us on Twitter: @HumaneTech_

    AI and Jobs: How to Make AI Work With Us, Not Against Us With Daron Acemoglu

    AI and Jobs: How to Make AI Work With Us, Not Against Us With Daron Acemoglu

    Tech companies say that AI will lead to massive economic productivity gains. But as we know from the first digital revolution, that’s not what happened. Can we do better this time around?

    RECOMMENDED MEDIA

    Power and Progress by Daron Acemoglu and Simon Johnson Professor Acemoglu co-authored a bold reinterpretation of economics and history that will fundamentally change how you see the world

    Can we Have Pro-Worker AI? Professor Acemoglu co-authored this paper about redirecting AI development onto the human-complementary path

    Rethinking Capitalism: In Conversation with Daron Acemoglu The Wheeler Institute for Business and Development hosted Professor Acemoglu to examine how technology affects the distribution and growth of resources while being shaped by economic and social incentives

    RECOMMENDED YUA EPISODES

    1. The Three Rules of Humane Tech
    2. The Tech We Need for 21st Century Democracy
    3. Can We Govern AI?
    4. An Alternative to Silicon Valley Unicorns

    Your Undivided Attention is produced by the Center for Humane Technology. Follow us on Twitter: @HumaneTech_

    Jonathan Haidt On How to Solve the Teen Mental Health Crisis

    Jonathan Haidt On How to Solve the Teen Mental Health Crisis

    Suicides. Self harm. Depression and anxiety. The toll of a social media-addicted, phone-based childhood has never been more stark. It can be easy for teens, parents and schools to feel like they’re trapped by it all. But in this conversation with Tristan Harris, author and social psychologist Jonathan Haidt makes the case that the conditions that led to today’s teenage mental health crisis can be turned around – with specific, achievable actions we all can take starting today.

    This episode was recorded live at the San Francisco Commonwealth Club.  

    Correction: Tristan mentions that 40 Attorneys General have filed a lawsuit against Meta for allegedly fostering addiction among children and teens through their products. However, the actual number is 42 Attorneys General who are taking legal action against Meta.

    Clarification: Jonathan refers to the Wait Until 8th pledge. By signing the pledge, a parent  promises not to give their child a smartphone until at least the end of 8th grade. The pledge becomes active once at least ten other families from their child’s grade pledge the same.

    Chips Are the Future of AI. They’re Also Incredibly Vulnerable. With Chris Miller

    Chips Are the Future of AI. They’re Also Incredibly Vulnerable. With Chris Miller

    Beneath the race to train and release more powerful AI models lies another race: a race by companies and nation-states to secure the hardware to make sure they win AI supremacy. 

    Correction: The latest available Nvidia chip is the Hopper H100 GPU, which has 80 billion transistors. Since the first commercially available chip had four transistors, the Hopper actually has 20 billion times that number. Nvidia recently announced the Blackwell, which boasts 208 billion transistors - but it won’t ship until later this year.

    RECOMMENDED MEDIA 

    Chip War: The Fight For the World’s Most Critical Technology by Chris Miller

    To make sense of the current state of politics, economics, and technology, we must first understand the vital role played by chips

    Gordon Moore Biography & Facts

    Gordon Moore, the Intel co-founder behind Moore's Law, passed away in March of 2023

    AI’s most popular chipmaker Nvidia is trying to use AI to design chips faster

    Nvidia's GPUs are in high demand - and the company is using AI to accelerate chip production

    RECOMMENDED YUA EPISODES

    Future-proofing Democracy In the Age of AI with Audrey Tang

    How Will AI Affect the 2024 Elections? with Renee DiResta and Carl Miller

    The AI ‘Race’: China vs. the US with Jeffrey Ding and Karen Hao

    Protecting Our Freedom of Thought with Nita Farahany

    Your Undivided Attention is produced by the Center for Humane Technology. Follow us on Twitter: @HumaneTech_

     

     

    Future-proofing Democracy In the Age of AI with Audrey Tang

    Future-proofing Democracy In the Age of AI with Audrey Tang

    What does a functioning democracy look like in the age of artificial intelligence? Could AI even be used to help a democracy flourish? Just in time for election season, Taiwan’s Minister of Digital Affairs Audrey Tang returns to the podcast to discuss healthy information ecosystems, resilience to cyberattacks, how to “prebunk” deepfakes, and more. 

    RECOMMENDED MEDIA 

    Testing Theories of American Politics: Elites, Interest Groups, and Average Citizens by Martin Gilens and Benjamin I. Page

    This academic paper addresses tough questions for Americans: Who governs? Who really rules? 

    Recursive Public

    Recursive Public is an experiment in identifying areas of consensus and disagreement among the international AI community, policymakers, and the general public on key questions of governance

    A Strong Democracy is a Digital Democracy

    Audrey Tang’s 2019 op-ed for The New York Times

    The Frontiers of Digital Democracy

    Nathan Gardels interviews Audrey Tang in Noema

    RECOMMENDED YUA EPISODES 

    Digital Democracy is Within Reach with Audrey Tang

    The Tech We Need for 21st Century Democracy with Divya Siddarth

    How Will AI Affect the 2024 Elections? with Renee DiResta and Carl Miller

    The AI Dilemma

    Your Undivided Attention is produced by the Center for Humane Technology. Follow us on Twitter: @HumaneTech_

    U.S. Senators Grilled Social Media CEOs. Will Anything Change?

    U.S. Senators Grilled Social Media CEOs. Will Anything Change?

    Was it political progress, or just political theater? The recent Senate hearing with social media CEOs led to astonishing moments — including Mark Zuckerberg’s public apology to families who lost children following social media abuse. Our panel of experts, including Facebook whistleblower Frances Haugen, untangles the explosive hearing, and offers a look ahead, as well. How will this hearing impact protocol within these social media companies? How will it impact legislation? In short: will anything change?

    Clarification: Julie says that shortly after the hearing, Meta’s stock price had the biggest increase of any company in the stock market’s history. It was the biggest one-day gain by any company in Wall Street history.

    Correction: Frances says it takes Snap three or four minutes to take down exploitative content. In Snap's most recent transparency report, they list six minutes as the median turnaround time to remove exploitative content.

    RECOMMENDED MEDIA 

    Get Media Savvy

    Founded by Julie Scelfo, Get Media Savvy is a non-profit initiative working to establish a healthy media environment for kids and families

    The Power of One by Frances Haugen

    The inside story of France’s quest to bring transparency and accountability to Big Tech

    RECOMMENDED YUA EPISODES

    Real Social Media Solutions, Now with Frances Haugen

    A Conversation with Facebook Whistleblower Frances Haugen

    Are the Kids Alright?

    Social Media Victims Lawyer Up with Laura Marquez-Garrett

    Your Undivided Attention is produced by the Center for Humane Technology. Follow us on Twitter: @HumaneTech_

     

     

    Taylor Swift is Not Alone: The Deepfake Nightmare Sweeping the Internet

    Taylor Swift is Not Alone: The Deepfake Nightmare Sweeping the Internet

    Over the past year, a tsunami of apps that digitally strip the clothes off real people has hit the market. Now anyone can create fake non-consensual sexual images in just a few clicks. With cases proliferating in high schools, guest presenter Laurie Segall talks to legal scholar Mary Anne Franks about the AI-enabled rise in deep fake porn and what we can do about it. 

    Correction: Laurie refers to the app 'Clothes Off.' It’s actually named Clothoff. There are many clothes remover apps in this category.

    RECOMMENDED MEDIA 

    Revenge Porn: The Cyberwar Against Women

    In a five-part digital series, Laurie Segall uncovers a disturbing internet trend: the rise of revenge porn

    The Cult of the Constitution

    In this provocative book, Mary Anne Franks examines the thin line between constitutional fidelity and constitutional fundamentalism

    Fake Explicit Taylor Swift Images Swamp Social Media

    Calls to protect women and crack down on the platforms and technology that spread such images have been reignited

    RECOMMENDED YUA EPISODES 

    No One is Immune to AI Harms

    Esther Perel on Artificial Intimacy

    Social Media Victims Lawyer Up

    The AI Dilemma

    Your Undivided Attention is produced by the Center for Humane Technology. Follow us on Twitter: @HumaneTech_

    Can Myth Teach Us Anything About the Race to Build Artificial General Intelligence? With Josh Schrei

    Can Myth Teach Us Anything About the Race to Build Artificial General Intelligence? With Josh Schrei

    We usually talk about tech in terms of economics or policy, but the casual language tech leaders often use to describe AI — summoning an inanimate force with the powers of code — sounds more... magical. So, what can myth and magic teach us about the AI race? Josh Schrei, mythologist and host of The Emerald podcast,  says that foundational cultural tales like "The Sorcerer's Apprentice" or Prometheus teach us the importance of initiation, responsibility, human knowledge, and care.  He argues these stories and myths can guide ethical tech development by reminding us what it is to be human. 

    Correction: Josh says the first telling of "The Sorcerer’s Apprentice" myth dates back to ancient Egypt, but it actually dates back to ancient Greece.

    RECOMMENDED MEDIA 

    The Emerald podcast

    The Emerald explores the human experience through a vibrant lens of myth, story, and imagination

    Embodied Ethics in The Age of AI

    A five-part course with The Emerald podcast’s Josh Schrei and School of Wise Innovation’s Andrew Dunn

    Nature Nurture: Children Can Become Stewards of Our Delicate Planet

    A U.S. Department of the Interior study found that the average American kid can identify hundreds of corporate logos but not plants and animals

    The New Fire

    AI is revolutionizing the world - here's how democracies can come out on top. This upcoming book was authored by an architect of President Biden's AI executive order

    RECOMMENDED YUA EPISODES 

    How Will AI Affect the 2024 Elections?

    The AI Dilemma

    The Three Rules of Humane Tech

    AI Myths and Misconceptions

     

    Your Undivided Attention is produced by the Center for Humane Technology. Follow us on Twitter: @HumaneTech_