Logo

    How Apple and Microsoft Built the Seeing-Eye Phone

    enDecember 03, 2021
    What was the main topic of the podcast episode?
    Summarise the key points discussed in the episode?
    Were there any notable quotes or insights from the speakers?
    Which popular books were mentioned in this episode?
    Were there any points particularly controversial or thought-provoking discussed in the episode?
    Were any current events or trending topics addressed in the episode?

    About this Episode

    Your smartphone can see, hear, and speak—even if you can’t. So it occurred to the engineers at Apple and Microsoft: Can the phone be a talking companion for anyone with low vision, describing what it’s seeing in the world around you?

    Today, it can. Thanks to some heavy doses of machine learning and augmented reality, these companies’ apps can identify things, scenes, money, colors, text, and even people (“30-year-old man with brown hair, smiling, holding a laptop—probably Stuart”)—and then speak, in words, what’s in front of you, in a photo or in the real world. In this episode, the creators of these astonishing features reveal how they turned the smartphone into a professional personal describer—and why they care so deeply about making it all work.

    Guests: Satya Nadella, Microsoft CEO. Saqib Shaikh, project lead for Microsoft’s Seeing AI app. Jenny Lay-Flurrie, Chief Accessibility Officer, Microsoft. Ryan Dour, accessibility engineer, Apple. Chris Fleizach, Mobile Accessibility Engineering Lead, Apple. Sarah Herrlinger, Senior Director of Global Accessibility, Apple.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    Recent Episodes from Unsung Science

    Grand Finale: A Pop Song is Born

    Grand Finale: A Pop Song is Born

    In the days of old, creating a song required a composer, a lyricist, an arranger, a recording engineer, a band or orchestra. Today, in the pop world, a single person often handles those jobs in a single studio. In this extraordinary episode, you’ll hear two-time Grammy winner Oak Felder create a new song, in real time, start to finish—and you’ll gain incredible insight into how technology and talent team up to produce art.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    Electric Planes Take Off

    Electric Planes Take Off

    Planes contribute 9% of the world’s carbon pollution, but electrifying them has always seemed impossible; batteries have never been powerful or light enough to carry themselves. But in 2023, batteries reached a tipping point in power and weight. Beta Technologies, based in Vermont, is flying its six-passenger vertical-takeoff airplanes every day. David Pogue was there at takeoff.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    Genetics, Votes, and Colin Firth

    Genetics, Votes, and Colin Firth

    The U.S. has fallen into polarized, partisan, political bickering. Online, liberals and conservatives seem to despise each other. But nobody seems to stop to ask: How did we get our liberal and conservative views in the first place? We formed our opinions by carefully weighing the issues and thoughtfully choosing a stance, right? Well, no; turns out over half of our political leanings are determined, incredibly, by our genes. In this episode: How we figured that out, and what it means for our future.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    How Does Google Maps Do It?

    How Does Google Maps Do It?

    Every month, over a billion people open their phones and fire up Google Maps. Its original function—offering driving directions, with real-time traffic tracking—was disruptive enough in 2008, when most people had to pay $10 a month for traffic data. But since that time, it’s become a global business directory, a transit timetable, crowdedness monitor, a Street View miracle—and now, in its newest release, an augmented-reality viewer of the cityscape around you. The question is: How is Google doing it, and why is it free? Meet the man who runs Google’s entire Geo division.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    How Cool Tech is Saving the Whales

    How Cool Tech is Saving the Whales

    For the most part, we don’t hunt whales anymore, but we’re still killing them—mostly by driving ships into them. One species, the North Atlantic right whale, is now extinct in most parts of the world; only 340 are left. But it may not be too late. An extraordinary coalition of nonprofits, research institutions, foundations, and even megalithic shipping corporations are teaming up to develop technology, prove the science, and, yes, save the whales.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    How the Webb Telescope Sees Back in Time

    How the Webb Telescope Sees Back in Time

    On Christmas Day, 2021, NASA launched the James Webb Space Telescope into orbit a million miles from Earth—a huge and insanely ambitious machine, billions of dollars over budget and 14 years past deadline. Now, as the telescope completes its first year of capturing astonishing images of the universe as it was just after the Big Bang, its creators discuss why so many things went right.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    Inside Elon Musk's Brain

    Inside Elon Musk's Brain

    People use all kinds of words to describe Elon Musk, from “genius” to “megalomaniac,” from “visionary” to “erratic”—but now there’s less reason to call him “enigmatic,” thanks to Walter Isaacson’s new 688-page biography. Isaacson hung out with Musk for two years, attending meetings, witnessing meltdowns, taking Musk’s 3 a.m. phone calls. In this special “Unsung Science” episode, Isaacson describes the man behind Tesla,     SpaceX, Starlink, and the social-media site once known as Twitter.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    Screaming Babies, Noise Canceling, and You

    Screaming Babies, Noise Canceling, and You

    In April 1978, MIT professor Amar Bose was flying home to Boston from Switzerland. But when he tried to listen to music through the airline’s headphones, he couldn’t hear a darned thing. He spent the rest of the flight doing acoustical math—and sketching out an idea for headphones that literally subtracted background noise from what you hear. Today, noise-canceling headphones are everywhere. But the revolution began with Amar Bose’s airplane sketches—and the 22-year, $50 million journey that led them to the ears on your head.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    The Pulse-Pounding Origin Story of USB-C

    The Pulse-Pounding Origin Story of USB-C

    There’s a new kind of jack in town—well, new as of 2014—called USB-C. This single, tiny connector can carry power, video, audio, and data between electronic gadgets—simultaneously. It can replace a laptop’s power cord, USB jacks, video output jack, and headphone jack. The connector is symmetrical, so you can’t insert it upside-down. It’s identical end for end, too, so it doesn’t matter which end you grab first. USB-C has the potential to charge your gadget faster and transfer data faster than what’s come before, too. And the brand doesn’t matter. My Samsung USB-C cable can charge your Apple MacBook and his Surface tablet. The only question left: Where did it come from? Who invented it? And why?

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    CeCe Moore Cracks Cold Cases with Genealogy

    CeCe Moore Cracks Cold Cases with Genealogy

    Genealogy has been around a while. So has DNA evidence. But what if you combined the two? What if you could use DNA from a crime scene, compare the unknown killer’s genetics with public databases of other people’s DNA, figure out who his relatives are, and thereby determine his identity? That’s the system that CeCe Moore invented five years ago. So far, she’s cracked over 270 cold cases using this method—and brought closure to hundreds of grieving families.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.