Context windows, computer constraints, and energy consumption with Sarah and Elad
This week on No Priors hosts, Sarah and Elad are catching up on the latest AI news. They discuss the recent developments in AI music generation, and if you’re interested in generative AI music, stay tuned for next week’s interview! Sarah and Elad also get into device-resident models, AI hardware, and ask just how smart smaller models can really get. These hardware constraints were compared to the hurdles AI platforms are continuing to face including computing constraints, energy consumption, context windows, and how to best integrate these products in apps that users are familiar with.
Have a question for our next host-only episode or feedback for our team? Reach out to show@no-priors.com
Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil
Show Notes:
(0:00) Intro
(1:25) Music AI generation
(4:02) Apple’s LLM
(11:39) The role of AI-specific hardware
(15:25) AI platform updates
(18:01) Forward thinking in investing in AI
(20:33) Unlimited context
(23:03) Energy constraints
