Logo

    Bethany McLean - Enron, FTX, 2008, Musk, Frauds, & Visionaries

    enDecember 21, 2022
    What role does self-delusion play in business scandals?
    How are Enron and FTX situations similar or different?
    Why is understanding human motivation crucial for business leaders?
    What are the challenges in designing effective compensation schemes?
    How does finance impact the overall economy according to the speaker?

    Podcast Summary

    • The Power of Self-Delusion in Business ScandalsSelf-delusion can prevent individuals from learning from past business scandals, emphasizing the importance of ongoing vigilance and understanding complexities of human behavior.

      The line between a visionary and a fraudster can be blurred, with self-delusion playing a significant role in business scandals. Bethany McClean, an acclaimed finance nonfiction writer, discussed this in relation to Enron and the global financial crisis. Despite similarities between these events and the ongoing situation with FTX, it's uncertain if SBF, the founder of FTX, was directly influenced by these past stories. Self-delusion is a powerful force that can prevent individuals from learning from history, making it crucial for us to understand these events for their inherent value in making sense of the world. While some may argue that we've addressed the issues highlighted in past scandals, new cases serve as reminders of the complexities of human behavior and the importance of ongoing vigilance.

    • Despite regulations like Sarbanes Oxley and Dodd-Frank, complex business and finance systems may not be fully protected from fraud.Regulations have limited impact on preventing fraud in complex business and finance systems, and harsh punishment for executives may not be consistent.

      While the regulations put in place after Enron, such as Sarbanes Oxley and Dodd-Frank, have had some impact on preventing large-scale fraud, the complexities of modern business and finance mean that these regulations may not be enough to fully protect investors. The Enron case involved both legal and actual fraud, with the company manipulating accounting rules to create a false economic reality and top executives engaging in self-dealing. The government's aggressive prosecution of Enron's top executives, particularly Jeff Skilling, was justified given the widespread insecurity caused by the company's collapse. However, the contrast between the harsh punishment meted out to Skilling and the lack of consequences faced by those involved in the financial crisis raises questions about the fairness and effectiveness of these regulations.

    • The role of short sellers in market efficiencyShort sellers challenge market inefficiencies, but societal biases and market conditions limit their numbers. Markets may be efficient in the long term but can be irrational in the short term, and short sellers help correct this.

      The market's efficiency and the role of short sellers are complex issues. During the Enron scandal, investment banks made significant money from providing services to Enron as its stock was rising, but short sellers like Jim Chanos also profited greatly from betting against the company. However, the shortage of short sellers exists due to societal biases against shorting, the long-term bull market making it difficult to make money through shorting, and the mental fortitude required to hold a contrarian view for an extended period. The efficient market hypothesis suggests that markets should price assets based on all available information, but the Enron case raises questions about its validity. The market may be efficient in the long term but can be irrational in the short term, and believing in its efficiency and rationality at all times is incorrect. Short sellers play a crucial role in correcting irrational exuberance, but their bias is often overlooked, and the market's inefficiencies persist.

    • Private markets: Bubbles and inflated valuationsThe lack of transparency and accountability in private markets could lead to bubbles and inflated valuations, potentially impacting various investors including pension funds and mutual funds.

      The increasing amount of money flowing into private markets, particularly in technology and venture capital, could potentially lead to bubbles and inflated valuations due to the lack of transparency and accountability. Institutional investors, including pension funds and mutual funds, are not immune to this trend, and the ability to privately mark portfolio company values can create a false sense of security. The recent piece in The Economist about private equity marks highlights this concern. Musk's story serves as an example of grand visions and government subsidies not always materializing as promised, which raises questions about the legitimacy of some private market success stories. Overall, the shift towards private assets may not be as safe as some believe, and the potential consequences could impact a wide range of investors.

    • Musk's acquisition of SolarCity driven by financial and reputational concernsMusk's loans to SolarCity and fear of bankruptcy, as well as protecting his reputation, led him to acquire the company

      Elon Musk's acquisition of SolarCity was driven by both financial and reputational concerns. Musk had extended loans to SolarCity that were at risk of being lost if the company went bankrupt, and he saw the acquisition as a way to bail himself out. Additionally, allowing SolarCity to fail could have cast doubt on Musk's image as a successful entrepreneur. The line between visionary and fraudster is not as clear-cut as it may seem, and intelligence does not necessarily protect one from committing fraud. In fact, some of the most notable corporate frauds have been perpetrated by highly intelligent individuals. The relationship between intelligence and fraud is complex, and it may be that the ability to rationalize actions, a trait common to intelligent individuals, can contribute to fraudulent behavior. The recent implosion of Twitter and the fallout for Elon Musk's reputation adds an interesting layer to this discussion.

    • Culture of deal making and self-delusionCorporate culture, incentives, and successful leaders can enable self-delusion and potentially fraudulent behavior through the obsession with deal making and rationalizing actions as blameless

      The ability to rationalize actions as blameless and the obsession with deal making for its own sake, rather than for the benefit of the company, can contribute to self-delusion and potentially fraudulent behavior. This pattern is not limited to individuals or companies that have ultimately failed, but seems to be prevalent across corporate America. The culture of a company, including the incentives it sets, plays a significant role in enabling or discouraging such behavior. Culture can be so compelling that individuals may not question the actions of their organization, even when they go against economic logic. Successful and charismatic leaders can further amplify this effect, making individuals more susceptible to mass delusion.

    • Understanding human motivations beyond incentivesExploring desires to matter and make a difference can motivate people, but jail sentences may not deter white-collar crime. Effective compensation schemes can align interests, but designing them is complex.

      Understanding human desires and motivations beyond incentives is crucial in influencing people's behavior, especially in the context of business and leadership. The desire to matter and make a difference can be a powerful motivator, and tapping into it can lead to significant impact. However, when it comes to deterring white-collar crime through punishment, the effectiveness is questionable. People may not consciously consider the potential consequences of their actions, and jail sentences may not serve as a deterrent. Instead, alternative incentives, such as long-term compensation schemes, can be explored to align executives' interests with the company's performance. However, designing effective compensation schemes is a complex challenge, as they may have unintended consequences that can lead to undesirable outcomes. Ultimately, a nuanced understanding of human psychology and motivation is essential in navigating these complex issues.

    • Compensation Systems and Their ImplicationsThe Enron scandal led to successful firms post-Enron, but long-term compensation and longer vesting periods have potential downsides. The crypto industry's future is uncertain, and finance's productive use in the economy is worth questioning.

      The discussion revolves around the idea of compensation systems and their potential implications. The speaker shares his perspective on the Enron scandal and how it led to a wave of successful firms post-Enron. He also raises questions about the importance of long-term compensation and the potential downsides of longer vesting periods. Furthermore, the conversation touches upon the crypto industry and its future, with the speaker expressing his skepticism and lack of understanding. Lastly, the speaker brings up the role of finance in the economy and wonders about the productive use of 9% of GDP in finance. Overall, the conversation sheds light on various aspects of business, compensation, and finance.

    • The finance industry's disproportionate influence and rewardsThe finance industry's dominance in attracting top talent and rewards can be detrimental to a healthy economy, as it may not contribute as significantly to employment and societal improvement as starting businesses do.

      The dominance of the finance industry, particularly hedge funds and private equity, in attracting top talent and disproportionate financial rewards, is a sign of an unhealthy economy. This issue is compounded by the fact that these industries may not contribute as significantly to employment and societal improvement as starting businesses do. The finance industry is meant to be the foundation that enables businesses and economic growth, but when it becomes the focus instead, it becomes problematic. Additionally, the ease with which some have made vast fortunes in finance, often due to external factors like low interest rates, can create an unfair perception of skill and intelligence. The debate around Fannie and Freddie's role in the economy highlights the complexity of understanding the financial sector's impact and the challenges in maintaining a balanced and productive economy.

    • Concerns over Fannie Mae, Freddie Mac and rising household debtThe speaker raised concerns over the potential risks of Fannie Mae, Freddie Mac's conservatorship and increasing household debt, emphasizing the importance of understanding the bigger picture and addressing these issues to prevent another financial crisis.

      The current state of Fannie Mae and Freddie Mac's conservatorship and the increasing household debt in the United States are complex issues with significant implications for the financial system. The speaker expressed concern over the potential risks and the lack of political will to address these issues. The mortgage crisis of 2008 serves as a reminder of the dangers of opaque financial instruments and the importance of understanding the bigger picture. Consumer debt, while different from mortgage-backed securities, still requires careful attention due to its potential impact on the economy. Unfortunately, there seems to be a lack of focus on these issues, leaving their resolution uncertain. Additionally, the speaker emphasized the importance of considering the broader context and trends, rather than getting lost in the details of specific areas.

    • Identifying Financial Calamities: A Complex TaskExperts struggle to predict financial crises due to complexities of financial system and unpredictability of confidence.

      While experts and analysts can help identify and understand the causes and consequences of financial calamities after they occur, they are not able to accurately predict them. The Financial Security Oversight Committee was established after the global financial crisis to identify and examine potential risks, but the complexities of the financial system and the unpredictability of confidence make it difficult to quantify and analyze the risks of a confidence collapse. In a world where local news has been decimated, the chances of identifying potential financial crises through serendipitous discovery are lower. Math and logic training can help in identifying missing pieces and connecting the dots, but there is no one right answer for the education required for someone thinking about the big picture.

    • Understanding the improbable through journalistic foundation and imaginationBe open-minded, question assumptions, and be aware of biases to make informed decisions in business and beyond.

      Having a strong journalistic foundation and the ability to question what doesn't make sense are crucial in understanding the improbable becoming probable. The speaker emphasizes the importance of training and imagination, as well as recognizing that the impossible can become reality in business history. Hindsight is often 2020, and it's difficult to identify red flags in the moment. Biases and the order of information presentation can also impact perception. For instance, the speaker questions whether they would have identified the problems with FTX if they had become interested in crypto a year earlier. In the case of fracking, the speaker wonders if investors were right in anticipating an oil shock and if it's now profitable due to that prediction. Ultimately, being open-minded, questioning assumptions, and being aware of biases are essential for making informed decisions.

    • Limited impact of US shale oil on world production and pricesThe US shale oil industry's inability to produce at scale questions its game-changing potential, while rating agencies' past scandals raise concerns about their impartiality and impact on financial markets.

      The US shale oil industry, while still profitable, has not lived up to the hype of being a game-changer in world oil production or prices. The industry's inability to produce at the required scale to be a major swing producer has proven the underlying thesis that the amount of oil that can be extracted profitably is limited. Additionally, the role of rating agencies in financial markets, particularly in the context of scandals like Enron and the housing crisis, raises questions about their ability to provide fair evaluations when paid by the entities being evaluated. Despite the reliance on credit ratings by many investors, the desire for cover provided by these agencies may hinder efforts to reform or do away with them.

    • Exploring solutions to prevent future corporate crisesWhile investigations after crises help uncover the truth, the costly and time-consuming bankruptcy process and the role of various entities in preventing future crises are key considerations.

      Despite efforts to reform institutions, such as credit rating agencies, in the wake of financial crises, the complexities of preventing future issues can be challenging. The FAA's thorough investigation process after plane crashes serves as an interesting analogy for addressing corporate crises, but the feasibility and applicability of such a system in the business world is uncertain. The bankruptcy process, while necessary for excavating the truth and preventing future manipulation, can be costly and time-consuming, with a significant amount of resources going towards legal fees and investigations. The role of various entities, including regulators, investigators, and journalists, in uncovering the truth is crucial for telling the overall story and preventing future crises. The bankruptcy administrator, such as John Ray in the cases of Enron and FTX, plays a vital role in this process, but the extent of their impact is still uncertain. Overall, finding a more efficient and effective way to address corporate crises and prevent future ones remains an ongoing challenge.

    • Perception can impact outcome in various situationsApproach stories with an open mind, avoid bias towards a particular outcome, and consider the impact of perception on individuals and organizations.

      The way individuals and organizations are perceived can greatly impact the outcome of a situation. In the case of the bankruptcy administrator of a major disaster, downplaying the severity of the situation could lead to criticism and mistrust, while exaggerating it could lead to praise and admiration. Similarly, in investigative journalism, initial assumptions about the actors involved can change as more information comes to light. The financial crisis is an example of this, where Bethany McLean initially believed homeowners were equally responsible for the crisis, but later changed her view after discovering deceptive tactics used by banks to sell risky mortgages. It's important for journalists to approach stories with an open mind and avoid bias towards a particular outcome. Additionally, the willingness of individuals or organizations to cooperate with journalists can lead to unique and interesting stories, regardless of the final interpretation.

    • Understanding the complexities of deception and ethical dilemmasStay informed, maintain ethical standards, and be vigilant to avoid unethical situations in investigative journalism or other fields.

      While some people may be more inclined towards truth-telling and transparency than others, human nature includes the capacity for deception. The line between deception and rationalization can be blurred, and the concept of moral luck adds complexity to the issue. To avoid getting involved in unethical situations, it's essential to be aware of bad people and bad situations and keep oneself clear of them. For those looking to pursue careers in investigative journalism or other fields that involve piecing together the big picture, the landscape has changed, and the advice given in the past may not apply. Instead, it's crucial to stay informed, maintain ethical standards, and be vigilant in identifying and avoiding unethical situations.

    • Exploring the economic consequences of the pandemic through writingWriting reveals gaps in comprehension and sheds light on societal rules shaping markets, with an upcoming book exploring capitalism's flaws during the pandemic.

      Writing provides a unique and essential perspective for understanding complex ideas. The speaker, a writer, shares how pursuing a writing career without financial support is more challenging now than in the past. However, the act of writing itself forces intellectual honesty and clarity, revealing gaps in comprehension. The speaker's upcoming book with Joan Osera explores the economic consequences of the pandemic and the role of government in shaping capitalism. The speaker emphasizes that markets don't exist independently of societal rules, and improper conditions can lead to market failures. The book aims to examine the flaws in capitalism and how they were exposed during the pandemic. The book is set to be released in October 2023.

    Recent Episodes from Dwarkesh Podcast

    David Reich - How One Small Tribe Conquered the World 70,000 Years Ago

    David Reich - How One Small Tribe Conquered the World 70,000 Years Ago

    I had no idea how wild human history was before chatting with the geneticist of ancient DNA David Reich.

    Human history has been again and again a story of one group figuring ‘something’ out, and then basically wiping everyone else out.

    From the tribe of 1k-10k modern humans who killed off all the other human species 70,000 years ago; to the Yamnaya horse nomads 5,000 years ago who killed off 90+% of (then) Europeans and also destroyed the Indus Valley.

    So much of what we thought we knew about human history is turning out to be wrong, from the ‘Out of Africa’ theory to the evolution of language, and this is all thanks to the research from David Reich’s lab.

    Buy David Reich’s fascinating book, Who We Are How We Got Here.

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here.

    Follow me on Twitter for updates on future episodes.

    Sponsor

    This episode is brought to you by Stripe, financial infrastructure for the internet. Millions of companies from Anthropic to Amazon use Stripe to accept payments, automate financial processes and grow their revenue.

    If you’re interested in advertising on the podcast, check out this page.

    Timestamps

    (00:00:00) – Archaic and modern humans gene flow

    (00:20:24) – How early modern humans dominated the world

    (00:39:59) – How bubonic plague rewrote history

    (00:50:03) – Was agriculture terrible for humans?

    (00:59:28) – Yamnaya expansion and how populations collide

    (01:15:39) – “Lost civilizations” and our Neanderthal ancestry

    (01:31:32) – The DNA Challenge

    (01:41:38) – David’s career: the genetic vocation



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enAugust 29, 2024

    Joe Carlsmith - Otherness and control in the age of AGI

    Joe Carlsmith - Otherness and control in the age of AGI

    Chatted with Joe Carlsmith about whether we can trust power/techno-capital, how to not end up like Stalin in our urge to control the future, gentleness towards the artificial Other, and much more.

    Check out Joe's sequence on Otherness and Control in the Age of AGI here.

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for updates on future episodes.

    Sponsors:

    - Bland.ai is an AI agent that automates phone calls in any language, 24/7. Their technology uses "conversational pathways" for accurate, versatile communication across sales, operations, and customer support. You can try Bland yourself by calling 415-549-9654. Enterprises can get exclusive access to their advanced model at bland.ai/dwarkesh.

    - Stripe is financial infrastructure for the internet. Millions of companies from Anthropic to Amazon use Stripe to accept payments, automate financial processes and grow their revenue.

    If you’re interested in advertising on the podcast, check out this page.

    Timestamps:

    (00:00:00) - Understanding the Basic Alignment Story

    (00:44:04) - Monkeys Inventing Humans

    (00:46:43) - Nietzsche, C.S. Lewis, and AI

    (1:22:51) - How should we treat AIs

    (1:52:33) - Balancing Being a Humanist and a Scholar

    (2:05:02) - Explore exploit tradeoffs and AI



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enAugust 22, 2024

    Patrick McKenzie - How a Discord Server Saved Thousands of Lives

    Patrick McKenzie - How a Discord Server Saved Thousands of Lives

    I talked with Patrick McKenzie (known online as patio11) about how a small team he ran over a Discord server got vaccines into Americans' arms: A story of broken incentives, outrageous incompetence, and how a few individuals with high agency saved 1000s of lives.

    Enjoy!

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here.

    Follow me on Twitter for updates on future episodes.

    Sponsor

    This episode is brought to you by Stripe, financial infrastructure for the internet. Millions of companies from Anthropic to Amazon use Stripe to accept payments, automate financial processes and grow their revenue.

    Timestamps

    (00:00:00) – Why hackers on Discord had to save thousands of lives

    (00:17:26) – How politics crippled vaccine distribution

    (00:38:19) – Fundraising for VaccinateCA

    (00:51:09) – Why tech needs to understand how government works

    (00:58:58) – What is crypto good for?

    (01:13:07) – How the US government leverages big tech to violate rights

    (01:24:36) – Can the US have nice things like Japan?

    (01:26:41) – Financial plumbing & money laundering: a how-not-to guide

    (01:37:42) – Maximizing your value: why some people negotiate better

    (01:42:14) – Are young people too busy playing Factorio to found startups?

    (01:57:30) – The need for a post-mortem



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enJuly 24, 2024

    Tony Blair - Life of a PM, The Deep State, Lee Kuan Yew, & AI's 1914 Moment

    Tony Blair - Life of a PM, The Deep State, Lee Kuan Yew, & AI's 1914 Moment

    I chatted with Tony Blair about:

    - What he learned from Lee Kuan Yew

    - Intelligence agencies track record on Iraq & Ukraine

    - What he tells the dozens of world leaders who come seek advice from him

    - How much of a PM’s time is actually spent governing

    - What will AI’s July 1914 moment look like from inside the Cabinet?

    Enjoy!

    Watch the video on YouTube. Read the full transcript here.

    Follow me on Twitter for updates on future episodes.

    Sponsors

    - Prelude Security is the world’s leading cyber threat management automation platform. Prelude Detect quickly transforms threat intelligence into validated protections so organizations can know with certainty that their defenses will protect them against the latest threats. Prelude is backed by Sequoia Capital, Insight Partners, The MITRE Corporation, CrowdStrike, and other leading investors. Learn more here.

    - This episode is brought to you by Stripe, financial infrastructure for the internet. Millions of companies from Anthropic to Amazon use Stripe to accept payments, automate financial processes and grow their revenue.

    If you’re interested in advertising on the podcast, check out this page.

    Timestamps

    (00:00:00) – A prime minister’s constraints

    (00:04:12) – CEOs vs. politicians

    (00:10:31) – COVID, AI, & how government deals with crisis

    (00:21:24) – Learning from Lee Kuan Yew

    (00:27:37) – Foreign policy & intelligence

    (00:31:12) – How much leadership actually matters

    (00:35:34) – Private vs. public tech

    (00:39:14) – Advising global leaders

    (00:46:45) – The unipolar moment in the 90s



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enJune 26, 2024

    Francois Chollet, Mike Knoop - LLMs won’t lead to AGI - $1,000,000 Prize to find true solution

    Francois Chollet, Mike Knoop - LLMs won’t lead to AGI - $1,000,000 Prize to find true solution

    Here is my conversation with Francois Chollet and Mike Knoop on the $1 million ARC-AGI Prize they're launching today.

    I did a bunch of socratic grilling throughout, but Francois’s arguments about why LLMs won’t lead to AGI are very interesting and worth thinking through.

    It was really fun discussing/debating the cruxes. Enjoy!

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here.

    Timestamps

    (00:00:00) – The ARC benchmark

    (00:11:10) – Why LLMs struggle with ARC

    (00:19:00) – Skill vs intelligence

    (00:27:55) - Do we need “AGI” to automate most jobs?

    (00:48:28) – Future of AI progress: deep learning + program synthesis

    (01:00:40) – How Mike Knoop got nerd-sniped by ARC

    (01:08:37) – Million $ ARC Prize

    (01:10:33) – Resisting benchmark saturation

    (01:18:08) – ARC scores on frontier vs open source models

    (01:26:19) – Possible solutions to ARC Prize



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enJune 11, 2024

    Leopold Aschenbrenner - China/US Super Intelligence Race, 2027 AGI, & The Return of History

    Leopold Aschenbrenner - China/US Super Intelligence Race, 2027 AGI, & The Return of History

    Chatted with my friend Leopold Aschenbrenner on the trillion dollar nationalized cluster, CCP espionage at AI labs, how unhobblings and scaling can lead to 2027 AGI, dangers of outsourcing clusters to Middle East, leaving OpenAI, and situational awareness.

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here.

    Follow me on Twitter for updates on future episodes. Follow Leopold on Twitter.

    Timestamps

    (00:00:00) – The trillion-dollar cluster and unhobbling

    (00:20:31) – AI 2028: The return of history

    (00:40:26) – Espionage & American AI superiority

    (01:08:20) – Geopolitical implications of AI

    (01:31:23) – State-led vs. private-led AI

    (02:12:23) – Becoming Valedictorian of Columbia at 19

    (02:30:35) – What happened at OpenAI

    (02:45:11) – Accelerating AI research progress

    (03:25:58) – Alignment

    (03:41:26) – On Germany, and understanding foreign perspectives

    (03:57:04) – Dwarkesh’s immigration story and path to the podcast

    (04:07:58) – Launching an AGI hedge fund

    (04:19:14) – Lessons from WWII

    (04:29:08) – Coda: Frederick the Great



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enJune 04, 2024

    John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI

    John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI

    Chatted with John Schulman (cofounded OpenAI and led ChatGPT creation) on how posttraining tames the shoggoth, and the nature of the progress to come...

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for updates on future episodes.

    Timestamps

    (00:00:00) - Pre-training, post-training, and future capabilities

    (00:16:57) - Plan for AGI 2025

    (00:29:19) - Teaching models to reason

    (00:40:50) - The Road to ChatGPT

    (00:52:13) - What makes for a good RL researcher?

    (01:00:58) - Keeping humans in the loop

    (01:15:15) - State of research, plateaus, and moats

    Sponsors

    If you’re interested in advertising on the podcast, fill out this form.

    * Your DNA shapes everything about you. Want to know how? Take 10% off our Premium DNA kit with code DWARKESH at mynucleus.com.

    * CommandBar is an AI user assistant that any software product can embed to non-annoyingly assist, support, and unleash their users. Used by forward-thinking CX, product, growth, and marketing teams. Learn more at commandbar.com.



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enMay 15, 2024

    Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

    Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

    Mark Zuckerberg on:

    - Llama 3

    - open sourcing towards AGI

    - custom silicon, synthetic data, & energy constraints on scaling

    - Caesar Augustus, intelligence explosion, bioweapons, $10b models, & much more

    Enjoy!

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Human edited transcript with helpful links here.

    Timestamps

    (00:00:00) - Llama 3

    (00:08:32) - Coding on path to AGI

    (00:25:24) - Energy bottlenecks

    (00:33:20) - Is AI the most important technology ever?

    (00:37:21) - Dangers of open source

    (00:53:57) - Caesar Augustus and metaverse

    (01:04:53) - Open sourcing the $10b model & custom silicon

    (01:15:19) - Zuck as CEO of Google+

    Sponsors

    If you’re interested in advertising on the podcast, fill out this form.

    * This episode is brought to you by Stripe, financial infrastructure for the internet. Millions of companies from Anthropic to Amazon use Stripe to accept payments, automate financial processes and grow their revenue. Learn more at stripe.com.

    * V7 Go is a tool to automate multimodal tasks using GenAI, reliably and at scale. Use code DWARKESH20 for 20% off on the pro plan. Learn more here.

    * CommandBar is an AI user assistant that any software product can embed to non-annoyingly assist, support, and unleash their users. Used by forward-thinking CX, product, growth, and marketing teams. Learn more at commandbar.com.



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Sholto Douglas & Trenton Bricken - How to Build & Understand GPT-7's Mind

    Sholto Douglas & Trenton Bricken - How to Build & Understand GPT-7's Mind

    Had so much fun chatting with my good friends Trenton Bricken and Sholto Douglas on the podcast.

    No way to summarize it, except: 

    This is the best context dump out there on how LLMs are trained, what capabilities they're likely to soon have, and what exactly is going on inside them.

    You would be shocked how much of what I know about this field, I've learned just from talking with them.

    To the extent that you've enjoyed my other AI interviews, now you know why.

    So excited to put this out. Enjoy! I certainly did :)

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. 

    There's a transcript with links to all the papers the boys were throwing down - may help you follow along.

    Follow Trenton and Sholto on Twitter.

    Timestamps

    (00:00:00) - Long contexts

    (00:16:12) - Intelligence is just associations

    (00:32:35) - Intelligence explosion & great researchers

    (01:06:52) - Superposition & secret communication

    (01:22:34) - Agents & true reasoning

    (01:34:40) - How Sholto & Trenton got into AI research

    (02:07:16) - Are feature spaces the wrong way to think about intelligence?

    (02:21:12) - Will interp actually work on superhuman models

    (02:45:05) - Sholto’s technical challenge for the audience

    (03:03:57) - Rapid fire



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat

    Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat

    Here is my episode with Demis Hassabis, CEO of Google DeepMind

    We discuss:

    * Why scaling is an artform

    * Adding search, planning, & AlphaZero type training atop LLMs

    * Making sure rogue nations can't steal weights

    * The right way to align superhuman AIs and do an intelligence explosion

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here.

    Timestamps

    (0:00:00) - Nature of intelligence

    (0:05:56) - RL atop LLMs

    (0:16:31) - Scaling and alignment

    (0:24:13) - Timelines and intelligence explosion

    (0:28:42) - Gemini training

    (0:35:30) - Governance of superhuman AIs

    (0:40:42) - Safety, open source, and security of weights

    (0:47:00) - Multimodal and further progress

    (0:54:18) - Inside Google DeepMind



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Related Episodes

    Paper F8: Laws and regulations

    Paper F8: Laws and regulations
    An important part of an external audit is the consideration by the auditor as to whether the client has complied with laws and regulations. Candidates preparing for F8, Audit and Assurance and P7, Advanced Audit and Assurance should have an understanding of how laws and regulations affect an audit. The auditing standard that is relevant to this podcast is ISA 250, Consideration of Laws and Regulations in an Audit of Financial Statements.

    #33 - A Movement Towards Equilibrium: The Situation of Treasury Fraud & Controls (Bottomline)

    #33 - A Movement Towards Equilibrium: The Situation of Treasury Fraud & Controls (Bottomline)

    In 2019, treasurers are feeling more secure and able to defend their organization against fraud, but fraud still exists. Craig Jeffery of Strategic Treasurer sits down with Chris Gerda, Risk and Fraud Prevention Officer and James Richardson, Head of Market Development of Bottomline Technologies to discuss the 2019 Treasury Fraud & Controls Survey Results. They describe how making and receiving secure payments should and should not look, along with other ways some need to step up and take action to prevent fraudulent behavior occurring in their organization. Listen in to their discussion.

    The Valley Current®: Does FTX Represent the Pinnacle of Massive Failures?

    The Valley Current®: Does FTX Represent the Pinnacle of Massive Failures?

    Incompetent boss jokes have long been a staple in the workforce, but between the Theranos convictions and now the FTX implosion there may be more than a little truth behind these jokes. Executives running their companies while not fully understanding their business appear to have become a growing trend and its resulting in massive cases of fraud. The consequences aren’t just for the CEO’s though, Sam Bankman-Fried admitting he screwed up with FTX has brought back skepticism regarding if we are headed towards a cashless or bank-free society. Host Jack Russo and CPA Steve Rabin discuss what impact FTX will have on the future of cryptocurrencies, inept leadership, and new layers of legislation.