Logo
    Search

    Byrne Hobart - FTX, Drugs, Twitter, Taiwan, & Monasticism

    enDecember 01, 2022

    Podcast Summary

    • The True Nature of FTX's Collapse is UnclearDespite encrypted chats and lack of proper accounting, it's unclear if FTX's collapse was due to fraud or poor accounting. Solutions differ based on the story.

      Key takeaway from the discussion about the FTX saga with Bernd Hobart is that the true nature of the events at FTX, a crypto exchange, is still unclear due to encrypted chats and lack of proper accounting. Multiple stories can be told, ranging from fraud to incompetence. If it was a Ponzi scheme, it's unclear when it started, and Alameda, an associated entity, may have used customer funds. However, if it was poor accounting, solutions like having a real auditor and consistent proof of reserves could be implemented. The actual story is likely a combination of extreme risk tolerance, poor accounting, and fraud at some point. It's worth understanding what happened because the solution sets differ based on the story. If it was fraud, it's harder to solve due to the willingness and ability of people to commit fraud. If it was poor accounting, it's more solvable. The fraud may have occurred late as a last desperate move. Ultimately, the response to FTX's collapse depends on what one believes happened. While most people would never intentionally commit fraud, the question becomes what one would do if they discovered they had spent customer funds unintentionally.

    • The FTX CEO's Reputation vs. RealityDespite a reputation for brilliance, the FTX CEO's operational errors demonstrate the importance of a well-rounded skill set for effective leadership.

      While the complexity of accounting fraud requires a high level of sophistication and attention to detail, the case of FTX suggests that even highly competent individuals can make significant operational errors. The FTX CEO's reputation as a genius was misleading, as the company's internal operations were chaotic, with poor record-keeping and a lack of oversight. The CEO may have intentionally played up his eccentricity to gain an advantage, but he may also have been so focused on his narrow area of expertise that he overlooked the importance of other skills. Ultimately, the story of FTX serves as a reminder that even the most brilliant individuals can make costly mistakes, and that effective leadership requires a well-rounded skill set.

    • Jane Street's Specialized Operations Team and Financial MarketsJane Street's operations team handles market stability and liquidity, enabling traders to focus on pricing discrepancies. The firm's opacity and emphasis on market presence during volatility necessitate a robust team. The use of stimulants in financial markets is significant but complex, requiring further research.

      Jane Street, a selective and profitable trading firm, may have a highly specialized operations team that handles the intricacies of market stability and liquidity, allowing traders to focus on identifying pricing discrepancies. The firm's opacity and emphasis on being present during market volatility necessitates a robust operations team. Additionally, the impact of drugs, particularly stimulants, on financial markets is an underrated yet significant factor. The historical connection between coffee shops and financial centers, as well as the consistent use of stimulants, suggests a link between alertness and financial activity. However, it's important to note that this is a complex issue and further research is needed to fully understand the relationship.

    • Impact of stimulants on economic boomsShort-term stimulants can lead to reckless behavior, while long-term require focus. Investor preferences for founders may shift between informal and formal based on economic trends.

      The type of stimulants used in business environments can significantly impact the nature of economic booms. Short-acting stimulants, like those used during hostile takeovers in the 1980s, can lead to reckless behavior and cost-cutting measures, while long-acting stimulants, such as those used during the mortgage-backed securities boom in the mid-2000s, require intricate detail and focus. Additionally, the public image of founders may also shift as investors move away from the informal, unconventional archetype towards more formal and detail-oriented individuals. This trend may be cyclical, with conformity and attention to detail becoming desirable qualities in certain industries. However, it's important to note that these observations are based on anecdotal evidence and further research is needed to confirm these trends.

    • Impact of upbringing on young talent's career trajectoryEarly identification of talent can be influenced heavily by parents and environment, making it challenging to separate natural ability from external factors.

      The hyperinformal behavior of founders, while it can signal a focused dedication to their work, can also indicate indifference to everything else and potentially be detrimental in regulated domains. Additionally, when identifying young talent, it's important to consider the influence of their upbringing and environment, as it can significantly impact their career trajectory. The earlier you go in identifying talent, the more you're over-indexing on what the parents did and emphasized. This can make it increasingly difficult to separate natural ability from external influences as you go younger. However, there are exceptions for prodigies and those with extraordinary talent. The trend of investing in younger talent is becoming more common, but it's crucial to remember the impact of their background on their development.

    • Assessing young talent's potential: Balancing natural ability and parental supportIdentifying young talent requires considering both natural ability and parental support. Overestimation of parental involvement can skew assessments, while neglecting it can lead to missed potential. Early exposure to activities can shape long-term interests, but it's crucial to recognize the modern manifestations of enduring aptitudes.

      Identifying young talent can be challenging due to the influence of parental involvement. Parents may overestimate their child's interests and abilities, making it difficult to assess true potential. Academic institutions often focus on short-term gains rather than long-term development, and aggressive parental involvement can lead to false signals of talent. It's essential to consider the intersection of natural ability and parental support when conducting talent searches. The ideal situation is finding individuals with both strong aptitude and supportive parents. However, there's a risk of identifying individuals with high potential but unsupportive home environments, leading to wasted talent once they leave home. Early exposure to certain activities can shape long-term interests and careers, but it's crucial to recognize that the modern instantiation of these enduring tendencies may vary. For instance, a child's aptitude for optimization and relentless focus could translate into various successful careers, such as finance or politics. Ultimately, the key is to identify and nurture raw talent while considering the role of supportive environments in shaping future success.

    • Parental involvement or connections can benefit certain rolesSome roles, particularly those requiring network-building and institutional attachment, can be influenced by parental involvement or connections, leading to significant advantages and impact on individual success.

      Certain roles, particularly those involving network-building and institutional attachment, may benefit from parental involvement or connections due to the unique skills and advantages they provide. The biography of Lyndon B. Johnson by Robert Caro is an excellent example of this, as Johnson's political career was significantly influenced by his upbringing and experiences. Caro's biographies offer valuable insights into the personalities and motivations of influential figures, and it's worth considering how many such figures exist today, especially in domains like sales, corporate development, and other areas where building a network is crucial. The impact of these individuals can be immense, as they're able to leverage their connections and relationships to grow faster and exert influence far beyond their own capabilities. However, it's important to note that not all roles require or benefit from this kind of parental involvement or connections. For instance, becoming a programmer may not rely on these factors as much, as everyone eventually reaches a point where technical skills and individual abilities become more important. Overall, the interplay between personal background, motivation, and the specific demands of a role is a complex issue, and the examples of figures like Johnson illustrate the potential impact of these factors on individual success.

    • Opportunities in stagnating industries for disruptive young individualsDuring times of industry change, ambitious young people can seize opportunities and make a significant impact through relentless determination and thorough research.

      Industries or sectors that have been stagnating for a long time and are approaching the limit of their current operating model present significant opportunities for disruptive, young individuals. This was evident during the New Deal era when the US government, which was hiring heavily, provided opportunities for ambitious young people like Lyndon B. Johnson to make their mark. The retirement or discrediting of older, established figures can lead to a significant shift in average industry age, creating a surge of opportunities. Caro's biography of Robert Moses illustrates the importance of relentless determination and thorough research in uncovering the truth. Caro's approach, which involved extensive research and documentation, likely had a profound impact on how influential figures in politics and urban governance view their roles. The Caro archetype, characterized by endless patience and a willingness to go the extra mile, may be less common but can leave a lasting impact.

    • Deep research reveals new insights and challenges beliefsDeep investigation can lead to a more nuanced understanding of complex subjects and the discovery of new information that challenges initial beliefs.

      The process of deep research and investigation can lead to a more nuanced understanding of complex subjects, as well as the discovery of new information that challenges previous beliefs. Robert Caro's biographies of powerful figures like Robert Moses and Lyndon B. Johnson serve as excellent examples of this. As Caro delved deeper into their stories, he found that there were aspects of their characters and actions that were initially overlooked or misunderstood. This ongoing process of discovery kept him motivated and ultimately led to groundbreaking works that provided a more complete picture of these historical figures. Additionally, the lengthy timeframe of his research allowed him to evolve his perspective on the subjects and present a complex, mixed view. Young people, inspired by events or figures, can also benefit from this approach, as they may uncover new insights and perspectives that deepen their understanding of the world around them.

    • Focus on passion and willfulness for successPassionately pursuing unique, weird projects increases chances of success. Produce impactful work in smaller increments for a more comprehensive understanding.

      Identifying and focusing on areas of passion and willfulness, rather than trying to optimize for industries or specific projects, can lead to success. The speaker suggests that the most interesting and impactful projects are often those that are weird and out there, with little infrastructure to support them. This selection process weeds out those who are not truly passionate and willful, leading to a higher likelihood of success. Additionally, producing impactful work in smaller increments, rather than trying to tackle large projects all at once, can lead to a more comprehensive understanding of a topic. This approach allows for a more nuanced and rounded view of the human condition and the specific object-level cases that contribute to the larger technological landscape.

    • Predicting Success or Failure of IndividualsDetermining success or failure of individuals is complex and uncertain, depending on their abilities, circumstances, and luck.

      Predicting the success or failure of individuals, especially those with ambitious plans, is a complex and uncertain endeavor. History is filled with examples of individuals who have made bold bets, some of which have paid off handsomely, while others have led to disastrous consequences. The line between a visionary and a collapsing star can be blurry, and it's often only in hindsight that we can determine which one was which. Some individuals seem to be responding to circumstances, while others have a clear long-term plan. However, even a well-thought-out plan can be dangerous if the individual has the means to execute it. Ultimately, the outcome depends on a variety of factors, including the individual's abilities, circumstances, and luck. As the speaker notes, it's often only after 200 years that we can look back and make a definitive assessment.

    • Leadership and Legitimacy on Twitter: Monarchs vs InstitutionsThe role of ambitious leaders like Elon Musk on Twitter versus institutionalized approaches raises questions about legitimacy and success, with potential implications for how people respond to and engage with social media platforms.

      The concept of ambition and leadership, particularly in the context of social media platforms like Twitter, raises complex questions about legitimacy and the role of institutions versus individual rule. The discussion highlights the potential implications of having a single monarch, like Elon Musk, leading Twitter versus a more institutionalized approach. The conversation also touches upon the idea that less ambitious people may end up repeating the same patterns, while those with bold ambitions might face failure or success. Additionally, the nature of Twitter's legitimacy and how people respond to it, including the role of humor and status, is another intriguing aspect explored in the conversation. Ultimately, the discussion suggests that these philosophies about leadership and legitimacy go in and out of fashion, with the US serving as an example of shifts between centralized systems with personal legitimacy and more rule-based systems.

    • The human desire for adventure and challengeThe human spirit, or thumos, drives us to seek adventure and overcome challenges, even in comfortable situations. The ability to respond to crises and maintain civilization depends on this spirit.

      Even in comfortable and seemingly stable situations, there exists a deep-rooted human desire for adventure, challenge, and the pursuit of glory. This was exemplified in the discussion through the analogy of playing a broken game of Civilization and the idea of "first men of history" in the context of companies like Twitter and Facebook. The concept of "thumos" or the human spirit was emphasized as a crucial factor in a civilization's ability to respond to external threats and maintain its existence. The post-World War II US was used as an example of a country where people had not experienced significant hardships and, as a result, might lack the necessary reserves of thumos to respond effectively to crises. The discussion also touched upon the idea of hormesis, or the beneficial effects of small doses of stress, and the possibility of some individuals reaching a point of total exhaustion and no longer being able to face challenges. The concept of the extent to which different countries fit into this model was also raised as an intriguing consideration.

    • Japan's economic recovery rooted in pre-war goals and strategiesJapan's economic recovery was shaped by its history, resulting in a productive workforce and industrial growth, despite challenges for other countries to replicate

      Japan's post-war economic recovery was not a completely new beginning but rather a continuation of pre-war goals and strategies. Japanese institutions and industries had their roots before World War II, and the country's desire for economic self-sufficiency led to invasions and resource extraction, then to close ties with the US for protection and access to markets. This strategic realignment resulted in a war economy in peacetime, with heavy industry and centralized control, and a workforce driven by a sense of obligation to rebuild the country. The intensity and focus of the Japanese workforce, shaped by their recent history, contributed to their productivity and industrial growth, which was difficult for other countries, like the US, to replicate. Sam Bankman-Fried, an effective altruist and proponent of diverse neutrality, is just one example of how individuals and ideas can persist and evolve through different historical contexts.

    • The Dangers of Extreme Beliefs in Effective AltruismExtreme beliefs among intelligent individuals in Effective Altruism can lead to harmful outcomes. Societies, including EA, need mechanisms to limit their influence. Smart advisors, not in executive roles, can provide valuable insights while mitigating potential dangers.

      Extreme beliefs, especially when held by highly intelligent individuals, can lead to dangerous and detrimental outcomes, particularly in complex, abstract economies where first principles thinking can guide actions towards extreme behaviors. It's important for societies, including the Effective Altruism (EA) community, to have mechanisms in place to limit the influence of the most fanatical believers. Historically, many belief systems have segregated such individuals, allowing them to follow their beliefs in a controlled environment, away from the mainstream society. However, in the case of EA, there is no such mechanism, and highly effective and intelligent individuals can wield significant power and influence. This correlation between power and potential craziness can lead to undesirable outcomes. A potential solution is to have smart individuals serve as advisors, but not in executive capacities. This way, the person making final decisions is reasonably intelligent and can understand the advice being given, while the smart individuals can provide valuable insights and nudge organizations in an EA-friendly direction. Ultimately, it's crucial to recognize the potential dangers of extreme beliefs and to have mechanisms in place to mitigate their impact on society.

    • Balancing fanaticism, ideas, and practical experienceSuccess often comes from a balanced approach to problem-solving and decision-making, combining fanaticism for new ideas, practical experience, and a pragmatic understanding of the situation.

      The role of ideas, fanaticism, and practical experience in shaping societal progress and decision-making is a complex interplay. While fanatics and thinkers can contribute valuable ideas and debates, it's crucial to have a balanced approach where they don't make the final decisions. Instead, a pragmatic leader with a good understanding of the situation is often the best choice. The discussion also touched upon the importance of understanding different approaches to problem-solving. Some people rely on data and empirical evidence, while others base their decisions on extensive knowledge of history, philosophy, and culture. Success often comes from a synthesis of both. In the realm of investing, both quantitative and qualitative approaches have their merits. Quants focus on identifying patterns and anomalies, while those with a deep understanding of the underlying factors provide explanations and context. The most successful strategies often combine both approaches, with quantitative findings informing qualitative insights. Overall, the conversation highlighted the importance of a balanced approach to problem-solving and decision-making, where fanaticism, ideas, and practical experience all play a role.

    • Balancing high-level theories and market realitiesInvestors should combine high-level theories with a deep understanding of market realities to mitigate risks and maximize returns. Be aware of potential false positives from data mining and unsustainable abstract theories. Consider alternative investments for hedging geopolitical risks.

      Successful investment strategies require a balance between high-level theories and low-level indicators. High-level theories provide the foundation for investment decisions, but it's essential to understand the current perception and the factors that could cause it to collide with reality. For instance, during the tech bubble in the late 1990s, many investors correctly identified the bubble, but those who profited the most were the ones who understood the overshooting in the opposite direction. Moreover, investors need to be aware of the risks associated with data mining and theory-driven views. Data mining can lead to false positives, and abstract theories can be unsustainable for a long time. To mitigate these risks, investors should combine high-level theories with a deep understanding of the current market environment and the factors that could cause a shift in perception. Regarding the specific question about being long on AI but hedging for the possibility of a Taiwan invasion, the best approach might be to focus on underwriting the Taiwan invasion debt or investing in Korean fabs as an alternative. However, geopolitical changes can have significant and long-lasting impacts on underlying technology, making it a complex issue to navigate.

    • Geopolitical risks and AI developmentConsider geopolitical risks when investing in tech companies, particularly those involved in AI and semiconductor manufacturing. In the event of an invasion, Intel and TSMC could be crucial for AI development in the US, but execution would be challenging. Diversify perspectives through sources like 'diff.co'.

      The potential invasion threat and the advancement of AI technology are two separate issues. If an invasion were to occur, Intel and TSMC could be the last hopes for continuing AI development in the US, with the possibility of a US operation to bring key engineers to the US to continue chip production. However, this is a tricky situation and may be difficult to execute effectively. It's important to note that this is just one potential scenario, and there are no clear hedges against such events. The podcast also touched upon the possibility of treasuries outperforming equities in times of crisis, but the overall focus was on the implications of an invasion on AI development. Overall, it's crucial to consider geopolitical risks when investing in technology companies, particularly those involved in AI and semiconductor manufacturing. The discussion also highlighted the importance of being informed and prepared for various scenarios, and the podcast "diff.co" was recommended as a source for diverse and thought-provoking perspectives.

    Recent Episodes from Dwarkesh Podcast

    Tony Blair - Life of a PM, The Deep State, Lee Kuan Yew, & AI's 1914 Moment

    Tony Blair - Life of a PM, The Deep State, Lee Kuan Yew, & AI's 1914 Moment

    I chatted with Tony Blair about:

    - What he learned from Lee Kuan Yew

    - Intelligence agencies track record on Iraq & Ukraine

    - What he tells the dozens of world leaders who come seek advice from him

    - How much of a PM’s time is actually spent governing

    - What will AI’s July 1914 moment look like from inside the Cabinet?

    Enjoy!

    Watch the video on YouTube. Read the full transcript here.

    Follow me on Twitter for updates on future episodes.

    Sponsors

    - Prelude Security is the world’s leading cyber threat management automation platform. Prelude Detect quickly transforms threat intelligence into validated protections so organizations can know with certainty that their defenses will protect them against the latest threats. Prelude is backed by Sequoia Capital, Insight Partners, The MITRE Corporation, CrowdStrike, and other leading investors. Learn more here.

    - This episode is brought to you by Stripe, financial infrastructure for the internet. Millions of companies from Anthropic to Amazon use Stripe to accept payments, automate financial processes and grow their revenue.

    If you’re interested in advertising on the podcast, check out this page.

    Timestamps

    (00:00:00) – A prime minister’s constraints

    (00:04:12) – CEOs vs. politicians

    (00:10:31) – COVID, AI, & how government deals with crisis

    (00:21:24) – Learning from Lee Kuan Yew

    (00:27:37) – Foreign policy & intelligence

    (00:31:12) – How much leadership actually matters

    (00:35:34) – Private vs. public tech

    (00:39:14) – Advising global leaders

    (00:46:45) – The unipolar moment in the 90s



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enJune 26, 2024

    Francois Chollet, Mike Knoop - LLMs won’t lead to AGI - $1,000,000 Prize to find true solution

    Francois Chollet, Mike Knoop - LLMs won’t lead to AGI - $1,000,000 Prize to find true solution

    Here is my conversation with Francois Chollet and Mike Knoop on the $1 million ARC-AGI Prize they're launching today.

    I did a bunch of socratic grilling throughout, but Francois’s arguments about why LLMs won’t lead to AGI are very interesting and worth thinking through.

    It was really fun discussing/debating the cruxes. Enjoy!

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here.

    Timestamps

    (00:00:00) – The ARC benchmark

    (00:11:10) – Why LLMs struggle with ARC

    (00:19:00) – Skill vs intelligence

    (00:27:55) - Do we need “AGI” to automate most jobs?

    (00:48:28) – Future of AI progress: deep learning + program synthesis

    (01:00:40) – How Mike Knoop got nerd-sniped by ARC

    (01:08:37) – Million $ ARC Prize

    (01:10:33) – Resisting benchmark saturation

    (01:18:08) – ARC scores on frontier vs open source models

    (01:26:19) – Possible solutions to ARC Prize



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enJune 11, 2024

    Leopold Aschenbrenner - China/US Super Intelligence Race, 2027 AGI, & The Return of History

    Leopold Aschenbrenner - China/US Super Intelligence Race, 2027 AGI, & The Return of History

    Chatted with my friend Leopold Aschenbrenner on the trillion dollar nationalized cluster, CCP espionage at AI labs, how unhobblings and scaling can lead to 2027 AGI, dangers of outsourcing clusters to Middle East, leaving OpenAI, and situational awareness.

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here.

    Follow me on Twitter for updates on future episodes. Follow Leopold on Twitter.

    Timestamps

    (00:00:00) – The trillion-dollar cluster and unhobbling

    (00:20:31) – AI 2028: The return of history

    (00:40:26) – Espionage & American AI superiority

    (01:08:20) – Geopolitical implications of AI

    (01:31:23) – State-led vs. private-led AI

    (02:12:23) – Becoming Valedictorian of Columbia at 19

    (02:30:35) – What happened at OpenAI

    (02:45:11) – Accelerating AI research progress

    (03:25:58) – Alignment

    (03:41:26) – On Germany, and understanding foreign perspectives

    (03:57:04) – Dwarkesh’s immigration story and path to the podcast

    (04:07:58) – Launching an AGI hedge fund

    (04:19:14) – Lessons from WWII

    (04:29:08) – Coda: Frederick the Great



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enJune 04, 2024

    John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI

    John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI

    Chatted with John Schulman (cofounded OpenAI and led ChatGPT creation) on how posttraining tames the shoggoth, and the nature of the progress to come...

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for updates on future episodes.

    Timestamps

    (00:00:00) - Pre-training, post-training, and future capabilities

    (00:16:57) - Plan for AGI 2025

    (00:29:19) - Teaching models to reason

    (00:40:50) - The Road to ChatGPT

    (00:52:13) - What makes for a good RL researcher?

    (01:00:58) - Keeping humans in the loop

    (01:15:15) - State of research, plateaus, and moats

    Sponsors

    If you’re interested in advertising on the podcast, fill out this form.

    * Your DNA shapes everything about you. Want to know how? Take 10% off our Premium DNA kit with code DWARKESH at mynucleus.com.

    * CommandBar is an AI user assistant that any software product can embed to non-annoyingly assist, support, and unleash their users. Used by forward-thinking CX, product, growth, and marketing teams. Learn more at commandbar.com.



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enMay 15, 2024

    Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

    Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

    Mark Zuckerberg on:

    - Llama 3

    - open sourcing towards AGI

    - custom silicon, synthetic data, & energy constraints on scaling

    - Caesar Augustus, intelligence explosion, bioweapons, $10b models, & much more

    Enjoy!

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Human edited transcript with helpful links here.

    Timestamps

    (00:00:00) - Llama 3

    (00:08:32) - Coding on path to AGI

    (00:25:24) - Energy bottlenecks

    (00:33:20) - Is AI the most important technology ever?

    (00:37:21) - Dangers of open source

    (00:53:57) - Caesar Augustus and metaverse

    (01:04:53) - Open sourcing the $10b model & custom silicon

    (01:15:19) - Zuck as CEO of Google+

    Sponsors

    If you’re interested in advertising on the podcast, fill out this form.

    * This episode is brought to you by Stripe, financial infrastructure for the internet. Millions of companies from Anthropic to Amazon use Stripe to accept payments, automate financial processes and grow their revenue. Learn more at stripe.com.

    * V7 Go is a tool to automate multimodal tasks using GenAI, reliably and at scale. Use code DWARKESH20 for 20% off on the pro plan. Learn more here.

    * CommandBar is an AI user assistant that any software product can embed to non-annoyingly assist, support, and unleash their users. Used by forward-thinking CX, product, growth, and marketing teams. Learn more at commandbar.com.



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Sholto Douglas & Trenton Bricken - How to Build & Understand GPT-7's Mind

    Sholto Douglas & Trenton Bricken - How to Build & Understand GPT-7's Mind

    Had so much fun chatting with my good friends Trenton Bricken and Sholto Douglas on the podcast.

    No way to summarize it, except: 

    This is the best context dump out there on how LLMs are trained, what capabilities they're likely to soon have, and what exactly is going on inside them.

    You would be shocked how much of what I know about this field, I've learned just from talking with them.

    To the extent that you've enjoyed my other AI interviews, now you know why.

    So excited to put this out. Enjoy! I certainly did :)

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. 

    There's a transcript with links to all the papers the boys were throwing down - may help you follow along.

    Follow Trenton and Sholto on Twitter.

    Timestamps

    (00:00:00) - Long contexts

    (00:16:12) - Intelligence is just associations

    (00:32:35) - Intelligence explosion & great researchers

    (01:06:52) - Superposition & secret communication

    (01:22:34) - Agents & true reasoning

    (01:34:40) - How Sholto & Trenton got into AI research

    (02:07:16) - Are feature spaces the wrong way to think about intelligence?

    (02:21:12) - Will interp actually work on superhuman models

    (02:45:05) - Sholto’s technical challenge for the audience

    (03:03:57) - Rapid fire



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat

    Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat

    Here is my episode with Demis Hassabis, CEO of Google DeepMind

    We discuss:

    * Why scaling is an artform

    * Adding search, planning, & AlphaZero type training atop LLMs

    * Making sure rogue nations can't steal weights

    * The right way to align superhuman AIs and do an intelligence explosion

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here.

    Timestamps

    (0:00:00) - Nature of intelligence

    (0:05:56) - RL atop LLMs

    (0:16:31) - Scaling and alignment

    (0:24:13) - Timelines and intelligence explosion

    (0:28:42) - Gemini training

    (0:35:30) - Governance of superhuman AIs

    (0:40:42) - Safety, open source, and security of weights

    (0:47:00) - Multimodal and further progress

    (0:54:18) - Inside Google DeepMind



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Patrick Collison (Stripe CEO) - Craft, Beauty, & The Future of Payments

    Patrick Collison (Stripe CEO) - Craft, Beauty, & The Future of Payments

    We discuss:

    * what it takes to process $1 trillion/year

    * how to build multi-decade APIs, companies, and relationships

    * what's next for Stripe (increasing the GDP of the internet is quite an open ended prompt, and the Collison brothers are just getting started).

    Plus the amazing stuff they're doing at Arc Institute, the financial infrastructure for AI agents, playing devil's advocate against progress studies, and much more.

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for updates on future episodes.

    Timestamps

    (00:00:00) - Advice for 20-30 year olds

    (00:12:12) - Progress studies

    (00:22:21) - Arc Institute

    (00:34:27) - AI & Fast Grants

    (00:43:46) - Stripe history

    (00:55:44) - Stripe Climate

    (01:01:39) - Beauty & APIs

    (01:11:51) - Financial innards

    (01:28:16) - Stripe culture & future

    (01:41:56) - Virtues of big businesses

    (01:51:41) - John



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Tyler Cowen - Hayek, Keynes, & Smith on AI, Animal Spirits, Anarchy, & Growth

    Tyler Cowen - Hayek, Keynes, & Smith on AI, Animal Spirits, Anarchy, & Growth

    It was a great pleasure speaking with Tyler Cowen for the 3rd time.

    We discussed GOAT: Who is the Greatest Economist of all Time and Why Does it Matter?, especially in the context of how the insights of Hayek, Keynes, Smith, and other great economists help us make sense of AI, growth, animal spirits, prediction markets, alignment, central planning, and much more.

    The topics covered in this episode are too many to summarize. Hope you enjoy!

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for updates on future episodes.

    Timestamps

    (0:00:00) - John Maynard Keynes

    (00:17:16) - Controversy

    (00:25:02) - Fredrick von Hayek

    (00:47:41) - John Stuart Mill

    (00:52:41) - Adam Smith

    (00:58:31) - Coase, Schelling, & George

    (01:08:07) - Anarchy

    (01:13:16) - Cheap WMDs

    (01:23:18) - Technocracy & political philosophy

    (01:34:16) - AI & Scaling



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Lessons from The Years of Lyndon Johnson by Robert Caro [Narration]

    Lessons from The Years of Lyndon Johnson by Robert Caro [Narration]

    This is a narration of my blog post, Lessons from The Years of Lyndon Johnson by Robert Caro.

    You read the full post here: https://www.dwarkeshpatel.com/p/lyndon-johnson

    Listen on Apple Podcasts, Spotify, or any other podcast platform. Follow me on Twitter for updates on future posts and episodes.



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Related Episodes

    Spotlight: Will Larry Elder Replace Governor Newsom In California’s Recall Election?

    Spotlight: Will Larry Elder Replace Governor Newsom In California’s Recall Election?

    Until recently, it looked like Governor Gavin Newsom of California would beat back the recall. But his constant incompetencies are catching up to him. Steve Forbes on the election recall Newsom is facing and on how recent polls show Larry Elder leading others and how he could be in line to replace Newsom after September 14th.

    Steve Forbes shares his What’s Ahead Spotlights each Tuesday, Thursday and Friday.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    Spotlight: The UAW Won But America's Taxpayers Will Lose — Here's Why

    Spotlight: The UAW Won But America's Taxpayers Will Lose — Here's Why

    Steve Forbes responds to the United Auto Workers union victory over major auto manufacturers, pointing out that the strike's settlements will come at the expense of profits—and that means bad news for consumers.

    Steve Forbes shares his What’s Ahead Spotlights each Tuesday, Thursday and Friday.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    Spotlight: How Biden’s Regulatory Blunders Are Crushing American Ingenuity

    Spotlight: How Biden’s Regulatory Blunders Are Crushing American Ingenuity

    Administration regulators have tightened water-use rules, pushed for energy-efficiency standards and its war on fossil fuels continues. All these unnecessary rules from Washington are making life less pleasant, more irritating and more expensive! Steve Forbes on how Biden's regulatory blunders are crushing American ingenuity and on why government interference is only making things worse.

    Steve Forbes shares his What’s Ahead Spotlights each Tuesday, Thursday and Friday.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    Spotlight: Is Ukraine-Russia War Escalating? How The U.S. Can Help

    Spotlight: Is Ukraine-Russia War Escalating? How The U.S. Can Help

    Putin's quest for control of Moscow, both politically and economically, continues to strain Ukraine. Recently Russia massed troops on the border of Ukraine, as if for a full-scale invasion. Is the Ukraine-Russia war escalating? Steve Forbes on how the U.S. can help Ukraine get out of Putin's clutches and on why we should take action and then follow through.

    Steve Forbes shares his What’s Ahead Spotlights each Tuesday, Thursday and Friday.

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.