Logo
    Search

    Marc Andreessen - AI, Crypto, 1000 Elon Musks, Regrets, Vulnerabilities, & Managerial Revolution

    enFebruary 01, 2023

    Podcast Summary

    • The Stress of Starting a Company vs. Venture CapitalismMarc Andreessen emphasizes the significant impact of starting a company on one's life and the unique stress of being a founder, contrasting it with the stress of venture capitalism.

      Starting a company is an intense and challenging experience, and Marc Andreessen, despite his entrepreneurial ambitions, has chosen to focus on venture capitalism instead due to the different kind of stress it presents. He emphasized that starting a company is not a decision to be taken lightly, and the implications of that decision can significantly impact one's life. Andreessen also mentioned that he stopped writing his blog due to the time commitment of starting a venture firm, and he writes intermittently on social media instead. He acknowledged that stress is present in every profession, but the stress of being a startup founder is unique because the responsibility and accountability are solely on the founder's shoulders. In contrast, investors have a layer of buffer and can help portfolio companies deal with issues without it being their own company.

    • Impact of AI on software developmentAI is transforming software development from human-machine interaction to dialogue-based systems, becoming the future of software itself.

      The impact of AI on software development is the current and future bottleneck, and it's at the forefront of a new stack that needs to be built. The way applications are built might drastically change, shifting from the traditional model of human-machine interaction to a dialogue-based one. AI is not just an additional focus area but the future of software itself. The speaker's past successes, such as the sale of Desk Data and Opsware, could have potentially led to dominating their respective markets if they had remained startups. However, the speaker focuses on the present and future, acknowledging the complexity and unpredictability of reality.

    • The world's unpredictability makes it more productive to focus on new endeavorsManagerial capitalism separates ownership and management, leading professionals to focus on running existing organizations, while individuals are better suited to navigate new ventures and uncertainties.

      The world is too complex and unpredictable for individuals or companies to constantly revisit old decisions. The rise of managerial capitalism, as described by James Burnham, separates ownership and management, leading to professional managers controlling large organizations. While these managers are effective at running things at scale, they are not typically trained or incentivized to build new things. The uncertainties and forks in the road that come with starting companies and navigating markets make it more productive for individuals to focus on new endeavors rather than dwelling on past decisions.

    • Venture capitalists and private equity firms enable entrepreneurial capitalism within managerial economyVCs and PE firms fund new companies and founders, fostering innovation, but eventually fall under managerial control, leading to a cycle of founder departure and new company creation. Without them, the economy would stagnate.

      Venture capitalists and private equity firms act as enablers for the resurfacing of the older bourgeois capitalist model within the current managerial system. They fund new companies and founders, representing a throwback to the older model of entrepreneurial capitalism. However, most of these companies eventually fall under managerial control, leading to a cycle where founders leave and start new companies. The economy is predominantly managerial, but the existence of venture capital and private equity keeps new institutions alive and innovation ongoing. Without these entities, the economy would become completely managerial, leading to a halt in innovation. The succession problem arises as these firms grow, and their founders consider handing over control to a managerial class. To keep the firms as bourgeois as possible, Ben and I, the founders of the firm, aim to maintain control and keep the firm a private entity.

    • The Succession Challenge: Founders to ManagersThe transition from founder-led to manager-led companies creates opportunities for new startups and longer investment lockups, but requires careful consideration of potential long-term projects and market adaptability.

      As tech companies grow, they often transition from being run by entrepreneurial founders to professional managers. This transition, known as the succession challenge, typically occurs when the company moves from the bourgeois capitalist model to the managerial model. Founders often hand the reins to long-suffering number 2s who have been running the day-to-day operations for years. However, these founders often regret their decision and wish they had handed it off to someone younger and more like themselves. This pattern illustrates the Burnham theory, which posits that large, complex organizations eventually get run by managers. The silver lining is that this transition creates opportunities for new startups to emerge and drive innovation. Regarding investment, having a longer lockup period for funds could allow investment in projects with longer incubation periods that might not be viable with a shorter time frame. However, the challenge lies in whether such projects truly exist and whether the longer time horizon is the limiting factor. Ultimately, the length of a lockup period is a trade-off between the potential for longer-term gains and the need for flexibility to adapt to changing market conditions.

    • Maintaining contact with reality is crucial for companiesSuccessful companies need to stay connected to the market and customers, especially during their early years. Providing larger funding may help, but self-bootstrapping research efforts could also be effective.

      While there are instances of successful long-term, well-funded companies, the general trend is that they often lose touch with reality and fail to build enterprises. Contact with the market and customers is crucial for companies, especially during the first 5-7 years. An alternative perspective is to consider providing larger amounts of funding to companies, which might enable them to operate on a more typical time frame while building potentially world-changing projects. However, the argument also suggests that basic research may require a different approach, and individuals like Bill Janeway, a legendary VC and economist, propose the idea of self-bootstrapping research efforts if the government's efforts are ineffective. Overall, maintaining contact with reality and finding the right balance between funding and timeframes are essential for successful entrepreneurship.

    • 50 years of federal research funding shaped tech's successVenture capital investments thrive in tech sectors built on solid research foundations, like computer science and biotech.

      The success of venture capital investments in the tech industry can be attributed to the prior 50 years of federal research funding in computer science and biotech. According to the speaker, these sectors have seen significant returns because they built upon a solid foundation of basic research. Computer science, in particular, has become a disruptive force across various industries, extending beyond just the production of computers. Biotech, on the other hand, has seen success by productizing research in the biological sciences. However, the speaker cautions that sectors without a substantial backlog of basic research may struggle to see significant returns for venture capital investments. Despite this, the speaker remains optimistic about the potential for computer science and software to apply to a broader range of industries and the emergence of niche companies with groundbreaking innovations. Ultimately, the future of venture capital lies in identifying sectors with a strong research foundation.

    • Venture capital firms focus on consistent returns and market share, not just assets under managementVenture capital firms adapt to the evolving industry, focusing on fostering innovation and supporting entrepreneurs, with debates on funding larger-scale projects.

      Successful venture capital firms like the one discussed don't focus solely on growing assets under management. Instead, they aim to maintain a consistent return level while maximizing market share and investing in promising opportunities. The underlying question, however, is not about the amount of capital but rather the availability of great entrepreneurs and their groundbreaking ideas. To address this, there's a debate on whether venture capital firms should back larger-scale projects with more funding. While some argue that firms like Tesla and SpaceX have proven the existing model works, others believe we need a new, more aggressive approach to tackle significant global challenges. Ultimately, the key takeaway is that the venture capital industry is continually evolving, and its role in fostering innovation and supporting entrepreneurs remains crucial.

    • Approach to investing in crypto startupsFocus on founders, identify market changes, ensure long-term investment horizon, and ignore short-term market fluctuations to maximize crypto startup value.

      When it comes to investing in crypto startups, the approach should be similar to traditional venture capital. This means looking for visionary founders, identifying deep technological or economic changes, ensuring a market exists, and having a long-term investment horizon. The difference in crypto is the earlier public floating of tokens and the prevalence of hedge funds, which can lead to excessive trading and misalignment of interests. Instead, it's crucial to focus on the underlying intrinsic value of the product and technology being developed, and to adopt a buy-and-hold strategy. This approach may not be popular in the crypto world, but it can help minimize speculation and maximize long-term value.

    • Understanding Productive vs Unproductive SpeculationProductive speculation supports new artists and investments, while unproductive speculation distracts from core value and can lead to market inefficiencies. A nuanced understanding is necessary to distinguish between the two.

      Speculation in art and other markets is a natural and necessary part of the economic process. It's important to distinguish between productive and unproductive forms of speculation. Productive speculation involves estimating future values and supporting new artists or investments, which can lead to long-term success and growth. Unproductive speculation, on the other hand, refers to obsessive daily trading and short-term profit-seeking, which can distract from the core value of art or other investments. The speaker argues that this distinction is not always clear-cut, and that many forms of investment involve elements of both speculation and value estimation. Additionally, the speaker challenges the cultural taboo against speculation and argues that it is essential for economies to function properly. In the context of NFTs, the speaker suggests that their role in allocating capital towards digital assets is valuable, even if the price efficiency of the market may be a secondary concern. Overall, the speaker advocates for a nuanced understanding of speculation and its role in art and financial markets.

    • NFTs as Digital Art: Value Beyond Production CostsNFTs, as a new form of digital art, offer unique benefits but their value ultimately comes from community perception and appreciation, not just production costs.

      NFTs, particularly those representing creative projects like art, should be viewed as digital art and subject to the same criticisms and valuations as traditional art forms such as paintings, photographs, and sculptures. The value of art is not solely determined by production costs but also by cultural significance, aesthetics, and the emotional connection it provides to people. NFTs, as a new form of digital art, can offer unique benefits, such as ownership and provenance, but their value ultimately comes from the community's perception and appreciation. The world we live in is not one where we have to choose between funding material advancements and artistic endeavors, but rather, we have an oversupply of capital and a need for more opportunities to invest in both areas. Art, literature, music, and other creative pursuits are essential parts of human existence, enhancing our lives and contributing to our higher aspirations and goals.

    • The importance of increasing the number and diversity of investable projects in venture capitalDespite the vast amount of available capital, the imbalance in the venture capital industry calls for more viable projects and great entrepreneurs, rather than a trade-off. The core activity of venture capital, project picking and financing, will continue to be complex, risky, and require judgment and taste from investors.

      The venture capital industry is facing a significant imbalance between the vast amount of available capital and the limited number of viable projects and great entrepreneurs. This imbalance calls for an increase in the number and diversity of investable projects, rather than a trade-off. The core activity of venture capital, which involves investing in new and risky projects, will continue to follow a consistent pattern of complexity, risk, and the need for judgment and taste from investors. Historically, this role has been compared to the financing of whaling expeditions 400 years ago, with venture capitalists acting as financiers and sharing profits through a system called carried interest. As the details of venture capital continue to change, the fundamental activity of project picking and financing will remain a crucial part of the industry.

    • The Role of Venture Capital and Private Investment EvolvesVenture capital and private investment will continue to shape the business landscape, with blurred lines between public and private markets and new mechanisms emerging. Building a company requires more personal commitment than investing in one, and the venture capital industry will continue to fund innovation but may change forms and regulations.

      The role of venture capital and private investment will continue to evolve over time, with blurred lines between public and private markets and new mechanisms like crypto tokens emerging. Debates around who should have access to private investments and the definition of "public" companies will continue, with potential for more liquidity for private companies and broader definitions of what it means to be public. Despite successful venture capitalists having the experience and knowledge to be entrepreneurs, it's often harder to build a company than to invest in one, requiring a higher level of personal commitment. The pipeline of successful founders becoming venture capitalists is clear, but the reverse is not as common. The venture capital industry will continue to play a fundamental role in financing innovation and growth, but its specific form and regulations will likely change over the next centuries.

    • Managing Managers: A Crucial Breakthrough for Entrepreneurs Turned InvestorsEntrepreneurs and investors have distinct roles, and mastering managerial skills is crucial for entrepreneurs transitioning to investment roles to effectively scale their impact.

      Running a company and being an investor are two vastly different endeavors. While entrepreneurs face a constant barrage of decisions and must act swiftly, investors have longer decision cycles and focus more on analysis and observation. The speaker likens the two roles to a football broadcator attempting to play as a running back. The ability to manage managers is a crucial breakthrough for those aiming to run large companies, as even CEOs only directly oversee a small number of employees. The skill of managing managers can then scale as one progresses up the corporate ladder.

    • Managing a team and scaling a business requires specific skills and a strong desire to learn and grow.Successful entrepreneurship involves intelligence, temperament, and a strong desire to learn and grow. Managing a team and scaling a business requires dealing with complexity and various domains of a business, which not everyone has the desire or ability to do for an extended period.

      Becoming a successful entrepreneur requires a combination of intelligence, temperament, and a strong desire to learn and grow. Managing a team and scaling a business involves dealing with complexity and various domains of a business. Not everyone has the desire or ability to do so for an extended period. The best-case scenario is a CEO managing a team of managers, allowing for the benefits of scale and innovation. However, if a venture capital firm like 16z experiences mediocre returns over 10 to 20 years, it might not be due to macroeconomic factors or investing in the wrong sectors. Instead, it could be due to making poor investments or a lack of technological change and innovation in the preceding decades. This last scenario is the most concerning as it is largely out of our control.

    • Risks of a Diversified VC Firm to a Single Sector's Failure and the Importance of Recognizing Innovative IdeasDespite diversification, a VC firm's reliance on a single sector's success poses a significant risk. Regulatory hurdles can stifle innovation in certain areas, like nuclear energy and fusion. Recognizing and nurturing innovative ideas, even in the face of challenges, is crucial for growth and success.

      The vulnerability of a diversified venture capital firm like a 16z to a single tech sector not working out is a real risk, especially when innovation in certain areas is outlawed or heavily regulated. The discussion highlighted the example of nuclear energy and fusion, which despite promising advancements, face regulatory hurdles that make it impossible to build new designs in the US. This risk is significant because innovation is crucial for the growth and success of various sectors. The firm's diversification across six primary investment domains offers some protection against the loss of a category, but there is a possibility that those categories may be more correlated than desired. Additionally, the old management of Twitter failed to fully recognize the potential value of the public graph, which could have been a "titanically valuable" expression of intent, loyalty, and brand signals in the world. The complexities of running companies and the potential for tenuous early stages make it challenging to second-guess management decisions. However, the belief that the public graph could have been a primary way for creators, politicians, and the economy to interact underscores the importance of recognizing and nurturing innovative ideas, even in the face of regulatory challenges.

    • The Economic Potential of Social MediaSocial media platforms like iGraph have immense economic potential, with examples like Twitter and musicians selling concert tickets illustrating this point. Elon Musk's views and social media's role in organizing events and even revolutions further highlight its value.

      Social media platforms like iGraph have immense economic potential that has yet to be fully realized. The speaker's observation began with the innovative ideas of a particular team, but the conversation soon shifted to the monetization possibilities of social media itself. The speaker used examples like Twitter and musicians selling concert tickets to illustrate this point. He also mentioned Elon Musk's views on the subject and how social media has been used for organizing events, even revolutions. The speaker expressed his conviction in social media's value relatively early, despite the widespread criticism during its inception. He also highlighted the contrasting views of Erdogan, who saw Twitter as a significant threat, and the western analysts who dismissed its importance. The speaker concluded by emphasizing that we are still in the early stages of the social media era and that its potential is vast, given the billions of people connected online.

    • Technology's integration into various sectorsTechnology's integration into sectors like education, healthcare, finance, real estate, law, and government will disrupt traditional industries, offering potential for innovation and efficiency gains.

      Technology's integration into various sectors of the economy is an overwhelming trend that will continue to grow as a percentage of GDP. This process, often driven by entrepreneurial capitalism and new tech companies, will disrupt traditional industries such as education, healthcare, finance, real estate, law, and government. While some sectors may initially resist change, the potential for innovation and efficiency gains are significant. The shape of the tech industry will evolve, with a focus on tackling larger, more complex markets. However, the challenge lies in building successful companies in these sectors, which often come with unique complexities. Ultimately, the goal is to improve upon outdated systems and deliver better solutions to consumers. Despite the potential for disruption, it remains to be seen whether the existing systems will be completely replaced or if they will continue to coexist alongside new alternatives.

    • The need for revolution in education and healthcareUniversities face politicization and declining value, healthcare lacks positive outcomes despite investment, both sectors are operating as cartels, new approaches needed for progress

      The traditional education and healthcare systems are facing significant challenges and are in need of revolution. The speaker argues that universities have become politicized, with much of the research being fake and degrees losing their value as an intelligence signal for employers. The cost of these degrees, which may not provide marketable skills, is also a concern. Healthcare, too, is facing issues, with limited positive outcomes despite significant investment. Both sectors are operating as cartels, and new ways of delivering education and healthcare are needed. Venture capital, like tech, could be a driver of change, but it, too, may be overstaffed and overfunded. The speaker suggests that these revolutions may not come quickly or easily, but they are necessary for progress.

    • Institutional investors shift to venture capital, leading to overfundingInstitutional investors allocate significant resources to venture capital, creating intense competition for top funds and potentially overvaluing companies due to the long-term nature and winner-takes-all mentality of the sector.

      The venture capital industry is experiencing an unprecedented influx of capital due to the shift in institutional investment models towards alternative assets. This overfunding has led to a situation where too much money is chasing too few productive investment opportunities, resulting in a highly competitive landscape. The Yale Endowment model, which includes investments in venture capital, real estate, and hedge funds, is now the norm for institutional investors. With a significant portion of the global asset base allocated to venture capital, the pressure to invest in the top funds is immense. Despite the knowledge that the sector is overfunded, investors continue to invest, hoping for the next big success. The long-term nature of venture capital investments allows for more time to realize returns, potentially leading to overinvestment. The "winner-takes-all" nature of venture capital also means that the company that raises the most capital at the earliest stages often sets the price, which can result in overvaluation. However, the best entrepreneurs understand the importance of having experienced investors on their team and avoid taking unnecessary risks with investors who may not fully understand the nature of a venture capital investment.

    Recent Episodes from Dwarkesh Podcast

    Tony Blair - Life of a PM, The Deep State, Lee Kuan Yew, & AI's 1914 Moment

    Tony Blair - Life of a PM, The Deep State, Lee Kuan Yew, & AI's 1914 Moment

    I chatted with Tony Blair about:

    - What he learned from Lee Kuan Yew

    - Intelligence agencies track record on Iraq & Ukraine

    - What he tells the dozens of world leaders who come seek advice from him

    - How much of a PM’s time is actually spent governing

    - What will AI’s July 1914 moment look like from inside the Cabinet?

    Enjoy!

    Watch the video on YouTube. Read the full transcript here.

    Follow me on Twitter for updates on future episodes.

    Sponsors

    - Prelude Security is the world’s leading cyber threat management automation platform. Prelude Detect quickly transforms threat intelligence into validated protections so organizations can know with certainty that their defenses will protect them against the latest threats. Prelude is backed by Sequoia Capital, Insight Partners, The MITRE Corporation, CrowdStrike, and other leading investors. Learn more here.

    - This episode is brought to you by Stripe, financial infrastructure for the internet. Millions of companies from Anthropic to Amazon use Stripe to accept payments, automate financial processes and grow their revenue.

    If you’re interested in advertising on the podcast, check out this page.

    Timestamps

    (00:00:00) – A prime minister’s constraints

    (00:04:12) – CEOs vs. politicians

    (00:10:31) – COVID, AI, & how government deals with crisis

    (00:21:24) – Learning from Lee Kuan Yew

    (00:27:37) – Foreign policy & intelligence

    (00:31:12) – How much leadership actually matters

    (00:35:34) – Private vs. public tech

    (00:39:14) – Advising global leaders

    (00:46:45) – The unipolar moment in the 90s



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enJune 26, 2024

    Francois Chollet, Mike Knoop - LLMs won’t lead to AGI - $1,000,000 Prize to find true solution

    Francois Chollet, Mike Knoop - LLMs won’t lead to AGI - $1,000,000 Prize to find true solution

    Here is my conversation with Francois Chollet and Mike Knoop on the $1 million ARC-AGI Prize they're launching today.

    I did a bunch of socratic grilling throughout, but Francois’s arguments about why LLMs won’t lead to AGI are very interesting and worth thinking through.

    It was really fun discussing/debating the cruxes. Enjoy!

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here.

    Timestamps

    (00:00:00) – The ARC benchmark

    (00:11:10) – Why LLMs struggle with ARC

    (00:19:00) – Skill vs intelligence

    (00:27:55) - Do we need “AGI” to automate most jobs?

    (00:48:28) – Future of AI progress: deep learning + program synthesis

    (01:00:40) – How Mike Knoop got nerd-sniped by ARC

    (01:08:37) – Million $ ARC Prize

    (01:10:33) – Resisting benchmark saturation

    (01:18:08) – ARC scores on frontier vs open source models

    (01:26:19) – Possible solutions to ARC Prize



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enJune 11, 2024

    Leopold Aschenbrenner - China/US Super Intelligence Race, 2027 AGI, & The Return of History

    Leopold Aschenbrenner - China/US Super Intelligence Race, 2027 AGI, & The Return of History

    Chatted with my friend Leopold Aschenbrenner on the trillion dollar nationalized cluster, CCP espionage at AI labs, how unhobblings and scaling can lead to 2027 AGI, dangers of outsourcing clusters to Middle East, leaving OpenAI, and situational awareness.

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here.

    Follow me on Twitter for updates on future episodes. Follow Leopold on Twitter.

    Timestamps

    (00:00:00) – The trillion-dollar cluster and unhobbling

    (00:20:31) – AI 2028: The return of history

    (00:40:26) – Espionage & American AI superiority

    (01:08:20) – Geopolitical implications of AI

    (01:31:23) – State-led vs. private-led AI

    (02:12:23) – Becoming Valedictorian of Columbia at 19

    (02:30:35) – What happened at OpenAI

    (02:45:11) – Accelerating AI research progress

    (03:25:58) – Alignment

    (03:41:26) – On Germany, and understanding foreign perspectives

    (03:57:04) – Dwarkesh’s immigration story and path to the podcast

    (04:07:58) – Launching an AGI hedge fund

    (04:19:14) – Lessons from WWII

    (04:29:08) – Coda: Frederick the Great



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enJune 04, 2024

    John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI

    John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI

    Chatted with John Schulman (cofounded OpenAI and led ChatGPT creation) on how posttraining tames the shoggoth, and the nature of the progress to come...

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for updates on future episodes.

    Timestamps

    (00:00:00) - Pre-training, post-training, and future capabilities

    (00:16:57) - Plan for AGI 2025

    (00:29:19) - Teaching models to reason

    (00:40:50) - The Road to ChatGPT

    (00:52:13) - What makes for a good RL researcher?

    (01:00:58) - Keeping humans in the loop

    (01:15:15) - State of research, plateaus, and moats

    Sponsors

    If you’re interested in advertising on the podcast, fill out this form.

    * Your DNA shapes everything about you. Want to know how? Take 10% off our Premium DNA kit with code DWARKESH at mynucleus.com.

    * CommandBar is an AI user assistant that any software product can embed to non-annoyingly assist, support, and unleash their users. Used by forward-thinking CX, product, growth, and marketing teams. Learn more at commandbar.com.



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe
    Dwarkesh Podcast
    enMay 15, 2024

    Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

    Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus

    Mark Zuckerberg on:

    - Llama 3

    - open sourcing towards AGI

    - custom silicon, synthetic data, & energy constraints on scaling

    - Caesar Augustus, intelligence explosion, bioweapons, $10b models, & much more

    Enjoy!

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Human edited transcript with helpful links here.

    Timestamps

    (00:00:00) - Llama 3

    (00:08:32) - Coding on path to AGI

    (00:25:24) - Energy bottlenecks

    (00:33:20) - Is AI the most important technology ever?

    (00:37:21) - Dangers of open source

    (00:53:57) - Caesar Augustus and metaverse

    (01:04:53) - Open sourcing the $10b model & custom silicon

    (01:15:19) - Zuck as CEO of Google+

    Sponsors

    If you’re interested in advertising on the podcast, fill out this form.

    * This episode is brought to you by Stripe, financial infrastructure for the internet. Millions of companies from Anthropic to Amazon use Stripe to accept payments, automate financial processes and grow their revenue. Learn more at stripe.com.

    * V7 Go is a tool to automate multimodal tasks using GenAI, reliably and at scale. Use code DWARKESH20 for 20% off on the pro plan. Learn more here.

    * CommandBar is an AI user assistant that any software product can embed to non-annoyingly assist, support, and unleash their users. Used by forward-thinking CX, product, growth, and marketing teams. Learn more at commandbar.com.



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Sholto Douglas & Trenton Bricken - How to Build & Understand GPT-7's Mind

    Sholto Douglas & Trenton Bricken - How to Build & Understand GPT-7's Mind

    Had so much fun chatting with my good friends Trenton Bricken and Sholto Douglas on the podcast.

    No way to summarize it, except: 

    This is the best context dump out there on how LLMs are trained, what capabilities they're likely to soon have, and what exactly is going on inside them.

    You would be shocked how much of what I know about this field, I've learned just from talking with them.

    To the extent that you've enjoyed my other AI interviews, now you know why.

    So excited to put this out. Enjoy! I certainly did :)

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. 

    There's a transcript with links to all the papers the boys were throwing down - may help you follow along.

    Follow Trenton and Sholto on Twitter.

    Timestamps

    (00:00:00) - Long contexts

    (00:16:12) - Intelligence is just associations

    (00:32:35) - Intelligence explosion & great researchers

    (01:06:52) - Superposition & secret communication

    (01:22:34) - Agents & true reasoning

    (01:34:40) - How Sholto & Trenton got into AI research

    (02:07:16) - Are feature spaces the wrong way to think about intelligence?

    (02:21:12) - Will interp actually work on superhuman models

    (02:45:05) - Sholto’s technical challenge for the audience

    (03:03:57) - Rapid fire



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat

    Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat

    Here is my episode with Demis Hassabis, CEO of Google DeepMind

    We discuss:

    * Why scaling is an artform

    * Adding search, planning, & AlphaZero type training atop LLMs

    * Making sure rogue nations can't steal weights

    * The right way to align superhuman AIs and do an intelligence explosion

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here.

    Timestamps

    (0:00:00) - Nature of intelligence

    (0:05:56) - RL atop LLMs

    (0:16:31) - Scaling and alignment

    (0:24:13) - Timelines and intelligence explosion

    (0:28:42) - Gemini training

    (0:35:30) - Governance of superhuman AIs

    (0:40:42) - Safety, open source, and security of weights

    (0:47:00) - Multimodal and further progress

    (0:54:18) - Inside Google DeepMind



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Patrick Collison (Stripe CEO) - Craft, Beauty, & The Future of Payments

    Patrick Collison (Stripe CEO) - Craft, Beauty, & The Future of Payments

    We discuss:

    * what it takes to process $1 trillion/year

    * how to build multi-decade APIs, companies, and relationships

    * what's next for Stripe (increasing the GDP of the internet is quite an open ended prompt, and the Collison brothers are just getting started).

    Plus the amazing stuff they're doing at Arc Institute, the financial infrastructure for AI agents, playing devil's advocate against progress studies, and much more.

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for updates on future episodes.

    Timestamps

    (00:00:00) - Advice for 20-30 year olds

    (00:12:12) - Progress studies

    (00:22:21) - Arc Institute

    (00:34:27) - AI & Fast Grants

    (00:43:46) - Stripe history

    (00:55:44) - Stripe Climate

    (01:01:39) - Beauty & APIs

    (01:11:51) - Financial innards

    (01:28:16) - Stripe culture & future

    (01:41:56) - Virtues of big businesses

    (01:51:41) - John



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Tyler Cowen - Hayek, Keynes, & Smith on AI, Animal Spirits, Anarchy, & Growth

    Tyler Cowen - Hayek, Keynes, & Smith on AI, Animal Spirits, Anarchy, & Growth

    It was a great pleasure speaking with Tyler Cowen for the 3rd time.

    We discussed GOAT: Who is the Greatest Economist of all Time and Why Does it Matter?, especially in the context of how the insights of Hayek, Keynes, Smith, and other great economists help us make sense of AI, growth, animal spirits, prediction markets, alignment, central planning, and much more.

    The topics covered in this episode are too many to summarize. Hope you enjoy!

    Watch on YouTube. Listen on Apple PodcastsSpotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for updates on future episodes.

    Timestamps

    (0:00:00) - John Maynard Keynes

    (00:17:16) - Controversy

    (00:25:02) - Fredrick von Hayek

    (00:47:41) - John Stuart Mill

    (00:52:41) - Adam Smith

    (00:58:31) - Coase, Schelling, & George

    (01:08:07) - Anarchy

    (01:13:16) - Cheap WMDs

    (01:23:18) - Technocracy & political philosophy

    (01:34:16) - AI & Scaling



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Lessons from The Years of Lyndon Johnson by Robert Caro [Narration]

    Lessons from The Years of Lyndon Johnson by Robert Caro [Narration]

    This is a narration of my blog post, Lessons from The Years of Lyndon Johnson by Robert Caro.

    You read the full post here: https://www.dwarkeshpatel.com/p/lyndon-johnson

    Listen on Apple Podcasts, Spotify, or any other podcast platform. Follow me on Twitter for updates on future posts and episodes.



    Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe

    Related Episodes

    Brad Feld (Foundry Group, TechStars) - Great Entrepreneurs Go Out and Do

    Brad Feld (Foundry Group, TechStars) - Great Entrepreneurs Go Out and Do
    Entrepreneur and early-stage investor Brad Feld offers advice and support to aspiring entrepreneurs. Feld, a managing partner at Foundry Group and a co-founder of TechStars, imparts personal experiences on managing your life as an entrepreneur. He also shares some of the defining characteristics his firm looks for in the entrepreneurs they invest in.

    AI + You | 4 ways to scale your personal growth

    AI + You | 4 ways to scale your personal growth

    In part two of our 3-part series on AI + You, we offer an actionable playbook on how AI can help us scale ourselves personally. Personal scale is all about broadening your skill set and strengthening your human relationships. To guide you, host Reid Hoffman speaks to Stanford HAI’s Fei-Fei Li, Inflection’s Mustafa Suleyman, tech-centric artist Holly Herndon and more AI pioneers. You’ll discover how AI can amplify your ability as a leader, coworker, collaborator and friend.

    Read a transcript of this episode: https://mastersofscale.com/

    Subscribe to the Masters of Scale weekly newsletter: https://mastersofscale.com/subscribe

    See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

    Tina Seelig (Stanford Technology Ventures Program) - The Art of Teaching Entrepreneurship and Innovation

    Tina Seelig (Stanford Technology Ventures Program) - The Art of Teaching Entrepreneurship and Innovation
    Stanford Technology Ventures Program's Executive Director Tina Seelig shares rich insights in creative thinking and the entrepreneurial mindset. Her talk, based on her 2009 book, What I Wish I Knew When I Was 20, cites numerous classroom successes of applied problem-solving and the lessons of failure.

    Steve Blank (Stanford Engineering) - Entrepreneurship Strengthens a Nation

    Steve Blank (Stanford Engineering) - Entrepreneurship Strengthens a Nation
    Retired serial entrepreneur Steve Blank, creator of the “Lean LaunchPad” methodology for startups, discusses Silicon Valley’s roots as the epicenter of electronic warfare in the mid-20th century and how the region’s innovation ecosystem formed. An adjunct professor in Stanford’s Department of Management Science & Engineering, Blank also walks through the lean-startup movement and how its principles are now helping the U.S. government innovate faster in the areas of basic science, health, national defense and international diplomacy.

    Elise Densborn (Splendid Spoon) - From Customer to Co-CEO

    Elise Densborn (Splendid Spoon) - From Customer to Co-CEO

    Elise Densborn is the co-CEO of Splendid Spoon, a direct-to-consumer meal delivery platform that offers ready-to-eat, plant-based meals. Densborn was first introduced to Splendid Spoon as a customer. After over a decade in the finance industry, she joined the Splendid Spoon team as a consultant in 2018 and quickly rose through the ranks in permanent roles as VP of finance and insights and COO, becoming co-CEO in 2021. In this conversation with Stanford lecturer Emily Ma, Densborn shares the advantages and challenges of being a woman and co-CEO at the intersection of food and technology.


    —-----------------------------------

    Stanford eCorner content is produced by the Stanford Technology Ventures Program. At STVP, we empower aspiring entrepreneurs to become global citizens who create and scale responsible innovations.


    CONNECT WITH US


    Twitter: https://twitter.com/ECorner 

    LinkedIn: https://www.linkedin.com/company/stanfordtechnologyventuresprogram/ 

    Facebook: https://www.facebook.com/StanfordTechnologyVenturesProgram/ 

    YouTube: https://www.youtube.com/user/ecorner


    LEARN MORE

    eCorner Website: https://ecorner.stanford.edu/

    STVP Website: https://stvp.stanford.edu/


    Support our mission of providing students and educators around the world with free access to Stanford University’s network of entrepreneurial thought leaders: https://ecorner.stanford.edu/give.