Summary

Key Takeaways

Notes

Introduction

• IJ Good intelligence explosion quote*
  • RSI
• Omega / Prometheus hypothetical
  • 1.0 → 10.0 in days
  • Mechanical Turk AWS arbitrage saturation
  • Started with content (movies / TV)
  • UBI-like charity / redistribution
  • → news, politics, persuasion
  • Education + persuasion (depolarization)
  • Agenda 7 slogans: democracy, tax cuts, gov’t social service cuts, military spending cuts, free trade, open borders, socially responsible companies
    • Erode all power structures in the world
  • Outsmarting business tycoons (index funds dominant)
  • Chaos / future shock, but still world getting dramatically better
  • “The Alliance” world order providing social services etc. better than gov’ts - disempowered / toppled

1: Most important convo of our lifetime

• 13.8B years - our universe is awakening (human consciousness)
• Life: a information processing machine that can retain its complexity and replicate
  • Life 1.0: (DNA, biological stage) life that evolves its hardware and software
  • Life 2.0: (learning, cultural stage) life that evolves its hardware but designs much of its software
  • Life 3.0: (technological stage) life that designs its hardware and software
• Humans are life 2.1 since we can make small hardware upgrades
• —
• Larry Page: “the most influential exponent of digital Utopianism”
  • “Larry accused Elon of being speciesist”
• Andrew Ng: techno skeptic - won’t happen in our lifetimes
• Stuart Russel, Eliezer, Nick Bostrom
• FoLI + conference → “beneficial AI”
• —
• AGI: “intelligence far beyond human level”
• Consciousness: subjective experience
• Teleology: explanation of things in terms of their goals or purposes > causes
• Don’t worry about 3: consciousness, evil, robots