Summary
Max Tegmark defines life and describes its progression from simple biological life (1.0) to cultural (2.0) and looks forward to the potential of technological life (3.0) that fully designs its own hardware and software as opposed to relying on evolution. He argues that intelligence is substrate independent - ie. it isn’t inherently a biological trait. Tegmark lays scenarios surrounding the singularity and how we must understand the goal alignment problem before AGI is upon us.
Key Takeaways
- AGI and Life 3.0 is coming
- Is intelligence substrate independent?
- Prepare for the singularity. Be obsessively future-proof
Notes
1: Most important convo of our lifetime
- Life: a process that can retain its complexity and replicate
- Life 1.0: (DNA, biological stage) life that evolves its hardware and software
- Life 2.0: (learning, cultural stage) life that evolves its hardware but designs much of its software
- Life 3.0: (technological stage) life that designs its hardware and software
- DNA stores 1.6Gb (1.0), brain 10Gb chemically, 100Tb biologically(2.0)
- Humans are 2.1 since we can make small hardware upgrades
- AI future opinions in 3 major categories:
- Digital utopians: AGI is natural, desirable next step in evolution
- Techno-skeptics: Don’t believe in near-term AGI, won’t have imminent impact (100s of years, only slows progress)
- Beneficial AI movement: AGI not necessarily positive, advocate starting ethics research now
- Human-level AGI: ability to accomplish any cognitive task at least as well as humans
2: Matter turns intelligent
- Computronium: any substrate which can perform computational functions (NAND gates)
- Brain: 100B neurons, 100T synapses, 15 watts, ~100B flops, 0.1 sec reaction time
- Moravec’s Paradox: Intelligence as a landscape with valleys (math) and peaks (creative thinking), water level rising as AI/ML advances
- Valleys easier for computers since not required for evolution
3: The near future
- Main downside of ML: it’s a black box, can’t understand why it made choice (hard to replace judges)