MNEMOSYNEv0.1.2563

Podcasts/Lex Fridman Podcast/Hotz, George

Hotz, George

aka "geohot"; founder of comma.ai, an autonomous/semi-autonomous driving technology company; his second appearance on the podcast

George Hotz: Hacking the Simulation & Learning to Drive with Neural Nets

Lex Fridman Podcast · Oct 22, 2020

▶ Watch on YouTube

Core ideas

Hotz opens with his answer to the Fermi paradox — intelligent civilizations likely exist but self-destruct, given the asymmetric physics of destruction versus defense (a nuclear warhead is trivial to build and split into decoys, but intercepting one is far harder; he contrasts this with cryptography, where defense structurally wins) — while dismissing UFO reports and most conspiracy theories as either psyops or overblown speculation, though he distinguishes clearly-documented historical conspiracies (COINTELPRO-style events, the end of the gold standard) from baseless ones. He revisits his earlier "hack the simulation" talk, clarifying its real point wasn't literal simulation theory but a provocation about how trivial most human status games (stock prices, social media) are compared to the "real game" nature is playing; he says he's only interested in simulation/theory-of-everything ideas (including Eric Weinstein's and Stephen Wolfram's work, which he hasn't engaged with) insofar as they yield testable predictions and actual power over nature, not intrinsic beauty. On mortality, Hotz says he wants not permanent immortality but the ability to choose his own death after he's learned "everything," and is open to radical self-modification (backup copies of himself, altering his own motivational architecture) to preserve that curiosity indefinitely — a position Fridman pushes back on, suggesting the finiteness of life may be precisely what generates curiosity in the first place.

A large technical section covers comma.ai's philosophy and comparison to Tesla: comma's explicit mission is "solve self-driving cars while delivering shippable intermediaries" (the comma two hardware/OpenPilot software, ~$1,200, supporting ~91 car models, with roughly 70% of buyers becoming daily active users). Hotz argues for genuine end-to-end neural-network driving (OpenPilot's lateral/steering control is now trained almost entirely end-to-end on user driving data, with lane detection removable) over Tesla's more modular multi-task/feature-engineered pipeline (segmentation nets, cone detectors, etc.), drawing an analogy to chess engines: hiring specialists for individual "pieces" (a "rook guy," a "cone guy") is a feature-engineering approach he believes will always lose to end-to-end learning, as AlphaZero beat Stockfish — citing DeepMind's MuZero as what he considers the likely template for eventually solving driving via learned world-model rollouts. He estimates full end-to-end level-5 driving is achievable "in the 2020s" though notes OpenPilot's current disengagement rate (~1 per 100 highway miles, up from 1 per 10 a year earlier) still needs roughly three more 10x improvements to match human safety. He predicts Elon Musk will ship driver monitoring before achieving level 5 autonomy (offering a $10,000 bet), arguing scene-adaptive driver monitoring (already implemented at comma, tightening or loosening based on estimated situational risk) doesn't need to be highly reliable to be valuable, unlike the external perception/control problem where errors are catastrophic. He's skeptical of Waymo's business model specifically (arguing robotaxis will resemble the money-losing scooter market, since users already choose speed over cost via UberPool and mostly don't), sharply critical of Nvidia's pricing strategy on high-end AI chips (arguing they're "shooting themselves in the foot" versus selling at Intel-style reasonable markup to build an ecosystem), and dismissive of GPT-3-scale language models as a path to general intelligence, given their character-level cross-entropy loss function and lack of long-term memory — while noting driving itself is more "Markovian" than language (most relevant state carries forward without needing long-range context).

On broader intellectual formation, Hotz describes three specific days of "radical transformation" in his thinking: discovering Eliezer Yudkowsky's early singularity writing (before Yudkowsky's AI-safety turn), which convinced him of near-term human technological obsolescence via computing's exponential doubling; discovering the Hutter Prize and the idea that lossless compression is mathematically equivalent to intelligence, which gave him a rigorous working definition of "intelligence" he'd previously lacked and which led him to spend six months trying to compete for the prize before pivoting into deep learning; and discovering Curtis Yarvin's "Unqualified Reservations" blog during Gamergate/the 2016 election cycle, which gave him an interpretive framework for politics. He argues the current moment already constitutes "the singularity" in his view — not a hard AI takeoff but a rapid rise in the bandwidth of human interconnection via technology — and states his real motivation for solving self-driving cars isn't the problem itself but that its tools will transfer to general intelligence research, while being careful to note that building a working level-5 system would prove something "indisputable" (financial and engineering value) even if it doesn't resolve philosophical questions about intelligence. He closes on love (distinguishing opiate/oxytocin-driven "love" he's skeptical of from an abstract, background love of humanity and love of ideas like mathematics), psychedelics (useful for learning about oneself, not the world, revisited occasionally in small doses), and his own eccentricity, rejecting mental-health framing of "crazy" in favor of a view of wide, mostly-normal human neurodiversity, closing with: "being right is super important, except at the expense of being wrong."

Excerpts

On why he believes end-to-end learning will always beat feature-engineered driving pipelines:

“If anything about the history of AI has taught us anything, it's that feature engineering approaches will always be replaced and lose to end-to-end. Now, to be fair, I cannot really make promises on timelines, but I can say that when you look at the code for Stockfish and the code for AlphaZero, one is a lot shorter than the other — a lot more elegant, required a lot less programmer hours to write.”

On the discovery that reframed his understanding of intelligence:

“One of maybe my quests before that was a search for the definition of the word intelligence, and I never had one. And I definitely have a definition of the word compression — it's a very simple, straightforward one... and that is equivalent to intelligence, which I believe. I'm not sure how useful that definition is day to day, but I now have a framework to understand what it is.”

On honest overpromising versus fraud, discussing Elon Musk:

“I think when it becomes wrong is if you know you're not gonna meet that deadline, if you're lying... Don't fake it till you make it, be honest and hope you make it the whole way. The technology wins.”