k0doval (@k0doval) header
k0doval (@k0doval) profile picture

👋🏾Here for Cloud Tech ✨and bikes.

Santa Monica, USA
Joined July 2014
A 34-year-old physics graduate student spent years writing a strange 800-page book in 1979 about a logician, a Dutch artist, and a German composer. It won the Pulitzer Prize the following year. It quietly became required reading at every AI lab in the world. It is the only book in history that makes the deepest ideas in computer science feel like a dream you cannot stop thinking about. I read it across 3 months on a single side table next to my bed and walked away seeing intelligence, consciousness, and AI in a way I cannot un-see. His name is Douglas Hofstadter. The book is called Gödel, Escher, Bach. Almost nothing in modern AI makes sense without this book. ChatGPT, Claude, Gemini, the entire architecture of self-attention, the alignment problem, the strange feeling that LLMs sometimes seem to understand and other times seem to be playing an elaborate symbol-shuffling game, all of it traces back to questions Hofstadter laid out in a single book published before most of today's AI engineers were born. Here is the story almost nobody tells you about how the book came to exist. Hofstadter was the son of Robert Hofstadter, who won the Nobel Prize in Physics in 1961 for measuring the size of the proton. He was supposed to follow in his father's footsteps. He started a physics PhD at the University of Oregon. He was miserable. He could not focus. He did not love the work. He kept getting pulled toward something else. The something else was a single question that had haunted him since childhood. How can meaning emerge from meaningless symbols? Specifically, how does a brain, which is made of nothing but cells firing electrical signals at each other, produce something that feels like consciousness, like understanding, like a self? He could not let the question go. He left physics. He started writing. The book took him years. He wrote it largely in isolation, working in the basement of his parents' house and at Indiana University, where he eventually finished it. He thought it would be read by maybe a few hundred logicians and AI researchers. Basic Books published it in 1979 as a 777-page hardcover. The next year it won the Pulitzer Prize for general non-fiction and the National Book Award for science. The book is structured in a way that almost no other book has ever attempted. The chapters alternate between two layers. One layer is technical chapters about logic, computability, neuroscience, and AI. The other layer is fictional dialogues between a tortoise and Achilles, characters borrowed from a paradox by Lewis Carroll. The dialogues play with the same ideas the technical chapters explain. Read in order, they do not feel like a textbook. They feel like a strange house with rooms that loop back into each other and corridors that change shape behind you. The first thing the book does is explain Gödel's incompleteness theorems in a way no math textbook had ever managed. Kurt Gödel, an Austrian logician working in 1931, proved something that broke mathematics. He showed that any formal system powerful enough to describe arithmetic contains statements that are true but cannot be proven inside that system. Mathematics, the most certain thing humans had ever built, has holes in it that can never be filled. Hofstadter spends hundreds of pages making you understand this proof not just as a mathematical theorem, but as a structural fact about every sufficiently complex system. Including the brain. Including any AI. The reason AI alignment is genuinely hard is not just engineering. It is structural. Any system smart enough to model itself will contain truths about itself it cannot reach from inside itself. Hofstadter showed this 50 years before AI safety was a field. The second thing the book does is introduce his core idea. He calls it the strange loop. A strange loop is what happens when a system, by climbing through layers of itself, somehow ends up back where it started. Escher's drawings of staircases that always go up but somehow loop back are visual strange loops. Bach's musical canons that modulate up through keys and end on the original note are auditory strange loops. Gödel's self-referential statements that talk about themselves are logical strange loops. Hofstadter argues that consciousness is a strange loop. Your brain builds a model of the world. Inside that model, it builds a model of itself perceiving the world. Inside that self-model, it builds a model of itself thinking about itself perceiving the world. The recursion does not bottom out. The self is what the loop feels like from the inside. This is the part that AI researchers cannot stop returning to. Modern transformer models use self-attention, which is technically a mechanism where a network attends to its own internal states across layers. Recursive reasoning, where a model thinks about its own thinking, is now a research area with its own conferences. Meta-learning, where models learn how to learn, is a direct descendant of what Hofstadter described in 1979 as the necessary structure of any conscious system. He wrote the philosophy. The engineers are now building the implementation. The third thing the book does is the part that haunts every AI conversation today. Hofstadter argued that meaning is not something separate from symbol manipulation. It is what symbol manipulation looks like from the inside, when the manipulation is complex enough and self-referential enough. A simple lookup table does not understand anything. But a system that processes symbols at sufficient depth, with enough self-modeling, with enough recursion, starts to look identical from the outside, and possibly from the inside, to a system that understands. This is the deepest question in modern AI. When ChatGPT generates a response, is it actually thinking, or is it just doing very fast symbol shuffling? Hofstadter spent 800 pages arguing that the distinction may not exist at sufficient scale. If a system shuffles symbols according to the right structure, meaning is what the shuffling looks like from the inside. You can read modern debates about AI consciousness from Yann LeCun, Geoffrey Hinton, Ilya Sutskever, and David Chalmers, and you will find that they are all, in their own ways, having the argument Hofstadter framed in 1979. The fourth thing the book did is the one that took the longest to be vindicated. Hofstadter argued, and continued arguing for decades, that the actual engine of human intelligence is not logic. It is not deduction. It is not pattern matching in any simple sense. It is analogy. The ability to see one thing as similar to another thing, to map the structure of one situation onto a different situation, is, in his view, the core of thought itself. For decades this was unfashionable. Symbolic AI focused on logic and rules. Statistical AI focused on pattern matching. Almost nobody worked seriously on analogy. Then large language models started working. And the people who looked closely at what they were doing realized something uncomfortable. LLMs are, fundamentally, analogy machines. They learn structural patterns from text and apply those patterns by analogy to new situations. They do not deduce. They do not reason logically by default. They map the shape of one thing onto the shape of another thing and produce output that fits the new shape. Hofstadter saw this before any of it existed. His later book Surfaces and Essences, written with Emmanuel Sander, is 600 pages defending the claim that analogy is the core of cognition. It came out in 2013. It was largely ignored. The ChatGPT release in 2022 was, in some sense, a vindication of the entire argument. The strangest thing about reading Gödel, Escher, Bach in 2026 is realizing how lonely the book must have felt when it was written. In 1979 there was no GPT. No deep learning. No transformer. The dominant approach to AI was symbolic logic, and most researchers thought minds were going to be programmed top-down, rule by rule, like a complicated chess engine. Hofstadter said the opposite. He said minds were emergent. They came from the bottom up. They were strange loops in complex substrates. The programmers' approach would never produce real intelligence because it was missing the recursive self-modeling that made minds real. He was right. The book is hard. I had to use all the LLMs and NotebookLM to understand it. It is not a beach read. You do not finish it in a weekend. The math chapters require attention. The dialogues require patience. Most people who buy it never finish it. That is fine. The book is structured so that reading any 50 pages produces a permanent shift in how you think. Bill Gates lists it among the books that shaped him. Steve Jobs read it. Almost every senior AI researcher in the world will tell you it was the book that made them fall in love with the question of intelligence in the first place. Hofstadter himself has been in doubt about modern LLMs. He has said they may have proven him right about analogy and wrong about consciousness at the same time. He is still writing. He is still working on the same question that pulled him out of physics 50 years ago. The 800-page book that explained intelligence before AI existed is sitting one click away from you. Most people will never open it. The ones who do will see the world differently for the rest of their lives.
164
497
105
2,652
415,744
Learning how to balance without falling is impractical – at Santa Monica, CA
3
Pro tip: The goals you didn’t complete this year write down how would you would achieve that goal based on weekly improvement. Then set your goals for next year starting with the unfinished and limit the rest of them. You can always add more goals if you finish all of them.
6
8
1
51
Curious about the long term mental health effects of remote work!? Someone’s gotta ask. – at Santa Monica, CA
1
TIL - you cannot eliminate risk, you can only transfer risk. Thanks @joemfbrown
Really impressed by the number of people that wake up early in LV, NV #awsreinvent2021 – at Paradise, NV
1
Curious about Kafka - and what data mesh, data flow, and data governance can do for you? Join us at #kafkasummit Americas 9/14-15th! share.vbooth.co/Snapbar/2021…
3
Say hello to @ConfluentInc! 👋 Live from the top of @Nasdaq’s MarketSite tower in Times Square, the $CFLT team rings this morning’s Opening Bell to celebrate their listing. Watch here: https://teapawt.net/t.co/NXGcl82kRh
1
34
16
125
Check out my Kafka Summit EU 2021 photo! Just heard @saucelabs talk about using Alembic with @confluent #streamingselfie share.vbooth.co/Snapbar/2021… #kafkasummit #streamingselfie
2
Learn why @zillow chose @apachekafka and how they overcame common migration challenges. Valuable lessons you don't want to miss at #KafkaSummit Europe! kafkasummit.io/
No matter how hard you work, how focused you get, or how stressed you are, always remember to do that which brings you joy. For me, that’s music, singing, dancing and moving. We’re only human. – at Los Angeles, CA
1
2
I’m teaming up with @SalesLoft for their Virtual Summit for Sales Leaders! Join us on Tuesday, October 13th for a half-day of curated content, plus superstar revenue leaders sharing their secrets for success. Learn more: https://teapawt.net/t.co/ierrf5GGjD #SalesLoftVirtualSummit – at North Carolina, USA
2
11
I see you out there trying to remove master from tech lingo. Would you walk away from a job because your boss talked down to one of your female Black co-workers? Would you send an email to your CEO if you sat in an interview review with dog-whistle racist comments?
24
208
29
966
"God created one race, the human race and humans created racism." - Jane Eliott
“Defund” means that Black & Brown communities are asking for the same budget priorities that White communities have already created for themselves: schooling > police,etc. People asked in other ways, but were always told “No, how do you pay for it?” So they found the line item.
4,688
29,532
1,666
132,712
If it’s not obvious by now: Journalism and Propaganda are not the same. – at Santa Monica, CA
$2.2M is what some of these firms spend on standing desks. What a joke.
Andreessen Horowitz launches $2.2M fund to invest in underserved founders tcrn.ch/3gTlI5i by @nmasc_
1
4
20
FBI (SIGINT) aircraft from yesterday is currently operating over Washington D.C. hunting for protestors. If returning home or hiding turn your phone into airplane mode, factory reset and destroy or hide your sim cards. #ICantBreathe #GeorgeFloyd #BlackLivesMatter
451
11,089
337
58,442