Vasseur JP

The next clue in AI reasoning: answers may be attractors. A new paper from Benhao Huang, Zhengyang Geng, and Zico Kolter introduces Equilibrium Reasoners (EqR) — a sharp mechanistic view of test-time scaling in latent reasoning models. The core idea is simple, but deep: Reasoning is not only generation. Reasoning can be convergence. EqR repeatedly updates a latent state. The authors hypothesize that generalizable reasoning emerges when training shapes the model’s latent dynamics so that stable attractors correspond to valid solutions. In other words, the answer is not merely “produced.” It is reached. This matters because test-time compute only helps when the model’s internal dynamics know how to use it. More iterations can improve reasoning — or make it worse — depending on whether the trajectory moves toward a solution-aligned attractor or falls into a spurious one. EqR scales along two axes: Depth: run more iterations so a trajectory can settle. Breadth: run multiple stochastic trajectories from different initializations and select/aggregate the ones that converge best. The first-page figure captures the punchline beautifully: training is capped at 16 iterations, yet the learned dynamics extrapolate beyond 1,024 iterations at test time. As fixed-point residual falls, accuracy rises. On Sudoku-Extreme, the paper reports a jump from 2.6% exact accuracy for feedforward models to over 99% with scalable latent reasoning — equivalent to unrolling up to ~40,000 layers. On Maze, EqR reaches 93.0%. But the benchmark is not the most interesting part. The most interesting part is the lens: Correct answers must become stable. They must be reachable. And convergence itself can become a signal. That gives the field a more precise language for test-time compute than “let the model think longer.” Not longer text. Not an external verifier. Not task-specific search priors. A learned attractor landscape. This feels important because modern AI is moving from static inference toward adaptive computation. The question is no longer only “how much compute should we spend?” It is: What internal dynamics make extra compute useful? Full credit to the authors: Benhao Huang, Zhengyang Geng, Zico Kolter. Paper: Equilibrium Reasoners: Learning Attractors Enables Scalable Reasoning arxiv.org/abs/2605.21488v1 I’m attaching the first page because Figure 1 is worth studying closely. The future of reasoning may not only be models that generate better answers. It may be models whose internal states learn where correct answers live — and how to converge there. #AIResearch #MachineLearning #Reasoning #TestTimeCompute #DynamicalSystems #ArtificialIntelligence