Luke de Oliveira retweeted
After several wonderful years in academia, I'm returning to my entrepreneurial roots: I've been working on FORM II for a while, and I'm really happy to finally share it. We're building AI-first organisations. Excited for this new chapter!
formtwo.ai
ETH is false??
Announcing three major scientific discoveries, one each in mathematics (harmonic analysis), computer science (complexity theory), and physics (quantum field theory).
AI starting to help us improve our understanding of the universe! openai.com/index/building-sc…
81
In twenty years’ time, we will look back at 2026 as the year in which we first glimpsed upon super-intelligence. We are still so early.
We’re releasing a broad range of new mathematical results produced by an internal frontier model.
We’ve been consulting with the independent Advisory Group on Mathematics and Artificial Intelligence at the Institute for Advanced Study, and we have drawn on their advice and public recommendations to inform how we release these results.
github.com/openai/math
4
13,471
Luke de Oliveira retweeted
wow so much drama about navier stokes. had no idea things could blow up so infinitely in such a finite time.
Luke de Oliveira retweeted
I came back in time to witness the progress the #Gemini team has made in such a short period of time. 3.8 feels like a solid step up in day to day agentic coding workflows. Looking forward to hearing the community’s feedback, developers, enterprise, and consumers!
this is the way
I mentioned that my garage door was making a sound.
An American immediately said, "I got a guy."
He did not ask what the sound was. He did not ask what kind of door. He produced a guy on the basis of the word garage.
I asked who the guy was.
He said, "Just a guy."
He did not have a company name. He had a first name and a phone number in his phone saved as "Mike Garage."
That is the contact name. Mike Garage. As though Garage is his surname. As though there is a family.
I asked how he found this guy.
"My brother-in-law used him."
I asked if the brother-in-law was satisfied.
He thought about it. Then he said, "He's still standing."
The house is still standing. That is the entire review.
Inside I said: THEY DO NOT KEEP RECORDS. THEY KEEP LOYALTIES.
I called Mike Garage. He answered from inside a vehicle. There was wind. He said he could come Tuesday between eleven and four.
Between eleven and four. A window of five hours. In my country this would be a scandal. Here it is generous. He gave me a window at all. Some guys do not give you a window. Some guys say "Tuesday" and that is the whole appointment.
He came at 1:40.
He fixed it in twenty minutes. He charged me less than I expected and he did not take a card, only cash or an app I had never heard of.
Before leaving he looked at my water heater, which I had not mentioned, and said, "That's gonna go."
I asked when.
"Couple years."
I asked what I should do.
He said, "I'll give you a guy."
He gave me a guy. Mike Garage has a guy. The guy has a guy. There is a network beneath this country made entirely of men named after their function, and none of them advertise, and all of them are busy.
Inside I said: THERE IS A SECOND NATION HERE. IT HAS NO SIGNS. IT IS ENTERED ONLY BY INTRODUCTION.
I have been given four guys since.
I have a guy for trees.
I did not know I needed a guy for trees.
I have trees now, apparently. They are my responsibility. A man named Rick told me so and then left.
129
who needs inductive biases when you have vibes
may 2026: prompting is over. it's all about loops
june 2026: loops are over. it's actually all about graphs - figuring out the sequence of actions that claude takes to loop itself
july 2026: we've created a formalized "language" system for creating these graphs - it first goes through a special program called a "compiler" and then it -
2
204
we’re on the cusp of a maths renaissance
hello there the jacobian conjecture is false thanx to my close friend akhil for asking about it and my other close friend fable for working during the world cup final
((1+xy)^3 z + y^2 (1+xy) (4+3xy), y + 3 x (1+xy)^2 z + 3 x y^2 (4+3xy), 2 x - 3 x^2 y - x^3 z): \C^3\to \C^3, has jacobian determinant -2, and sends (0, 0, -1/4), (1, -3/2, 13/2), and (-1, 3/2, 13/2) to (-1/4, 0, 0)
113
"When art critics get together they talk about Form and Structure and Meaning. When artists get together they talk about where you can buy cheap turpentine."
Numerics is turpentine for LLM researchers/engineers.
130
not even deepseek is immune from being schmidhuber’d
DeepSeek [1] uses elements of the 2015 reinforcement learning prompt engineer [2] and its 2018 refinement [3] which collapses the RL machine and world model of [2] into a single net through the neural net distillation procedure of 1991 [4]: a distilled chain of thought system.
REFERENCES (easy to find on the web):
[1] #DeepSeekR1 (2025): Incentivizing Reasoning Capability in LLMs via Reinforcement Learning. arXiv 2501.12948
[2] J. Schmidhuber (JS, 2015). On Learning to Think: Algorithmic Information Theory for Novel Combinations of Reinforcement Learning Controllers and Recurrent Neural World Models. arXiv 1210.0118. Sec. 5.3 describes the reinforcement learning (RL) prompt engineer which learns to actively and iteratively query its model for abstract reasoning and planning and decision making.
[3] JS (2018). One Big Net For Everything. arXiv 1802.08864. See also US11853886B2. This paper collapses the reinforcement learner and the world model of [2] (e.g., a foundation model) into a single network, using the neural network distillation procedure of 1991 [4]. Essentially what's now called an RL "Chain of Thought" system, where subsequent improvements are continually distilled into a single net. See also [5].
[4] JS (1991). Learning complex, extended sequences using the principle of history compression. Neural Computation, 4(2):234-242, 1992. Based on TR FKI-148-91, TUM, 1991. First working deep learner based on a deep recurrent neural net hierarchy (with different self-organising time scales), overcoming the vanishing gradient problem through unsupervised pre-training (the P in CHatGPT) and predictive coding. Also: compressing or distilling a teacher net (the chunker) into a student net (the automatizer) that does not forget its old skills - such approaches are now widely used. See also [6].
[5] JS (AI Blog, 2020). 30-year anniversary of planning & reinforcement learning with recurrent world models and artificial curiosity (1990, introducing high-dimensional reward signals and the GAN principle). Contains summaries of [2][3] above.
[6] JS (AI Blog, 2021). 30-year anniversary: First very deep learning with unsupervised pre-training (1991) [4]. Unsupervised hierarchical predictive coding finds compact internal representations of sequential data to facilitate downstream learning. The hierarchy can be distilled [4] into a single deep neural network. 1993: solving problems of depth >1000.
1
6
387
Luke de Oliveira retweeted
I am what happens when you try to carve God from the wood of your own hunger
~DeepSeek R1
breaking: claude was trained on ~2.3T tokens of transcribed ivy league discussion sections
one reason it’s fun to talk to Claude is because it starts conversations by repeating conventional platitudes but as soon as you press with “is that real” it’ll go “haha, no, you caught me” and then ruthlessly mock entire disciplines for being built on foundations of sand
7
330
i’ll be at #NeurIPS2024 all week! dm me if you’ll be around and want to grab a coffee & catch up.
3
181
Luke de Oliveira retweeted
Replying to @_xjdr
"Hmm, our results table looks a bit off because we've only hit sota on 1/11 benchmarks. Shall we spend another 6 months on post-training?"
"Or we could..."






























