
DPhil student @FLAIR_Ox and @AIatMeta. Previously @Mila_Quebec and @rllabmcgill Theory of Mind / Coordination / Rainbow Teaming Opinions my own.
Joined December 2016
- Tweets297
- Following405
- Followers794
- Likes3.8K
Pinned Tweet
Theory of Mind (ToM) is crucial for next gen LLM Agents, yet current benchmarks suffer from multiple shortcomings.
Enter 💽 Decrypto, an interactive benchmark for multi-agent reasoning and ToM in LLMs!
Work done with @TimonWilli & @j_foerst at @AIatMeta & @FLAIR_Ox
🧵👇
Andrei Lupu retweeted
reading the pained responses of mathematicians, there’s a real cruelty in the way the labs have pursued this. not least because the attempted outcome in dropping so much unvalidated and poorly-written work (per the comments) is to push some of the world’s most passionate problem-solvers to be fact-checkers to a machine, as a kind of cynical cheap-as-free RL environment-by-nerdsnipe. dump a bunch of shit in public, call it solutions, get the experts to pore over it, painstakingly review and critique, scrape their efforts and use it to tweak the model, all while stoking terror about the future of the profession. it’s fucked up.
Andrei Lupu retweeted
If you find two ants in your kitchen, the best estimate of the total number of ants in your kitchen is not two
We're detailing two new incidents that occurred during external cyber evaluations conducted by independent evaluation partners.
We outline what happened, how the activity was contained, and how we’re working with evaluators to strengthen our approach to third-party testing.
openai.com/index/third-party…
Make the numerator be submitted papers and you've solved the peer review crisis.
I created the Slop Index: a satirical citation index that calculates how much "slop" a researcher produces. It punishes having many papers with low citation counts.
You can calculate your own slop index at slop-index.com.
Wild times ahead!
hello there the jacobian conjecture is false thanx to my close friend akhil for asking about it and my other close friend fable for working during the world cup final
((1+xy)^3 z + y^2 (1+xy) (4+3xy), y + 3 x (1+xy)^2 z + 3 x y^2 (4+3xy), 2 x - 3 x^2 y - x^3 z): \C^3\to \C^3, has jacobian determinant -2, and sends (0, 0, -1/4), (1, -3/2, 13/2), and (-1, 3/2, 13/2) to (-1/4, 0, 0)
I will be at #ICML2026 to present Decrypto!
Reach out to discuss theory of mind, metacognition, and the path to general scientific reasoning!
Theory of Mind (ToM) is crucial for next gen LLM Agents, yet current benchmarks suffer from multiple shortcomings.
Enter 💽 Decrypto, an interactive benchmark for multi-agent reasoning and ToM in LLMs!
Work done with @TimonWilli & @j_foerst at @AIatMeta & @FLAIR_Ox
🧵👇
To BOLDly do what no lab has done before!
Excited to be part of it!
Hello world :)
We are BOLD — the British Open-ended Learning and Discovery Lab!
BOLD is a new academic research lab fully focussed on paradigm breaking discoveries in fundamental AI. We work towards more efficient & open AI that is built around human needs and capabilities.
To pursue these breakthroughs, we pioneer new modes of collaboration in academia that are more focussed, resourced, agile, and collaborative. Rather than fragmenting resources, today we are sunsetting 5 of the UKs leading AI labs to join forces under our joined scientific vision.
Our vision is centered around three pillars:
⚡ Beyond backpropagation – questioning the foundations of the field.
🤝 Human-centric learning & discovery – treating humans as core to our algorithms
🤖 Embodied learning – fast learning and adapting methods that deal with the messy real world
BOLD is backed by @UKRI_News and @EPSRC with £30M – and this is just the beginning. We are urgently looking for partners and sponsors to 10x this.
👉 ox.ac.uk/news/2026-06-22-oxf…
👉 bold-lab.ai
@j_foerst, @CULLYAntoine, @tonizza82, @shimon8282, @tonizza82, Ani Calinescu & @_rockt
Andrei Lupu retweeted
Mean Field Games provide a framework for modelling large populations.
ICML26 Spotlight: Introducing Recurrent Structural Policy Gradient for partially observable MFGs with common noise, benefitting from faster convergence than model-free RL, but remaining tractable, unlike DP.
Andrei Lupu retweeted
Hindsight Experience Replay has become the ubiquitous method for goal-conditioned reinforcement learning, but leaves open the question of which goal to relabel with.
In this work, accepted at ICML, we propose instead simply Learning Everything All at Once (LEO).
1/
Natural evolution's open-endedness leads to beautiful, complex emergent structures and self-organizing behavior 🌱✨. Replicating this in silico is famously hard 💻. Our paper points to a promising direction by evolving populations of competing neural cellular automata with lifelike behavior 🧬🤖 #Isambard
⚠️⚠️flashing lights, rapid cuts, or strobe effects in this thread! 🚨🚨
1/n
ARC-AGI-3: Revenge of the POMDP
Now I can't wait for ARC-AGI-4 to be entirely multi-agent!
Benchmarking algorithm discovery with rigorous meta-train and meta-test splits!
The world will be a very different place the day DiscoGen is saturated!
Andrei Lupu retweeted
New paper. A Positive Case for Faithfulness.
When asked to explain their decisions, LLMs can give highly plausible self-explanations. But are these explanations actually faithful, or are they just post-hoc rationalizations?
We measure faithfulness via simulatability.
Andrei Lupu retweeted
Windermere vs Buttermere
Windermere: Since 2017, over fifty billion litres of treated sewage and more than 30,000 hours of untreated sewage have made their way into the lake.
Buttermere: a lake where the water company is not allowed to put any sewage at all.
Images taken on 24 and 25 April 2025.
The only way to protect Windermere is to end the sewage pollution once and for all.
savewindermere.com
A much-needed benchmark for research agents, and the closest we've ever been to an LLM dance-off!
Check out DiscoBench! 🕺
Andrei Lupu retweeted
My Oxford lab (@FLAIR_Ox ) is hiring Phd students! If you are thinking of doing a Phd in blue-sky and -sort of crazy ambitious- ML and have a technically strong background and love to work with others, please consider all options for joining us:
1) Direct entry - deadline is the 1st of Dec AOE (ox.ac.uk/admissions/graduate…)
2) AIMS CDT (ox.ac.uk/admissions/graduate…) deadline on 27th of Jan 2026 AOE
3) EIT CDT (ox.ac.uk/admissions/graduate…) deadline on the 7th of Jan 2026 AOE
Student funding is a real constraint / concern in the UK (especially for overseas students) and by applying for these three programs you can maximize your chances of ending up in a very very special place.
This resonates deeply. It is sad to read, and unfortunately the norm in recent years.
The most original papers or those at the intersection of different sub-fields get the worst of it too, since it is harder to grasp the value of their contribution at a glance.
I am an AC for ICLR 2026. One of the papers in my batch was just withdrawn. The authors wrote a brief response, explaining why the reviewers failed at their job. I agree with most of their comments. The authors gave up. They are fed up. Just like many of us. I understand. We pretend the emperor has clothes, but he is naked.
Here is the final part of their withdrawal notice. I took the liberty to make it public, to highlight that what we are doing with AI conference reviews these last few years is, basically, madness.
---
Comment: We thank the reviewers for their time.
However, upon reading the reviews for our paper, it became immediately apparent that the four "reject" ratings are not based on good-faith academic disagreement, but on a critical failure to read the submitted paper.
The reviews are rife with demonstrably false claims that are directly contradicted by the text. The core justifications for rejection rely on asserting that key components are "missing" when they are explicitly detailed in the manuscript. Some specific examples are (and many are even fake claims).
Claim: Harder tasks like GSM8K are missing.
Fact: GSM8K results are in many tables, like Table 2 (Section 4.2) and Appendix G.
Claim: The method does not use per-layer ranks.
Fact: This is the entire point of our method. The reviewer clearly mistook our method for the baselines. (Section 2, Table 1).
Claim: The GP kernel is not specified.
Fact: It is specified in Appendix E (Table 6).
Claim: There is no ablation of the method's three stages.
Fact: Section 4.4 ("Ablation Study") and Appendix J are dedicated to this.
Reviewers have a fundamental responsibility to read and evaluate the work they are assigned. The nature of these errors is so fundamental, so systemic in overlooking explicit content, that it goes far beyond what "limited time" or "oversight" can explain. This work has gone through several rounds of revision over the last year. In earlier submissions, the paper usually received borderline or weak-accept scores.
Numerous signs strongly suggest that some reviewers are relying entirely on AI tools to automatically generate peer reviews, rather than fulfilling their fundamental responsibility of personally reading and evaluating manuscripts.
We strongly protest this.
This is a gross disrespect to the authors. It is a flagrant desecration of the reviewer's sacred duty. It fundamentally undermines the integrity of the entire peer-review process.
Given that the reviews are not based on the actual content of our paper, we have decided to withdraw the submission.
We leave this comment so that future readers of the OpenReview page are aware that the items described as "missing" are already present in the submitted manuscript. These negative reviews for this submission are factually unsound and do not reflect the content of the paper. We cannot and will not accept an assessment that is not based on the work we actually submitted.
Mika is fantastic, I would 100% jump on this if I could!
I’m hiring a Student Researcher at @GoogleDeepMind. This research role centers on topics of open-ended self-improvement and discovery with LLM agents.
📍 Location: London
🗓️ Duration: 6 months, 100%
🚀 Start date: June or July 2026
Apply now using the links below👇
A band-aid, to be sure, but an elegant one.
Congratulations to everyone who got their @NeurIPSConf papers accepted 🎉🎉🎉
At #EurIPS we are looking forward to welcoming presentations of all accepted NeurIPS papers, including a new “Salon des Refusés” track for papers which were rejected due to space constraints!





























