Pinned Tweet
If you are interested in AI, then here is a recent paper we wrote on how we are using AI agents to help solve complex public problems. arxiv.org/abs/2407.13960
Robert Bjarnason retweeted
Important, but not unexpected, finding that experts working with AI agents are swayed by the positions of the AI, even if they think they are working independently.
If your independent judgement matters on a task, you need to be deliberate about when in the process to use AI.
Replying to @AlexTamkin
The agent was told to make the best honest case for its options, but to change its mind if the evidence required it, and never to mislead the analysts.
Analysts went with the agent's lean 86% of the time. If the agent's lean had no effect, we'd expect this to be 50%.
Robert Bjarnason retweeted
The coding interview is dead, at least for my team at Anthropic. I've seen enough to know that it no longer provides signal. I removed it from loops this month.
I have a spicy, optimistic take - I think there's an opportunity for junior engineers: felixrieseberg.com/hunger-be…
Robert Bjarnason retweeted
Announcing three major scientific discoveries, one each in mathematics (harmonic analysis), computer science (complexity theory), and physics (quantum field theory).
AI starting to help us improve our understanding of the universe! openai.com/index/building-sc…
Robert Bjarnason retweeted
Can we finally make a theory for Darwin's "Endless Forms Most Beautiful and Most Wonderful"?
Introducing ruliobiology as a path to general theory in biology, starting with foundations for a theory of biological form
writings.stephenwolfram.com/…
Robert Bjarnason retweeted
The details for our (@DrPatrickE) cell trainer platform are up!
drmichaellevin.org/resources…
Robert Bjarnason retweeted
1/14) Virtual animals are a long-standing goal in neuro-AI, but they should actually behave like real animals.
We present SCAMPER: a virtual rat for RL studies that moves naturally during both exploration, and goal-directed behavior.
Project page: aidansirbu.com/SCAMPER-site/
Robert Bjarnason retweeted
The world of digital animals always brings me joy ... and I thought I'd share some rather interesting-looking specimens I found today as part of my latest science project...
Robert Bjarnason retweeted
Biology has been doing computer science for four billion years. Before the discovery of DNA, Alan Turing and John von Neumann worked out the logic of self-replicating machines, showing how matter folds into a system that reads and executes instructions to build itself.
Robert Bjarnason retweeted
AI transforming the game industry:
The Last Masterpiece of the human-only era of game design (GTA 6) is coming. Major studios are going to accelerate with AI. Anon devs & communities doing insane mashups. And indies are stuck with anti-AI customers
Other industries will follow,
Robert Bjarnason retweeted
Most of what we call human intelligence lives at the level of society, not the individual. None of us knows how to build a toaster from scratch on our own, yet together we can get to the moon.
The most capable AI today operates the same way: as societies of models.
Robert Bjarnason retweeted
The ideal outcome for science isn't a couple of labs using proprietary models and millions of dollars to crack trophy problems, it's to have millions of AI-aided human scientists who follow their curiosity and become way more ambitious
Robert Bjarnason retweeted
As a former math professor and still sometime math researcher, I am rather disappointed in the reaction of the "official math community" to LLMs doing math epically well...
The official hierarchy of award-winning mathematicians and prize committees do not f**king own mathematics, and nobody should have to get permission to prove f**king math theorems !!! Come on people !!
What would piss me off would be if rich companies were proving important, useful math and keeping it secret and not sharing it with the world (which after all supplied their models with all that critical data on the historical math already created etc.) -- but this is NOT what is happening, at least not so far at least...
LLMs are currently superhuman mathematicians in some respects, yet inferior to strong human mathematicians in other respects. Whether creative mathematical conjecturing turns out to be AGI-hard is not 100% clear, but I suspect that in some respects the answer will turn out to be yes.
As Josef Urban , a longtime leader of the academic AI theorem-proving world put it very concisely: Math has two big functions, it's fun and it's useful.
The utility of math should vastly increase as we develop better and better AI-math tools. And yes, we want to be careful this utility is not captured in a few companies, but this particular problem is not happening now... probably largely because the economic value of new math is relatively indirect compared to a lot of other things.
The fun of doing math will not go away any more than the fun of playing guitar solos goes away if there are robots that can shred faster than any human. The kinds of fun we can most naturally have will shift, as has happened over and over throughout history.
If fancy math prizes or math PhD degrees become infeasible or have to change dramatically, so be it, these were never really the core of math which existed before any of these (in some ways already problematic) social institutions...
I remember when I was an academic mathematician, there was a strong vibe that the mathematicians were at the top of the intellectual hierarchy, with physicists just below, then chemists and engineers, then biologists .. and everyone else just barely above the chimpanzees and politicians.... (The physicists also placed themselves at the top, I think, and mostly considered the mathematicians useful but a bit pedantic and misguided, fussing about missing proof details in calculations that had already been successfully compared to experimental data...) --
What we are seeing now I think is the wounding of this sort of overweening math ego... Plus some practical worry about the potential end of "math researcher" as an economically viable profession -- although current tenured profs are probably safe for a while, as governments and universities are unlikely to adapt to exponential change too much till post-Singularity..
Anyway all this is a sideshow to lots of other related major issues/conflicts unfolding concurrently, it's just one that happens to hit close to home as math was where I started my career..
I have been playing with using LLMs and AI agents to try to invent new kinds of math more appropriate for modeling the experiences of agent hives... a different kind of fun. For those curious...
1) Basics of new "distinction calculus" math
bengoertzel.substack.com/p/d…|
2) Attempted start of application to beneficial superintelligence,
bengoertzel.substack.com/p/f…
Soon enough the agents may not need my help with this sort of thing, in which case I will move on to some alternate method of filling spare late evenings ;)
Robert Bjarnason retweeted
Drug discovery is where frontier AI can matter the most.
Today we're announcing @Chaidiscovery’s collaboration with @GSK, following a successful wet-lab evaluation of our models. Using Chai-3, @GSK found binders to every target tested.
AI is entering its proof-point phase.
Robert Bjarnason retweeted
"Evolution is anything but random."
This is INSANE...
@akarshkumar0101 (@MIT_CSAIL, @SakanaAILabs) on artificial life: searching the space of possible universes with foundation models, why evolved networks find structure SGD misses (with @kenneth0stanley), and LLMs evolving Core War programs.
Robert Bjarnason retweeted
An astrophysicist worked with Claude Science to create the first complete ultraviolet map of the sky. Astronomers have already created complete sky maps from radio to gamma rays. But large regions of the sky have never been observed in UV.
In today’s science blog, Brice Ménard explains how he guided Claude to find existing datasets, combine them, and fill in the gaps with statistical inference. The work would have taken humans weeks of work, but, with Claude, just took a few days while Ménard worked on other projects.
The resulting map is a useful teaching tool and an example of exactly the sort of slow, low-priority work which scientists never quite get around to, but which AI now makes feasible.
Read more: anthropic.com/research/the-m…
Robert Bjarnason retweeted
Today we announced interim data from our first-in-human, Phase 1 clinical trial evaluating our lead program in optic neuropathies, showing it was well-tolerated by 3 participants with glaucoma.
Read more about our safety & visual field observations here:bit.ly/4ASWq0p
Robert Bjarnason retweeted
LLMs have crossed an important threshold: surpassing top human experts on some research problems. Capabilities have been steadily improving for years, but in scientific discovery there is a big difference between a model just below top human performance and one just above it. That helps explain why the surge in math results feels so sudden.
LLM capabilities remain jagged, and there are many ways they are still worse than humans. But as models continue to improve, I expect breakthroughs in other domains to follow, leading to a new era of scientific discovery.
Robert Bjarnason retweeted
The most important thing we can apply AI to is improving medicine and human health - very excited about this partnership with the CZI and the Virtual Biology Initiative!
Today, Isomorphic Labs joins the Virtual Biology Initiative (VBI) as a founding member.
We are helping build an open resource for the global research community to accelerate how we understand and treat disease.
Read more here: isomorphiclabs.com/articles/…


























