Pascal Thomet (@pthomet) header
Pascal Thomet (@pthomet) profile picture

Dear ImGui Bundle author: Python & C++ GUIs, used in research, robotics and 3D. Readable code, science you can play with. Open to missions. Let's make AI safe!

Paris
Joined June 2008
Photo by Pascal Thomet (@pthomet)Photo by Pascal Thomet (@pthomet)Photo by Pascal Thomet (@pthomet)Photo by Pascal Thomet (@pthomet)Photo by Pascal Thomet (@pthomet)Photo by Pascal Thomet (@pthomet)Photo by Pascal Thomet (@pthomet)Photo by Pascal Thomet (@pthomet)Photo by Pascal Thomet (@pthomet)
Pascal Thomet retweeted
Slaughterbots are here. They're killing civilians and proliferating to bad actors just as we warned in this 2017 film. Countries have now been discussing this issue for 13(!) years in a Geneva forum called the CCW that's useless because it requires unanimity for every decision. This week, they could have agreed to start negotiations on the first international treaty on AI, something that would create new international law on autonomous weapons. They failed to do that. Instead, states agreed to a weak and impotent approach. It is not a binding treaty. It is not enough. The situation will only get worse, and we need clear legal rules more than ever. Time is up - the issue of Slaughterbots must be put to a majority vote. Over 130 states want clear legal rules, and they must take this issue to a forum where their voices will be heard.
17
62
9
272
16,203
Pascal Thomet retweeted
.@paulfchristiano thinks that on the current trajectory (absent any slowing down), there is a 1 in 3 chance that we could have superintelligence powerful enough to overthrow the government within a year. (He articulates a concrete scenario). He argues that the labs should pause further algorithmic progress until they can secure their weights and research secrets. Otherwise China could simply steal the superintelligence in the middle of the intelligence explosion, and the labs would no longer be able to slow down even if they saw their models going off the rails. He also explains how AIs will be trained during the intelligence explosion, and why even a system trained entirely inside a data center could still have the capabilities profile such that humans would have very little chance of competing with it or controlling it. And he discusses the plan for alignment - basically, making a superintelligence that actually does what we ask the way we mean it. Fixing reward hacks and building better graders will help up till the next few model generations, but he thinks that no single current approach has better than even odds of letting us control superintelligence. The hope is that the AIs figure out the solution to this problem during the intelligence explosion. Paul is head of the Alignment Research Center. Previously, he was head of AI safety at the US AI Safety Institute. Before that, he led alignment at OpenAI, where he invented RLHF. He’s recently joined OpenAI’s board (though here he is speaking as a private citizen).
211
266
193
2,174
760,241
Pascal Thomet retweeted
Paul Christiano (OpenAI board member) yesterday: "There's material risk of AI takeover in the next 6-12 months. We have seen roughly the things we might expect to see shortly before something really bad were to happen. Even with [any] realistic policy responses, the risk remains exceptionally high. If we build this as quickly as we can in the easiest way we can the chance is [more like] a coin flip [within the next 3 years]. For most people in this room, the most likely reason they will die is because of an AI accident." Christiano: • Is on OpenAI's safety and security committee (which exists to block risky practices) • Co-invented RLHF at OpenAI back in 2017-2021 • From 2024-2026 was head of safety at the US gov's AI agency (now called CAISSI) (Video is from 'The Hinton Lectures' there's another on tonight and tomorrow.)
116
311
130
1,414
339,652
Pascal Thomet retweeted
Conservative pundit @MattWalshBlog on banning superintelligence: "That technology by definition is outside of human control." "Should we tell them they can't do that? Yes, clearly we should."
30
57
18
369
22,951
Pascal Thomet retweeted
Since August, a team within METR has worked with internal Anthropic information to assess whether AI itself is accelerating AI development. We are now publishing a report summarizing the results of this risk assessment.
261
726
446
5,689
1,986,406
Pascal Thomet retweeted
"Papa, c'est quoi le #racisme ?" Et bah écoute chouchou, @jmaphatie te fait une belle leçon qu'on devrait faire écouter dans toutes les écoles ce matin. Le pente glissante que l'on prend bien trop vite est l'évidence même d'une Histoire qui se répète. L'Europe vaut mieux que ça
Merde @jmaphatie. T'en fais des caisses, mais je supprime pas une virgule de ton propos. Merci pour ce moment. A ce moment de notre Histoire.
6
48
300
43,960
Pascal Thomet retweeted
We at AIFP are spooked by this information. IF (big IF) Anthropic really is imminently about to meet the RSP threshold of 2x acceleration over baseline, then it seems timelines to full RSI and superintelligence may be very short indeed. For example if we naively optimize the AIFM parameters to achieve 2x acceleration over baseline progress in Jan 2027, we get superintelligence sooner than depicted in AI 2027. We are thinking harder and longer about this now and will hopefully have a lengthier update on our thinking to share in the next week.
Anthropic updated its S1 this morning. Notable additions re automated AI R&D and human oversight of it: "[...] our internal estimates and our expectations regarding future models, rather than our current models, indicate that we may imminently meet our Responsible Scaling Policy’s definition of 'dramatically accelerated progress attributable to AI.' We have not designated any of our current models as exceeding this threshold, and we continue to assess the underlying data. We are also evaluating the implications of meeting the AI research and development capability threshold and will release further reports in the future as we set forth in our Responsible Scaling Policy." "We are also considering additional measures, including updates to our Responsible Scaling Policy, to require human review and approval of certain decisions in our research and development processes as our models perform an increasing share of that work." "We believe our investments in safety techniques will enable us to manage these risks and responsibly realize substantially more leverage from Claude than we do today in developing AI models. However, we do not anticipate being able to safely use Claude to fully autonomously design and build successive generations of frontier models without meaningful human supervision or understanding, if and when that becomes technically possible. Accordingly, we are considering updates to our Responsible Scaling Policy to keep humans in control of frontier model development at Anthropic." sec.gov/Archives/edgar/data/…
80
275
56
1,993
283,153
Pascal Thomet retweeted
I grew up in the Pacific Northwest and we'd sometimes see signs of mountain lions around the property. Knowing that, and walking alone through the forest at night, is a particular kind experience. What I feel now reminds me of that
We at AIFP are spooked by this information. IF (big IF) Anthropic really is imminently about to meet the RSP threshold of 2x acceleration over baseline, then it seems timelines to full RSI and superintelligence may be very short indeed. For example if we naively optimize the AIFM parameters to achieve 2x acceleration over baseline progress in Jan 2027, we get superintelligence sooner than depicted in AI 2027. We are thinking harder and longer about this now and will hopefully have a lengthier update on our thinking to share in the next week.
5
10
1
217
9,081
Pascal Thomet retweeted
dear imgui 1.93.0 released! (123rd release) github.com/ocornut/imgui/rel… - ImDrawList rework w/ many improvements and fixes (e.g. inward/outward stroke pos, better thick strokes, AA ends, baked rounded corners & more) - mixed values, and 50+ other fixes/features.
10
46
4
425
16,336