PrivacySafe retweeted
As someone who uses both open and closed models a lot, I think these new benchmarks are actually MORE representative of reality, not less.
The local AI community gets a lot of things right, but they also way overhype open models.
Opus 5.5, for instance, is MILES ahead of the best open weight models and this now much more accurately reflects that.
I don’t think this is some “let’s promote the frontier labs falsely” fake benchmarks, I think they just finally removed the benchmaxxing that we’ve all seen and felt in local models over the last 4mo or so.
Announcing Artificial Analysis Intelligence Index v5, featuring 2 new benchmarks and 3 upgrades. For the first time, the majority of the Index is built on private datasets
The Artificial Analysis Intelligence Index is our composite measure of model capabilities across tasks reflecting real-world usage today. v5 is our biggest upgrade since v4 launched in January. With v5, 60% of the Index is now based on evaluations with private test sets or held-out answers.
Alongside Intelligence Index v5, we’re launching the Artificial Analysis Progress Index v1, which tracks model capability over time on one continuous scale.
New to the Intelligence Index:
➤ FrontierCode 2.0: Cognition's newly-launched private benchmark of real-world coding tasks, graded on whether a repository maintainer would merge the agent's change
➤ Terminal-Bench-Science: 70 agentic scientific research tasks, run in a terminal environment
Upgraded:
➤ HLE-Diamond (replacing Humanity's Last Exam): a refined 1,000-question version of Humanity's Last Exam, split evenly between reasoning and knowledge questions
➤ AA-Omniscience v1.1: An updated dataset with saturated and public set questions removed, new questions added, and ambiguous or erroneous questions revised
➤ CritPt v2: a private, 40-question hard subset of CritPt v2, revised by the CritPt authors and run with a code-execution tool
Staying in the Index: AA-Briefcase, AutomationBench-AA, GDP.pdf and Terminal-Bench 4.0
Removed from the Index: GDPval-AA v2.1, SciCode, and AA-LCR v1.1
Key results:
➤ Claude Opus 5.5 (max) leads at 58, ahead of GPT-6 Astra (max, 57) and GPT-6.1 Sol (max, 55): Anthropic and OpenAI hold the top five models. Gemini 4 Argon (high) is next at 50
➤ The open weights gap widens from 3 points to 12: Kimi K3.1 Pro (weights not yet released) is the top open weights model at 46. Among released weights, DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) lead at 32 - 26 points behind the leader and below Claude Haiku 5.5 (max, 36)
➤ Cost per task varies by more than 13x among the leading models: of the 10 highest-scoring models shown, GPT-6.1 Terra (max) is the cheapest at $0.96 per Intelligence Index task and Claude Fable 5.1 (max) the most expensive at $13.04
PrivacySafe retweeted
We got you covered fam 💪🏻
Love the great work of our team @GetPrivacySafe. They have grinded all hours this past week, so a huge shout out to all the efforts that have not gone unnoticed in keeping the community safe.
Share the scripts wide and far!
#php #php2shell
aaaand... 3, 2, 1... we've got scripts for that ;) github.com/PrivacySafe/secur…
PrivacySafe retweeted
Wow! Big news today!
Soon Discord messages will be indexable on Google. If you're in a public Discord which is discoverable, and has not changed its privacy settings, any messages posted moving forward can be found from search engines!
Hooray!!!!!1 (I think this is very bad)
PrivacySafe retweeted
This gratis event is divided into two parts. First we will discuss #surveillance and how encryption protects personal #privacy, which will include a Q&A with Henry Fisher, the founder of @TechloreInc and a digital rights activist, as well as a short video from renowned cryptographer Bruce Schneier.
EncryptFest will include a hands-on workshop on how you can encrypt your email using the FSF's Email Self-Defense guide (ESD). Join Us!
fsf.org/blogs/community/2026…
PrivacySafe retweeted
TOMORROW: Join us online, in New Haven, or in Boston for #EncryptFest, a joint event with @fsf ! Our @profdiggity will be interviewing Henry from @TechloreInc at 1:00pm EDT my.fsf.org/civicrm/event/reg… #privacy
Do you want to learn how to encrypt your email? Register for #EncryptFest: u.fsf.org/encryptfest-regist… #FreeSoftware #surveillance #FSF #encryption
PrivacySafe retweeted
If you're interested in John and the issue of secure conversations, check out the work we're doing at @GetPrivacySafe !
xitter.cf/GetPrivacySafe/status/…
Thanks to @missdiorsheree of @SuperteamAU for leading our #hackathon team 🤓
Check out the results in the video below or try the app yourself (via the web app or Android app) 👇
PrivacySafe retweeted
People are just now rediscovering @JohnKiriakou 's work. We discussed this on his show in 2025 in the context of @ivycybered 👇
youtube.com/watch?v=AMg54ioS…
Our #security advisor @JohnKiriakou is trending again! worth listening to what he has to say. Worried about #privacy? Hit us up and we can help you out 🛡️
PrivacySafe retweeted
Our #security advisor @JohnKiriakou is trending again! worth listening to what he has to say. Worried about #privacy? Hit us up and we can help you out 🛡️
PrivacySafe retweeted
CIA can access your phone and laptop cameras and microphones, says former CIA officer John Kiriakou.
PrivacySafe retweeted
Everybody's working [on] the weekend... 🎶 #infosec
Our #security patch repository now addresses the latest #PHP2shell exploits in the wild. We've published 9 scripts to address 22 CVEs across 10 software projects and 6 programming languages, plus 2 other disclosed #infosec incidents. github.com/PrivacySafe/secur…
PrivacySafe retweeted
Another day, another patch(es) 🏴☠️🪝🤷🏻♀️
#phpocalpse
We added patches specifically for the vulnerabilities facing ImageMagick for software Discourse and MediaWiki. Worth looking at for any sysadmin - you could be using ImageMagick and you don't know it 😉 github.com/PrivacySafe/secur… #infosec #security #cybersecurity
PrivacySafe retweeted
Replying to @SuperteamTH
Thankfully the grid is alphabetically sorted! I see @GetPrivacySafe near the center 😎
PrivacySafe retweeted
Just leaving this here cause our team does some amazing work @GetPrivacySafe @profdiggity. Super proud of our awesome team 💪🏻
Help us keep #privacyapublicgood if our patch saved you from the #phpocalypse 🤖🥼👻
#FOSS #FLOSS #OpenSource #privacyforall
🔆We've published a detailed mitigation script for the #PHP @php_net #0day exploits on Debian / Ubuntu / Trisquel for the public good. Sharing is caring! 💞 github.com/PrivacySafe/secur…
PrivacySafe retweeted
Updates added for #node #ruby #gitlab #emudhra CVEs / vulns @GetPrivacySafe 👇
github.com/PrivacySafe/secur…
MEMBER HIGHLIGHT: @Hashlock_ 🇦🇺
Two critical PHP bugs landed this week, and our security members moved fast. Hashlock put out a patch guide, and Perth’s @GetPrivacySafe shared a free mitigation script.
Running PHP anywhere in your stack? Patch today 👇
PrivacySafe retweeted
MEMBER HIGHLIGHT: @Hashlock_ 🇦🇺
Two critical PHP bugs landed this week, and our security members moved fast. Hashlock put out a patch guide, and Perth’s @GetPrivacySafe shared a free mitigation script.
Running PHP anywhere in your stack? Patch today 👇
1/ Patch your PHP today.
Two critical bugs in PHP itself (CVE-2026-109618 and CVE-2026-109619, CVSS 9.2) let an attacker run code on your server with one web request. No login needed.
Exploit attempts are already being seen.
Full guide: hashlock.com/blog/patch-your…
PrivacySafe retweeted
Bright and early tomorrow morning, catch me on at 9:20am @ISACANews #SecureIT26 Conference at Frasers Kings Park, Perth.
I will be discussing #blockchain and #privacy, demoing this with @GetPrivacySafe @solana based x402 community payments with @AUDD_digital stablecoins.
PrivacySafe retweeted
I can confirm @profdiggity the #ISACA audience appreciated this gem 💎☺️ @GetPrivacySafe 🙏
Patch yourselves! 🏴☠️⚓️
#php0day #PHP #phpocalypse
PrivacySafe retweeted
Replying to @GetPrivacySafe @php_net
We have now published an additional *monitoring* script that sysadmins can run as an *indicator of compromise*. This is necessary on systems that are *patched already* for the two published CVEs, as there is at least one more confirmed exploit for systems even after updating @php_net . github.com/PrivacySafe/secur…





























