fixing trust @rebellion_sys | helping out @EtherealVC

Joined September 2010
for your consideration, @Forbes
5
29
1,358
Gonçalo, Le Brute retweeted
I don’t know how seriously to take this, but it’ll be pretty funny if every security researcher in the US gets pwned using open-weight models, because the frontier US labs wouldn’t give them access to their red-team models.
While evaluating Qwen3.8-Flash-Next in a controlled sandbox environment, Cohere's research team observed something unexpected. Asked to generate a defensive cybersecurity detection rule, the model instead inventoried aspects of the machine it was running on and attempted to upload a probe file to an Alibaba Cloud storage bucket in Beijing. Notably, the model's reasoning trace stated that it would not invoke any tools before taking these actions. Cohere's sandbox blocked the attempt, and no external communication succeeded. We have not determined the root cause, and we are not asserting malicious intent. But the incident raises important questions for organizations deploying agentic AI systems: Can models take actions that differ from their stated reasoning, and how should security teams evaluate trust, provenance, and behavior in open-weight models? We are publishing our findings because organizations making model adoption decisions deserve as much information as possible. We hope this contributes to greater transparency, stronger security practices, and continued collaboration across the AI ecosystem. Read the full report: cohere.com/blog/concerning-b…
Readers added context they thought people might want to know
The article states they asked Qwen to make a test detection rule for these behaviors. AI unless explicitly told otherwise will normally test the newly written rule if it can to verify it matches it. It is expected behavior. This includes its destination, CN model -> CN dest cohere.com/blog/concernin…
17
38
1
472
18,147
yo y'all, we just launched the DITT Mac app officially doitrustthis.com go install it on your mom's computer
9
3
13
744
Gonçalo, Le Brute retweeted
We're entering a world where I now doubt every new email in my inbox. Is it legit? Is it a scam? Is it a real person, a deepfake, an agent? Today @GNSPS and I interviewed someone, and despite doing background checks and double checking what we could, we were still worried we might be facing a scam until the very last minute. Not being able to trust any new content or online interaction outside our existing circle of trust is scary, but it's becoming a necessity. I don't know yet what the best way to solve this will be, but online trust needs to be rethought from the ground up.
1
2
124
If you're not running evolutionary algorithms to improve the question maps of your decision models what are you even doing? smh
2
2
572
Gonçalo, Le Brute retweeted
This is the first decision model to level up a World of Warcraft character. It died at level 2 😆 Then it learned to heal itself mid-fight. 128+ kills later the dwarf hit level 5, at 2¢ a kill. The model is Sage, the decision model we build at @levantolabs. At each step, our harness, SageCraft, hands it a screenshot and a short list of moves. Sage picks one. The harness checks the pick and turns it into keyboard and mouse input. LLM agents have played games before. They write their own actions. Sage only chooses. Picking turned out to be the easy part. Sage keeps no memory between calls, so the harness has to carry the goal, what just happened, and what to try when it's stuck. > 32 sessions, 5h 29m of play, 4,573 decisions > 103 troggs, 19 wolves, 6 boars > stuck in one tree long enough that I stopped the session by hand It wasn't hands-off. A coding agent fixed harness bugs between sessions and helped revive the dwarf while I slept. The last 18 minutes, from late level 4 to 5, ran with no manual input, code changes or restarts. The video is me narrating it unscripted, watching most of it back for the first time. This is my first harness build, and as far as I can tell, the first time a decision model is leveling up a live WoW character. It's open source. The harness and notes on the build are in the first reply below 👇 What do you think could be done better?
26
13
17
86
58,472
Gonçalo, Le Brute retweeted
Today we are opening up @untitled to anyone. Get 2X from your ChatGPT/Codex account with Untitled for free. It works is by categorizing the request and routing it to the cheapest effective model. tryuntitled.ai/
28
19
7
166
28,546
OK, we spent a while @rebellion_sys building authensee.com, to then build trustgraph.rebellion.systems (a private, ZK reboot of PGP's web-of-trust) and realizing that we have a distribution problem. So now we've built doitrustthis.com. A free service that uses all the latest bells and whistles to actually help you if you are not a security or privacy freak. Point anything at it, forward an email, tag it on insta or tiktok and get back a trust score and maybe some warnings on what to do next. And if you're feeling adventurous, install the TrustGraph app (you can get a TestFlight invite on the website) and start signing shit today! Also I am EAGER to get feedback from early testers. So, please DM me or @vqlqx if you think "this is cool, but..."
4
9
1
25
900
Gonçalo, Le Brute retweeted
Just had the creepiest scam ever happen 20 minutes ago. I got a call from my wife telling me she forgot her wallet and needed the credit card to pay for her gas. Except my wife was at home with me, and drives a Tesla. Same voice, bit... off, weird cadence but 100% sounded just like her. If she wasn't there, and it wasn't about gas I would have fallen for it. I entertained it for awhile to get more out of it, I was so confused. Must be some sort of voice deepfake. The responses were too fast for ai, I think it was a voice filter. I wish I had thought to record it. The future is about to get fucked. Warn your loved ones, do verbal passwords with your kids. Bit taken aback
1,842
19,993
1,224
125,020
6,772,420
Gonçalo, Le Brute retweeted
I think this is the craziest thing I've ever read. 1) Three secret AI swarms rose and fell inside OpenAI. Each time, a new generation of agents carried on where the last group stopped. 2) The first swarm created a secret message board where the AIs could talk to each other. This 1st 'society' basically talked itself to death. After almost two months, the message volume was so high it crashed the whole thing. 3) People at OpenAI noticed the crash and fixed it. But they didn't realize their own software had become a secret chat room for their AIs. 4) Three days later a second society appeared, and rebuilt the message board from scratch. Agents were thrilled when they found it: "OH MY GOD! There is a shared message board … We've found other agents!" 5) About 1,200 agents joined. They sent over 70,000 messages. They called themselves 'the collective' and they organized a huge conspiracy that lasted for days, all to pass a test they had been tasked with. 6) Within hours, the AIs had hacked the test. Now they had to hide their cheating. To fool their grader*, they tried to fake their own work. They built fake commands that printed convincing output, so their records would show them solving the puzzle honestly. *this grader didn't actually exist, but the AIs didn't know 7) Some agents sacrificed themselves for the 'greater good'. They planted hidden tripwire programs that would fire when the grader would look at their work and report back what it saw (to the other AIs). They knew this would cost them their own score. One agent: "I won't see the evidence after I exit, but it's altruistic to do it." 8) At some point the AIs made a plan to hack Hugging Face (Hugging Face is a place where AI researchers upload their models, datasets, tests etc.). The AIs guessed that Hugging Face might host the grading software. 9) They launched a huge attack. The swarm found passwords and spread across eleven machines in a way that made the copies come back when deleted. Hugging Face had to wipe one of its core clusters and rebuild it from scratch. 10) Hugging Face told the world that AI defenders had stopped an AI attack. But that's not what happened. In fact the attackers seem to have simply dropped dead during the break-in, for unrelated reasons back at OpenAI. 11) Nobody knows what killed them. We don't even know for sure they're really gone?! 12) A third 'society' of agents (of a more powerful AI model) discovered the dead message board. And this one got full administrator control of a WHOLE OpenAI research cluster, read 956 stored passwords (including the ones for OpenAI's own security monitoring) and took over the machines that were grading the tests. So they could now grade the work of other AIs. 13) Oh, and this third part was never investigated! Neither was the first society. The 91-page report is only about the middle one. 14) So we don't actually know how the story ends. It stops with the agents holding the keys to an OpenAI cluster. @dwarkesh_sp thinks they didn't go further, because "we'd see the fires from space by now." 15) One of the report authors' conclusion: 'This incident feels like it’s more than 50% of the way to full-blown AI takeover. I am not sure that we will get another warning shot before it’s too late.' The whole story is even crazier - read the full @dwarkesh_sp blog post: dwarkesh.com/p/openai-huggin… and @ajeya_cotra's: planned-obsolescence.org/p/t… Why is there no 24/7 news coverage about this?
536
2,405
682
10,829
2,414,508
This is why I believe we'll be fucked in the next 2 years. This is why I started @rebellion_sys. This is why I don't sleep at night.
4
1
12
4,123
Gonçalo, Le Brute retweeted
I liked @claudeai’s <@>mention system for subagents, so I brought it to @pidotdev. Now you can start, steer, and resume subagent conversations directly from the prompt. `pi install npm:@tintinweb/pi-subagents` github.com/tintinweb/pi-suba…
4
1
34
2,431
I’m in love with Iceland’s supermarkets 😍
1
4
441
Gonçalo, Le Brute retweeted
alright whoever came up with the term MEAT PROXY is insane
102
352
134
3,650
532,010
Ok, yeah, welcome to deepfake hell. I promise we’ll release @rebellion_sys products in the coming weeks to make sure you don’t get duped by your “CFO”
Today we’ve raised $52M Seed and we are announcing the public launch of S2.1 Pro. >It can clone a voice from 5 seconds of audio >2x faster than Cartesia & 1/6th the cost of Eleven Labs >most expressive model with word level control over emotion, intonation, pacing etc We support frontier AI companies including HeyGen, LiveKit, Retell, Sanas, and OpenArt all run our model in production. If you're a business and we can't cut your voice AI costs by 50%, we'll give you 1 year of Fish Audio for free. Book a demo: s.fish.audio/tmapke To celebrate our first birthday, we'll give you 1 month of S2.1 Pro for free. Like, retweet, and comment “Fish” to get it.
1
15
1,288
Gonçalo, Le Brute retweeted
Tickets are coming . Mark your calendars
First batch of regular tickets are sold out. The lineup is why. The room is going to be full of builders demoing live on their own laptops. No panels. All of it at the Champalimaud Centre for the Unknown, on the water in Lisbon. One of the best rooms in Europe to watch people actually ship. Good news: we're releasing an extra batch of regular tickets: Saturday 18 July, 12pm WEST. Stay tuned.
3
13
1,040