
owning evals and agents @AikidoSecurity | prev @Hacktronai building pimi for myself
in.ur.computer
Joined July 2017
- Tweets3.8K
- Following805
- Followers598
- Likes9.7K
Pinned Tweet
pretty happy with how my custom harness is evolving! some highlights:
- editor mode to edit, browse and review code LSP on the go with support for annotations for agents
- same-thread provider switch so rotate between diff providers and models without losing context
- PR review built-in so no need to use the abomination that is g*thub
- attack mode that does UI/UX QA testing or whatever you want. uses browsers, terminals, and desktop app testing (alfa)
- first-class annotation support for web and desktop apps. select what u want tested for the edge case rubbing against ur OCD and the agents will test exactly that
OSS forever, vibeslopped but 💖optimized💖
Debarshi retweeted
Nice argument, but I’ve already released a 12M-line lean formalization that you are the soyjack and I am the chad.
update
cooked my agent orchestrator some more:
- connect to multiple remote hosts over ssh/tailscale
- spaces as a home for your mind. store papers, links, videos and reference them in chats
- ask pimi. just ask her to do things and be nice (non negotiable)
- delegate tasks from chat to different providers and switch providers in-chat seamlessly
- track tasks and updates automagically get shit done
- some nice new and live themes for those eyes chico
- view how you (ab)use your clankers, what u got done and how you can save tokens
1
52
cooked my agent orchestrator some more:
- connect to multiple remote hosts over ssh/tailscale
- spaces as a home for your mind. store papers, links, videos and reference them in chats
- ask pimi. just ask her to do things and be nice (non negotiable)
- delegate tasks from chat to different providers and switch providers in-chat seamlessly
- track tasks and updates automagically get shit done
- some nice new and live themes for those eyes chico
- view how you (ab)use your clankers, what u got done and how you can save tokens
is it worth it to get ps5? ofc for gta vi. i've never had a console.
in my country ps5 pro isn't available but I might be able to get it from EU. not sure if worth it tho is ps5 can already handle gta vi w stable fps
3
3
387
it's a pleasure working with the @Google team on these evals! stay tuned for more :)
Replying to @pilvar222
full leaderboard: aikido.dev/aikido-arena
also shoutout to my colleague @iminurputer for the wonderful work he's doing on these benchmarks :)
3
241
Debarshi retweeted
please have a good day. If your day is not good yet meybe it will be good later, or maybe your tomorrow will be a good day. Thank you
i have been building my own agent orchestrator as a fork of another project and holyshit! Supply chain is hell!
so many ways to get pwned so many vectors!!!
doesn't help that the project i forked used dependencies like rainwater anywya ive cleaned up and maintain minimalism
4
187
Debarshi retweeted
man, who should i trust? a bunch of nerds who made linux run on apple silicon, reverse engineering that pesky gpu isa among a gazillion other things, all pre-ai.
or the guy who thinks having your agent rewrite shitty rust he never looked at in x86_64 is excellence?












