Formless Art for the Future
๐บ๐ธ
Joined August 2023
- Tweets14.1K
- Following1.9K
- Followers975
- Likes27.4K
๐
Geoffrey Hinton once noticed that the tellers at his bank kept changing. When he asked one of them why, the teller didn't know, only that they got moved around a lot.
Hinton guessed the reason... if staff never work with the same people for long, it's much harder for a few of them to team up and cheat the bank.
That thought became one of the most useful tricks in deep learning. While a neural network trains, you randomly switch off about half its neurons at every step. No neuron can lean on a particular partner, so each one has to learn something useful on its own. The trick is called dropout, and it helped AlexNet win the 2012 ImageNet contest, which set off the modern AI boom. It's still built into many of today's networks.
EverythingSings.Art retweeted
I swear the fucking algo is purposefully trying to drive us insane. This shit is horrid. Yes, gender war slop, yearning posting, random mass murders, war, what a lovely fucking world we have made for ourselves here on X the fucking annihilate yourself app.
EverythingSings.Art retweeted
there will be within the next few years stunning advances in biology. there will whole new ways to think about what biological study even means. i would be only mildly surprised if there were near term solutions to problems like cancer, neurodegenerative disease, etc
EverythingSings.Art retweeted
A very clear eyed picture of whatโs coming. You will need a software factory for defense, not just internal productivity.
Just spent the last 7 days on the front lines of the vulnpocalypse fending off an active cyber attack on one of our products.
Some thoughts:
- Software factories are going to be required equipment for everyone. Thereโs just no way to keep up with the pace of highly automated adversaries without one.
- We were lucky because we had spent the last few months getting our software factory running well. It is nice to have for product development but proved to be absolutely essential this week.
- At the minimum you need to have a coding server in the cloud pre-provisioned with read only access to all your logs and all the services you depend on for observability. With that in place you are a prompt away from reasonably good situational awareness, ongoing monitoring with loops, and ability for coding agents to validate fixes against your actual, observed attack patterns.
- Shared coding server also unlocks multiplayer incident response where everyone can see every session and jump in as needed. Sharing session links that can be forked is much higher bandwidth than re-explaining things.
- You donโt need to be Ramp/Stripe/Uber scale to have a working software factory in the cloud. We are a team of 3. Ours is built with an @opencode server (thanks @thdxr!), a forked version of compound engineering optimized for automated workflows (thanks @kieranklaassen!) and a multiplayer agent in slack that handles crons (we have our own harness but pick your favorite here).
- To get our software factory up and running well, we had to stop all new product development for ~6 weeks and just focus on getting the validation systems working that enabled us to reliably shipping PR without human code review. This felt very painful in the moment but was totally worth the eventual speedup in velocity.
- KYC for @AnthropicAI & @OpenAI cyber programs is now easy and quick (at least for defensive access), but a day felt like a lifetime this week. Submit your app now before you really need it.
- Getting Mythos access unlocked a deeper level of analysis that helped us shift from reactive mitigation to proactive patching. Wish we had done this a few weeks earlier. Get started now!
EverythingSings.Art retweeted
My 2yo does this thing where he approaches me and repeats "I need to be Master Chief," which means I have to give him a small foam dart pistol and put his mom's motorcycle helmet on him. He (relatively) quietly walks around like that for a while before announcing that he's "done"
