Ciaran Jessup retweeted
I recreated an entire GPT architecture in a spreadsheet.
It is a nanoGPT designed by @karpathy with about 85000 parameters, small enough to be packed into a spreadsheet file.
It is great for learning about how transformer works as it shows all the data and parameters going through a transformer pipeline, and all the calculations are actually working inside those cells.
Here is a link to the project where you can download the file and play with it yourself. No coding needed, it is just a spreadsheet. 😉
Spreadsheet is all you need:
github.com/dabochen/spreadsh…
Also thanks to @BrendanBycroft with his LLM visualisation project which inspired this.
Ciaran Jessup retweeted
A ton of AI and Robotics developments this week.
Big announcements from Hugging Face, Kuaishou, Atom Limbs, Amazon, Apple WWDC, Microsoft, CMU Robotics, and Yale Faboratory.
Here's everything that happened and how to make sense out of it:
Ciaran Jessup retweeted
🚨 GitHub and GitLab comments are being abused to push malware via Microsoft repo URLs.
Let's dive in:
Ciaran Jessup retweeted
I hit a bug in the Attention formula that’s been overlooked for 8+ years. All Transformer models (GPT, LLaMA, etc) are affected.
Researchers isolated the bug last month – but they missed a simple solution…
Why LLM designers should stop using Softmax 👇
evanmiller.org/attention-is-…
Ciaran Jessup retweeted
This paper is going viral.
Why?
Authors were able to find a way to enable the Recurrent Memory Transformer to retain information across up to 2 million tokens 🤯
In simpler words, it can process and remember vast amounts of data, significantly more than before.
Just so you have an idea, GPT-4 handles 32K tokens (~50 pages of documents), while the entire Harry Potter series is ~1.5M tokens.
Imagine the potential implications of this:
• AI could write entire novels, not just blog posts
• It could aid in complex scientific research by analyzing vast quantities of data
• Enhance customer service by retaining years of interaction history
• It could store and recall the entirety of your life experiences!!
Ciaran Jessup retweeted
I hacked into a @Bing CMS that allowed me to alter search results and take over millions of @Office365 accounts.
How did I do it? Well, it all started with a simple click in @Azure… 👀
This is the story of #BingBang 🧵⬇️
Ciaran Jessup retweeted
I'm excited to announce the release of GPT4All, a 7B param language model finetuned from a curated set of 400k GPT-Turbo-3.5 assistant-style generation.
We release💰800k data samples💰 for anyone to build upon and a model you can run on your laptop!
Real-time Sampling on M1 Mac
Ciaran Jessup retweeted
11 ways ChatGPT saves me hours of work every day, and why you'll never outcompete those who use AI effectively.
A list for those who write code:
1 of 16
Ciaran Jessup retweeted
Goaaaaaaaal (maybe?) ⚽️
Channel 4 suffer an outage on their website and app leaving football fans unable to watch the England vs Germany match.
downdetector.co.uk/status/ch… #EnglandvsGermany #ENGGER #UefaNationsLeague @Channel4 @All4
Ciaran Jessup retweeted
My favorite bug among the vulnerabilities I presented today! 😆
The original intent was to compare the password. However, the developer copy-and-pasted the code but forgot to replace the variable name. That leads to the Authentication Bypass on IIS.
Ciaran Jessup retweeted
The Brooklyn Public Library has announced that any teenager in America is now eligible for a Brooklyn Public Library card.
Teens can sign out ebooks + audiobooks from wherever they live.
The move is designed to combat censorship, with some titles listed as "always available."
Ciaran Jessup retweeted
This won the internet today for me. 😂
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
Ciaran Jessup retweeted
blog.codinghorror.com/updati…
This is a very cool project.
I owe so much of my current abilities and career to the the semi-DIY games culture of 80s computers (in the 90s tho, long story, short version is we were kinda poor at the time)
Ciaran Jessup retweeted
Everyone; we've raised enough to help 2 families escape domestic abuse! Thank you for the support. If you still want to help, the EP is still available on bandcamp!
skimode.bandcamp.com/track/s…
Hey gang,
A new Skimode release has just dropped. Featuring @KatieHightower "She's My Religion" is a cover of @palewaves indie smash. As always all proceeds go to @RefugeCharity
It's available now on bandcamp!
skimode.bandcamp.com/track/s…
#synthwave #synthpop #NewMusic
Ciaran Jessup retweeted
3️⃣
#Metaballs
Quine JS
<pre id=p style=background:#000><svg onload='setInterval(f=n=>{for(t++,o=i=1;i++<476;o+=i%30?([(f+"")[i%195],"o"][c=0|(h=v=>(M=Math).hypot(i/30-8+3*M.sin(t/8/v),i%30/2-7+4*M.cos(t/9/v)))(7)*h(9)*h(6)/52]||".").fontcolor(c?c>2:n):"\n");p.innerHTML=o},t=1)'>
Ciaran Jessup retweeted
Remember that slime-mould preso? The one that explained really well why co-ordination breaks down in growing orgs?
medium.com/@komorama/on-sche… is an excellent follow up on the kind of judo-moves you've got as a leader to mitigate some of the issues.
Ciaran Jessup retweeted
Today we're publishing a detailed technical writeup of FORCEDENTRY, the zero-click iMessage exploit linked by Citizen Lab to the exploitation of journalists,
activists and dissidents around the world. googleprojectzero.blogspot.c…
Ciaran Jessup retweeted
Just got off phone with a client. Log4j is in their network. Vendor claims patch will be available next release... which is multiple months from now.
Here's what you do if you're in this situation.
1. Keep calm. There's no need to panic.
2. Carefully read this thread.
1/?


























