bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them (@bitsapien_logs) header
bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them (@bitsapien_logs) profile picture

Love solving problems and β€œsimplifying” complexity. Talk to me about politics, tech and social issues. Engineer @Meta / Facebook | Opinions are my own.

Joined July 2011
Photo by bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them (@bitsapien_logs)Photo by bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them (@bitsapien_logs)Photo by bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them (@bitsapien_logs)Photo by bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them (@bitsapien_logs)Photo by bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them (@bitsapien_logs)Photo by bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them (@bitsapien_logs)Photo by bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them (@bitsapien_logs)Photo by bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them (@bitsapien_logs)Photo by bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them (@bitsapien_logs)Photo by bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them (@bitsapien_logs)
#til What associative memory is, in the context of LLMs The way traditional memory works is when given a key, or memory address, the value is retrieved. Let’s say you want a blue box stored in rack number 10. …
5
33
… thing” with 6 corners. This is it does by finding β€œvector similarities” (will get into this black box in a later tweet).
10
… are conceptually similar. LLMs retrieve not based on exact matches as in the case of associative memory, but rather base it on similarity. Associative memory needs exact matches, like β€œblue box”, while LLMs would also return a blue box, if your query was β€œsky coloured …
18
… One other feature of associative memory is that the search is parallel across all data, making it faster than linear search on data in traditional memory. There is specific hardware that supports associative memory. LLMs however do not use this hardware but …
8
…It then does a pattern search to get to the expected result. This obviously needs more memory and resources both when storing and retrieving. …
12
… You would input rack number 10 to get to the blue box in a racks filled with toys. However, in associative memory, any of these inputs: β€œblue box” or β€œblue toy” or β€œbox” would lead you to the blue box. This is because associative memory also holds what the data looks …
18
Well today was fun! Wordle 222 3/6 β¬›πŸŸ©πŸŸ©β¬›β¬› πŸŸ©πŸŸ©πŸŸ©πŸŸ©β¬› 🟩🟩🟩🟩🟩
So I gave it a shot as well. This is fun ! Wordle 221 6/6 ⬜⬜⬜⬜⬜ ⬜⬜🟩⬜⬜ 🟨⬜🟩🟨⬜ ⬜🟨🟨⬜🟨 ⬜⬜⬜⬜⬜ 🟩🟩🟩🟩🟩
1
2
Narrating a pretty bad experience with @HelloFreshUK I forgot to cancel my order since they don’t even send a notification before dispatching an order or charging me. I called them up and asked them to cancel it so food is not wasted, their response - β€œnot possible”. #unethical
1
They offered me a 50% discount, but they are fine with wasting that food. Not cool.
This new year, resolve to read β€œAnnihilation of Caste” by Dr B R Ambedkar. It would take you a few hours but the understanding you’ll gain is life changing.
bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them retweeted
Everyone who hasn’t, should read Dr. B. R. Ambedkar’s #AnnhilationOfCaste. That’s it. That’s the tweet.
22
155
6
1,056
Flew to London last week on an @airindiain flight. Faced some extremely rude behaviour and was lied to about their policies/infrastructure. I realised it was a lie because they switched their version once they knew I was flying business class. This is outright #discrimination !
1
Random Sunday Thought: Designing systems, starting from their interface makes more sense in my head than other strategies.
1
bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them retweeted
Replying to @WakefitCo
@WakefitCo, horrible customer care service, I ordered a mattress one week ago, the delivery guy asked my address but didnot deliver,ever since I have been calling Wakefit and their delivery partner as well,they don’t know where my order is it is marked delivered. #horrible
2
1
1
#TIL Using `index` instead of an `id` as the key in #reactjs could be one of the reasons why your "infinity scroll" component is painfully slow. Check this pretty interesting talk giving a gist of how React works internally youtu.be/i793Qm6kv3U?t=1028
2
2
Discovered the IAM Policy Simulator today on the #AWS web console. This has greatly simplified when trying to apply the principle of least privilege", so that the IAM roles I create only have enough permissions to do what I ask them to do, nothing more and nothing less.
Q: What is the test for equality in #Clojure #RichHickey: Equality means the same thing for everything in Clojure, it means - equal value .. Clojure definitely de-emphases identity Wouldn't the world be a better place if this was THE test for equality - value and NOT identity?
1
From a programmer's perspective this test for equality clearly is more intuitive. Equality must NOT be a function of the position of a piece of data(objects) in memory . That's confusing and you stuck with custom code like "deepEqual" that should have been a language feature.
bitsapien πŸ³οΈβ€πŸŒˆ Ξ» | they/them retweeted
Central govt has assured Supreme Court to vaccinate the entire adult population by Dec end. This requires 238 million doses every month from June. Procure on a war footing. Launch free universal mass vaccination drive NOW. hindustantimes.com/india-new…
11
81
287