Tokenization is the first step in every LLM pipeline — and we barely look at it.
I built TokEntropyDrift to fix that.
It's a tokenizer drift + entropy explorer for researchers, prompt engineers, and LLM nerds like me.
2
1
102
Can You Do It All? Lessons from Johnny Walker youtube.com/shorts/_hO0qQPRZ… via @YouTube
36
When do we get the Grok app in the Tesla? I'd love to have conversations while driving. Thanks @elonmusk
59
Listening to JRE and nodding with @elonmusk about the impossibility of overemphasizing the difficulty of #manufacturing. Just the #scheduling part is a proven NP-Hard problem. You need my Genetic Algorothm #AI software to get good solutions :) #nMetric
134
World camp and yet still a total douche bag... #maxverstapen #dbag
1
3
Replying to @foofighters
There’s always that tall guy in front of you with a phone 🤣 #ffroxy #FooFighters
2
Do NOT go to the #RustyTaco at Coors/Montano... Super Slow (>1 hour with several "it'll be right there." NOPE! Avoid it! @RustyTacoTweets
1
Why Did Stores Have Such Strange Inventory Issues When COVID-19 Hit? Toi... youtu.be/lROj5Q4T5G8 via @YouTube
Interesting article on UI design trends - The _Decline_ of Usability... datagubbe.se/decusab/ #UI
Replying to @SiteGround
@SiteGround Thanks for your worthless support. YOU moved my hosted site to a different IP address, and then wouldn't tell me what the new one was! It's a PUBLIC address you dimwits. You guys suck.
I had a dream last night that I won a "celebrity lunch" with @rainnwilson . He asked if "The Office" was my favorite show. When I said "No. Backstrom is my favorite," he got annoyed and left...
B-36 Bomber Nuclear Accident, Albuquerque, 1957 youtu.be/p0gRHgwSGhE via @YouTube
Google wrongly terminated our new business via our Google Play Developer Account by Mark Dodson medium.com/p/google-wrongly-…
Why is the mutation rate in genetic algorithms extremely small? by Steve Cook quora.com/Why-is-the-mutatio…
Join me and other developers here: ibm.biz/dronedrop2018 to win a DJI drone! #IBMDroneDrop @IBMDeveloper
I think @PrincipledTech answered everything and resolved the #intel #9900k questions. Median isn't bad; Cooler wouldn't matter unless thermal throttling, etc. Exclusive: Interview w/ Principled Technologies on Intel Testing (9900K) youtu.be/qzshhrIj2EY #goodJob
1



