Sourav (@srvmshr) header
Sourav (@srvmshr) profile picture

ML University of Tokyo. Prev: Microsoft Research RF, @virginia_tech. Personal opinions. Coasting life with @jnchrltte. AI Babysitting currently.

Tokyo-to, Japan
Joined April 2013
Photo by Sourav (@srvmshr)Photo by Sourav (@srvmshr)Photo by Sourav (@srvmshr)Photo by Sourav (@srvmshr)Photo by Sourav (@srvmshr)Photo by Sourav (@srvmshr)Photo by Sourav (@srvmshr)Photo by Sourav (@srvmshr)
It is interesting to me that you could actually delete SOUL.md from Muse Agent & make it soulless (?). It favors no moral compunction then (PS: This is how Zuck would want it anyway) /S
76
Haven't shared this ever. I was terrible at arithmetic in grade school. My father until grad school, wasn't convinced anything technical was cut for me. He has gone to even discouraging me from studying CS/Math even after I got through INMO. He tried to convince me for BIO/ECON
1
120
It was an uncomfortable topic at home. Part of the reason why he declined to sponsor me for Masters at Columbia or EPFL, when I had admits. I went on a full ride to @virginia_tech PhD against their will (they'd have wanted me to do MBA or civil services)
1
47
Often these stereotypes start at home. Even educated parents fall for the trope going by some flawed evaluation metrics (class tests, tuition ranks etc) Math is about loving structure of world. This ain't a rat race. And if your definition of it is one, this field isn't for you.
24
I FWIW like the idea there's specialized LM which do this - and only this. Everything cannot be offloaded to Jev
Microsoft is going back in time 😂 Sentiment-Analysis-7B is a 7B-parameter model built on top of mistralai/Mistral-7B-Instruct-v0.2 and was fine-tuned for sentiment analysis with reinforcement learning huggingface.co/microsoft/Sen…
92
Today we're also releasing Mirror! Mirror is a coding agent that we've been using internally for a while now. It has first-class support for Beam, and you can easily switch to other models on the backend 💻 GitHub: github.com/reflection-oss/mi… 📖 Docs: developers.reflection.ai/mir… 🔑 API key: platform.reflection.ai/
We've released the weights for Beam!! 🤗 huggingface.co/reflection 📄 Model card: reflection.ai/beam-model-car… 🧪 Try Beam in our playground & get an API key: platform.reflection.ai/playg… 📚 AND we take open model safety seriously and have posted our safety report: reflection.ai/beam-safety-re…
2
17
1
132
4,355
Sourav retweeted
Argon has this amazing natural understanding of the world. It can do so many things from first principles. Here's a pelican riding a bike, using fourier epicycles. Video made by Argon. Time-synced Lyria 3.5 music prompted by Argon.
235
592
238
8,427
2,224,251
Replying to @AndrewCurran_
Also we don't know how paracetamol works, we don't know why people sleep, or how gravity works. We very much don't know *why* cancer drugs work. I think this is a mathematician misunderstanding how empirical sciences work.
2
10
704
That time of year when I have to update this slide again.
5
24
190
16,890
Success has many fathers, failure has none.
Princeton didn’t consider Anne Carson worthy of a recommendation for tenure, and she couldn’t continue teaching at McGill after its Department of Classics was shut down. Now, everyone wants to claim her as their own …
1
117
Not only has the US never televised public executions in its history, but not even the Nazi defendants sentenced to death at the Nuremberg trials had their executions televised (it was deemed violative of the human rights that post-WW2 institutions were trying to re-establish). The most amazing part of this is that Nidal Hasan is paraplegic and close to 60. So this disgusting spectacle will involve rolling him out in a wheelchair, then live-streaming his body as it's pumped full of bullets. When I and others pointed out last night that public executions are carried out only by the countries we're told are the most primitive and savage (Afghanistan, North Korea), MAGA enthusisasts replied that we were too weak. Pummeling an old guy in a wheelchair with bullets -- as a reality TV show -- seems like an odd and dubious defintion of "strength," let alone an expression of the western values they endlessly claim they and they alone are trying to salvage.
2,420
3,466
288
20,289
1,608,077
October in The City
5
15
2
295
4,788
Introducing a new generative model, Empirical Variational Autoencoder (EVA): We can revive VAEs for sequential generation only with an extra single linear layer that predicts the next prior without VQVAEs or diffusion models. Project page: mapooon.github.io/EVAPage/
7
49
4
356
34,435
Sourav retweeted
wake up babe the freaking pope got schmidhuber'd
55
316
37
3,896
177,855
I don't understand why people take that trio seriously anymore. They have been nothing but burning goodwill and bridges everywhere.
Timnit Gebru doubles down on the "stochastic parrots" framing, saying you "cannot expect LLMs to be factual." As evidence to support this, she cites errors in... Google AI Overviews. We need to start a GoFundMe to pay for these people to have access to Opus 5.5 and Astra.
4
206
Fair point 💯
Let's be honest. This is the only definition ever offered for "stochastic parrots" in the paper. In other words, no definition at all. I've seen no disavowal by any of the authors of this awful rhetorical device that has done more harm to the understanding of LLMs by academics. I still see this cited by people as "evidence" that LLMs "don't really think" and therefore could not be used for "research". This was a bad paper written full of bad claims even for its time. I must admit I fell for it then but Google were right to not want to be associated with it.
106
Sourav retweeted
So the point of the stochastic parrot argument is that LLMs have zero understanding of language or anything else, they are just regurgitating training data. This hypothesis has been thoroughly disproven by LLMs solving millennium problems our smartest mathematicians have failed.
Lol I’m really not going to answering these people sputtering on about “stochastic parrots” at this point. Why does the accurate description of LLMs trigger you so much?
95
25
13
667
263,466
re "LLMs vs stochastic parrots" debate, including "but current LLMs are not just LMs anymore" and "but Emily, Timnit etc still make these claims": why do you care so much what a couple of irrelevant scholars say? take any topic, you will find an idiot scholar making bad claims
Replying to @MelMitchell1
Bender's FAQ here mostly leaves me thinking that current models are still very limited for the basic reasons she'd outlined in the paper. She specifically says the framing is "extremely relevant" to current models.
19
4
2
127
13,936