Mayank Singh (@geekmarcus) header
Mayank Singh (@geekmarcus) profile picture

PhD student at @UArizona | Interested in #NLProc, History, #Astronomy, and more | Part-time @GameOfThrones fan account

Joined June 2010
Photo by Mayank Singh (@geekmarcus)Photo by Mayank Singh (@geekmarcus)Photo by Mayank Singh (@geekmarcus)Photo by Mayank Singh (@geekmarcus)Photo by Mayank Singh (@geekmarcus)Photo by Mayank Singh (@geekmarcus)Photo by Mayank Singh (@geekmarcus)Photo by Mayank Singh (@geekmarcus)Photo by Mayank Singh (@geekmarcus)
It’s kinda crazy to me that we melt sand down, clean it to 99.99999% purity, literal wizards have to draw it slowly into an ingot, we cut it, inscribe a hundred billion little on/off switches on it, and when you run electric current through it you can do basic arithmetic, which when you do enough of it can do any math on the planet, and which describes reality well enough that we can teach it the ontological meaning of words and their distance from each other on a high-dimensional space, and if you ask, it can tell you what word comes next and that apparently is powerful enough that if you do it a hundred billion times it’s the smartest thing to ever exist oh yeah and we use this primarily for email
217
973
108
12,315
449,587
Mayank Singh retweeted
🤖 Agent: “Done! $30 promo applied. Pizza’s on the way 🍕” 💳 Bank statement: Charged full price 🤦‍♂️ Now imagine rewarding that run as a success during post-training. Meet Sauron: an evidence-first agentic verifier that makes evaluation faster, cheaper, and more reliable through shared-evidence clustering, targeted trace/state queries, and independent claim verification. 📄 arxiv.org/abs/2610.17724
3
10
6
33
4,505
Mayank Singh retweeted
An epic journey unlike anything you've seen before. Watch the exclusive official trailer for #Ramayana, coming to theaters worldwide November 5. Tickets are on sale now at Fandango - fandan.co/Ramayana
352
3,012
1,219
17,933
3,727,016
Attention arXiv authors. Because of the exponential increase in submissions, arXiv is limiting the number of papers that a person can submit each month to two. 1/
arXiv has updated our policy on rate limiting for all submitters. This update was made to fairly distribute moderator time & support the arXiv community of staff, volunteers, readers & authors. Please read our announcement to learn more: blog.arxiv.org/2026/10/01/up…
43
194
41
1,461
208,537
Mayank Singh retweeted
waking up and seeing your agent stopped to ask for permission 8h ago
306
2,523
259
45,092
1,020,775
Wondering which conference will get 100k abstracts.
3
394
Mayank Singh retweeted
Replying to @PessimistsArc
Right. Dario was already claiming that GPT2 was too dangerous to open source back in 2019. I made fun of them then. Everyone should make fun of them now.
392
3,169
464
25,889
1,995,843
An amazing photo of Mayor Zohran Mamdani, Pope Leo XIV’s new archbishop of New York, Ronald Hicks, and Archbishop Elpidophoros
402
2,901
202
24,621
1,767,240
Mayank Singh retweeted
the biggest take away is they solved one of the hardest problems in mathematics, not for humanity nor for the prize money nor for the science, but for the ability to poast about it on twitter faster than the other guy, truly beautiful
Replying to @SebastienBubeck
Some more technical points: (a) We began working on the Millennium problems due to viral twitter rumors that Anthropic had resolved 2 Millenium problems. Our aim was to see whether our system was also capable of this impressive feat, especially given our excitement regarding the large recent capability increases of our internal model detailed in our blog post. (b) We did not see any of their work until they released it publicly last night. One can in hindsight see that our proofs differ significantly and even the precise results proved are different in the Euler case (forced vs unforced). It is also worth noting that our team consisted largely of mathematicians, physicists and computer scientists with the deepest roots in academia and respect for the stature and integrity of the Millennium problems. (c) Levent reached out unprompted to an OpenAI employee on Wednesday. Due to his numerous posts on Twitter (S^6, Jacobian, Hadamard…) which appear to represent Anthropic and use Anthropic internal models, we believed that their project was, at least in part, an Anthropic project. Additionally recent further tweets by Levent (“augustus mirabilis”) led us to believe that they had solved at least 1 Millennium problem and would likely release it soon. (d) Regarding the level of human involvement on our end: although a group of people was involved in our efforts, we collectively had no research-level expertise in fluid dynamics and the Navier-Stokes problem, and therefore were unable to meaningfully contribute to the mathematical content. We involved several people in order to initially attempt multiple Millenium problems using a variety of multiagent techniques.
20
255
11
4,472
82,538
Mayank Singh retweeted
"i'm in the edit logs of a niche german-language wiki for developers created in 2001"
“we sandboxed the agent” meanwhile the agent:
13
305
1
6,194
261,705
Mayank Singh retweeted
Call me Andrej coz without Claude mai kaam nahi Karpathy
239
404
53
6,449
256,181
Mayank Singh retweeted
Seems like a lot of folks have discovered Looped / Recurrent Transformers tonight :)
3
2
1
45
4,288
Mayank Singh retweeted
India in the 1800s: A glimpse through the paintings by Edwin Lord Week.
1
98
616
12,334
I hope no one throws a paper written with Claude Opus 5 at me to review!
2
3
419
Mayank Singh retweeted
Positional embeddings discard syntax, keeping only order & distance. We show that syntax can be reintroduced by adding two lightweight tag embeddings, looked up from small tables, into the model's input embedding, resulting in improved fundamental language modeling. Delighted that our paper on Syntax-informed Positional Embeddings (SiPE) was accepted to EMNLP 2026 main conference! 🥂 w/ Hyungji Kim & @msurd #EMNLP2026 #InductiveBias #PreTraining
Positional embeddings encode order and distance, but are agnostic to syntax. "Please move this large file to another folder." To act, move must bind file (object) and folder (destination). Absolute PE: no link. Relative PE/RoPE: "six tokens apart." A dependency parse tree: one arc. Introducing Syntax-informed Positional Embeddings (SiPE) (1/n)🧵
1
2
5
481
Mayank Singh retweeted
This is a super cool website. You can scroll around and look at any country's population pyramid, fertility rate, and mortality rate by year. Check this out:
218
3,536
173
24,699
1,800,593
Mayank Singh retweeted
I met the love of my life in the San Francisco Corgi Cafe. Additionally, I’m leaving OpenAI to join Anthropic! Reverse that. I’m leaving Anthropic to join OpenAI! Got rejected by YC. Just got accepted to YC. Taste is the moat. I’m working on RL environments. Actually I’m working on data. No, scratch that, I’m working on personalizable AI for science and enterprise. Taste is the moat. I spent 10 million dollars on Claude tokens last month. I built nothing. There’s nothing to build oh my God what do I build where’s my taste taste isn’t the moat wait taste is the moat taste is the moat taste is the moat taste
150
140
63
3,705
331,448
COLM @COLM_conf 2026: San Francisco, CA ICLR @iclr_conf 2027: San Francisco, CA NAACL @naaclmeeting 2027: San Francisco, CA Very curious if this is pure coincidence 👀
13
12
5
296
75,254
Mayank Singh retweeted
Replying to @vikhyatk
9
20
420
18,420