Mandeep (@themandeepc) profile picture

Building fast & cheap web agents @ https://teapawt.net/t.co/uTgQEFnvYJ. Systems engineer, database hugger, and a budding boulderer

SF / London
Joined December 2016
Photo by Mandeep (@themandeepc)Photo by Mandeep (@themandeepc)Photo by Mandeep (@themandeepc)Photo by Mandeep (@themandeepc)Photo by Mandeep (@themandeepc)Photo by Mandeep (@themandeepc)Photo by Mandeep (@themandeepc)Photo by Mandeep (@themandeepc)Photo by Mandeep (@themandeepc)Photo by Mandeep (@themandeepc)
So many inference supply chain attacks. And I mean … inference neoclouds that silently forward your requests to a provider in China?? Maybe inference providers aren’t so fungible after all. For an entirely social/trust reason.
1
54
So that leaves, what? The hyperscalers, Modal, Baseten, and the 4 big neoclouds?
18
I’ve never seen anything so unjustifiably cynical as the HN thread on Anthropic’s IPO.
1
154
Man, GTA 6 looks so good. Started my day by watching the Twitch streams. The NPC behaviour is incredible! On the road unfortunately, so I'm not gonna be able to play until mid-December 😭
1
3
207
Webmasters are adopting various agentic web standards, but not Web Bot Auth. Web Bot Auth lets websites identify and allow 'good' bots. But since it's not taking off, maybe big sites just don't want agentic bot traffic.
1
62
Looking forward to this build night on Friday in SF!
Things you could build with Limitr in 3 hours on Friday: - Agent spend limits - Credits and usage billing - Plan-based feature flags - Rate limits for your free tier Any of them puts you in the running for a Nintendo Switch Lite. luma.com/2y910q2k
1
2
4
99
sorry everyone! think I brought my British weather with me 😅
A potent band of rain is approaching San Francisco from the west, as of shortly before 9 a.m. Radar estimates suggest parts of the band are producing roughly 0.1 to 0.3 inches of rain in just 15 minutes. Live storm updates >> sfchronicle.com/weather/arti…
1
112
Is there a personal agent good at making phone calls to customer support? Need a refund of £20 from TfL. Of course, there’s no email support so you gotta call. Barring an agent, I’m unlikely to bother.
1
79
The more painful you make security, the less secure things will be. To wit, why is it so awkward to create a Slack bot
74
Mandeep retweeted
翻到黄仁勋一段2022年的老视频 一个身价千亿的科技大佬,路过街头直播间,竟然主动凑过去点歌、互动。 完全没有大老板的架子,反而像个爱凑热闹的普通大叔,太接地气了!
350
1,033
136
12,812
1,031,141
Mandeep retweeted
Statement from Singapore Govt re Alice Huang, that there were no investigations conducted
33
178
71
1,415
251,204
Fun fact: it appears reasoning via Codex is worse than via API. For a given reasoning setting and prompt, Codex typically emits 5-10x less reasoning tokens. (Also reproduced by others: github.com/openai/codex/issu…)
102
Tip: got lots of concurrent http connections (e.g. to many sandboxes)? aiohttp >> httpx. We benchmarked around about 400x higher throughput. aiohttp with HTTP 1.1 even beats httpx with HTTP2 multiplexing.
1
1
4
181
This is for many concurrent connections to the same host btw. I know the lore is aiohttp is more performant than httpx, but I've largely found it to be a wash. This is one instance where the difference is substantial. (the performance issue in httpx, in this instance, is due to a sequential data structure in httpcore. That has pathological performance for many connections on the same client.)
32
A big reason the internet is so successful is that it's decentralised. You don't need to coordinate with a centralised authority to setup a web presence or do e-commerce. So it's baffling to think connectors and first-party integrations are a sensible way to give agents access to the world's massive number of businesses. Centralised systems tend to be exclusionary. Even the centralised systems ~most of us use -- e.g. Mastercard and Visa -- are actually provided in a decentralised manner. There's an endless number of payment providers, merchant bank accounts and other network facilitators, each of which operates with different policies & distribution. I think it's really obvious that the right path forward for agents is figuring out how to coordinate between uncoordinated parties whose systems speak a different language. Historically this was basically impossible ... but historically AI didn't exist.
2
2
97
With few exceptions of course. I suspect secure payments is best handled in a relatively standardised way, likely involving a player with huge market presence (ie, Stripe @link). But even there, one is effectively making use of existing networks that have hard-won distribution.
25
Workload Identity Federation! All the big LLM companies support it. There's no reason API keys, and cybersecurity attacks to fetch LLM API keys, should be a thing.
1
56
tbh I think the UK government, in its various (tax) schemes to promote technology, has consistently failed to care about the image of things being British, vs just creating jobs or collecting revenue. It's hard to understate the durable ecosystem value generated by the former.
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
52
good prompt
good prompt "find all of the implicit state machines in my app"
2
2
146
Next big unlock in coding: automatically schedule a task to be done in the future. e.g. clean up backwards compatibility code, look at spans before/after prompt change and see if degradation in performance, etc All without the human cognitive overload of remembering
3
164