just another layer of cellophane
Joined October 2020
- Tweets520
- Following1.1K
- Followers367
- Likes6.1K
Pinned Tweet
The New York City special lobo is sitting in a malfunctioning subway car with the heat on full blast during the middle of a heat wave because you’re so sick of every conversation opening with “it’s so hot outside” from fidi to uws or until you feel it’s done enough brain damage
Ratio
So much of our alpha is in the infra layer anyway. So we’d rather work with open source projects and contribute back. Thanks @sgl_project for building amazing stuff!
fyi it's $3/M tokens in $15/M tokens out 460 tok/s
we call them "serverless Servers"; a predestined liberation from nominative determinism. but the synthesis-- burried in the name itself! how we designed/built the system to be fast without forgetting itself by preserving the modal experience, answered here
modal.com/blog/serverless-se…
and so the expropriators are expropriated
you can load any open or custom model on modal workers. the inference is all yours : )
> 21 yo new grad from the rust belt
> friend says “hey wanna come work at an ai startup for the summer and live in nyc”
> sure.jpg
> given a hat w Walmart GoPro on it, roll of paper towels, used gloves
> goes to random yc apartments to clean all day
AGI wasn’t built in a day
Today, we're launching shift. We're starting by cleaning your apartment in New York City, for free.
Here's how it works. Book a shift cleaning. A vetted shift operator comes to your home wearing one of our devices. They clean. They leave. You pay nothing.
In exchange, we record the cleaning. Robotics is being built on data about how people do daily tasks, and the value of that recording is what funds the service. Anything personal in it is anonymized before the recording is processed.
By now, you have heard about the shift to AI more times than you can count. About the shift toward you, the part where you actually feel it, you have heard almost nothing. Shift is what starts to make it concrete, in specific cities, with specific services.
Today, cleaning in New York. Soon, handymen, repairs, and errands across the globe. And this is just one side of shift, with more on the way.
Comment “shift” and we’ll send you an early access link.
That plants are green (bc it’s inefficient to metabolize) and sunsets are not (bc Rayleigh scattering of short wave len) and gold is yellow (bc it’s heavy causing 6s and 5d orbital gap to be small), seems all we can see is residue; light the daily singularities could not absorb
Foiled on my morning commute by Po (the red Cantonese teletubby) offering a rose to those willing to “pose with po”. Faintly desperate for a Valentine’s tribute, I looked to Po unsure of whether to make eye contact into the ocelli or with the visible breath from the mesh mouth.
About to burst into tears as my Waymo (low aggression, 5s grace period on greens before attempting turns) is stuck in a line of 11 other Waymos (also all beta and cannot rise to the challenge that is Stevenson and 6th).
Everyone honks at us the second we make the turn.
prophetically named dflash for @_dcw02
Two days since DFlash was released, and @_dcw02 (on @modal research) already shipped support for it in SGLang.
Why are we so excited about this?
Diffusion speculators let us get *way* higher tok/s than auto-regressive models. E.g. we're seeing a 4.73x boost with H200s + FA3 already — with still more improvements to come!
Reach out to us if we can help you get this in prod today, and huge thanks to @zhijianliu and team for coming up with this technique.
Out: doing cardio for summer abs
In: doing cardio so I can keep my hands out of my pockets for more than 10min in the nyc winter so I can respond to slack messages
Speaking into the void bc if someone hears you it might actually affirm the meaninglessness of your actions