Pinned Tweet
Good question @VishalMalvi_ ! Here's what's going on behind the scenes of the @gmail iOS app 👇
...I knew this was familiar 😐
teapawt.net/emergetools/status/198…
Time to open up the printer to see what’s going on
… aka time to look at the HP iOS app to see why it’s 400 MB 🖨️
18
1,460
Emerge Tools retweeted
At @Sentry’s AI offsite this week, @indragie & I decided to kick things off with a bang❗️
We’d seen a video where friends bought each other ridiculous shirts before a flight and had to wear whatever they were given... so naturally, we did the same for the offsite (ft. @zeeg)
If you see us around SF today, make sure to say hi
Other notes:
- Flutter app
- 207 MB of dynamic frameworks (worse for size compared to static)
- lot of external dependencies
1
6
694
The real TL;DR
teapawt.net/emergetools/status/206…
There's no excuse anymore, Sentry Size Analysis is free 100 builds / month
That's a nightly + weekly releases on Android & iOS and then some
docs.sentry.io/product/size-…
5
873
We focused on the video file b/c it's so easy to optimize + having a 23 MB onboarding video, seen once by user, is ... not ideal
But all the images are also easily optimized, saving 30+ MB.
Optimizing the video & images + stripping binary symbols would save ~75 MB, a third of the total app size
2
6
645
Here's the metadata comparison of the new file + a side-by-side of a random frame, which is virtually indistinguishable
Note the lower bitrate (15.45 Mbps vs. 3.42 Mbps) and file size (23.2 MB vs. 5.1 MB)
1
6
651
TL;DR on the video file, it's encoded with way higher bitrate than needed
If you want to learn more about bitrate, check out this thread
teapawt.net/emergetools/status/198…
It’s Friday, we do have a job, and we do have things to do
But we’re going to tell you about bitrate today
Why this @weedmaps video on the left is 14x bigger than the one on the right, despite looking the same 🌿
1
10
885
It's a 12 second video of some wings flying around
What's egregious is that 1 line of ffmpeg reduces this by ~80% (and you could do even more)
1
23
1,299
There's no excuse anymore, Sentry Size Analysis is free 100 builds / month
That's a nightly + weekly releases on Android & iOS and then some
docs.sentry.io/product/size-…
Some other notes:
Opus generally did a great job on all site recreations, regardless of scenario, but did see improvements w/ screenshot access
Here's an example of Opus recreating linear, 1st image is no screenshot, 2nd image has screenshot access
1
2
322
Might put some more rigor into this - would be cool to see how different models improve (or not) across the scenarios. For convenience this was only done on Anthropic models
1
2
314
Influenced by the release of Snapshots on Sentry
We're bullish on snapshot testing to both guard agent changes + as an artifact that can be used by an agent, excited to see more development here 🫡
docs.sentry.io/product/snaps…
3
340
Here are the runs for the agents with screenshot access, subjectively closer to the actual site
1
2
247
Take this Netflix example. Here are 5 sonnet runs of “Agent 1” (left is actual site, right is agent output)
In every case, the agent failed to get the background right
1
2
247
First step: a scraper to take screenshots of a websites
We then had 3 agents try to recreate the reference image
Agent 1: just told to recreate as closely as possible
Agent 2: can screenshot its work and reference it
Agent 3: can screenshot + run a pixel diff
2
3
590
