Sebastian Galkin (@paraseba) profile picture
Sao Paulo, Brazil
Joined February 2008
Photo by Sebastian Galkin (@paraseba)Photo by Sebastian Galkin (@paraseba)Photo by Sebastian Galkin (@paraseba)Photo by Sebastian Galkin (@paraseba)Photo by Sebastian Galkin (@paraseba)Photo by Sebastian Galkin (@paraseba)Photo by Sebastian Galkin (@paraseba)
Sebastian Galkin retweeted
โšก @nvidia 's Earth-2 StormScope-EU model, live at #GTCBerlin: together we built a pipeline that turns fresh satellite observations into a new AI forecast every 10 minutes ๐Ÿ›ฐ๏ธ๐ŸŒฉ๏ธ The speed came from the whole pipeline, not just the model: blog link follows ๐Ÿ‘‡
1
1
1
178
Very proud of the work @cherian_deepak has done on Icechunk. Icechunk wouldn't exist without his effort and talent.
๐ŸŒ Earthmover engineer Deepak Cherian's use of tools from @anthesishq for property testing, stateful testing, fault injection, and concurrency testing techniques was featured on a recent Bug Bash podcast: it's a terrific episode! youtube.com/watch?v=hmVzoJEYโ€ฆ
2
32
Sebastian Galkin retweeted
๐Ÿ”Š Announcing Zax: A new tensor-native data-proximate compute service from Earthmover! Zax's query planner creates an execution plan that innately understands scientific data. Zax beta services, Zax-SQL and Zax-OpenEO, are now available to customers and free tier users. ๐ŸŽ‰
2
5
2
10
1,463
Sebastian Galkin retweeted
๐Ÿš€ย Earthmover is hiring! We are so grateful to those who have already applied for the Forward Deployed Engineer & Icechunk Maintainer role: this application cohort is still open. ๐ŸŒ
2
2
2
301
Sebastian Galkin retweeted
๐Ÿงฌ Access biology archives with modern tools โ€” no conversion needed! ๐Ÿ”ฌ SciPy 26: Xarray for OME-Zarr, custom indexes, Icechunk virtualization โ€” read files in place. 11.5GB .h5ad โ†’ 158MB refs, 1.82M cells, no download. 198MB NDPI โ†’ 2.8MB, byte-identical reads. ๐Ÿ”— in replies
1
1
1
218
Sebastian Galkin retweeted
๐Ÿ™ Thank you to everyone that spun up a free Arraylake Community Tier account: @rabernat and @LindseyNield will show you around on a webinar next Thurs Sept 10 11AM ET! Join us: Reg link follows. ๐Ÿ—‚๏ธ Version-controlled repos โ˜๏ธ Cloud storage ๐Ÿ“ก Served data
1
2
178
Come work with us, help us put some really important scientific data in Icechunk format.
๐Ÿš€ Earthmover is hiring! Our mission: to empower people to use scientific data to solve humanity's greatest challenges. Open now: Forward-Deployed Engineer & Icechunk Maintainer- 100% remote with some travel to spend time with colleagues and customers. Join us! ๐Ÿš€
1
81
Sebastian Galkin retweeted
๐ŸงŠ Watch @paraseba's talk on Icechunk at Scientific Computing in Rust 2026: ACID transactions + git-style versioning over PB-scale n-dim arrays. See why Icechunk appeals to scientific fields as diverse as astronomy ๐Ÿช, biology ๐Ÿฆ , neuroscience ๐Ÿง  and physics โš›๏ธ.
1
2
4
206
Sebastian Galkin retweeted
14 PB of NOAA HRRR data. 1 billion GRIB messages. Queryable via virtual Icechunk Zarr within seconds of @NOAA publishing it. Guest post from dynamical.org's Alden & Marshall on low-latency virtualization at PB scale: earthmover.io/blog/virtual-aโ€ฆ
1
5
169
Sebastian Galkin retweeted
๐Ÿš€ Three Mars atmospheric reanalysis datasets are now on the Earthmover Marketplace: ARCO-OpenMARS, ARCO-MACDA v2.0 & ARCO-EMARS v1.0. Cloud-native Zarr: slice exactly the variables you need in Python, no download required. โ˜๏ธโšก app.earthmover.io/marketplacโ€ฆ ๐Ÿš€
1
1
2
198
The US National Weather Service is adopting Icechunk!
Replying to @NOAA
@NOAA's NWS is adopting Icechunk for CIRRUS, the next-gen system replacing AWIPS. ๐ŸงŠ ACID transactions + cloud-native I/O at PB scale ๐Ÿš€ 100x faster than existing NetCDF workflows ๐Ÿ›๏ธ Serving FAA, FEMA, NASA, USDA, DOE + every state earthmover.io/blog/icechunk-โ€ฆ
29
Very proud of the work we are doing. Free cloud datasets for science, SLAs for businesses, best consistency and performance we know of. See also our recent ERA5 dataset earthmover.io/blog/low-latenโ€ฆ
๐Ÿ›ฐ๏ธ Old file format? No problem! We made the full GOES-16 satellite archive queryable as a single Zarr store โ€” without copying a single byte ๐ŸงŠ Find out how: earthmover.io/blog/virtual-zโ€ฆ
1
25
Sebastian Galkin retweeted
๐Ÿ›ฐ๏ธ Old file format? No problem! We made the full GOES-16 satellite archive queryable as a single Zarr store โ€” without copying a single byte ๐ŸงŠ Find out how: earthmover.io/blog/virtual-zโ€ฆ
2
1
16
956
Sebastian Galkin retweeted
Ship fast, break nothing. ๐Ÿš€ We built a test that runs Icechunk v1 AND v2 in a single Python process, randomly interleaves their calls, and auto-shrinks failures โ€” using a tool called third-wheel ๐Ÿ›ž Result: zero v1/v2 compatibility issues reported. โœ… Full write up link๐Ÿ‘‡
1
1
156
Sebastian Galkin retweeted
๐ŸŒŠ Arraylake now speaks MCP. Connect Claude, ChatGPT, or Cursor to your array data to browse repos, query Flux, render maps, all in natural language. Agents empowerment, no notebook required. โšก Full announcement & links to the docs๐Ÿ‘‡
1
1
174
Sebastian Galkin retweeted
๐ŸงŠ Icechunk V2: made more reliable for the scale V1 users wanted with help from great OSS tools. ๐Ÿ›ค๏ธ shuttle (@awscloud) systematically explores async task orderings to find race conditions โ˜ข๏ธ toxiproxy (@Shopify) poisons network connections to harden retry logic Links ๐Ÿ‘‡
1
1
1
152
Sebastian Galkin retweeted
From GeoTIFF chaos โ†’ cloud-native climate risk: Eoliann built AIRIS to predict floods, fires & droughts with precision across time horizons to 2050. Powered by Earthmover, they turned TBs of satellite data into fast, decision-ready insights: earthmover.io/blog/
2
24
1,258
Sebastian Galkin retweeted
Icechunk V2 is coming soon- so to check compatibility with V1 pre-release, @xarray_dev Ian Hunt-Isaak built third-wheel, a tool to ๐ข๐ง๐ฌ๐ญ๐š๐ฅ๐ฅ ๐ฆ๐ฎ๐ฅ๐ญ๐ข๐ฉ๐ฅ๐ž ๐ฏ๐ž๐ซ๐ฌ๐ข๐จ๐ง๐ฌ ๐จ๐Ÿ ๐ญ๐ก๐ž ๐ฌ๐š๐ฆ๐ž ๐ฉ๐š๐œ๐ค๐š๐ ๐ž ๐ฌ๐ข๐๐ž ๐›๐ฒ ๐ฌ๐ข๐๐ž: witness the magic.
1
2
3
182
Sebastian Galkin retweeted
Announcing the Earthmover Data Marketplace: cloud native access to high-velocity weather, climate, & E/O datasets. Get access to ARCO ready data cubes from trusted providers, including forecasts from @ECMWF @NOAA- and exciting new AI-based forecasts!
1
1
2
11
598
Sebastian Galkin retweeted
๐ŸงŠ Icechunk 2 is now available in alpha: Move/rename nodes without rewriting, shift chunks without consuming I/O, write metadata at the repo level, host repos on any HTTP server, and so many performance improvements. Read @rabernat and @paraseba's post for the full story! ๐ŸŽ
1
1
2
212