Sebastian Galkin retweeted
โก @nvidia 's Earth-2 StormScope-EU model, live at #GTCBerlin: together we built a pipeline that turns fresh satellite observations into a new AI forecast every 10 minutes ๐ฐ๏ธ๐ฉ๏ธ
The speed came from the whole pipeline, not just the model: blog link follows ๐
Very proud of the work @cherian_deepak has done on Icechunk. Icechunk wouldn't exist without his effort and talent.
๐ Earthmover engineer Deepak Cherian's use of tools from @anthesishq for property testing, stateful testing, fault injection, and concurrency testing techniques was featured on a recent Bug Bash podcast: it's a terrific episode! youtube.com/watch?v=hmVzoJEYโฆ
2
32
Sebastian Galkin retweeted
๐ Announcing Zax: A new tensor-native data-proximate compute service from Earthmover!
Zax's query planner creates an execution plan that innately understands scientific data. Zax beta services, Zax-SQL and Zax-OpenEO, are now available to customers and free tier users. ๐
Sebastian Galkin retweeted
๐ย Earthmover is hiring! We are so grateful to those who have already applied for the Forward Deployed Engineer & Icechunk Maintainer role: this application cohort is still open. ๐
Sebastian Galkin retweeted
๐งฌ Access biology archives with modern tools โ no conversion needed! ๐ฌ
SciPy 26: Xarray for OME-Zarr, custom indexes, Icechunk virtualization โ read files in place.
11.5GB .h5ad โ 158MB refs, 1.82M cells, no download. 198MB NDPI โ 2.8MB, byte-identical reads.
๐ in replies
Sebastian Galkin retweeted
๐ Thank you to everyone that spun up a free Arraylake Community Tier account: @rabernat and @LindseyNield will show you around on a webinar next Thurs Sept 10 11AM ET! Join us: Reg link follows.
๐๏ธ Version-controlled repos
โ๏ธ Cloud storage
๐ก Served data
Come work with us, help us put some really important scientific data in Icechunk format.
๐ Earthmover is hiring! Our mission: to empower people to use scientific data to solve humanity's greatest challenges.
Open now: Forward-Deployed Engineer & Icechunk Maintainer- 100% remote with some travel to spend time with colleagues and customers. Join us! ๐
1
81
Sebastian Galkin retweeted
๐ง Watch @paraseba's talk on Icechunk at Scientific Computing in Rust 2026:
ACID transactions + git-style versioning over PB-scale n-dim arrays. See why Icechunk appeals to scientific fields as diverse as astronomy ๐ช, biology ๐ฆ , neuroscience ๐ง and physics โ๏ธ.
Sebastian Galkin retweeted
14 PB of NOAA HRRR data. 1 billion GRIB messages. Queryable via virtual Icechunk Zarr within seconds of @NOAA publishing it.
Guest post from dynamical.org's Alden & Marshall on low-latency virtualization at PB scale: earthmover.io/blog/virtual-aโฆ
Sebastian Galkin retweeted
๐ Three Mars atmospheric reanalysis datasets are now on the Earthmover Marketplace: ARCO-OpenMARS, ARCO-MACDA v2.0 & ARCO-EMARS v1.0.
Cloud-native Zarr: slice exactly the variables you need in Python, no download required. โ๏ธโก
app.earthmover.io/marketplacโฆ ๐
The US National Weather Service is adopting Icechunk!
Replying to @NOAA
@NOAA's NWS is adopting Icechunk for CIRRUS, the next-gen system replacing AWIPS.
๐ง ACID transactions + cloud-native I/O at PB scale
๐ 100x faster than existing NetCDF workflows
๐๏ธ Serving FAA, FEMA, NASA, USDA, DOE + every state
earthmover.io/blog/icechunk-โฆ
29
Very proud of the work we are doing. Free cloud datasets for science, SLAs for businesses, best consistency and performance we know of. See also our recent ERA5 dataset earthmover.io/blog/low-latenโฆ
๐ฐ๏ธ Old file format? No problem! We made the full GOES-16 satellite archive queryable as a single Zarr store โ without copying a single byte ๐ง Find out how: earthmover.io/blog/virtual-zโฆ
1
25
Sebastian Galkin retweeted
๐ฐ๏ธ Old file format? No problem! We made the full GOES-16 satellite archive queryable as a single Zarr store โ without copying a single byte ๐ง Find out how: earthmover.io/blog/virtual-zโฆ
Sebastian Galkin retweeted
Ship fast, break nothing. ๐
We built a test that runs Icechunk v1 AND v2 in a single Python process, randomly interleaves their calls, and auto-shrinks failures โ using a tool called third-wheel ๐
Result: zero v1/v2 compatibility issues reported. โ
Full write up link๐
Sebastian Galkin retweeted
๐ Arraylake now speaks MCP.
Connect Claude, ChatGPT, or Cursor to your array data to browse repos, query Flux, render maps, all in natural language. Agents empowerment, no notebook required. โก
Full announcement & links to the docs๐
Sebastian Galkin retweeted
Sebastian Galkin retweeted
From GeoTIFF chaos โ cloud-native climate risk: Eoliann built AIRIS to predict floods, fires & droughts with precision across time horizons to 2050.
Powered by Earthmover, they turned TBs of satellite data into fast, decision-ready insights: earthmover.io/blog/
Sebastian Galkin retweeted
Icechunk V2 is coming soon- so to check compatibility with V1 pre-release, @xarray_dev Ian Hunt-Isaak built third-wheel, a tool to ๐ข๐ง๐ฌ๐ญ๐๐ฅ๐ฅ ๐ฆ๐ฎ๐ฅ๐ญ๐ข๐ฉ๐ฅ๐ ๐ฏ๐๐ซ๐ฌ๐ข๐จ๐ง๐ฌ ๐จ๐ ๐ญ๐ก๐ ๐ฌ๐๐ฆ๐ ๐ฉ๐๐๐ค๐๐ ๐ ๐ฌ๐ข๐๐ ๐๐ฒ ๐ฌ๐ข๐๐: witness the magic.
Sebastian Galkin retweeted
















