
Large-scale ML infra and tools for interactive data analytics | Maintaining https://teapawt.net/t.co/wn77fzXje4 and https://teapawt.net/t.co/jgkeoFwq3C | Previously @IllinoisCS, @ucbrise
Bellevue, WA
Joined May 2012
- Tweets62
- Following278
- Followers154
- Likes390
Stephen Macke retweeted
#DBRX, a new general-purpose LLM, is now available on Databricks Marketplace!
Enterprises can use DBRX in RAG apps or to build a DBRX-style MoE model with their own data. Check it out to advance your AI initiatives. dbricks.co/43yPx3Q
Stephen Macke retweeted
Wow, @ProjectJupyter is the winner of the White House OSTP "Technical Advancement to Enable Open Science" category.
Amazing to see recognition of the project at a national level! Makes me proud of the ecosystem of interconnected tools we've built.
whitehouse.gov/ostp/news-upd…
Excited that interactive dataflow and reactivity continue to gain traction with interfaces for data and scientific computing! Amazing how fast the folks at @marimo_io have made their tool one of the best out there for Python; lots of lessons to bring to github.com/ipyflow/ipyflow
We've added an inspiration section to our README: github.com/marimo-team/marim…
@marimo_io was inspired by @PlutoJL, which in turn was inspired by @observablehq. We've also remixed ideas from other reactive programming tools like @stephen_macke's ipyflow and @streamlit.
7
276
Stephen Macke retweeted
Also in the same session at 10:30, @sh_reya and @stephen_macke will present their work on making computational notebooks more production-ready, by applying program slicing techniques. Now you don’t need to compromise between experimentation and rigor. Take note, notebook cos.!
Slice away all the junk in your comp notebook! @sh_reya and @stephen_macke introduce nbslicer, a tool for better reproducibility of artifacts in notebooks (via reactive exec/backward slicing). Builds on @stephen_macke’s work on nbsafety (now called ipyflow) To appear at VLDB’23!
Stephen Macke retweeted
I have a feeling these three sentences are not enough to prevent some nasty bugs.
If you don't save a reference to an asyncio Task it could disappear at any time. Your code would stop running, but likely only when your app is under real load.
Good luck figuring that out.
Stephen Macke retweeted
📣 Introducing Ponder: Run #pandas on 1TB+ DIRECTLY in your data warehouse 🚀
Learn more below! 🧵[1/N]
ponder.io/run-pandas-on-1tb-…
#python #datascience #AI #database
Stephen Macke retweeted
Notebook ML workflows have a lot of exploration & data wrangling, mixed w/modeling. Relevant artifacts (dataframe, model) are only a sliver of the workflow. So @stephen_macke & I developed nbslicer, a dynamic slicer for Python notebooks, built on ipyflow (github.com/ipyflow/ipyflow)
ipyflow 💖 ipywidgets
Just put the finishing touches on the integration and really happy about how it turned out.
Always felt like ipywidgets should be able to trigger cell execution in response to, e.g., slider adjustments -- with github.com/ipyflow/ipyflow, it's finally here!
Stephen Macke retweeted
This demo youtu.be/SHs9PxiCdxM blows my mind:
It stores the entire execution/dependency graph of variables in a notebook and snapshots it according to your specifications.
It think that this could be used to build a better notebook that allows for instant time travel etc.
Replying to @HamelHusain
Have you checked out @lineapy_oss yet? It does a really extreme version of this, including linking all objects in the session to the code that produced them.
For computational notebooks with reactivity, the ordering of reactively executed cells should proceed
100%in any direction ⤵️⤴️↕️
0%strictly downward ⬇️
0%🤡 strictly upward ⬆️
1 votes • Final results 1
134
Reactive execution in github.com/ipyflow/ipyflow with ctrl+shift+enter / cmd+shift+enter is 🔥🔥🔥
Stephen Macke retweeted
you ever discover a software that's like.... holy shit, this is absolute magic?
yeah, well, for me, it's ffsubsync: github.com/smacke/ffsubsync
idk how, but... holy effing wow this thing works amazingly (syncs subtitles to videos).
Incredible team well-positioned to seamlessly scale up analytics and insights all while keeping intact the familiar open source data tools we know and love.
We’re thrilled to officially announce Ponder and our seed funding round of $7M, led by @lightspeedvp with participation from @intelcapital @8vc and @thehousefund . Learn about why we started Ponder here: ponder.io/announcing-ponder/ — highlights below. [1/4] 🧵
3
Stephen Macke retweeted
🎉 Proud to announce @ponderdata and our $7M seed funding!! 🧵below
We’re thrilled to officially announce Ponder and our seed funding round of $7M, led by @lightspeedvp with participation from @intelcapital @8vc and @thehousefund . Learn about why we started Ponder here: ponder.io/announcing-ponder/ — highlights below. [1/4] 🧵
Stephen Macke retweeted
So incredibly excited for the official launch of @ponderdata today, taking our research on making @pandas_dev usable at scale with @modin_project and @lux_api to the next level ...
Stephen Macke retweeted
Vol:15 No:3 → Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System vldb.org/pvldb/vol15/p739-pe…
Stephen Macke retweeted
(1/n) This week @dorisjlee from @ucbrise and @BerkeleyISchool will be joining us on the Stanford MLSys Seminar to talk about her fantastic work on @lux_api. You can catch us live on YouTube this Thursday at 1:30 PT!
Deets in 🧵👇:
youtube.com/watch?v=yrmSoU8j…
Stephen Macke retweeted
📢 THE DAY HAS FINALLY COME
Announcing 🥁
🔥🔥Notebooks in Production With Metaflow.🔥🔥
Orchestrate notebook execution in your DAGs & visualize/debug production workflows. Outputs are rendered in the MetaFlow GUI 🚀
outerbounds.com/blog/noteboo…
But that's not all! 🧵 👇 1/n



















