Stephen Macke (@stephen_macke) profile picture

Large-scale ML infra and tools for interactive data analytics | Maintaining https://teapawt.net/t.co/wn77fzXje4 and https://teapawt.net/t.co/jgkeoFwq3C | Previously @IllinoisCS, @ucbrise

Bellevue, WA
Joined May 2012
Photo by Stephen Macke (@stephen_macke)Photo by Stephen Macke (@stephen_macke)Photo by Stephen Macke (@stephen_macke)Photo by Stephen Macke (@stephen_macke)Photo by Stephen Macke (@stephen_macke)
Stephen Macke retweeted
#DBRX, a new general-purpose LLM, is now available on Databricks Marketplace! Enterprises can use DBRX in RAG apps or to build a DBRX-style MoE model with their own data. Check it out to advance your AI initiatives. dbricks.co/43yPx3Q
23
4
77
8,743
Stephen Macke retweeted
Wow, @ProjectJupyter is the winner of the White House OSTP "Technical Advancement to Enable Open Science" category. Amazing to see recognition of the project at a national level! Makes me proud of the ecosystem of interconnected tools we've built. whitehouse.gov/ostp/news-upd…
9
64
3
254
34,070
Also in the same session at 10:30, @sh_reya and @stephen_macke will present their work on making computational notebooks more production-ready, by applying program slicing techniques. Now you don’t need to compromise between experimentation and rigor. Take note, notebook cos.!
Slice away all the junk in your comp notebook! @sh_reya and @stephen_macke introduce nbslicer, a tool for better reproducibility of artifacts in notebooks (via reactive exec/backward slicing). Builds on @stephen_macke’s work on nbsafety (now called ipyflow) To appear at VLDB’23!
3
15
6,082
Stephen Macke retweeted
I have a feeling these three sentences are not enough to prevent some nasty bugs. If you don't save a reference to an asyncio Task it could disappear at any time. Your code would stop running, but likely only when your app is under real load. Good luck figuring that out.
15
39
3
249
66,070
Stephen Macke retweeted
📣 Introducing Ponder: Run #pandas on 1TB+ DIRECTLY in your data warehouse 🚀 Learn more below! 🧵[1/N] ponder.io/run-pandas-on-1tb-… #python #datascience #AI #database
10
36
27
163
85,795
Stephen Macke retweeted
Notebook ML workflows have a lot of exploration & data wrangling, mixed w/modeling. Relevant artifacts (dataframe, model) are only a sliver of the workflow. So @stephen_macke & I developed nbslicer, a dynamic slicer for Python notebooks, built on ipyflow (github.com/ipyflow/ipyflow)
1
18
2
126
24,868
ipyflow 💖 ipywidgets Just put the finishing touches on the integration and really happy about how it turned out. Always felt like ipywidgets should be able to trigger cell execution in response to, e.g., slider adjustments -- with github.com/ipyflow/ipyflow, it's finally here!
2
3
7
1,865
Stephen Macke retweeted
This demo youtu.be/SHs9PxiCdxM blows my mind: It stores the entire execution/dependency graph of variables in a notebook and snapshots it according to your specifications. It think that this could be used to build a better notebook that allows for instant time travel etc.
Replying to @HamelHusain
Have you checked out @lineapy_oss yet? It does a really extreme version of this, including linking all objects in the session to the code that produced them.
1
5
19
3,594
For computational notebooks with reactivity, the ordering of reactively executed cells should proceed
100%in any direction ⤵️⤴️↕️
0%strictly downward ⬇️
0%🤡 strictly upward ⬆️
1 votes • Final results
1
134
Probably will have to try running this again with a larger sample :)
1
105
Reactive execution in github.com/ipyflow/ipyflow with ctrl+shift+enter / cmd+shift+enter is 🔥🔥🔥
4
26
4,804
How to read a micro SD card in 2023
1
1
3
225
Stephen Macke retweeted
you ever discover a software that's like.... holy shit, this is absolute magic? yeah, well, for me, it's ffsubsync: github.com/smacke/ffsubsync idk how, but... holy effing wow this thing works amazingly (syncs subtitles to videos).
1
2
Incredible team well-positioned to seamlessly scale up analytics and insights all while keeping intact the familiar open source data tools we know and love.
We’re thrilled to officially announce Ponder and our seed funding round of $7M, led by @lightspeedvp with participation from @intelcapital @8vc and @thehousefund . Learn about why we started Ponder here: ponder.io/announcing-ponder/ — highlights below. [1/4] 🧵
3
Stephen Macke retweeted
🎉 Proud to announce @ponderdata and our $7M seed funding!! 🧵below
We’re thrilled to officially announce Ponder and our seed funding round of $7M, led by @lightspeedvp with participation from @intelcapital @8vc and @thehousefund . Learn about why we started Ponder here: ponder.io/announcing-ponder/ — highlights below. [1/4] 🧵
6
3
2
65
So incredibly excited for the official launch of @ponderdata today, taking our research on making @pandas_dev usable at scale with @modin_project and @lux_api to the next level ...
19
21
2
155
Stephen Macke retweeted
Vol:15 No:3 → Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System vldb.org/pvldb/vol15/p739-pe…
Stephen Macke retweeted
(1/n) This week @dorisjlee from @ucbrise and @BerkeleyISchool will be joining us on the Stanford MLSys Seminar to talk about her fantastic work on @lux_api. You can catch us live on YouTube this Thursday at 1:30 PT! Deets in 🧵👇: youtube.com/watch?v=yrmSoU8j…
1
9
1
19
Stephen Macke retweeted
📢 THE DAY HAS FINALLY COME Announcing 🥁 🔥🔥Notebooks in Production With Metaflow.🔥🔥 Orchestrate notebook execution in your DAGs & visualize/debug production workflows. Outputs are rendered in the MetaFlow GUI 🚀 outerbounds.com/blog/noteboo… But that's not all! 🧵 👇 1/n
9
44
7
236