Open Source Derived Data Platform for Planet-Scale Workloads
Joined September 2022
- Tweets97
- Following5
- Followers223
- Likes18
Pinned Tweet
The Open Sourcing Venice talk is published!
youtu.be/pJeg4V3JgYo
Many thanks to @strangeloop_stl for the great event organization and subsequent editing!
New blog post by Gaojie Liu (linkedin.com/in/gaojie-liu-9…) and Jialin Liu (linkedin.com/in/jialin0630)
"Venice platform at LinkedIn now handles over 175M key lookups/sec and 230M writes/sec, all while maintaining a write-latency SLA under 10 minutes."
linkedin.com/blog/engineerin…
Super excited about the new peer-to-peer file transfer feature in Venice! 🚀
It's already speeding up bootstrap times by up to 600%+ in production.
Check out Jingyan Li's talk to learn more about this awesome project
youtube.com/watch?v=rosg_NgP…
Learn about Hybrid Stores, WAL, Multi-WAL, Replication and CRDTs in Venice!
youtu.be/mM-6GysXii4
This project is also the realization of VIP-5 (Venice Improvement Proposal 5), which you can read more about here: venicedb.org/docs/proposals/…
Check out the latest @InfoQ podcast, featuring a wide-ranging conversation between @olimpiupop and @felixgv about databases, derived data, technical migrations, performance, Venice, Java, RocksDB, @duckdb and more!
podcasts.apple.com/us/podcas…
In this advanced use case, #VeniceDB is used to merge batch and stream inputs, and to transport the data to serving nodes which load it into GPUs, thus updating their ML model in near real time. Check out the paper for more details!
arxiv.org/abs/2407.13218
See this talk from Apurv Kumar at this year's #VeniceCon, to hear about how they re-architected their service to leverage Da Vinci, and achieved significant improvements across many dimensions!
youtube.com/watch?v=JMULRvcm…
Learn about #VeniceDB's next-gen read path, a project named Fast Client 🚀 , presented by Xun Yin at #VeniceCon this Summer!
The next talk from #VeniceCon 2024 is now online!
What #VeniceDB Shipped in the Last Year!
Understand where #VeniceDB fits into @LinkedInEng’s #AI / #ML ecosystem, by watching this first part of the first talk of our recent #VeniceCon event!
youtu.be/PmjGEXek--s
And after this one, you can follow up with the second part of this talk right here: youtu.be/PlCvF9C2RAU
Check out this #VeniceDB overview given by @ZacAttackFTW at #VeniceCon 2024! Subscribe here or on YouTube to hear about the other talks recorded at the event!
youtu.be/PlCvF9C2RAU