
Trustless is what we need in AI epoch / CEO at @fractalyze_io , Ex CTO @a41_allforone, Samsung Research, @DecipherGlobal
seoul
Joined December 2021
- Tweets154
- Following368
- Followers1.1K
- Likes470
Everyone can use the same models. BUT, They don’t have your workload data.
That data tells you where you can reuse computation, which tasks need less intelligence, and how to tune your inference stack.
Why don't you user your own weapon? you can reduce up to 80% of your cost.
You can *own* the current frontier lab's intelligence only after 6m.
opened, commoditized super intelligence, localized + personalized ai is so much close now. inevitable.
higher! we now use our tech into AI inference.
Great work from @fractalyze_io optimizing Qwen3-Omni on vLLM-Omni for a single RTX 5090. Their AWQ-4bit, batch-1 text-prompt tests cut time to first audio from 213ms to 23ms vs. stock vLLM-Omni.
We’d love to see these optimizations contributed upstream to vLLM-Omni so more users can benefit!😄
jooman ➡️ working on AI inference retweeted
🇸🇬 SINGAPORE | 11th June 🇸🇬
We hosted one of the most hardcore Whitepaper Reading Club sessions in Singapore last Thursday, where we were deciphering:
🧠 Cryptography’s XLA Moment: Why ZK may need a compiler, not another proving system 🧠
This session was led by @jumanzi_dev from Fractalyze, the team building “the PyTorch for ZK” — a Python-first compiler stack for Zero-Knowledge.
Big shoutout to our:
- Discussion: Jooman & Batzorig from Fractalyze for working on this amazing project. They are deeply passionate about what they do and I feel I've learned so much.
- Thank you to my partner in crime @BrianSeong who made this session possible.
- Great to see @ulandaoon @kowei1995 @9oelM and welcome @tomespel (welcome back to ZK)
🙏 Appreciate @kimmi from @SuperteamSG, for being there for us :)
📝 For more information:
- Fractalyze: fractalyze.io
- Event summary: docs.google.com/document/d/1…
📆 Upcoming events: luma.com/whitepaper
‼️ THE EVENT NOTES > TL;DR ‼️
(1) ZK’s Problem: zkVM/proving teams like @SuccinctLabs, @RiscZero, @ziskvm, OpenVM, Plonky3 (@0xPolygon), Jolt from @a16zcrypto, and Binius from @IrreducibleHW are all fighting the same hard problem: turning Rust/CUDA, memory layout, GPU execution, and field arithmetic into production-level proving performance.
(2) Fractalyze's Solution: Build ZK proving systems in high-level Python, then let a cryptography-native compiler handle optimization underneath.
(3) Zorch: Fractalyze’s stack aims to become the “PyTorch for ZK” — making proving systems easier to write, test, optimize, package, and deploy.
(4) The XLA Analogy: ML scaled as researchers stopped hand-writing kernels. @OpenXLA / MLIR helped high-level models compile into efficient hardware execution.
(5) Cryptography Needs the Same Layer: ZK, FHE, MPC, post-quantum crypto, and formal verification all need better compiler infrastructure if they are going to become real products they are going to become real products — see @zama, @TACEO_IO, @rv_inc, and @NethermindSec.
(6) Not Just Developer UX: The goal is not only abstraction. The deeper claim is that compiler automation can beat hand-written optimization by reasoning across the whole computation graph.
(7) Hardware Portability: Today’s ZK systems are often tied to specific @nvidia GPU assumptions. A compiler layer could make cryptographic workloads easier to move across CPU, GPU, FPGA, and future crypto-specific hardware — a direction also explored by teams like @Ingo_zk / ICICLE and @cysic_xyz.
(8) Ethereum: This matters for real-time block proving, lighter validation, larger block capacity, and the long-term vision of @ethereumfndn becoming easier to verify.
(9) Bigger Than ZK: The real question is whether advanced cryptography can move from research papers and hand-built systems into reusable infrastructure — the same way AI did.
🧠QUESTIONS:
(i) Is the next major ZK breakthrough a new proving system — or the compiler layer underneath all of them?
(ii) If Ethereum itself becomes ZK-powered, what is the future role of ZK rollups?
(iii) Can cryptography become a profitable product category, or is it closer to public-good infrastructure?
(iv) Will AI-generated code make formal verification and verifiable compute much more important?
(v) What happens when cryptography gets 100x or 1000x cheaper to run?
#ZK #Cryptography #Ethereum #MLIR #XLA #VerifiableCompute #Fractalyze #WhitepaperReadingClub
Exciting to see this is starting to trend!
I expect within ~2-3y, We will see
> ppl needs the accuracy more than ever
> only way to handle this is math/crypto.
> AI is so good at math/crypto.
> meet the singularity
> see the *next-git* on sw supply chain
Many people have claimed that with AI-assisted bug finding, secure code (and hence trustless anything) will be impossible.
I have a much more optimistic take, and AI-assisted formal verification is a major part of the reason why:
vitalik.eth.limo/general/202…
jooman ➡️ working on AI inference retweeted
Crypto is losing talent fast
Not because of the 24/7 culture but because of what the grind produces
Brilliant engineers ship products to zero users.
Product managers optimize apps nobody opens.
Great designers polish interfaces for protocols that die
Working hard on the wrong thing breaks people faster than working hard on the right thing ever could
jooman ➡️ working on AI inference retweeted
Progress toward real-time proving for Ethereum L1 is nothing short of extraordinary.
In May, SP1 Hypercube proved 94% of L1 blocks in under 12 seconds using 160 RTX 4090s. Five months later Pico Prism proves 99.9% of the same blocks in under 12 seconds, with just 64 RTX 5090s. Average proving latency is now 6.9 seconds.
Performance has outpaced Moore's law ever since Zcash pioneered practical SNARKs a decade ago. Today's Pico Prism results are a striking reminder of that exponential curve.
Beyond performance, zkVM diversity is remarkable. At least nine zkVMs are racing toward real-time proving: Airbender, Ceno, Jolt, OpenVM, Pico Prism, R0VM, SP1 Hypercube, Ziren, ZisK. That diversity is strength, similar to CL and EL client diversity.
Fusaka, expected in December, will simplify real-time proving. EIP-7825 caps per-tx gas usage, enabling more parallel proving via subblocks. MODEXP, a prominent "prover killer", is being repriced with EIP-7823 and EIP-7883.
By year's end several teams will prove every L1 EVM block on a 16-GPU cluster, drawing less than 10kW total. The 10kW target—about the same as a Tesla home charger—matters for on-prem proving in garages and offices, eliminating reliance on cloud proving.
gigagas frontier
L1 throughput has grown 100x since genesis ten years ago, from 20 kilogas/sec to 2 megagas/sec. With zkEVMs we can 100x again, in half the time. The key is to bypass validators as Ethereum's current scalability bottleneck.
Lean execution proofs also decentralise validation. Goodbye 4TB NVMe, 8 cores, 64GB RAM recommended by EIP-7870. A Raspberry Pi running statelessly, or even a phone, will soon suffice. The scalability vs decentralisation dilemma is dying.
Zooming out, the lean Ethereum vision is gigagas L1 and teragas L2. Gigagas L1 (10K TPS) means high-value payments, trading, and social apps directly on mainnet. Teragas L2 (10M TPS) means welcoming the entirety of finance onto Ethereum.
Nov 22: Ethproofs day demo
Behind the scenes teams are preparing a special Devconnect demo. In 38 days my home validator will run on zkEVM proofs. My mighty Geth node will go dark—no more execution client.
Devconnect Argentina is Ethereum's world fair. World fairs unveiled the lightbulb, running water, cars, refrigeration, phones, escalators. Real-time proving is Ethereum's lightbulb moment.
Ethereum's future is bright. Believe in something :)
jooman ➡️ working on AI inference retweeted
1/ Today marks the beginning of a new chapter for Irreducible. We started as a custom-hardware company, and now we are fully focused on high-performance software.
Read below about our pivot and our new proof system, Binius64 👇
jooman ➡️ working on AI inference retweeted
One thing I like about @RiscZero and @boundlesshq is that they truly care about security.
In May 2024, RISC Zero published a blog article verifying that they can pass "The Rekt Test".
This test is a security questionnaire created in collaboration with various security experts, including members of @immunefi, @trailofbits, @eulerfinance, @FireblocksHQ, and @SolanaFndn. It covers 12 criteria that must be achieved to reach the highest level of security.
In the blog, RISC Zero demonstrated that they meet the standards in all processes except for one item that was not applicable, showing that they are serious about security. afaik, RISC Zero is the only project that has publicly announced compliance with the Rekt Test since its public release.
In addition, RISC Zero has undergone security audits for their zkVM from top-tier audit companies such as @hexens and @VeridiseInc, and while also publicly running bug bounties through @HackenProof.
From HackenProof, I could find the $50K bounty payment for a vulnerability found in their zkVM 👀
Since security vulnerabilities in ZK protocols can destroy the entire protocol, security awareness is extremely important. In this regard, RISC Zero's preparedness is evaluated as very thorough. This is also why I am bullish on Boundless.
jooman ➡️ working on AI inference retweeted
It’s unbelievable to see ethereums sci-fi roadmap of using ZK to scale everything coming true.
Hearing the roadmap in 2018 it seemed insane even as an academic with a long time horizon.
Kudos to the ZK pioneers and the ethereum community!
🤯 real-time proving is here 🤯
Mainnet EVM blocks proven in under 1 Ethereum slot (12s). Goosebumps.
Succinct proves every Ethereum L1 block:
→ 94% in <12s
→ 99% in <13s
→ 99.9% in <12s, soon™
Yesterday RISC Zero unveiled a $120K home GPU cluster—proofs expected in 9.25s. Brevis, OpenVM, Snarkify, ZisK, ZKM are weeks from joining the real-time club.
Soon™ my validator will verify EVM blocks on a Rasberry Pi Pico—a $5 board that consumes <1W. I will ditch my EL client in favour of a zkEL. No 1 TB NVMe. Goodbye Geth, hello zkReth. Stateless and RAMless verification in milliseconds on a single CPU core.
With real-time proving 1 gigagas/sec (10K TPS) is within reach, without compromising validator decentralisation. From now on expect regular gas limit bumps. 10% of stake is already voting for a 60M limit—your validators can too.
Snarkifying mainnet turns Ethereum L1 into the first based and native rollup. Stage 2. Bug-free. Decentralised sequencing. No security council. No governance. The L1 will lead by example.
This Friday we celebrate. Join us for Ethproofs call #2, May 23 at 2pm UTC. 25 speakers, 2 hours of content. Calls are open—DM @corcoranwill for a calendar invite.
We are witnessing history. Believe in something real. Believe in real-time proving.






















