
ml research/engineering • prev @audiogen
latent space
Joined June 2023
- Tweets6.5K
- Following1.2K
- Followers1.7K
- Likes50.6K
I built a custom jax runtime for Flux.2-Klein 4b that cuts text2image generation latency down to 306ms.
full writeup: kelechi.cc/articles/flicker
It is also more cost-effective, with respect to compute pricing and generation time, giving you more generations/images per $
1
23
Two big levers are using a custom flash attention kernel (without the running softmax calculations) and a fused pre-attention qk-prep kernel, plus other fixes in the text encoder pass and Vae decoding.
1
1
81
All development/testing was done on a @GoogleColab v6e-1 chip. Parallel GPU benchmarks were on @modal's rtx pro 6000 (thanks for the free credits😅).
feedback/criticism is highly appreciated,
41
last presentable Jax thing I did was making a checkpointing library for Flax(nnx API) models.
still needs more testing and improvement. I created it cus I wanted to make something simpler than the rest
github.com/kelechi-c/nnx_sav…
11
752
excited to share that I have joined @audiogenai (as a research intern) to build the next generation of audio/music generation models 🚀.
It's been extremely cool working with the team so far 🫡
tensor retweeted
I have EXCITING news:
I've started a company!
Introducing Sophont
We’re building open multimodal foundation models for the future of healthcare. We need a DeepSeek for medical AI, and @SophontAI will be that company!
Check out our website & blog post for more info (link below)
tensor retweeted
companies just wanna make money, so all you need to do is show them how you can help them make money
drop everything you have ever been told about getting a job and start over from that simple statement
Cool.
Now someone should make arxiv reels.
wikitok.vercel.app/
It's 2:00 AM
Who wants infinite scrolling wikipedia!!
tensor retweeted
Training our most capable Gemini models relies heavily on our JAX software stack + Google's TPU hardware platforms.
If you want to learn more, see this awesome book "How to Scale Your Model":
jax-ml.github.io/scaling-boo…
It was put together by my @GoogleDeepMind colleagues
@_sholtodouglas, @charliexychen, @pchoy95, @albertwebson, @vinayramasesh, @froystig, @anselmlevskaya, @sharadvikram, and Fede Lebron, and describing the work of many, many people!
DeepSeek reminds me of Pixart-alpha.
$27k cost for diffusion training compared to Dalle-2(~$2M), SDv1.5($320k), etc, while getting better results.
Chinese engineers 🐐
Link: arxiv.org/abs/2310.00426
Yeah, There's also microdiffusion which achieved close results with $2K! github.com/SonyResearch/micr…
5
129















