teapawtteapawt
Arnav Jaitly
@arnitly

I write about Tech, AI and startups.

London, England
ajaitly.dev
Joined December 2017
  • Tweets4.8K
  • Following590
  • Followers602
  • Likes13.9K
462Media
  • Tweets
  • Tweets & Replies
  • Reposts
  • Articles
  • Media
  • Search
Arnav Jaitly@arnitly13 Jan 2025

Foundations of Transformer Models - Absolute Positional Embeddings

Have you ever felt confident about the big picture of transformer architectures but found yourself scratching your head when it came to the nitty-gritty details? If so, you’re not alone. Whether you…

Article · @arnitly
2
232
Arnav Jaitly@arnitly9 Dec 2024

Willow: Google’s Quantum Leap Toward the Future of Computing

Google just dropped its latest quantum computing chip, Willow, and the tech world is buzzing! But here’s the kicker—it’s not the finish line. It’s just the second step in Google’s ambitious …

Article · @arnitly
1
39
Arnav Jaitly@arnitly6 Dec 2024

What is K/V Context Quantization and why does it matter?

I recently learned that Ollama added K/V context cache quantization to their models. This upgrade is a game-changer. It slashes vRAM usage dramatically, enabling you to expand context sizes or run lar…

Article · @arnitly
2
99
Load more