Alek Andreev (@alek) profile picture

many futures are possible.

Joined November 2006
Photo by Alek Andreev (@alek)Photo by Alek Andreev (@alek)Photo by Alek Andreev (@alek)Photo by Alek Andreev (@alek)Photo by Alek Andreev (@alek)Photo by Alek Andreev (@alek)Photo by Alek Andreev (@alek)Photo by Alek Andreev (@alek)Photo by Alek Andreev (@alek)Photo by Alek Andreev (@alek)
Alek Andreev retweeted
Gemma 4 outperforms models over 10x their size! (note the x-axis is log scale!)
142
234
42
2,905
220,616
An exciting milestone for AI in science: Our C2S-Scale 27B foundation model, built with @Yale and based on Gemma, generated a novel hypothesis about cancer cellular behavior, which scientists experimentally validated in living cells.  With more preclinical and clinical tests, this discovery may reveal a promising new pathway for developing therapies to fight cancer.
535
3,117
1,030
21,333
6,881,231
Alek Andreev retweeted
Thanks Jeff Lawson for buying the Onion so we could get this great zoom in on electoral coverage. No other news source has gone to this level of detail.
106
1,841
330
19,256
3,620,599
A great set of models have entered the arena! Sadly Gemma2 9B dropped from one of their tables so I had to add it. Would be even better if all models were evaluated with same codebase as I see fluctuations in numbers.
We just released two small models, with 3B and 8B parameters. Ministral 3B is exceptionally strong, outperforming Llama 3 8B and our previous Mistral 7B on instruction following benchmarks. mistral.ai/news/ministraux/
7
20
1
136
33,519
Gemma 2 just got even better! 🚀 New Japanese-tuned 2B model AND a $150K Kaggle competition to build Gemma models for every language. Great to have @sundarpichai here to share the excitement! Read more: goo.gle/Gemma4Japan #GemmaDeveloperDay
44
69
16
460
141,675
Alek Andreev retweeted
We also collect more votes for Gemma-2-27B (now 5K+) for the past few days. Gemma-2 stays robust against Llama-3-70B, now the new best open model!
3
23
13
132
165,065
Gemma 2 is out and it’s crazy to think we can fit the best open LLM in the world on an old 32GB USB stick. 🧵
Gemma 2 is available to researchers & developers. At 27B it delivers best-in-class performance for its size and is competitive even to models over twice its size! Proud to continue our tradition of thoughtfully bringing cutting-edge research to the open models ecosystem.
2
3
1
25
5,309
Gemma 2B (shipping very soon), will be the most capable on-device model. This is a new space and it's very exciting what app developers can do with local, private LLMs.
1
1
255
The whole Gemma team is irreplaceable, but I want to particularly thank the pretraining team - @pathak__shreya, @moruganribieru , Cassidy Hardin, @Mesnard_Thomas. 🙏 to @armandjoulin, who always knows when to say no.
2
244
Announcing RecurrentGemma, which removes the quadratic compute complexity of transformers!
Releasing RecurrentGemma - one of the strongest 2B-param open models designed for fast inference on long sequences and massive throughput! Both pre-trained and IT checkpoints available + code - try them out here! Code: github.com/google-deepmind/r… Weights: kaggle.com/models/google/rec…
1
6
1,593
I am very happy to announce that Gemma 1.1 Instruct 2B and “7B” are out! Here are a few details about the new models: 1/11
11
65
27
361
324,691
UPDATE: Gemma 1.1 7B & 2B - Instruction Tuned! ✨ > substantial gains in quality, coding capabilities, factuality, and instruction following. > better multi-turn conversation quality. huggingface.co/google/gemma-…
5
57
4
296
104,695
It's a joyful journey working with the brilliant, tight-knit Gemma team! There is a bright future for open models!
Introducing Gemma - a family of lightweight, state-of-the-art open models for their class built from the same research & tech used to create the Gemini models.  Demonstrating strong performance across benchmarks for language understanding and reasoning, Gemma is available worldwide starting today in two sizes (2B and 7B), supports a wide range of tools and systems, and runs on a developer laptop, workstation or @GoogleCloud. Excited to see what you’ll create →  ai.google.dev/gemma blog.google/technology/devel…
1
1
6
11,413
The few people who didn't leave Irpin were mostly those too old and to frail to walk. For them, the last month has been hell. Death, illness and frayed nerves, a few miles from Kyiv. I found it difficult to listen to these stories & keep it together. theguardian.com/world/2022/m…
80
1,432
129
3,005
Alek Andreev retweeted
Russia's brutal siege of Ukraine's port city of Mariupol has left residents without electricity, water, or heat for nearly 3 weeks. “We were so happy when it snowed. We gathered the snow, cleaned the cigarette butts from it, and drank that." foreignpolicy.com/2022/03/18…
1
39
1
77
Alek Andreev retweeted
Odessa opera and ballet theater. Scary times
1
56
2
72