
Staff RS @GoogleDeepMind, Gemini Omni controllability, co-led Veo3 and Veo3.1 Ingredients-to-Video. Physical and spacial reasoning, agentic video generation.
London, England
Joined October 2015
- Tweets129
- Following581
- Followers1K
- Likes526
Gemini Omni 1.1 Flash is our newest multimodal model for video generation and editing. It delivers a new suite of creative capabilities and controls for developers 🎥
With this update you can:
🎬 Extend your scenes
🎯 Specify starting and ending frames of a shot
➕ Add video input references
✨ Upscale your favorite takes up to 4K
⚡ Test ideas quickly in 360p
See these in action 🧵
Yulia Rubanova retweeted
What if your footage could become anything?
It can. Just use Gemini Omni on the Pika MCP.
One year later with Omni and this test can pass. I saw it getting pretty close, so I tweaked the prompt:
> A video of a man counting to 10 on his fingers, show the number in the corner. A new number every 1s, no dialogue other than the numbers he says. He uses two hands for numbers bigger than 5.
- the model does 1 to 5 consistently well
- struggles more when two hands are used, usually on 7 and 8
- if you ask it to count faster, errors increase
- it keeps a good cadence
🤖 Made with AI
not sure why nobody is talking about this but Google Omni is insane at video editing
Original Video (left) vs Omni Edited Video (right)
everyone is comparing it to Seedance and missing the point completely. Seedance is for generating videos from scratch. Google Omni is for editing videos that already exist. which are two completely different use cases
this is like when Nano Banana 1 first came out and nobody realized how big it was going to be. this is the first AI that can actually properly edit videos..
i've generated a few hundred videos with this model and it can do literally any type of edit you can think of. changing voices, swapping characters, removing watermarks, adding captions, transitions, pop ups, whatever. if you can describe the edit you want it can do it
this completely crushes every other model on the market when it comes to video editing. nothing else even comes close right now
and this is just the flash model. imagine what the pro version is going to be able to do when it drops in a couple months
this should have way more hype than it's getting..
Yulia Rubanova retweeted
The likeness preservation and natural realism coming out of Gemini #Omni Flash is absolutely unreal 🤯
Huge shoutout to the insanely talented team for pushing these boundaries. The team absolutely cooked. 👨🍳🔥
If Flash is this good... imagine what Pro is about to unleash. 👀✨
🤖 Made with AI
Yulia Rubanova retweeted
We sat down with @OfficialLoganK @nbrichtova @doomie @gbarthmaron to talk about Gemini Omni Flash. It was pretty wild.
Yulia Rubanova retweeted
Super excited to see Gemini Omni finally out in the world! Having been part of this project since its inception, I've seen how its native multimodal capabilities can redefine what's possible. We're truly entering the "Nano Banana era" for video generation. Give it a try!
Yulia Rubanova retweeted
So excited to finally talk about this work!
Veo is a surprisingly strong world simulator. We fine-tuned Veo on action-conditioned, multi-view robotics data.
Key result: running a policy in the world model is strongly correlated with real-world results.
A few important take-aways:
1) Veo Robotics models real-world physics and robot interactions
2) The base model's world knowledge is retained after fine-tuning and can model OOD scenarios not seen in the robotics data
3) The world model can be used to score task success or failure for a given policy
4) This proves useful for predictive red teaming: simulate dangerous or rare scenarios that would be difficult or irresponsible to execute on the real robot, and judge its performance
I couldn't be more excited about where generalist video models are headed.
Generalist robots need a generalist evaluator. But how do you test safety without breaking things? 💥
🌎 Introducing our new work from @GoogleDeepMind:
Evaluating Gemini Robotics Policies in a Veo World Simulator
veo-robotics.github.io
🧵👇
Yulia Rubanova retweeted
Our second Nano Banana in three months 🚢 🚢. Super proud of the team!!
Looking forward to seeing what you'll create with it. Any feedback welcome!
Yulia Rubanova retweeted
Here is @GoogleDeepMind's Sima agent following different instructions inside a world generated by Genie 3.
Yulia Rubanova retweeted
Even though my team built this capability, it’s still absolutely mind-blowing to me that this works: you can literally put anything (consistent characters, objects, scenes, …) into the worlds you generate with Veo.
Yulia Rubanova retweeted
Greenfield (@GDMGreenfield), our in-house creative team, is now on X! Follow them to learn about the latest tips and tricks for Veo 3 and our other generative models.
Greenfield prompt tip of the day:
Add excitement to your shots with Veo 3 camera controls! You can use multiple camera controls within a single prompt by stringing together a sequence of camera movements. For example, you can try combining effects over time: "The camera position is stationary," "Move the camera backward," "Move the camera down," "Move the camera to the right." Experiment to create dynamic scenes!
Yulia Rubanova retweeted
TLDR:
Given 1-3 reference images and a text prompt, you can use Veo to compose them in a video.
Here's me in a few weeks from now in Greece:
Yulia Rubanova retweeted
Can’t wait for everyone to give this a try. 🔥This has been long in the making by a fantastic team.
Bringing multiple characters, objects, scenes or literally anything you want into your generations with Veo’s stunning visual quality is a big unlock for visual storytelling, filmmaking, and world building.
Now in Flow: labs.google/flow/about
Replying to @SebJefferies
Reference-powered video
You can now give Veo images of a scene, outfit, or object, and it will generate a full video aligned with your creative direction.
You give the look,Veo gives you motion. 👇
Yulia Rubanova retweeted
Video, meet audio. 🎥🤝🔊
With Veo 3, our new state-of-the-art generative video model, you can add soundtracks to clips you make.
Create talking characters, include sound effects, and more while developing videos in a range of cinematic styles. 🧵
Yulia Rubanova retweeted
Get into the zone with Flow. 🎬
It combines the best of our most advanced models Veo, Imagen and Gemini into 1️⃣ master filmmaking tool - helping you weave cinematic clips, dynamic scenes, and compelling narratives into stories with consistent results.
Yulia Rubanova retweeted
Brush🖌️ is now a competitive 3D Gaussian Splatting engine for real-world data and supports dynamic scenes too! Check out the release notes here:
github.com/ArthurBrussee/bru…

























