
Founder | Physical AI Previously PhD @IMPRS & Uni Tübingen | Intern @wayve_ai @Oxford_VGG
Joined June 2021
- Tweets90
- Following295
- Followers649
- Likes152
Katrin Renz retweeted
The most important AI research center in Europe isn’t in London, Paris, or Berlin. It’s in a university town of 90,000 people you’ve probably never heard of.
Tübingen, in southwestern Germany, is home to Cyber Valley - an AI consortium set up in 2016 with €165M from the state of Baden-Württemberg, the Max Planck Society, and partners including Bosch, Mercedes-Benz, and Amazon. The region publishes more machine learning and computer vision research to top conferences than anywhere else in Europe. Aleph Alpha came out of here.
With @FastCodeAI Labs now registered in Baden-Württemberg, we’re applying to join the Cyber Valley Startup Network.
Thanks to Paul-David at Cyber Valley for the time.
Why did the elephant cross the road? To expose how fragile your model is.
There's a relatively quiet but serious problem in autonomous driving research: most models are trained and evaluated on the same scenarios.
Analyzing seven state-of-the-art models, we find that success rates drop by 22.8% on average, highlighting fundamental robustness concerns in current approaches. The benchmark is fully open, and includes a toolbox for researchers to define their own generalization tests.
1
117
20,187
Work done with Simon Gerstenecker and Andreas Geiger.
We have fully open-sourced the benchmark alongside our custom toolbox.
🔗 Code, Data & Toolbox: lnkd.in/dz3UZ8VG
📄 Read the Paper: lnkd.in/dnnkHvK2
49
18,677
🚗🌱 𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗣𝗹𝗮𝗻𝗧 𝟮.𝟬: 𝗮𝗻 𝗼𝗯𝗷𝗲𝗰𝘁-𝗰𝗲𝗻𝘁𝗿𝗶𝗰 𝗽𝗹𝗮𝗻𝗻𝗶𝗻𝗴 𝘁𝗿𝗮𝗻𝘀𝗳𝗼𝗿𝗺𝗲𝗿
We’re excited to share PlanT 2.0, a SOTA planner for CARLA Leaderboard 2.0.
Paper: arxiv.org/abs/2511.07292
Code: github.com/autonomousvision/…
🛠️ 𝗞𝗲𝘆 𝗶𝗺𝗽𝗿𝗼𝘃𝗲𝗺𝗲𝗻𝘁𝘀
• Extended object classes to capture CARLA Leaderboard 2.0 complexity
• Disentangled waypoint representation for lateral and longitudinal control
• Updated dataset and modified expert to tackle newly introduced scenarios
1
1
257
Katrin Renz retweeted
Thanks for highlighting our work!
MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Models
"We propose a novel Masked Diffusion Policy Optimization (MDPO) to exploit the Markov property diffusion possesses and explicitly train the model under the same progressive refining schedule used at inference. MDPO matches the performance of the previous state-of-the-art (SOTA) method with 60x fewer gradient updates, while achieving average improvements of 9.6% on MATH500 and 54.2% on Countdown over SOTA when trained within the same number of weight updates. Additionally, we improve the remasking strategy of MDLMs as a plug-in inference replacement to overcome the limitation that the model cannot refine tokens flexibly. This simple yet effective training-free strategy, what we refer to as RCR, consistently improves performance and yields additional gains when combined with MDPO"
Katrin Renz retweeted
MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Models
"We propose a novel Masked Diffusion Policy Optimization (MDPO) to exploit the Markov property diffusion possesses and explicitly train the model under the same progressive refining schedule used at inference. MDPO matches the performance of the previous state-of-the-art (SOTA) method with 60x fewer gradient updates, while achieving average improvements of 9.6% on MATH500 and 54.2% on Countdown over SOTA when trained within the same number of weight updates. Additionally, we improve the remasking strategy of MDLMs as a plug-in inference replacement to overcome the limitation that the model cannot refine tokens flexibly. This simple yet effective training-free strategy, what we refer to as RCR, consistently improves performance and yields additional gains when combined with MDPO"
Katrin Renz retweeted
One concern that I have as an AI researcher when publishing code is that it can potentially be used in dual-use applications.
To solve this, we propose Civil Software Licenses. They prevent dual-use while being minimal in the restrictions they impose:
civil-software-licenses.gith…
Katrin Renz retweeted
We have released the code for our work, CaRL: Learning Scalable Planning Policies with Simple Rewards.
The repository contains the first public code base for training RL agents with the CARLA leaderboard 2.0 and nuPlan.
github.com/autonomousvision/…
Katrin Renz retweeted
We now know RL agents can zero-shot crush driving benchmarks. Can we put them on a car and replace the planning stack? We're hiring a postdoc at NYU to find out!
Email me if interested and please help us get the word out.
Katrin Renz retweeted
#CVPR2025 Paper Picks #3
🚗 SimLingo: Vision-Language-Action for autonomous driving by @KatrinRenz et al. @wayve_ai
Autonomous driving meets language grounding.
SimLingo drives and understands — using only cameras.
No LiDAR. No diffusion. Just vision, language, and action.
📢Excited to present our poster "SimLingo" tomorrow at #CVPR2025. Drop by to talk about vision-language-action models, language-action grounding, or anything else :)
📍Saturday, 10:30 - 12:30 Poster #130
Joint work with Long Chen @ElaheArani @SinavskiOleg @wayve_ai
Katrin Renz retweeted
Only a few days to go until #CVPR2025 kicks off 🤩
This year, we’re excited to share our research paper #SIMLINGO — a foundation model that brings together vision, language, and action to power more generalizable, interpretable embodied agents. 🚗🗣️👀
Come find us at booth 1429 to see it in action and chat with the team!
In the meantime, check out the paper and demo here arxiv.org/abs/2503.09594
Katrin Renz retweeted
1 year since we launched LINGO-2 @wayve_ai 🧠
With LINGO-2, our AI is trained to both make decisions *and* communicate them. The first closed-loop vision-language-action driving model (VLAM) tested on public roads, LINGO-2 has been game-changing for exploring the connection between language and driving.
Want to catch the latest with LINGO? We'll be presenting our new research paper SIMLINGO at #CVPR2025 arxiv.org/html/2503.09594v1
LINGO-2 blog 👉 wayve.ai/thinking/lingo-2-dr…
#LINGO2 #EmbodiedAI #Simulation
Katrin Renz retweeted
Just happened to know that DriveLM ranked #9 on the Most Influential ECCV Papers (2024-09 Version). Thorough benchmarking on driving with VLM gains it popularity! paperdigest.org/2024/09/most…

















