The Kim Jaechul Graduate School of AI at KAIST
Seoul, Republic of Korea
Joined March 2022
- Tweets207
- Following263
- Followers2.7K
- Likes197
Pinned Tweet
๐ NVIDIA ร KAIST Joint AI Research Lab is here!
๐ $300M for Sovereign Agentic Future
Announced by @JensenHuang himself in SF! The new lab at the Kim Jaechul Graduate School of AI brings top KAIST talent + @nvidia's full-stack tech + massive compute๐ฅ
nvidianews.nvidia.com/news/nโฆ
KAIST AI retweeted
๐ค What if robots could reason not just in words, but through the dynamics of the physical world?
๐ Introducing ๐ง๐ต๐ถ๐ป๐ธ๐ช๐ผ๐ฟ๐น๐ฑ from @NVIDIAAI !
๐ก By reasoning through shared physical dynamics, robots could learn from human experience and transfer motion intelligence across embodiments.
๐๐ผ๐ ๐ถ๐ ๐๐ผ๐ฟ๐ธ๐
โ ๐๐ต๐ฎ๐ถ๐ป-๐ผ๐ณ-๐๐๐ป๐ฎ๐บ๐ถ๐ฐ๐ (๐๐ผ๐): A shared motion reasoning space across human and robot embodiments.
โ ๐ช๐ผ๐ฟ๐น๐ฑ ๐๐บ๐ฎ๐ด๐ถ๐ป๐ฎ๐๐ถ๐ผ๐ป: Imagines future world representations conditioned on CoD.
โ ๐ฅ๐ ๐ณ๐ฟ๐ผ๐บ ๐ช๐ผ๐ฟ๐น๐ฑ ๐๐บ๐ฎ๐ด๐ถ๐ป๐ฎ๐๐ถ๐ผ๐ป: Reinforces reasoning through alignment between imagined and observed futures, enabling learning from human and robot videos.
๐ช๐ต๐ฎ๐ ๐ถ๐ ๐ฒ๐ป๐ฎ๐ฏ๐น๐ฒ๐
โ Robust real-world manipulation under unseen objects and environments.
โ Human-guided skill composition for novel multi-step robot tasks.
โ Robust generalization under task and environment shifts in simulation.
๐ ๐ข๐๐ฟ ๐๐ถ๐๐ถ๐ผ๐ป: Scale generalizable motion intelligence through human videos toward a unified System-1 reasoning layer for Physical AI.
Paper, robot demos & more below! ๐
KAIST AI retweeted
๐จ New paper alert!
Despite recent advances in reward fine-tuning for diffusion and flow models, achieving high rewards remains challenging without sacrificing sample diversity or substantially drifting away from the pretrained distribution.
We address this with DFR: Distributional Functional Rewards, a framework that balances reward optimization with preserving desirable properties of the generated distribution! ๐งต
KAIST AI retweeted
[QUESTION] Given a text, can we identify which AI model wrote it? This question is becoming increasingly important due to model distillation and misuse (e.g., Anthropic's www-cdn.anthropic.com/e50be2โฆ).
[ANSWER] Our work (komseok0109.github.io/ATLAS/) @KAIST_AI shows that we can identify the source LLM family across different writing domains and model versions, and detect traces of teacher models after distillation.
๐ Project page: huggingface.co/spaces/ming99โฆ
๐ค Demo: huggingface.co/spaces/ming99โฆ
๐ LinkedIn: lnkd.in/p/gCaC4_iw
๐ arXiv: arxiv.org/abs/2610.19583
KAIST AI retweeted
๐ฌ Can AI discover unknown scientific knowledge by itself?
Excited to introduce Principia: Test-Time Hypotheses-to-Principle Construction for Scientific Discovery.
Principia uses LLMs to turn experimental observations into scientific principles at test time:
๐ From observations to hypotheses
Compare related inputs and their outcomes to propose explanations for how specific characteristics contribute to the observed results.
๐ง From hypotheses to principles
Generalize recurring relationships across hypotheses into broader principles that guide subsequent predictions and candidate generation.
๐ Refine knowledge with new observations
Use new observations to revisit earlier hypotheses and reconstruct the principles built on them.
Huge thanks to my co-authors at @KAIST_AI: @SangwooPark0306, @jinheonbaek, @SoyeongJeong97, and @SungJuHwang1
๐ Paper: arxiv.org/abs/2610.32195
#AIforScience #ScientificDiscovery #LLM #TestTimeLearning #KnowledgeConstruction
KAIST AI retweeted
๐ Pivot-SD is an ORAL at #EMNLP2026!
We post-train a diffusion LM with a loss on just 10 tokens per response, and it beats both SFT and diffusion RL on math & code.
The trick isn't training on fewer tokens. It's training on the right ones.
EMNLP is right around the corner!
Meet our students who are excited to connect and meet new people at the conference! Take a look and say hello! ๐
kaist-gsai.github.io/emnlp20โฆ
KAIST AI retweeted
๐ค Improving robot foundation models with real-world RL, then continually carrying that experience forward across tasks.
Introducing ๐๐๐๐ฅ๐จ๐: ๐ฐ๐ผ๐ป๐๐ถ๐ป๐๐ฎ๐น ๐ผ๐ณ๐ณ-๐ฝ๐ผ๐น๐ถ๐ฐ๐ ๐ฅ๐ for robot foundation models.
Our real-world policies learn through physical robot interaction, starting from a small set of demos.
We inherit the actorโcritic across tasks and distill earlier behavior, so experience accumulates while prior skills remain.
๐ป ๐๐ผ๐ ๐ฎ๐ฑ๐ฑ๐ถ๐๐ถ๐ผ๐ป๐ฎ๐น ๐๐ฃ๐จ ๐๐ฟ๐ฎ๐ถ๐ป๐ถ๐ป๐ด ๐ผ๐๐ฒ๐ฟ๐ต๐ฒ๐ฎ๐ฑ: RL updates a compact actorโcritic while the foundation model stays frozen.
โก Subsequent tasks reach 95% success in about ๐ฐโ๐ญ๐ฎ ๐บ๐ถ๐ป๐๐๐ฒ๐ ๐ผ๐ณ ๐ฟ๐ผ๐ฏ๐ผ๐ ๐ถ๐ป๐๐ฒ๐ฟ๐ฎ๐ฐ๐๐ถ๐ผ๐ป.
On real robots:
๐ Up to 68.5% less robot interaction vs. single-task RL
๐ฏ 98.3% final prior-task success
๐ฌ A 60-second overview below.
๐ accrue-rl.github.io/
๐งต 1/6
KAIST AI retweeted
Do language models always need to see the full 1M-token context window? What if they can just tell us which tokens they actually need?
We're excited to share Declarative Attention (DA), a sparse attention protocol that lets a model declare which context they need for each reasoning step, in plain text. The inference engine can use this to mask out up to 99% of KV cache reads for global attention.
Across 15 long-context tasks, DA reduces global attention KV reads by 46% with only 1.4pp accuracy drop on Gemma-4 31B and 20% with 2.1pp on Qwen-3.6 27B. This accuracy gap shrinks as we scale up the model size. Zero-shot.
We discuss further potential in agentic settings with dedicated post-training, and model-controlled KV cache offloading as a path toward reversible context compaction.
We explain details and link our paper below.
KAIST AI retweeted
Can explicitly learning future point motion improve the model that generates those future images?
We introduce VPM (Video-Point Model), a 4D world model that jointly forecasts future multi-view videos + persistent 3D point trajectories.
Short answer: yes. Teaching a video world model to forecast 3D point tracks makes its videos more faithful & 3D-consistent, and makes robots better.
๐ Project: rootyjeon.github.io/video-poโฆ
๐งต [1/6]
Can AI agents learn from their own failures? ๐ค
Excited to host Prof. @XiaoxiaoLi8 (@UBC, @VectorInst, @YaleMed) for an invited talk on how agents can diagnose failures, adapt, and recursively improve themselves, drawing lessons from vision and medical AI!
๐ค Made with AI
KAIST AI retweeted
๐ Agents are now taking over some of our knowledge work! But, after working through a stack of files over dozens of turns, something they saw slips out of what they deliver.
Excited to introduce RunningTab๐งพ, where the environment keeps a running tab of what the agent has read and what the task still owes, until the work is handed in.
From writing reports and checking budgets to pulling figures from a century of government records, it consistently outperforms the same agent without the tab and baselines that track the task in the model itself.
Paper: huggingface.co/papers/2610.1โฆ
KAIST AI retweeted
Introducing SQAM, Q-Learning with Scalar Adjoint Matching! ๐ Off-policy RL for flow policies, without a single VJP through the policy. Bigger gains on the hardest tasks, at a lower cost per update. ๐งต [1/8]
KAIST AI retweeted
Full-duplex dialogue models listen and speak at the same time, yet are still evaluated against a partner that cannot react.
โจ Meet DyaFDB: two full-duplex models converse directly, and we score both.
๐ Paper: arxiv.org/abs/2610.08125
๐ Page: dyafdb.github.io/
1/ ๐งต
KAIST AI retweeted
Speech+RL paper from @Qualcomm AI Research and @KAIST_AI !
For more natural conversational AI, we usually use full-duplex speech language models, which can perform smooth turn-taking and also produce uh-huh-like backchannels.
However, there is no clear answer to when a model should barge in. So in this field, we explore reinforcement learning rather than relying solely on supervised fine-tuning. But due to the nature of full-duplex SLMs, their token distribution is totally different from that of normal language models. So our idea is to build a reinforcement learning method for full-duplex speech language models. Our method, HiPLEX (Hierarchical policy factorization for full-duPLEX SLMs), factorizes the policy into when to talk and what to talk. Plus, our credit assignment method causally attributes rewards to the correct or incorrect timing and semantic decisions. (See Figure 1 featuring the cute San character!)
arxiv: arxiv.org/abs/2610.07727
huggingface paper: huggingface.co/papers/2610.0โฆ
Huge thanks to my Qualcomm speech team.
KAIST AI retweeted
Speech+Agent paper from @Qualcomm and @KAIST_AI
When we handle a cascaded speech agent system (ASR+LLM+TTS) for any reason, the LLM can call tools, but latency is a problem. We researched how we can hide the tool-calling latency and found that we can hide it within ASR time.
We tested it on the Samsung Galaxy S26 Ultra and confirmed that we can reduce latency and also (which we didnโt anticipate) improve performance!
Check out our paper!
arxiv: arxiv.org/abs/2610.07641
๐ค : huggingface.co/papers/2610.0โฆ
LinkedIn: lnkd.in/p/gSvihjfE
KAIST AI retweeted
Must-read papers of the week
Top:
โช๏ธ Context Language Models by @Meta
โช๏ธ Invent a Dataset by @adaption_ai
โช๏ธ World Observer by @KAIST_AI
โช๏ธ The Planning Limits of Latent World Models by @uommedia
โช๏ธ JEPA-TTT by @hri_usa and @JohnsHopkins
โช๏ธ False Frontiers by @RutgersU and co
Worth checking:
โช๏ธ EVO-WAM
โช๏ธ InterEvolve
โช๏ธ OneStreamer
โช๏ธ LoopVL: Recurrent Visual Intelligence
โช๏ธ WorldPlay2
โช๏ธ Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief States
โช๏ธ LLMs are General Asynchronous Agents
โช๏ธ ActiveSaddler
โช๏ธ EVOKE
โช๏ธ GraphForge
Here is the full list of the most interesting papers + links and our weekly AI news digest:
turingpost.com/p/reflection-โฆ
KAIST AI retweeted
World models have one eye: the camera.
They can evolve what they see, but the rest of the world quickly goes unobserved.
So what if we gave them more eyes, like LoL wards or StarCraft Observers, and let them move around the world?
We introduce World Observer!
TL;DR: Keep the off-screen world evolving. Joint actor-observer generation with freely placed and movable panoramic observers.
Proj page: cvlab-kaist.github.io/world-โฆ
@KAIST_AI @hyunwookee
KAIST AI retweeted
Your emails, chats, docs, and tickets keep piling up, and the right ones get harder to find. ๐ก
๐บ๏ธ Introducing CorpusMap, which organizes a growing corpus around recurring entities, so agents follow connections instead of searching from scratch.
๐ Better answers, fewer tokens.