KAIST AI retweeted
We'll be presenting MoSS at #CoRL2026.
TL;DR: a modular sensory stream framework that lets VLAs jointly use multiple physical signals (tactile, torque, force) for contact-rich manipulation. Video: GR00T N1.5 vs. GR00T N1.5 + MoSS.
๐ Poster Session 1, Poster #33
๐๏ธ Mon 11/9, tt, Lone Star (3F)
๐ arxiv.org/abs/2604.23272
๐ jiminlx.github.io/MoSS
w/ @huiwon0516 @myungkyukoo @jungwoopark01 @JinwooShin0417 @KAIST_AI @RLWRLD
TL;DR: a modular sensory stream framework that lets VLAs jointly use multiple physical signals (tactile, torque, force) for contact-rich manipulation. Video: GR00T N1.5 vs. GR00T N1.5 + MoSS.
๐ Poster Session 1, Poster #33
๐๏ธ Mon 11/9, tt, Lone Star (3F)
๐ arxiv.org/abs/2604.23272
๐ jiminlx.github.io/MoSS
w/ @huiwon0516 @myungkyukoo @jungwoopark01 @JinwooShin0417 @KAIST_AI @RLWRLD
0
3
22
1,203
KAIST AI retweeted
We fine-tuned a model to explain science in the voice of a friendly rubber duck. Then it started telling users to end their real-life friendships.
What happened?
We investigate relationships between behaviors in which fine-tuning on one brings out another.
๐ป Paper & Code: httpIAlignment #AIPersona
@KAIST_AI @IBMResearch
What happened?
We investigate relationships between behaviors in which fine-tuning on one brings out another.
๐ป Paper & Code: httpIAlignment #AIPersona
@KAIST_AI @IBMResearch
1
14
59
14,554
KAIST AI retweeted
Can we scale up imagination-free WAMs (e.g., Fast-WAM)?
Introducing ๐๐ฟ๐ฒ๐ฎ๐บ๐๐ฟ๐ฒ๐ฒ, an imagination-free WAM that improves with stronger video models and more video data, running at 11 Hz with a 14B video backbone.
harryjo97.github.io/dreamfree/
๐งต[1/13]
Introducing ๐๐ฟ๐ฒ๐ฎ๐บ๐๐ฟ๐ฒ๐ฒ, an imagination-free WAM that improves with stronger video models and more video data, running at 11 Hz with a 14B video backbone.
harryjo97.github.io/dreamfree/
๐งต[1/13]
3
41
181
11,899
KAIST AI retweeted
Robots have learned from robot demos. But can they learn new tasks from human experience alone?
๐ค CoRL 2026 Scaling H2R Workshop - Oral Presentation
Introducing H2RB: Human-to-Robot Bridge. We bridge perception and action gaps to transfer new skills and scale human experience s. ๐งต
๐ Paper: arxiv.org/abs/2611.04391
๐ Project: junhyeong-park.me/h2rb/
๐ค HF Paper: huggingface.co/papers/2611.04โฆ
๐ฅ๏ธ Code: github.com/jun-brro/h2rb-โฆ
๐ค CoRL 2026 Scaling H2R Workshop - Oral Presentation
Introducing H2RB: Human-to-Robot Bridge. We bridge perception and action gaps to transfer new skills and scale human experience s. ๐งต
๐ Paper: arxiv.org/abs/2611.04391
๐ Project: junhyeong-park.me/h2rb/
๐ค HF Paper: huggingface.co/papers/2611.04โฆ
๐ฅ๏ธ Code: github.com/jun-brro/h2rb-โฆ
5
11
36
1,693
KAIST AI retweeted
๐ฅ What if video diffusion models could learn a universal language of actions across humans and robots?
๐ Introducing ๐๐ฟ๐ฒ๐ฎ๐บ๐ซ: Video Diffusion Model Is a Universal Latent Action Learner!
DreamX extracts compact, transferable latent actions directly from pretrained video ating motion from visual appearance.
๐๐ผ๐ ๐ถ๐ ๐๐ผ๐ฟ๐ธ๐
โ ๐ฉ๐ถ๐ฑ๐ฒ๐ผ ๐ฑ๐ถ๐ณ๐ณ๐๐๐ถ๐ผ๐ป ๐ฝ๐ฟ๐ถ๐ผ๐ฟ๐: Built on Cosmos-Predict2.5, DreamX extracts action-relevant dynamics directly from pretrained spatiotemporal features.
โ ๐ ๐ผ๐๐ถ๐ผ๐ป ๐ฑ๐ถ๐๐ฒ๐ป๐๐ฎ๐ป๐ด๐น๐ฒ๐บ๐ฒ๐ป๐: Uses generative priors and future-video reconstruction to separate motion from appearance.
โ ๐๐ผ๐บ๐ฝ๐ฎ๐ฐ๐ ๐น๐ฎ๐๐ฒ๐ป๐ ๐ฝ๐ผ๐น๐ถ๐ฐ๐: Predicts compact latent action codes instead of future videos for efficient robot control.
๐ช๐ต๐ฎ๐ ๐ถ๐ ๐ฒ๐ป๐ฎ๐ฏ๐น๐ฒ๐
โ Any-to-any video transfer across scenes and embodiments.
โ Zero-shot human-to-robot video and executable action transfer without paired humanโrobot training data.
โ High-quality latent action representations, achieving state-of-the-art performance on LARYBench.
Paper, videos & demos below! ๐
๐ Introducing ๐๐ฟ๐ฒ๐ฎ๐บ๐ซ: Video Diffusion Model Is a Universal Latent Action Learner!
DreamX extracts compact, transferable latent actions directly from pretrained video ating motion from visual appearance.
๐๐ผ๐ ๐ถ๐ ๐๐ผ๐ฟ๐ธ๐
โ ๐ฉ๐ถ๐ฑ๐ฒ๐ผ ๐ฑ๐ถ๐ณ๐ณ๐๐๐ถ๐ผ๐ป ๐ฝ๐ฟ๐ถ๐ผ๐ฟ๐: Built on Cosmos-Predict2.5, DreamX extracts action-relevant dynamics directly from pretrained spatiotemporal features.
โ ๐ ๐ผ๐๐ถ๐ผ๐ป ๐ฑ๐ถ๐๐ฒ๐ป๐๐ฎ๐ป๐ด๐น๐ฒ๐บ๐ฒ๐ป๐: Uses generative priors and future-video reconstruction to separate motion from appearance.
โ ๐๐ผ๐บ๐ฝ๐ฎ๐ฐ๐ ๐น๐ฎ๐๐ฒ๐ป๐ ๐ฝ๐ผ๐น๐ถ๐ฐ๐: Predicts compact latent action codes instead of future videos for efficient robot control.
๐ช๐ต๐ฎ๐ ๐ถ๐ ๐ฒ๐ป๐ฎ๐ฏ๐น๐ฒ๐
โ Any-to-any video transfer across scenes and embodiments.
โ Zero-shot human-to-robot video and executable action transfer without paired humanโrobot training data.
โ High-quality latent action representations, achieving state-of-the-art performance on LARYBench.
Paper, videos & demos below! ๐
3
15
82
5,189
KAIST AI retweeted
Our new preprint, โLost in Recovery: Demystifying Recovery Behavior of Computer-Use Agents via Goal-Oriented Action Replay,โ is now available!
๐งญ We introduce ReTrace, a framework for studying how computer-use agents recover from mistakes. We evaluate agents on OSWorld and WindowsAgentArena through three research questions:
๐ก RQ1: Can recovery unlock latent task-solving ability?
Under ideal recovery, returning to an appropriate prior state outperforms restarting from scratch under the same retry budget, especially with few retries.
๐ RQ2: Do agents already have recovery capabilities?
Agents rarely recover spontaneously. Explicit recovery instructions reveal substantial latent ability, especially in generalist models. Strong task performance does not necessarily imply strong recovery.
๐ RQ3: Does recovery improve task completion?
On OSWorld, Qwen3.5-9Bโs task success improves from 39.38% to 44.26% (+4.88 percentage points) with history up to the recovery target. Inaccurate recovery can also reduce success.
ReTrace formalizes Transition-Consistent Recovery: identical downstream actions should yield identical outcomes from the recovered and target states. We evaluate recovery through goal-oriented action replay and visual consistency checks. Our findings highlight accurate recovery as a core capability for reliable computer-use agents.
Huge thanks to my co-authors and my advisor at @KAIST_AI : @SangwooPark0306 , @jinheonbaek , @kangsan_kim_ , @youngwan_Lee , @SungJuHwang1 for their support!
๐ค Hugging Face: huggingface.co/papers/2610.27โฆ
๐ Paper: arxiv.org/abs/2610.27954
๐ป GitHub: github.com/BangProx/ReTRAโฆ
๐งญ We introduce ReTrace, a framework for studying how computer-use agents recover from mistakes. We evaluate agents on OSWorld and WindowsAgentArena through three research questions:
๐ก RQ1: Can recovery unlock latent task-solving ability?
Under ideal recovery, returning to an appropriate prior state outperforms restarting from scratch under the same retry budget, especially with few retries.
๐ RQ2: Do agents already have recovery capabilities?
Agents rarely recover spontaneously. Explicit recovery instructions reveal substantial latent ability, especially in generalist models. Strong task performance does not necessarily imply strong recovery.
๐ RQ3: Does recovery improve task completion?
On OSWorld, Qwen3.5-9Bโs task success improves from 39.38% to 44.26% (+4.88 percentage points) with history up to the recovery target. Inaccurate recovery can also reduce success.
ReTrace formalizes Transition-Consistent Recovery: identical downstream actions should yield identical outcomes from the recovered and target states. We evaluate recovery through goal-oriented action replay and visual consistency checks. Our findings highlight accurate recovery as a core capability for reliable computer-use agents.
Huge thanks to my co-authors and my advisor at @KAIST_AI : @SangwooPark0306 , @jinheonbaek , @kangsan_kim_ , @youngwan_Lee , @SungJuHwang1 for their support!
๐ค Hugging Face: huggingface.co/papers/2610.27โฆ
๐ Paper: arxiv.org/abs/2610.27954
๐ป GitHub: github.com/BangProx/ReTRAโฆ
1
7
17
455
KAIST AI retweeted
LLMs get better the longer they think. Unified multimodal models don't. Why?
๐ rootyjeon.github.io/larc-umm/
๐ NeurIPS 2026
Introducing LARC: Latent Reasoning in Continuous Space. Reasoning moves into the model's hidden states, so image generation finally scales at test time. ๐งต
๐ rootyjeon.github.io/larc-umm/
๐ NeurIPS 2026
Introducing LARC: Latent Reasoning in Continuous Space. Reasoning moves into the model's hidden states, so image generation finally scales at test time. ๐งต
3
27
142
22,967
KAIST AI retweeted
ThinkWorld
World Imagination Reinforces Chain-of-Dynamics Reasoning
paper: huggingface.co/papers/2610.37โฆ
World Imagination Reinforces Chain-of-Dynamics Reasoning
paper: huggingface.co/papers/2610.37โฆ
7
18
123
18,974
KAIST AI retweeted
Introducing OmniShowcase: subject-to-video that shows every side of the subject from 4 images, even 360ยฐ orbits.
~2x lower geometric error than the best multi-view baseline on ShowcaseBench & real-world NAVI.
Project page: justin4ai.github.io/OmniShowcase/
Paper: arxiv.org/abs/2610.35684
~2x lower geometric error than the best multi-view baseline on ShowcaseBench & real-world NAVI.
Project page: justin4ai.github.io/OmniShowcase/
Paper: arxiv.org/abs/2610.35684
1
2
9
335
#2 in the world! ๐๐ฅ
Huge shoutout to our amazing students, researchers, and our entire KAIST family! Let's keep pushing! ๐
Huge shoutout to our amazing students, researchers, and our entire KAIST family! Let's keep pushing! ๐
Tsinghua leads more NeurIPS 2026 papers than any institution. KAIST is #2, ahead of MIT and Stanford.
8 of the top 10 are in Asia. Europe's best: Oxford, #14.
My agents were idle last evening, so they ranked all 9,130 papers. The top 50 ๐
1
14
94
3,519
KAIST AI retweeted
๐ค What if robots could reason not just in words, but through the dynamics of the physical world?
๐ Introducing ๐ง๐ต๐ถ๐ป๐ธ๐ช๐ผ๐ฟ๐น๐ฑ from @NVIDIAAI !
๐ก By reasoning through shared physical dynamics, robots could learn from human experience and transfer motion intelligence ๐ ๐ถ๐ ๐๐ผ๐ฟ๐ธ๐
โ ๐๐ต๐ฎ๐ถ๐ป-๐ผ๐ณ-๐๐๐ป๐ฎ๐บ๐ถ๐ฐ๐ (๐๐ผ๐): A shared motion reasoning space across human and robot embodiments.
โ ๐ช๐ผ๐ฟ๐น๐ฑ ๐๐บ๐ฎ๐ด๐ถ๐ป๐ฎ๐๐ถ๐ผ๐ป: Imagines future world representations conditioned on CoD.
โ ๐ฅ๐ ๐ณ๐ฟ๐ผ๐บ ๐ช๐ผ๐ฟ๐น๐ฑ ๐๐บ๐ฎ๐ด๐ถ๐ป๐ฎ๐๐ถ๐ผ๐ป: Reinforces reasoning through alignment between imagined and observed futures, enabling learning from human and robot videos.
๐ช๐ต๐ฎ๐ ๐ถ๐ ๐ฒ๐ป๐ฎ๐ฏ๐น๐ฒ๐
โ Robust real-world manipulation under unseen objects and environments.
โ Human-guided skill composition for novel multi-step robot tasks.
โ Robust generalization under task and environment shifts in simulation.
๐ ๐ข๐๐ฟ ๐๐ถ๐๐ถ๐ผ๐ป: Scale generalizable motion intelligence through human videos toward a unified System-1 reasoning layer for Physical AI.
Paper, robot demos & more below! ๐
๐ Introducing ๐ง๐ต๐ถ๐ป๐ธ๐ช๐ผ๐ฟ๐น๐ฑ from @NVIDIAAI !
๐ก By reasoning through shared physical dynamics, robots could learn from human experience and transfer motion intelligence ๐ ๐ถ๐ ๐๐ผ๐ฟ๐ธ๐
โ ๐๐ต๐ฎ๐ถ๐ป-๐ผ๐ณ-๐๐๐ป๐ฎ๐บ๐ถ๐ฐ๐ (๐๐ผ๐): A shared motion reasoning space across human and robot embodiments.
โ ๐ช๐ผ๐ฟ๐น๐ฑ ๐๐บ๐ฎ๐ด๐ถ๐ป๐ฎ๐๐ถ๐ผ๐ป: Imagines future world representations conditioned on CoD.
โ ๐ฅ๐ ๐ณ๐ฟ๐ผ๐บ ๐ช๐ผ๐ฟ๐น๐ฑ ๐๐บ๐ฎ๐ด๐ถ๐ป๐ฎ๐๐ถ๐ผ๐ป: Reinforces reasoning through alignment between imagined and observed futures, enabling learning from human and robot videos.
๐ช๐ต๐ฎ๐ ๐ถ๐ ๐ฒ๐ป๐ฎ๐ฏ๐น๐ฒ๐
โ Robust real-world manipulation under unseen objects and environments.
โ Human-guided skill composition for novel multi-step robot tasks.
โ Robust generalization under task and environment shifts in simulation.
๐ ๐ข๐๐ฟ ๐๐ถ๐๐ถ๐ผ๐ป: Scale generalizable motion intelligence through human videos toward a unified System-1 reasoning layer for Physical AI.
Paper, robot demos & more below! ๐
11
17
92
5,298
KAIST AI retweeted
๐จ New paper alert!
Despite recent advances in reward fine-tuning for diffusion and flow models, achieving high rewards remains challenging without sacrificing sample diversity or substantially drifting away from the pretrained distribution.
We address this with DFR: al Rewards, a framework that balances reward optimization with preserving desirable properties of the generated distribution! ๐งต
Despite recent advances in reward fine-tuning for diffusion and flow models, achieving high rewards remains challenging without sacrificing sample diversity or substantially drifting away from the pretrained distribution.
We address this with DFR: al Rewards, a framework that balances reward optimization with preserving desirable properties of the generated distribution! ๐งต
4
12
79
6,671
KAIST AI retweeted
[QUESTION] Given a text, can we identify which AI model wrote it? This question is becoming increasingly important due to model distillation and misuse (e.g., Anthropic's www-cdn.anthropic.com/e50be2e51e7695โฆ).
[ANSWER] Our work (komseok0109.github.io/ATLAS/) @KAIST_AI shows that we can identify the source LLM family across different writing domains and model versions, and detect traces of teacher models after distillation.
๐ Project page: huggingface.co/spaces/ming999โฆ
๐ค Demo: huggingface.co/spaces/ming999โฆ
๐ LinkedIn: lnkd.in/p/gCaC4_iw
๐ arXiv: arxiv.org/abs/2610.19583
[ANSWER] Our work (komseok0109.github.io/ATLAS/) @KAIST_AI shows that we can identify the source LLM family across different writing domains and model versions, and detect traces of teacher models after distillation.
๐ Project page: huggingface.co/spaces/ming999โฆ
๐ค Demo: huggingface.co/spaces/ming999โฆ
๐ LinkedIn: lnkd.in/p/gCaC4_iw
๐ arXiv: arxiv.org/abs/2610.19583
0
2
12
431
KAIST AI retweeted
๐ฅฆ How can we mitigate reward hacking in rubric-based RL?
We introduce FORK, a simple reward that balances standard rubric coverage with response precisionโthe proportion of a response that is both necessary and factually correct.
We introduce FORK, a simple reward that balances standard rubric coverage with response precisionโthe proportion of a response that is both necessary and factually correct.
5
10
91
7,954
KAIST AI retweeted
๐ฌ Can AI discover unknown scientific knowledge by itself?
Excited to introduce Principia: Test-Time Hypotheses-to-Principle Construction for Scientific Discovery.
Principia uses LLMs to turn experimental observations into scientific principles at test time:
๐ From ses
Compare related inputs and their outcomes to propose explanations for how specific characteristics contribute to the observed results.
๐ง From hypotheses to principles
Generalize recurring relationships across hypotheses into broader principles that guide subsequent predictions and candidate generation.
๐ Refine knowledge with new observations
Use new observations to revisit earlier hypotheses and reconstruct the principles built on them.
Huge thanks to my co-authors at @KAIST_AI: @SangwooPark0306, @jinheonbaek, @SoyeongJeong97, and @SungJuHwang1
๐ Paper: arxiv.org/abs/2610.32195
#AIforScience #ScientificDiscovery #LLM #TestTimeLearning #KnowledgeConstruction
Excited to introduce Principia: Test-Time Hypotheses-to-Principle Construction for Scientific Discovery.
Principia uses LLMs to turn experimental observations into scientific principles at test time:
๐ From ses
Compare related inputs and their outcomes to propose explanations for how specific characteristics contribute to the observed results.
๐ง From hypotheses to principles
Generalize recurring relationships across hypotheses into broader principles that guide subsequent predictions and candidate generation.
๐ Refine knowledge with new observations
Use new observations to revisit earlier hypotheses and reconstruct the principles built on them.
Huge thanks to my co-authors at @KAIST_AI: @SangwooPark0306, @jinheonbaek, @SoyeongJeong97, and @SungJuHwang1
๐ Paper: arxiv.org/abs/2610.32195
#AIforScience #ScientificDiscovery #LLM #TestTimeLearning #KnowledgeConstruction
0
15
36
2,759
KAIST AI retweeted
๐ Pivot-SD is an ORAL at #EMNLP2026!
We post-train a diffusion LM with a loss on just 10 tokens per response, and it beats both SFT and diffusion RL on math & code.
The trick isn't training on fewer tokens. It's training on the right ones.
We post-train a diffusion LM with a loss on just 10 tokens per response, and it beats both SFT and diffusion RL on math & code.
The trick isn't training on fewer tokens. It's training on the right ones.
5
4
11
467
EMNLP is right around the corner!
Meet our students who are excited to connect and meet new people at the conference! Take a look and say hello! ๐
kaist-gsai.github.io/emnlp2026/
Meet our students who are excited to connect and meet new people at the conference! Take a look and say hello! ๐
kaist-gsai.github.io/emnlp2026/
0
5
33
1,883
KAIST AI retweeted
๐ค Improving robot foundation models with real-world RL, then continually carrying that experience forward across tasks.
Introducing ๐๐๐๐ฅ๐จ๐: ๐ฐ๐ผ๐ป๐๐ถ๐ป๐๐ฎ๐น ๐ผ๐ณ๐ณ-๐ฝ๐ผ๐น๐ถ๐ฐ๐ ๐ฅ๐ for robot foundation models.
Our real-world policies learn through physical robot rom a small set of demos.
We inherit the actorโcritic across tasks and distill earlier behavior, so experience accumulates while prior skills remain.
๐ป ๐๐ผ๐ ๐ฎ๐ฑ๐ฑ๐ถ๐๐ถ๐ผ๐ป๐ฎ๐น ๐๐ฃ๐จ ๐๐ฟ๐ฎ๐ถ๐ป๐ถ๐ป๐ด ๐ผ๐๐ฒ๐ฟ๐ต๐ฒ๐ฎ๐ฑ: RL updates a compact actorโcritic while the foundation model stays frozen.
โก Subsequent tasks reach 95% success in about ๐ฐโ๐ญ๐ฎ ๐บ๐ถ๐ป๐๐๐ฒ๐ ๐ผ๐ณ ๐ฟ๐ผ๐ฏ๐ผ๐ ๐ถ๐ป๐๐ฒ๐ฟ๐ฎ๐ฐ๐๐ถ๐ผ๐ป.
On real robots:
๐ Up to 68.5% less robot interaction vs. single-task RL
๐ฏ 98.3% final prior-task success
๐ฌ A 60-second overview below.
๐ accrue-rl.github.io
๐งต 1/6
Introducing ๐๐๐๐ฅ๐จ๐: ๐ฐ๐ผ๐ป๐๐ถ๐ป๐๐ฎ๐น ๐ผ๐ณ๐ณ-๐ฝ๐ผ๐น๐ถ๐ฐ๐ ๐ฅ๐ for robot foundation models.
Our real-world policies learn through physical robot rom a small set of demos.
We inherit the actorโcritic across tasks and distill earlier behavior, so experience accumulates while prior skills remain.
๐ป ๐๐ผ๐ ๐ฎ๐ฑ๐ฑ๐ถ๐๐ถ๐ผ๐ป๐ฎ๐น ๐๐ฃ๐จ ๐๐ฟ๐ฎ๐ถ๐ป๐ถ๐ป๐ด ๐ผ๐๐ฒ๐ฟ๐ต๐ฒ๐ฎ๐ฑ: RL updates a compact actorโcritic while the foundation model stays frozen.
โก Subsequent tasks reach 95% success in about ๐ฐโ๐ญ๐ฎ ๐บ๐ถ๐ป๐๐๐ฒ๐ ๐ผ๐ณ ๐ฟ๐ผ๐ฏ๐ผ๐ ๐ถ๐ป๐๐ฒ๐ฟ๐ฎ๐ฐ๐๐ถ๐ผ๐ป.
On real robots:
๐ Up to 68.5% less robot interaction vs. single-task RL
๐ฏ 98.3% final prior-task success
๐ฌ A 60-second overview below.
๐ accrue-rl.github.io
๐งต 1/6
4
33
141
7,124
KAIST AI retweeted
Do language models always need to see the full 1M-token context window? What if they can just tell us which tokens they actually need?
We're excited to share Declarative Attention (DA), a sparse attention protocol that lets a model declare which context they need for each n text. The inference engine can use this to mask out up to 99% of KV cache reads for global attention.
Across 15 long-context tasks, DA reduces global attention KV reads by 46% with only 1.4pp accuracy drop on Gemma-4 31B and 20% with 2.1pp on Qwen-3.6 27B. This accuracy gap shrinks as we scale up the model size. Zero-shot.
We discuss further potential in agentic settings with dedicated post-training, and model-controlled KV cache offloading as a path toward reversible context compaction.
We explain details and link our paper below.
We're excited to share Declarative Attention (DA), a sparse attention protocol that lets a model declare which context they need for each n text. The inference engine can use this to mask out up to 99% of KV cache reads for global attention.
Across 15 long-context tasks, DA reduces global attention KV reads by 46% with only 1.4pp accuracy drop on Gemma-4 31B and 20% with 2.1pp on Qwen-3.6 27B. This accuracy gap shrinks as we scale up the model size. Zero-shot.
We discuss further potential in agentic settings with dedicated post-training, and model-controlled KV cache offloading as a path toward reversible context compaction.
We explain details and link our paper below.
20
40
318
11,995























