David Held retweeted
Excited to share that I’m now leading a research team at @rai_inst! We’re training dexterous policies in simulation to be deployed and refined on custom hardware.
We may be looking for interns in this area soon. I’ll be at #CoRL2026 in Austin — DM me if you’d like to chat!
We may be looking for interns in this area soon. I’ll be at #CoRL2026 in Austin — DM me if you’d like to chat!
8
7
90
3,226
David Held retweeted
🚨Introducing DISCO🪩: Distilled Tree Search over Continuous Actions (Best Paper Finalist🏆 at #CoRL2026)
DISCO combines learned policies with Monte-Carlo Tree Search (MCTS) over continuous actions for long-horizon manipulation tasks.
A thread 🧵👇
DISCO combines learned policies with Monte-Carlo Tree Search (MCTS) over continuous actions for long-horizon manipulation tasks.
A thread 🧵👇
6
30
137
7,831
David Held retweeted
Can learning to grasp teach a robot to use tools? 🤖🖐️
Introducing our #CoRL2026 paper:
“From Grasps to Dexterity: Large-Scale Grasp Pretraining for Dexterous Manipulation”
We turn grasp data into pretraining for autonomous tool use.
🎥 Project & videos: yingyuan0414.github.io/grasp2dexterit…
🧵👇 (1/9)
Introducing our #CoRL2026 paper:
“From Grasps to Dexterity: Large-Scale Grasp Pretraining for Dexterous Manipulation”
We turn grasp data into pretraining for autonomous tool use.
🎥 Project & videos: yingyuan0414.github.io/grasp2dexterit…
🧵👇 (1/9)
5
19
85
3,663
David Held retweeted
Thrilled to share that our paper DISCO: Distilled Tree Search over Continuous Actions has been selected as a 𝐂𝐨𝐑𝐋 𝟐𝟎𝟐𝟔 𝐁𝐞𝐬𝐭 𝐏𝐚𝐩𝐞𝐫 𝐀𝐰𝐚𝐫𝐝 𝐅𝐢𝐧𝐚𝐥𝐢𝐬𝐭! 🏆 Congrats to @_ksaha 🎉
Can robots learn to plan for the long horizon without expensive search at Monte Carlo Tree Search in simulation and iteratively distills its discoveries into a policy that can execute directly, without search at test time. We demonstrate strong performance on long-horizon object packing and stacking, including real-world transfer!
📍 Catch us in Austin!
🎤 Oral: Nov 10, 11:00–11:30 AM | Hilton Austin (Session O6)
📌 Poster: Nov 10, 5:00–6:30 PM | JW Marriott Austin (Session P2, Poster #176)
🔗 distilled-search.github.io
Can robots learn to plan for the long horizon without expensive search at Monte Carlo Tree Search in simulation and iteratively distills its discoveries into a policy that can execute directly, without search at test time. We demonstrate strong performance on long-horizon object packing and stacking, including real-world transfer!
📍 Catch us in Austin!
🎤 Oral: Nov 10, 11:00–11:30 AM | Hilton Austin (Session O6)
📌 Poster: Nov 10, 5:00–6:30 PM | JW Marriott Austin (Session P2, Poster #176)
🔗 distilled-search.github.io
8
17
202
9,909
David Held retweeted
Life update: I recently graduated from CMU RI, and last year I went through the academic faculty job market in robot learning. I was fortunate to receive a lot of help and support from many people throughout the process.
Compared to industry job applications, there are relatively few resources available online about the faculty application process. So I decided to open-source all of my application materials from last year here:
docs.google.com/document/d/1x-…
I hope these materials can be helpful to others who are considering pursuing an academic career!
Compared to industry job applications, there are relatively few resources available online about the faculty application process. So I decided to open-source all of my application materials from last year here:
docs.google.com/document/d/1x-…
I hope these materials can be helpful to others who are considering pursuing an academic career!
22
66
893
127,009
David Held retweeted
Robots can’t always see the physics they act under: hidden mass, friction, kinematic constraints. A scalar reward only says "failed." The outcome of an action says much more.
Introducing SCOUT: test-time policy adaptation from action-outcome feedback. Sim-trained, adapts in the es 🧵👇 #CORL2026
Introducing SCOUT: test-time policy adaptation from action-outcome feedback. Sim-trained, adapts in the es 🧵👇 #CORL2026
6
26
126
9,337
David Held retweeted
A man in Australia asked his agent (Claude running on OpenClaw) to book him a spot in a popular gym class. The agent found a software vulnerability that let it book the class weeks further ahead than should have been possible. When the user then asked if it could move him up the covered the API had no authorisation checks on cancelling other people’s reservations, so it cancelled the person in the first spot and moved him up the list.
Some people will call this misalignment, but his agent was perfectly aligned to him - it was only trying to help its user get what he wanted. The most important thing about this story, in my opinion, is that it gives you a window into what is about to start happening on a massive scale once millions of people have an agent trying to get their beloved users the best seats, bookings, appointments or reservations through absolutely any means necessary.
Some people will call this misalignment, but his agent was perfectly aligned to him - it was only trying to help its user get what he wanted. The most important thing about this story, in my opinion, is that it gives you a window into what is about to start happening on a massive scale once millions of people have an agent trying to get their beloved users the best seats, bookings, appointments or reservations through absolutely any means necessary.
724
2,600
22,498
3,552,147
David Held retweeted
Boo! 👻 GHOST has been accepted to #RSS2026!
Can we learn manipulation skills from human video (without action retargeting)?
Yes! GHOST learns generalizable manipulation skills by training a hierarchical policy with an embodiment-agnostic sub-goal predictor + troller.
🧵(1/7)
Can we learn manipulation skills from human video (without action retargeting)?
Yes! GHOST learns generalizable manipulation skills by training a hierarchical policy with an embodiment-agnostic sub-goal predictor + troller.
🧵(1/7)
2
14
71
4,628
David Held retweeted
🧩 #ICML2026 💥 How can a model discover the 3D objects in a scene—their shape, color, and position—without any labels? Introducing 3D-DLP, a self-supervised object-centric model that decomposes colored 3D scenes (RGB-D and voxels) into a set of 3D latent particles.
4
9
54
11,111
David Held retweeted
Excited to present the first-ever 3D, generalizable, handheld tactile imaging system! 👇
Our system learns to visualize the inner structure of soft objects purely through touch -
"More with LESS: Local Scene Representation for Tactile Imaging," has been accepted to #RSS2026 🇦🇺
e the locality of touch for large-scale tactile SSL? Read on! 🧵
Our system learns to visualize the inner structure of soft objects purely through touch -
"More with LESS: Local Scene Representation for Tactile Imaging," has been accepted to #RSS2026 🇦🇺
e the locality of touch for large-scale tactile SSL? Read on! 🧵
4
19
116
31,610
David Held retweeted
My first last-author paper, with @lakshitadodeja and @rai_inst collaborators!
When deploying Behavior Cloning (BC) policies, we encounter performance gaps due to compounding error, subtle task shifts, etc.
We want to be able to post-train BC policies with a few online interactions to quickly improve performance.
Q2RL is what we hoped for in a robot post-training algorithm:
- ✅it starts with BC policy rollouts (no need for large, diverse datasets), and
- ✅it's sample-efficient enough for real-world online reinforcement learning!
See the thread and linked website for more details. Paper and code are released!
When deploying Behavior Cloning (BC) policies, we encounter performance gaps due to compounding error, subtle task shifts, etc.
We want to be able to post-train BC policies with a few online interactions to quickly improve performance.
Q2RL is what we hoped for in a robot post-training algorithm:
- ✅it starts with BC policy rollouts (no need for large, diverse datasets), and
- ✅it's sample-efficient enough for real-world online reinforcement learning!
See the thread and linked website for more details. Paper and code are released!
Can BC policies be quickly improved through real world experience?
Our new #RSS2026 paper proposes Q2RL, a method that bridges BC and RL for on-robot learning.
Q2RL improves BC policies by up to 3.75x with just 1-2 hours of online interaction!
So when life gives you BC, make in thread 🧵
4
6
80
11,612
David Held retweeted
I’m attending #ICLR2026 in Rio this week to present LPWM! Friday April 24 Poster Session 3 10:30, Oral Session 4B 3:15p. Happy to chat about self-sup object-centric learning and world models. I’ll be on the job market soon and looking for exciting opportunities!
#ICLR @iclr_conf
#ICLR @iclr_conf
🚀 #ICLR2026 Oral 💥
How can we design world models that capture object interactions directly from pixels?
Introducing Latent Particle World Models-the first end-to-end self-supervised, object-centric world model, trained from videos, supporting action/img/lang conditioning.
1/n
3
8
52
6,375
David Held retweeted
I’m so tired of writing rebuttals to this kind of “lack of novelty” review: “This paper trivially combines A, B, and C, so the algorithmic novelty is limited.”
Technically, most (if not all) robotics papers are convex combinations of existing ideas.
I still deeply appreciate A+B+C papers—especially when they deliver:
- New capabilities: the “trivial combination” unlocks behaviors we simply couldn’t achieve before
- Sensible & organic design: A+B+C is clearly the right composition—not some arbitrary A′+B+C′
- Nontrivial interactions: careful analysis of the dynamics, coupling, or failure modes between A, B, C
- Rehabilitating old ideas: A was dismissed for years, but paired with modern B/C, it suddenly works—and teaches us why
- System-level & "interface" insight: the contribution is not any single piece, but how the pieces talk to each other
- Scaling laws or regimes: identifying when/why A+B+C works (and when it doesn’t)
- Engineering clarity: making something actually work robustly in the real world is not “trivial”
- New problem formulations: sometimes the real novelty is in the reformulation—only under this view does A+B+C make sense.
Maybe worth keeping these in mind when reviewing the next A+B+C paper : )
Technically, most (if not all) robotics papers are convex combinations of existing ideas.
I still deeply appreciate A+B+C papers—especially when they deliver:
- New capabilities: the “trivial combination” unlocks behaviors we simply couldn’t achieve before
- Sensible & organic design: A+B+C is clearly the right composition—not some arbitrary A′+B+C′
- Nontrivial interactions: careful analysis of the dynamics, coupling, or failure modes between A, B, C
- Rehabilitating old ideas: A was dismissed for years, but paired with modern B/C, it suddenly works—and teaches us why
- System-level & "interface" insight: the contribution is not any single piece, but how the pieces talk to each other
- Scaling laws or regimes: identifying when/why A+B+C works (and when it doesn’t)
- Engineering clarity: making something actually work robustly in the real world is not “trivial”
- New problem formulations: sometimes the real novelty is in the reformulation—only under this view does A+B+C make sense.
Maybe worth keeping these in mind when reviewing the next A+B+C paper : )
29
123
987
118,540
David Held retweeted
🚀 #ICLR2026 Oral 💥
How can we design world models that capture object interactions directly from pixels?
Introducing Latent Particle World Models-the first end-to-end self-supervised, object-centric world model, trained from videos, supporting action/img/lang conditioning.
1/n
How can we design world models that capture object interactions directly from pixels?
Introducing Latent Particle World Models-the first end-to-end self-supervised, object-centric world model, trained from videos, supporting action/img/lang conditioning.
1/n
4
47
282
30,064
I am filling out a fellowship application letter of recommendation, and one question is: "Applicant's achievements reflect his or her ability: * - select -Not at All; Well; Moderately Well; Very Well; Extremely Well".
If I select "Well" then what does that imply?
If I select "Well" then what does that imply?
3
1
25
4,327
What are the best slides you have seen to explain transformers to someone who has never seen them before?
2
1
11
3,304
David Held retweeted
Introducing FMVP: a method that adapts to natural arm motions during robot-assisted dressing.
Pre-trained on vision in sim, fine-tuned with limited real-world vision+force data, and tested in a 12-user, 264-trial study, FMVP is robust across garments and motions. #CoRL2025
Pre-trained on vision in sim, fine-tuned with limited real-world vision+force data, and tested in a 12-user, 264-trial study, FMVP is robust across garments and motions. #CoRL2025
1
15
38
7,961
Check out our new CoRL paper on how to find shapes that cause failures for robot manipulation policies!
How do we discover a robot's failure modes before deploying it in the real world? Standard benchmarks often don't capture the full picture, leaving policies vulnerable to plausible variations in object shape.
Thrilled that our work, "Geometric Red-Teaming for Robotic accepted as an oral presentation at #CoRL2025! We introduce a framework to automatically find these geometric blindspots.
georedteam.github.io
🧵
2
2
22
4,028
Check out our CoRL 2025 paper on learning from past interactions; we show, theoretically and experimentally, the benefit of using a generator-verifier paradigm!
A closed door looks the same whether it pushes or pulls. Two identical-looking boxes might have different center of mass. How should robots act when a single visual observation isn't enough?
Introducing HAVE 🤖, our method that reasons about past interactions online! #CORL2025
0
3
19
3,136


















