Pinned Tweet
Training a robot to grasp an object means learning from many attempts, viewpoints and situations. One robot with three cameras at 20 fps produces 216,000 images per hour. Now that robotics is scaling, how can we efficiently train on all this data? x.com/i/article/2108…
6
24
150
14,059
Imagine having this many robots to test your model on @RoboColosseum 👀
We’ve assembled a fleet of robots. This is just a part of it.
Now we put the models to the test, in the real world.
Coming online in 48 hours.
5
6
54
2,657
🤖 LeRobot 🤝 Trackio 🎯
LeRobot now ships with Trackio for experiment tracking. One flag is all it takes:
--trackio.enable=true
Live loss curves, GPU metrics, and the exact command of every run. Open source and fully compatible with the HF Hub 🤗
LeRobot now ships with Trackio for experiment tracking. One flag is all it takes:
--trackio.enable=true
Live loss curves, GPU metrics, and the exact command of every run. Open source and fully compatible with the HF Hub 🤗
9
11
87
5,743
Coming from W&B? Switching is easy 👇
📖 Docs: huggingface.co/docs/lerobot/m…
🤖 LeRobot: github.com/huggingface/le…
🎯 Trackio: github.com/gradio-app/tra…
📖 Docs: huggingface.co/docs/lerobot/m…
🤖 LeRobot: github.com/huggingface/le…
🎯 Trackio: github.com/gradio-app/tra…
1
1
8
818
Change a robot’s mind mid-move 🤖
New blog: Prompting Robots with LeRobot. Send a new instruction to a running policy and watch it change course, no reset needed. You can also use it with steerable policies trained on multiple tasks.
lerobot-rollout --interactive=true
po
New blog: Prompting Robots with LeRobot. Send a new instruction to a running policy and watch it change course, no reset needed. You can also use it with steerable policies trained on multiple tasks.
lerobot-rollout --interactive=true
po
7
18
106
6,524
LeRobot retweeted
In collaboration with @huggingface, we’ve released the largest open robot dataset, alongside their first open System 1-System 2 model that can reason over step-by-step actions.
FineART is built with 40K+ demonstrations across 151 tasks and 500K subtask labels.
Together, the designed for each other, and both are available on @LeRobotHF where robotics developers work today.
FineART is built with 40K+ demonstrations across 151 tasks and 500K subtask labels.
Together, the designed for each other, and both are available on @LeRobotHF where robotics developers work today.
29
36
325
36,031
Reachy mini can drive around with its hoverboard now!
Reachy Mini has wheels now!
Our little open-source AI robot can finally explore beyond the desktop.
And that's not all:
📱 New mobile app: no computer needed
👑 NFC hats that unlock new personalities and apps
Physical AI just got a lot more fun.
Watch it👇
3
4
53
3,675
Read how we help @microagi scale their infra on @huggingface!
As our customers scale to training robot models using millions of hours of our recordings, we needed to build a new kind of data infrastructure.
Terabytes of data delivered in minutes, and the capacity to deliver over a Petabyte per day to each of our customers, to multiple ime. That’s more than 10 Gigabytes a second, delivered into any cloud, wherever our customers need it.
Using our customer portal, customers select precisely the data they want and it starts arriving in minutes at their destination, including AWS, GCP, Cloudflare, Hugging Face and any cloud provider who can handle the ingest speed.
We’ve written about how we worked with @huggingface and @Cloudflare to build this secure, scalable infrastructure. Link in comments.
1
1
15
2,195
New in LeRobot: DM0.5 by @Dexmal_AI 🤖
A 4B VLM with a 680M flow-matching action expert, pretrained on 7 robot embodiments. Right now it's the top open-source model on RoboColiseum.
Fine-tune it on your robot:
--policy.path=lerobot/dm05_base
Docs 👇
huggingface.co/docs/lerobot/m…
A 4B VLM with a 680M flow-matching action expert, pretrained on 7 robot embodiments. Right now it's the top open-source model on RoboColiseum.
Fine-tune it on your robot:
--policy.path=lerobot/dm05_base
Docs 👇
huggingface.co/docs/lerobot/m…
14
30
208
11,451
We checked the port on LIBERO: lerobot/dm05_libero solves 197/200 episodes across all four suites.
DM0.5 is on main now and ships in the next LeRobot release.
Thanks @Dexmal_AI for the model and the video 🎥 How it works 👇
dexmal.com/blog/dm0.5
DM0.5 is on main now and ships in the next LeRobot release.
Thanks @Dexmal_AI for the model and the video 🎥 How it works 👇
dexmal.com/blog/dm0.5
0
0
6
963
Another dataset now on Hugging Face, 600 hours of manipulation data!
We release Gen-HumanWholeBody, an egocentric whole-body manipulation dataset with industry's highest precision. The dataset is now open-source! 🚀 huggingface.co/datasets/genro…
🚶600 hours of whole-body manipulation data
🎯 ~3 cm whole-body MPJPE
🌍 16,976 real-world scenarios
🦾 1,281 ing this dataset to help researchers and developers advance whole-body motion learning, human-to-robot transfer and embodied foundation models.
Contact Us:opendata@genrobot.ai
Discord: discord.gg/rSSb5thgu
3
10
73
4,919
So many SO-ARMs! 💪
Here is the robotics workshop organized at @NVIDIAGTC Berlin that uses SO-ARM101 and LeRobot to control real and simulated robotic arms. The light box makes it easier to get policies working in any location and light conditions.
Here is the robotics workshop organized at @NVIDIAGTC Berlin that uses SO-ARM101 and LeRobot to control real and simulated robotic arms. The light box makes it easier to get policies working in any location and light conditions.
16
29
349
23,600
We trained π0.5 for 8 hours on 4× H100, streaming a 10.7 TB dataset straight from the Hub.
Time spent waiting for data: 0.52% of step time.
No full download first.
Just add --dataset.streaming=true
How it works 👇
huggingface.co/spaces/lerobot…
Time spent waiting for data: 0.52% of step time.
No full download first.
Just add --dataset.streaming=true
How it works 👇
huggingface.co/spaces/lerobot…
27
32
331
16,189
Tell your robot what you want, in plain words.
New in LeRobot: a vision-language model breaks your goal into skills your robot's brain already knows, steers it step by step, and answers questions as it works.
Demo: huggingface.co/spaces/lerobot…
New in LeRobot: a vision-language model breaks your goal into skills your robot's brain already knows, steers it step by step, and answers questions as it works.
Demo: huggingface.co/spaces/lerobot…
12
28
202
19,505
💥 LeRobot × Zenoh
Remote inference just landed in LeRobot: the policy runs on a GPU server or cloud, the robot keeps moving. Cameras, motors and recording stay on the robot computer, actions stream back.
What this unblocks:
🤖 Robot side: a laptop or a small board is enough leop and recording.
🖥️ Server side: big model checkpoints run on a GPU server or in the cloud.
🏃 Smooth motion, with or without RTC: the next action chunk is predicted while the current one executes, and new chunks are aligned and blended into the ongoing motion.
🔌 Works on the same machine, over the lab network, or across the internet through a Zenoh router with TLS.
Remote inference just landed in LeRobot: the policy runs on a GPU server or cloud, the robot keeps moving. Cameras, motors and recording stay on the robot computer, actions stream back.
What this unblocks:
🤖 Robot side: a laptop or a small board is enough leop and recording.
🖥️ Server side: big model checkpoints run on a GPU server or in the cloud.
🏃 Smooth motion, with or without RTC: the next action chunk is predicted while the current one executes, and new chunks are aligned and blended into the ongoing motion.
🔌 Works on the same machine, over the lab network, or across the internet through a Zenoh router with TLS.
21
29
215
13,543
Join us to talk with LeRobot engineers, ask questions and see what's coming soon to LeRobot.
LeRobot Live - Thursday 8th of October at 4:00 PM CET
Join on our Discord: discord.gg/GZaVGvBcZ?even…
LeRobot Live - Thursday 8th of October at 4:00 PM CET
Join on our Discord: discord.gg/GZaVGvBcZ?even…
8
14
128
11,231