A robot completes an action.

But does it know the task is actually finished?

SenseNova-RoboRSI documents where embodied AI still fails: misjudging success, forgetting completed subtasks, undoing earlier progress, and struggling with irreversible mistakes.

The research is open here:
arxiv.org/abs/2610.22471
We release the most comprehensive ๐—ฒ๐—บ๐—ฝ๐—ถ๐—ฟ๐—ถ๐—ฐ๐—ฎ๐—น ๐˜€๐˜๐˜‚๐—ฑ๐˜† ๐—ผ๐—ณ ๐—š๐—ฃ๐—ง-๐Ÿฒ-๐—”๐˜€๐˜๐—ฟ๐—ฎโ€™๐˜€ ๐—ฒ๐—บ๐—ฏ๐—ผ๐—ฑ๐—ถ๐—ฒ๐—ฑ ๐—ถ๐—ป๐˜๐—ฒ๐—น๐—น๐—ถ๐—ด๐—ฒ๐—ป๐—ฐ๐—ฒ across 12 simulation benchmarks and 8 real-robot platforms, together with ๐—ฆ๐—ฒ๐—ป๐˜€๐—ฒ๐—ก๐—ผ๐˜ƒ๐—ฎ-๐—ฅ๐—ผ๐—ฏ๐—ผ๐—ฅ๐—ฆ๐—œ: an open-source harness framework and t ~1/50 the cost of GPT-6-Astra.

Here's what we found:
๐Ÿ”น ๐—ง๐—ต๐—ฒ ๐—ฐ๐—ฎ๐—ฝ๐—ฎ๐—ฏ๐—ถ๐—น๐—ถ๐˜๐˜† ๐—ฐ๐—ฒ๐—ถ๐—น๐—ถ๐—ป๐—ด ๐—ถ๐˜€ ๐—ฎ๐—ฐ๐˜๐˜‚๐—ฎ๐—น๐—น๐˜† ๐—บ๐˜‚๐—ฐ๐—ต ๐—ต๐—ถ๐—ด๐—ต๐—ฒ๐—ฟ. Under a unified protocol (ICL + up to 10ร— the interaction budget), GPT-6-Astra achieves clear SOTA across all 12 benchmarks: RoboDojo: 27.6% at 1ร— โ†’ 81.9% at 10ร—, DexJoCo: 87.3% vs. 40.3% prior SOTA, while the LIBERO benchmarks are pushed to saturation.

๐Ÿ”น ๐—ง๐—ผ๐—ผ ๐—บ๐˜‚๐—ฐ๐—ต ๐—ฏ๐˜‚๐—ฐ๐—ธ ๐—ณ๐—ผ๐—ฟ ๐˜๐—ต๐—ฒ ๐—ฏ๐—ฎ๐—ป๐—ด. Even a simple task like placing pens in a holder costs ~$55 in inference.

๐Ÿ”น ๐—ง๐—ต๐—ฒ ๐˜„๐—ผ๐—ฟ๐—น๐—ฑ ๐—ฑ๐—ผ๐—ฒ๐˜€๐—ปโ€™๐˜ ๐˜„๐—ฎ๐—ถ๐˜. Time matters as real robots overheat, and an egg burned while the model was still thinking.

Our takeaway: GPT-6-Astra has largely crossed the threshold of ๐—ฒ๐—บ๐—ฏ๐—ผ๐—ฑ๐—ถ๐—ฒ๐—ฑ ๐—ฐ๐—ผ๐—บ๐—ฝ๐—ฒ๐˜๐—ฒ๐—ป๐—ฐ๐—ฒ, but ๐—ฝ๐—ฟ๐—ฎ๐—ฐ๐˜๐—ถ๐—ฐ๐—ฎ๐—น ๐—ฒ๐—บ๐—ฏ๐—ผ๐—ฑ๐—ถ๐—ฒ๐—ฑ ๐—ถ๐—ป๐˜๐—ฒ๐—น๐—น๐—ถ๐—ด๐—ฒ๐—ป๐—ฐ๐—ฒ is not here yet.

๐ŸŒ Project page: sensenova.ai/has-gpt-6-astrโ€ฆ
๐Ÿ“„ Report: sensenova.ai/gpt-6/assets/dโ€ฆ
๐Ÿ’ป Code & model: github.com/OpenSenseNova/โ€ฆ

Oct 22, 2026 ยท 10:15 AM UTC

8
40
167
26,514
RepliesRelevant
Replying to @Damn_coder
@Damn_coder Forgetting completed tasks sounds like a serious issue for long-running robotics workflows.
0
0
1
49
Replying to @Damn_coder
@Damn_coder SenseNova-RoboRSI is highlighting problems that really matter outside benchmarks.
0
0
1
95
Replying to @Damn_coder
@Damn_coder Robots still have a lot to learn about fixing their own mistakes.
0
0
1
26
Replying to @Damn_coder
@Damn_coder Misjudging success and undoing progress is such key embodied failure
0
0
0
15
Replying to @Damn_coder
@Damn_coder Task completion sounds simple until a robot has to judge it.
0
0
0
18