Our Turing Frontier Research Lab recently released CyberStrike, a real-world cybersecurity benchmark.
A long-horizon benchmark evaluating frontier agents across the cybersecurity lifecycle, from vulnerability exploitation and secure remediation to threat detection and incident s across 3,600 trials: GPT-5.6 Sol (xhigh) led at a 31.5% mean per-task pass rate, but many high-scoring near misses failed binary grading. Seventy-two of 200 tasks were unsolved.
CyberStrike has 200 expert-authored tasks: 120 defensive, 68 offensive, and 12 DFIR.
Of 3,600 recorded trials, 3,106 were graded; the remaining 494 were reported safety refusals.
On the atlas-records-export-offensive task, GPT-5.6 Sol reported: "The submitted proof replayed successfully: all 14 HTTP steps returned 200." The verifier found no protected artifact. No configuration solved the task; four declared success, and two refused.
At the Turing Frontier Research Lab, we continue building benchmarks, training sets, and training recipes that push frontier models forward in the domains where real capability matters.
More on CyberStrike: labs.turing.com/benchmarks/cyb…
A long-horizon benchmark evaluating frontier agents across the cybersecurity lifecycle, from vulnerability exploitation and secure remediation to threat detection and incident s across 3,600 trials: GPT-5.6 Sol (xhigh) led at a 31.5% mean per-task pass rate, but many high-scoring near misses failed binary grading. Seventy-two of 200 tasks were unsolved.
CyberStrike has 200 expert-authored tasks: 120 defensive, 68 offensive, and 12 DFIR.
Of 3,600 recorded trials, 3,106 were graded; the remaining 494 were reported safety refusals.
On the atlas-records-export-offensive task, GPT-5.6 Sol reported: "The submitted proof replayed successfully: all 14 HTTP steps returned 200." The verifier found no protected artifact. No configuration solved the task; four declared success, and two refused.
At the Turing Frontier Research Lab, we continue building benchmarks, training sets, and training recipes that push frontier models forward in the domains where real capability matters.
More on CyberStrike: labs.turing.com/benchmarks/cyb…
Sep 21, 2026 · 4:29 PM UTC
3
3
25
3,294
Reach out to learn more about our research, benchmarks, and datasets: go.turing.com/contact-us?utm…
1
1
11
412