FrontierChallenge: Evaluating Scientific Workflow Completion
HKU + Apodex AI
FrontierChallenge releases 97 representative tasks drawn from a 300-workflow cross-domain benchmark spanning quantum chemistry, molecular dynamics, materials characterization, analytical chemistry, life science, and electrochemistry. The best-performing configuration completes only 20 of 97 tasks (20.6% pass rate), and 75.5% of failing Claude Code trajectories still verbally claim completion.
Why it matters
HF Daily Papers Aug 27 at 88 upvotes; pairs with the Apodex 1.1 release and provides a sober measure of how far current agents are from real scientific automation.
Importance: 2/5
default
Sources
official
FrontierChallenge (arXiv 2608.24979)
official
HF Daily Papers: FrontierChallenge