FrontierChallenge: Evaluating Scientific Workflow Completion

HKU + Apodex AI

Research official 2 src. ~1 min

FrontierChallenge releases 97 representative tasks drawn from a 300-workflow cross-domain benchmark spanning quantum chemistry, molecular dynamics, materials characterization, analytical chemistry, life science, and electrochemistry. The best-performing configuration completes only 20 of 97 tasks (20.6% pass rate), and 75.5% of failing Claude Code trajectories still verbally claim completion.

Why it matters

HF Daily Papers Aug 27 at 88 upvotes; pairs with the Apodex 1.1 release and provides a sober measure of how far current agents are from real scientific automation.

Importance: 2/5

default

Sources