FDE-Gym: Benchmarking Agents on Forward-Deployed Engineering Delivery Tasks

An agentic benchmark of 95 end-to-end delivery tasks from 20 real customer scenarios across 18 sectors, where agents must clarify ambiguous requirements with scripted stakeholders and modify production-like systems, scored on improvement in the customer's own metric. Across 13 model configurations from seven providers, the best reached a mean score of 0.56 and fully resolved only 14 of 95 tasks, with discovering unstated constraints the main bottleneck.