Deep Search in Real-World Web Environments

Introduces the OpenDS task and OpenDS-World, a human-verified benchmark of 200 tasks requiring agents to search, browse and reconcile evidence from multiple independent sources in the live open web. Twelve frontier models under one tool protocol peaked at 39.0% accuracy, with human attempts over 1,000 trials reaching 21.1%, and error analysis points to tool orchestration and long-search stopping behaviour as the main failure modes.