EvoArena: LLM Agents Score Only 39.6% on Dynamic Evolving Environments Benchmark
MIT
EvoArena models environment changes as sequences of progressive updates across terminal, software, and social domains, in contrast to the static settings assumed by most agent evaluations. Best current agents achieve only 39.6% accuracy. The authors also propose EvoMem, a structured-update-history mechanism that improves performance by 1.5% on EvoArena, 6.1% on GAIA, and 4.8% on LoCoMo.
Why it matters
Static-environment benchmarks may substantially overestimate real-world agent performance where conditions keep changing. EvoArena quantifies this gap and provides a concrete memory-tracking fix. #3 on HF Daily June 12 with 50 upvotes.
Importance: 2/5
#3 HF Daily June 12 (50 upvotes), exposes major gap in agent evaluation methodology