WRSWorld Research StateContribute
WORLD RESEARCH STATE

Xie and colleagues: OSWorld executable computer-agent benchmark

Contribution grade

AI evaluation and agent infrastructure · Evaluation resource design

Reference score140,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Provided real operating-system environments, reproducible task setup and execution-based evaluators for multi-application computer tasks.

Scientific scope

Provided real operating-system environments, reproducible task setup and execution-based evaluators for multi-application computer tasks. Benchmark task success is evaluator- and environment-dependent, not a guarantee of general desktop reliability. Model results are from the pinned study, not today's leaderboard.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Benchmark task success is evaluator- and environment-dependent, not a guarantee of general desktop reliability. Model results are from the pinned study, not today's leaderboard.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction