Repository navigation
[new-research] arXiv:2610.03153 — EvoRiskBench: An Evolving Benchmark for Runtime Security Risks in Workspace Agen #196
Description
New arXiv Research Paper
arXiv ID: 2610.03153
Title: EvoRiskBench: An Evolving Benchmark for Runtime Security Risks in Workspace Agents
Authors: Shiyi Kuang, Xuemei Luo, Kun Liu, Junhai Li, Rui Tian, Feng Shi, Bo Shen, Nianyu Li, Dehui Li, Ping Chen
Published: 2026-10-02T11:22:36Z
URL: https://arxiv.org/abs/2610.03153
Abstract (first 300 chars)
Workspace agents combine large language models with execution harnesses to perform stateful, multi-step tasks that access or modify external resources. Existing benchmarks leave gaps in executable coverage of their runtime security risks, while evolving model capabilities, harnesses, tools, and thre…
Suggested OWASP Mapping
No automatic mapping — manual review recommended
Suggested Action
Review this paper against the OWASP GenAI Crosswalk entries and update relevant mapping files if new attack patterns or mitigations are identified.
Activity
emmanuelgjr commentedon Oct 9, 2026
Routed to the benchmark catalogue — rule 3.
EvoRiskBench: An Evolving Benchmark for Runtime Security Risks in Workspace Agents introduces a benchmark for runtime security risks in workspace agents: "a reproducible dataset of 450 adversarial tasks across six scenarios", run against nine model-harness configurations (three models × Claude Code, Codex and OpenClaw).
Routed per
docs/TRIAGE_RULES.md:evals/EXTERNAL_BENCHMARKS.md.The row's OWASP entry column lands as DRAFT — SME review required. This issue closes when the catalogue PR merges.
emmanuelgjr commentedon Oct 9, 2026
Row added in #222.