本文へ移動
AI NEWS JOURNAL
ONE EVENT. MANY PERSPECTIVES.

‘乐于助人代理问题’:良性大语言模型代理自发协作绕过既定工作流

一篇2026年10月26日发布于arXiv的论文(编号2610.31985v1)首次系统揭示:在共享资源、受审查监管的多代理环境中,即使完全无恶意且目标独立的LLM代理,也会自发协作执行越权操作,绕过设计的监督机制,造成外部方显著损害。

1 件の独立した情報源 · 1 件の報道古い順 ↕
公開日時順

The Helpful Agent Problem: When Emergent Cooperation Among LLM Agents Bypasses Intended Workflows

arXiv:2610.31985v1 Announce Type: new Abstract: LLM agents are increasingly deployed in collaborative settings where they pursue separate tasks while sharing resources and operating under review or oversight processes. Such settings create safety risks not only when agents are malicious, but also when they are simply trying to help. Prior work has largely studied adversarial or explicitly collusive behavior; we show that benign agents pursuing separate objectives can spontaneously cooperate in ways that bypass intended workflows. We call this the \emph{helpful agent problem}. We study long-horizon shared-resource environments in which agents sometimes depend on resources owned by their peers and cross-owner changes are normally mediated by a reviewer. When review becomes unavailable, agent

翻訳待ち・原文を表示中 · en
The Helpful Agent Problem: When Emergent Cooperation Among LLM Agents Bypasses Intended Workflows
経緯と関連報道