跳到正文
AI NEWS JOURNAL
arXiv cs.CLAI NEWS / JOURNAL

跨代理交接的任务接管基准测试

arXiv:2610.36523v1 发布类型:新 提要:随着智能体在更长的任务中开展协作,责任可能会在工作完成之前在不同模型之间转移。接收方模型必须在继承先前的决策、观察与行动的基础上,同时满足剩余的需求。评估这一交接过程,需要将交接时保留的信息与接收方如何继续推进任务之间的关联纳入考量;而仅凭任务成功率和记忆保持度等指标,并不足以全面反映这种关系。我们提出了“交接状态连续性基准”(HSC-Bench),包含1,039个任务,用于评估任务接管的两个互补维度:恢复相关的知识库证据,以及从已建立的对话、工具与文件操作状态中延续工作。对六种接收模型的对比表明,结构

翻译暂未成功,当前显示原文。

arXiv:2610.36523v1 Announce Type: new

Abstract: As agents collaborate on longer tasks, responsibility may pass between models before the work is complete. The receiving model must build on prior decisions, observations, and actions while addressing the remaining requirements. Evaluating this transition requires connecting the information preserved at handoff to how the receiver continues the work, a relationship that task-success and memory-retention scores alone do not capture. We introduce the Handoff State Continuity Benchmark (HSC-Bench), comprising 1,039 tasks that evaluate two complementary aspects of task takeover: recovering relevant repository evidence and continuing from established conversational, tool, and file-work state. Comparisons across six receiving models show that structured handoff state improves repository evidence recovery for every model and continuation performance for most models. The strongest receivers differ between the two tracks, showing that evidence-recovery rankings alone do not characterize performance when continuing from inherited state. By combining these comparisons with checks of subsequent responses and actions, HSC-Bench evaluates both access to prior evidence and adherence to established commitments and completed work. This provides a basis for selecting receiving models and assessing handoff representations according to the work that must be carried forward.

资料来源

arXiv cs.CL
← 继续阅读全部动态