arxiv-2609-08444 SRC-0223 · paper

Safe Task Planning with Long-Term Graph Memory for Embodied Agents

Siyuan Li, Taiyan Lang, Aoqi Yan, Jia Yu, Feifan Liu, Yihan Du

Created: 2026-09-08 · Ingested: 2026-09-19

Large language models (LLMs) and vision-language models (VLMs) have significantly advanced zero-shot task planning for embodied agents. However, most LLM- and VLM-driven methods struggle to generate safe high-level actions due to a lack of physical risk awareness, particularly under partial observability, where hazards lie outside the immediate field of view. To address this challenge, we propose a novel safe task-planning framework, SafeMem, which constructs and maintains a long-term semantic graph memory of the open and dynamic environment. Based on egocentric observations, the proposed fram

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.

supportsFor VLM-driven embodied task planning with an egocentric camera, where hazards can fall out of view, the form of the memory handed to a risk predictor decides whether safety improves: an object-relation graph that retains out-of-view objects and updates edges after actions raises safe success rate well above no memory, while feeding the full image history or a flat list of seen objects scores below having no memory at all, because relationships and structure, not object recall, are what risk prediction needs.