arxiv-2305-16291 SRC-0030 · paper

Voyager: An Open-Ended Embodied Agent with Large Language Models

Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, Anima Anandkumar

Created: 2023-05-25 · Ingested: 2026-09-14

https://arxiv.org/abs/2305.16291(opens in a new tab)

We introduce Voyager, the first LLM-powered embodied lifelong learning agent in Minecraft that continuously explores the world, acquires diverse skills, and makes novel discoveries without human intervention. Voyager consists of three key components: 1) an automatic curriculum that maximizes exploration, 2) an ever-growing skill library of executable code for storing and retrieving complex behaviors, and 3) a new iterative prompting mechanism that incorporates environment feedback, execution errors, and self-verification for program improvement. Voyager interacts with GPT-4 via blackbox queries, which bypasses the need for model parameter fine-tuning. The skills developed by Voyager are temporally extended, interpretable, and compositional, which compounds the agent's abilities rapidly and alleviates catastrophic forgetting. Empirically, Voyager shows strong in-context lifelong learn…

In brief

Unverified figures: 102. These do not appear in the abstract this was written from, so read the paper before quoting them.

An LLM agent that writes reusable code skills into a growing library, driven by a self-generated curriculum and refined by execution feedback, learns Minecraft continually without any weight updates. Voyager queries GPT-4 through prompts only, storing verified JavaScript programs in a vector database keyed by GPT-3.5 embeddings, and runs in MineDojo with Mineflayer for low-level control. Against re-implemented ReAct, Reflexion and AutoGPT baselines, it discovers 63 unique items within 160 prompting iterations, 3.3x more than counterparts, travels 2.3x longer distances, unlocks the wooden level 15.3x faster, stone 8.5x, iron 6.4x, and is the only method to reach diamond (102 iterations, 1/3 trials). On 4 unseen tasks in a fresh world it solves all within 50 iterations while all baselines score 0/3. Ablations isolate the components: a random curriculum drops item count by 93%, removing self-verification drops it 73%, and swapping GPT-4 for GPT-3.5 in code generation costs 5.7x in unique items. Trials are only 3 per condition, baselines were adapted from NLP settings rather than built for Minecraft, and no gradient-based Minecraft agent is compared since Voyager uses a high-level API. Perception is text-only; 3D building needed human visual critique. Treat the skill library as the transferable idea, since it also lifted AutoGPT.

Written from the abstract by claude-opus-5 on 2026-09-15, with every figure checked against it. Not a substitute for the paper.

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.

No claims cite this yet.