arxiv-2609-07135 SRC-0215 · paperNutriBench-Kitchen: Benchmarking Embodied AI for Nutrition Management
Yulin Wei, Xiangchen Wang, Jianhui Pan, Jinyu Xiao, Zheng Tan, Ruozai Tian
Created: 2026-09-07 · Ingested: 2026-09-19
https://arxiv.org/abs/2609.07135(opens in a new tab)An embodied kitchen assistant must do more than recognize food in isolated frames. It must track ingredient states over time and integrate visual observations with recipe and nutritional knowledge to support constraint-aware decision-making. We formalize this capability as \emph{Embodied Nutrition Management}: perceiving nutrition-relevant events, maintaining a persistent food state, and using it for knowledge-grounded planning. Existing benchmarks evaluate static food understanding or embodied cooking actions, but do not measure whether an agent can continuously update and use nutrition-relev
In brief
Vision-language models can spot that an ingredient was used and still fail to carry that change into a later answer; explicit food-state memory recovers much of the loss, and a 4B model with it beats models many times larger.
NutriBench-Kitchen contains 1,500 manually verified QA pairs from 160 long-form cooking videos (145 HD-EPIC segments, 15 self-recorded with physically measured ingredient weights), split into 5 task families (Ingredient Entry, Memory Management, Recipe Query, Long-/Short-Term Planning) and disjoint Easy (frame hint given) and Hard (multi-turn, no hint) regimes. Nutri-Vgent adds separate episodic, food-state and recipe memories on Qwen3-VL backbones.
Humans average 92.0%; Gemini 2.5 Pro 61.1%, GPT-4o 47.7%. Qwen2.5-VL-7B falls from 30.7% to 3.3% on Ingredient Entry between Easy and Hard. Nutri-Vgent lifts Qwen3-VL-8B from 53.4% to 62.3% overall, Ingredient Entry Hard 14.0% to 73.3%, Recipe Query Hard 63.4% to 94.1%; generic RAG (Vgent) drops to 31.7%.
Measured, with a component ablation isolating episodic vs food memory (each alone lowers the average: 51.8% and 46.9% for 8B). There is no matched compute or token-budget baseline, and gains do not hold everywhere: IE Easy falls from 30.7% to 20.0%, and Long-Term Planning degrades under memory.
The task is observational only, no action execution, 1 agent architecture, 2 backbone sizes.
If you assume long-context VLMs already track object state, this gives you a concrete counterexample and a cheap fix.
Written from the abstract by claude-opus-5 on 2026-09-18, with every figure checked against it. Not a substitute for the paper.
Referenced by
Claims in this catalog that draw on this source, and whether as support or counterpoint.