arxiv-2609-04355 SRC-0204 · paper

VLA-Precision: Asymmetric Co-Bootstrapping for Efficient Real-World Online RL of Vision-Language-Action Models

Chenyu Su, Zhaolong Shen, Yuan Qian, Chen Qian, Rui Zhang, Feng Yan

Created: 2026-09-03 · Ingested: 2026-09-19

Pretrained vision-language-action (VLA) models enable broad manipulation but remain unreliable in tasks demanding precision and repeatability. Applying real-world online reinforcement learning (RL) to VLA post-training enables autonomous trial-and-error improvement beyond demonstrations alone, but exposes two bottlenecks: 1) unreliable value signals can induce policy drift; 2) large-VLA overhead constrains throughput and sample efficiency. To address these challenges, we present VLA-Precision, an efficient real-world online RL framework featuring the Asymmetric Co-Bootstrapping (ACoB) algorith

In brief

Real-world online RL on top of a task-finetuned large VLA can push manipulation success past the demonstration ceiling, provided value estimates are calibrated gradually and updates are anchored to a frozen reference rather than maximizing absolute Q.

VLA-Precision fine-tunes π0.5 with LoRA on the action expert, combining intervention-driven flow-matching behavior cloning, TD return propagation plus state-matched preference ranking across a critic ensemble, and reference-regularized relative-advantage updates. It is evaluated on 9 high-precision chemistry tasks (contact-rich, contact-light, contact-free, bimanual) across 4 embodiments, against HIL-SERL, ConRFT, Robo-Dopamine, π0 and π0.5.

Reported average success is 98.3% after 45.8 min of online training per task, with 27.6 s episodes; 177 of 180 held-out trials succeed, 100% on 7 tasks. π0.5 and π0 reach 67.8% and 59.4%; the RL baselines reach 7.8% and 10.0%. The systems side, ACoB-Stream, claims up to 10.9x throughput and efficiency gains.

Evidence is measured on real hardware with 20 trials per method-task pair and Wilson 95% intervals on 5 representative tasks, plus intervention-rate curves. Baselines were built for compact policies or Octo, so the comparison confounds algorithm with backbone scale; no matched-compute or equal-intervention baseline is shown, and the 10.9x figure has no named ablation in the text here.

One task family, 1 VLA family, 1 lab, self-run evaluation; generalization beyond lab-scale precision tasks is untested.

If you assumed real-robot RL on large VLAs needs 400–1,000+ episodes per task, this suggests sub-hour budgets are plausible with human corrections in the loop.

Written from the abstract by claude-opus-5 on 2026-09-18, with every figure checked against it. Not a substitute for the paper.

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.

supportsFor real-world online RL post-training of large pretrained vision-language-action policies on high-precision manipulation, optimizing the action head toward a paired advantage margin against a frozen reference action, rather than maximizing absolute Q values, yields higher autonomous success on long multi-step tasks, because absolute-Q maximization amplifies early optimistic value errors into policy drift that behavior-cloning regularization alone does not stop.