arxiv-2609-17848 SRC-0410 · paper

SFT or RL for Tool-Calling Agents? A Controlled Study Across Data, Method, and Scale

Md Tahmid Rahman Laskar, Xue-Yong Fu, Shashi Bhushan TN

Created: 2026-09-15 · Ingested: 2026-09-22

Limited controlled evidence exists on how training data, adaptation method, and model scale jointly affect tool-calling performance in language-model agents. We evaluate supervised fine-tuning (SFT) with LoRA, reinforcement learning (RL) via Group Relative Policy Optimization (GRPO), and SFT followed by GRPO across six Qwen3 models from 0.6B to 32B parameters, covering both in-distribution performance and cross-dataset transfer. SFT with LoRA is the strongest in-distribution method throughout the 0.6B-32B range and best in 15 out of 18 experimental settings. On cross-dataset transfer, the meth

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.

supportsFor adapting Qwen3 instruction-tuned models from 0.6B to 32B to tool-calling corpora, LoRA supervised fine-tuning gives the best in-distribution exact-match accuracy (best in 15 of 18 settings, never below zero-shot), while GRPO holds only a sub-one-point average edge on cross-dataset transfer and SFT followed by GRPO under a matched data budget is rarely best at either.