arxiv-2502-00350 SRC-0312 · paper

OrcaLoca: An LLM Agent Framework for Software Issue Localization

Created: 2025-02-01 · Ingested: 2026-09-19

Recent developments in Large Language Model (LLM) agents are revolutionizing Autonomous Software Engineering (ASE), enabling automated coding, problem fixes, and feature improvements. However, localization -- precisely identifying software problems by navigating to relevant code sections -- remains a significant challenge. Current approaches often yield suboptimal results due to a lack of effective integration between LLM agents and precise code search mechanisms. This paper introduces OrcaLoca, an LLM agent framework that improves accuracy for software issue localization by integrating priori

In brief

Engineering the search process around an LLM agent, rather than letting the LLM schedule its own actions, raises issue localization accuracy on real repositories. OrcaLoca adds 3 pieces on top of a graph representation of a codebase: a priority queue over LLM-proposed search actions with redundancy elimination, decomposition of class and file skeletons into sub-actions ranked by a scoring sub-agent, and context pruning that keeps only search results close to candidate bug locations by shortest-path distance on the code graph.

Running on Claude-3.5-Sonnet-20241022 over SWE-bench Lite's 300 instances, it reaches 65.33% (196) function match and 83.33% (250) file match, and 41.00% (123) resolved after its output is fed into Agentless-1.5's repair stage. Against a reproduced Agentless-1.5 baseline on the same model, that is +6.67 percentage points function match, +4.62 percentage points function match precision, and +6.33 percentage points resolved rate.

The gains are measured, not argued, and the localization-to-repair comparison holds the editor and model fixed. An ablation on the 93-instance SWE-bench Common subset shows each component contributes roughly 3-5 percentage points, dropping function match from 76.34% (71) to 70.97%-73.12%. No matched token-budget baseline is reported; cost is about $0.87 per instance for search plus $0.90 for editing.

Boundaries: 1 model family, Python repositories only, and a single open-source repair pipeline. Treat the scheduler and pruning as cheap add-ons worth trying before switching models.

Written from the abstract by claude-opus-5 on 2026-10-17, with every figure checked against it. Not a substitute for the paper.

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.

supportsConstraining a localization agent with a priority queue over candidate code regions scored for relevance, decomposition of each search action, and pruning of context by distance from the issue's anchors reached a 65% function-level match rate on SWE-bench Lite, the best open-source result at the time, and feeding its locations to an open-source repair pipeline raised the resolved rate by about 6 points.