arxiv-2505-07849 SRC-0315 · paper

SweRank: Software Issue Localization with Code Ranking

Created: 2025-05-07 · Ingested: 2026-09-19

Software issue localization, the task of identifying the precise code locations (files, classes, or functions) relevant to a natural language issue description (e.g., bug report, feature request), is a critical yet time-consuming aspect of software development. While recent LLM-based agentic approaches demonstrate promise, they often incur significant latency and cost due to complex multi-step reasoning and relying on closed-source LLMs. Alternatively, traditional code ranking models, typically optimized for query-to-code or code-to-code retrieval, struggle with the verbose and failure-descrip

In brief

Single-shot retrieve-and-rerank beats multi-turn LLM agents at finding which functions a GitHub issue refers to, at a fraction of the cost. The usual assumption that codebase localization needs iterative tool use (grep, file reads, dependency traversal) does not hold once ranking models are trained on issue-shaped queries.

SweRank pairs a bi-encoder retriever (137M and 7B) with a listwise LLM reranker (7B and 32B), trained on SweLoc: 67,341 (PR, codebase) pairs from 3387 Python repos, with top-K consistency filtering (K=20) and 15 mined hard negatives. Evaluation is on SWE-Bench-Lite (274 examples) and LocBench (560 examples) at file, module and function granularity.

SweRankLLM-Large reaches 88.69 function Acc@10 on SWE-Bench-Lite vs 77.37 for LocAgent with Claude-3.5, at $0.015 vs $0.66 per instance. On issues touching 2–3 functions, LocAgent drops from 82.0% to 47.1% while SweRankEmbed-Large holds 77.1%.

Evidence includes ablations on filter threshold, data size, and 3 retriever and 6 reranker base models, all improving after SweLoc finetuning. Agent baselines are cited numbers, not rerun; cost comparison is not matched-budget.

Training data is Python-only bug reports; issues touching >5 functions stay in single-digit accuracy, and repair Pass@1 only moves 22.6 to 24.5 against an oracle 25.9.

If you are paying for agentic localization, a trained reranker is the cheaper default.

Written from the abstract by claude-opus-5 on 2026-10-17, with every figure checked against it. Not a substitute for the paper.

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.

supportsIssue localization can be done as retrieval-and-rerank with no agent at all: an embedding model and reranker trained on issue-to-patched-function pairs mined from public GitHub (SweLoc) localize functions on SWE-bench Lite and LocBench at least as accurately at Acc@10 as agents built on Claude 3.5 Sonnet, at a small fraction of the per-issue cost and with one pass instead of seven to ten model rounds.