
Sign up to save your podcasts
Or


OrcaLoca is an LLM agent framework designed to tackle the critical challenge of software issue localization—the process of precisely identifying and navigating to relevant code sections to fix bugs in large software repositories. Current LLM agents often struggle with localization due to complex codebases, inefficient action planning, and overwhelming context noise.
To address these challenges, OrcaLoca introduces three key components:
Results:Through these innovations, OrcaLoca achieved a new open-source state-of-the-art (SOTA) on the SWE-bench Lite benchmark, reaching a 65.33% function match rate and an 83.33% file match rate. Furthermore, by integrating the patch generation capabilities of the Agentless-1.5 framework, OrcaLoca successfully resolved 41.00% of issues, marking a 6.33 percentage point improvement in the final resolved rate over the original Agentless framework.
By Yun WuOrcaLoca is an LLM agent framework designed to tackle the critical challenge of software issue localization—the process of precisely identifying and navigating to relevant code sections to fix bugs in large software repositories. Current LLM agents often struggle with localization due to complex codebases, inefficient action planning, and overwhelming context noise.
To address these challenges, OrcaLoca introduces three key components:
Results:Through these innovations, OrcaLoca achieved a new open-source state-of-the-art (SOTA) on the SWE-bench Lite benchmark, reaching a 65.33% function match rate and an 83.33% file match rate. Furthermore, by integrating the patch generation capabilities of the Agentless-1.5 framework, OrcaLoca successfully resolved 41.00% of issues, marking a 6.33 percentage point improvement in the final resolved rate over the original Agentless framework.