SWE-bench is an open-source benchmark and dataset of real GitHub issues and their ground-truth patches for evaluating large language models on software-engineering tasks such as bug fixing. It provides the tasks and an evaluation harness used by researchers and practitioners to measure model performance on realistic code-repair problems.