SWE-bench/SWE-bench_LiteDataset Summary SWE bench Lite is subset of SWE bench, a dataset that tests systems’ ability to solve GitHub issues automatically. The dataset collects 300 test Issue Pull Request pairs from 11 popular Python. Evaluation is performed by unit test verification using post PR behavior as the reference solution. The dataset was released as part of SWE bench: Can Language Models Resolve Real World GitHub Issues? Want to run inference now? This dataset only contains the… See the full description on the dataset page: https://huggingface.co/datasets/SWE bench/SWE bench Lite.

SWE-bench_Lite

PUBLIC

Mirrored

Dataset Summary SWE-bench Lite is subset of SWE-bench, a dataset that tests systems’ ability to solve GitHub issues automatically. The dataset collects 300 test Issue-Pull Request pairs from 11 popular Python. Evaluation is performed by unit test verification using post-PR behavior as the reference solution. The dataset was released as part of SWE-bench: Can Language Models Resolve Real-World GitHub Issues? Want to run inference now? This dataset only contains the… See the full description on the dataset page: https://huggingface.co/datasets/SWE-bench/SWE-bench_Lite.

Formats:md, parquetLibraries:Datasets, Dask, Polars, Croissant

ArXiv:2310.06770

imported

huggingface

minio

size_categories:n<1K

format:parquet

modality:text

library:datasets

library:pandas

library:mlcroissant

library:polars

region:us

0downloads0likes1.2 MB

Dataset Card

Edit

No dataset card provided yet.

Formats

parquet

Source

Mirrored from an external registry.

Last synced 6/12/2026

Paper for this model

arXiv:2310.06770

Paper2310.06770 0

Dataset Viewer

API

Preview not yet available for this dataset