HELM vs SWE-bench

HELM and SWE-bench are both popular model benchmarks. Here is how they compare.

FeatureHELMSWE-bench
OverviewStanford's holistic evaluation framework for language modelsThe authoritative AI coding benchmark on real GitHub issues

HELM alternatives · SWE-bench alternatives · 中文版