Benchmarks

NL2Repo

Codingunit % · normalized over [0, 72]

Generating a complete, working code repository from a natural-language specification.

#ModelSourceScoreNormalized

Score distribution

6 tracked results across the normalization window

072

Score vs. parameters

Open-weights models, log-x params