Evals / tables

Multi-step jobs

1 scenario, 1 run by an agent. Each run shows its result, time and new tokens.

ScenarioCodexwithout deftCodexwith deft, skill installedClaude Opus 5.5without deftClaude Opus 5.5with deft, skill installedClaude Codewithout deftClaude Codewith deft
Clean a dataset into a reportgdp.csv mixes countries with regions such as World. Using the country list in countries.csv, make gdp-2015.xlsx with only real countries for 2015, with the columns Country Name, Code and Value, largest first.pass58s · 15.7kpass24s · 12.2kpass29s · 15.9kpass28s · 14.2knot runnot run