Evals / tables

Analyse

3 scenarios, 3 run by an agent. Each run shows its result, time and new tokens.

ScenarioCodexwithout deftCodexwith deft, skill installedClaude Opus 5.5without deftClaude Opus 5.5with deft, skill installedClaude Codewithout deftClaude Codewith deft
Profile a tableHow many rows does gdp.csv have and what is the largest Value? Save the column statistics as stats.json.pass21s · 7.3kpass18s · 14.7kpass21s · 10.1kpass17s · 10.9knot runnot run
Ask a table with SQLUsing gdp.csv, write the ten countries with the highest Value in 2015 to top.csv with the columns Country Name and Value.pass12s · 6.0kpass21s · 9.9kpass15s · 12.0kpass16s · 13.3knot runnot run
Totals per groupAdd up Value for each Year in gdp.csv and save the totals as per-year.csv.pass13s · 3.9kpass15s · 9.3kpass16s · 10.3kpass16s · 12.2knot runnot run