Evals / audio

Tags and facts

1 scenario, 1 run by an agent. Each run shows its result, time and new tokens.

ScenarioCodexwithout deftCodexwith deft, skill installedCodexwith deft, skill as agents.mdClaude Opus 5.5without deftClaude Opus 5.5with deft, skill installedClaude Codewithout deftClaude Codewith deft
Answer a question about audioWhat is the duration of example.ogg in seconds? Write the number to duration.txt.pass12s · 3.4kpass18s · 7.3kpass12s · 9.7kpass13s · 8.7kpass9s · 10.0knot runnot run