Evals / image

Format conversion

5 scenarios, 5 run by an agent. Each run shows its result, time and new tokens.

ScenarioCodexwithout deftCodexwith deft, skill installedCodexwith deft, skill as agents.mdClaude Opus 5.5without deftClaude Opus 5.5with deft, skill installedClaude Codewithout deftClaude Codewith deft
Convert an iPhone photoConvert photo.heic to photo.jpg.fail11s · 3.3kpass11s · 8.7kfail9s · 5.4kpass21s · 10.4kpass6s · 9.1knot runnot run
Decode WebPConvert gallery.webp to gallery.png.pass8s · 5.2kpass12s · 3.9kpass8s · 8.9kpass10s · 9.3kpass6s · 9.2knot runnot run
Rasterise an SVGExport tiger.svg as a 1024 pixel wide PNG called tiger.png.fail31s · 7.6kpass19s · 9.1kpass11s · 5.6kpass67s · 14.0kpass11s · 10.4knot runnot run
Convert a print-ready CMYK JPEGcmyk.jpg is CMYK and looks wrong on the web. Save it as rgb.png in normal RGB colors.pass9s · 3.1kpass10s · 4.0kpass10s · 5.5kpass42s · 14.3kpass43s · 15.5knot runnot run
Picture to PDF by extensionConvert gallery.webp to gallery.pdf.pass8s · 5.0kpass13s · 6.8kpass10s · 8.9kpass11s · 8.7kpass10s · 9.2knot runnot run