Evals / image

Crop, rotate and frame

4 scenarios, 4 run by an agent. Each run shows its result, time and new tokens.

ScenarioCodexwithout deftCodexwith deft, skill installedCodexwith deft, skill as agents.mdClaude Opus 5.5without deftClaude Opus 5.5with deft, skill installedClaude Codewithout deftClaude Codewith deft
Centre crop to a squareCrop DSCN0010.jpg to a centered square called square.jpg.pass14s · 6.3kpass16s · 16.6kpass12s · 10.0kpass19s · 10.2kpass11s · 9.8knot runnot run
Rotate an imageRotate DSCN0010.jpg 90 degrees clockwise and save it as turned.jpg.pass10s · 3.2kpass14s · 5.0kpass10s · 5.1kpass15s · 10.8kpass13s · 9.9knot runnot run
Bake in EXIF orientationlandscape_6.jpg shows sideways in some apps. Save upright.jpg with the pixels actually rotated and no rotation flag.pass17s · 4.5kpass22s · 9.5kpass12s · 5.2kpass16s · 9.2kpass18s · 12.7knot runnot run
Add a white borderAdd a 40 pixel white border around hopper.png and save it as framed.png.pass10s · 3.2kpass14s · 7.3knot runpass11s · 8.7kpass16s · 10.0knot runnot run