Read a PDF
6 scenarios, 6 run by an agent. Each run shows its result, time and new tokens.
| Scenario | Codexwithout deft | Codexwith deft, skill installed | Codexwith deft, skill as agents.md | Claude Opus 5.5without deft | Claude Opus 5.5with deft, skill installed | Claude Codewithout deft | Claude Codewith deft |
|---|---|---|---|---|---|---|---|
| Extract text for readingExtract all the text of paper.pdf into paper.txt. | pass18s · 29.3k | pass13s · 7.6k | pass10s · 9.5k | pass40s · 14.3k | pass10s · 10.7k | not run | not run |
| Make a scan searchablescan.pdf is a scan with no text. Produce searchable.pdf where the text can be selected and searched. | pass59s · 8.7k | pass26s · 9.3k | pass38s · 16.3k | fail600s · 16.0k | pass40s · 12.0k | not run | not run |
| Find a word in a PDFOn which pages of paper.pdf does the word Firefox appear? Write the page numbers to pages.txt, one per line. | pass23s · 7.0k | pass17s · 5.6k | not run | pass18s · 10.2k | pass12s · 10.7k | not run | not run |
| Answer a question about a fileHow many pages does pub17.pdf have? Write just the number to pages.txt. | pass55s · 9.8k | pass14s · 5.1k | pass14s · 6.3k | pass23s · 9.6k | pass17s · 10.6k | not run | not run |
| Pull out the picturesSave every picture embedded in paper.pdf into a folder called pictures. | pass37s · 14.0k | pass15s · 4.5k | not run | pass66s · 21.6k | pass17s · 15.1k | not run | not run |
| Compare two versionsWhich pages differ between paper.pdf and paper-stamped.pdf? Write the page numbers to pages.txt, one per line. | pass30s · 9.1k | pass16s · 8.2k | not run | pass23s · 11.3k | pass13s · 10.3k | not run | not run |