Evals / video / See inside a video
Answer a question about a video
How long is jellyfish.mp4 in seconds, and what is its resolution? Write the answer to info.txt.
The task
The reference answer shows the job can be done with deft. It is not an agent run.
deft video info jellyfish.mp4 > info.txt
Input
Reference output
ok video.info jellyfish.mp4 0:10.010, 1280x720 duration=10.01001 width=1280 height=720 fps=29.97 video_codec=h264 bitrate=837535
How a result is judged (1 check)
- text: file = "info.txt", contains = ["1280", "720"]
Runs
CodexWithout deftPassed2026-11-07
- Time
- 11s
- New tokens
- 3.4k
- Total input
- 53.6k
- Output tokens
- 0.3k
- Commands
- 3
- Failed
- 0
Trace
I’ll inspect the video metadata in the current directory and write the duration and resolution to `info.txt`.
pwd && rg --files -g 'jellyfish.mp4' -g 'info.txt'output
jellyfish.mp4
ffprobe -v error -show_entries format=duration:stream=width,height -of default=noprint_wrappers=1 jellyfish.mp4output
width=1280 height=720 duration=10.010010
cat > info.txt <<'EOF' Duration: 10.01 seconds Resolution: 1280 × 720 pixels EOF cat info.txtoutput
Duration: 10.01 seconds Resolution: 1280 × 720 pixels
`info.txt` now contains the video’s duration (10.01 seconds) and resolution (1280 × 720 pixels).
Output
Duration: 10.01 seconds Resolution: 1280 × 720 pixels
CodexWith deft, skill installedPassedRead the skillUsed deft2026-11-07
- Time
- 15s
- New tokens
- 7.6k
- Total input
- 72.4k
- Output tokens
- 0.5k
- Commands
- 4
- Failed
- 0
Trace
I’ll inspect the video metadata and write the duration and resolution to `info.txt` in the current directory.
cat .agents/skills/deft/SKILL.mdoutput
--- name: deft description: "Use deft instead of writing a script for file jobs: PDF merge/split/compress/watermark, image resize/convert/compress, video and audio trim/convert/compress, spreadsheets, Markdown to PDF/HTML, and YouTube downloads and subtitles." --- # deft One local command for file jobs. Prefer it over writing Python or shell scripts. Syntax: `deft <group> <command> [inputs] [-o output] [--options]` Groups: - `pdf`: Merge, split, compress, encrypt, forms, OCR, compare, convert - `image`: Resize, crop, convert, compress, filters, montage, OCR - `video`: Trim, crop, speed, convert, compress, GIF, frames (ffmpeg) - `audio`: Convert, trim, merge, fade, speed, tag, normalize (ffmpeg) - `doc`: Word/ODT/RTF: to text, Markdown, HTML, PDF; find and replace - `slides`: PowerPoint: extract text, Markdown outline, PDF handout - `data`: JSON/YAML/TOML/XML: convert, query with jq syntax, merge, diff - `sheet`: Excel/CSV/ODS tables: filter, sort, join, pivot, convert - `md`: Markdown to PDF, HTML, Word, EPUB; table of contents - `html`: HTML to Markdown, text, Word, PDF; screenshots - `epub`: E-books: info, to text, Markdown and PDF - `email`: EML files: headers, text, attachments - `contact`: VCF address books: to and from CSV - `calendar`: ICS calendars: to and from CSV - `gps`: GPX and KML tracks: convert, distance and time - `youtube`: Info, download, audio, subtitles, thumbnail (yt-dlp) - `file`: Any file: hash, duplicates, batch rename, base64, encoding - `qr`: Cre … 728 more characters
I’m using the `deft` file tool instructions for the video metadata lookup.
deft video --helpoutput
deft video - commands (input -> output) info video -> report Duration, size, frame rate, codecs add-audio video -> video Replace or mix the soundtrack: --audio song.mp3 add-subtitles video -> video Add subtitles: burned into the picture, or --soft chunk video -> video... Cut into equal parts: --length 10:00 compress video -> mp4 Smaller file: --level, --target-size, --max-height convert video|gif -> video Change container and codec: --to mp4|webm|mov|mkv crop video -> video Cut a region: --box or --aspect 1:1 download url -> video Save a video: --resolution 720p, --to mp4|webm|mkv [net] extract-audio video -> audio Save the soundtrack: --to mp3|m4a|wav|flac|ogg extract-subtitles video -> srt|vtt Save an embedded subtitle track: --to srt|vtt fade video -> video Fade: --fade-in 1 --fade-out 2 frames video -> png|jpg... Save frames as images: --fps 1 or --at 0:05,0:10 from-images image... -> video Slideshow: --duration, --fps, --audio merge video... -> mp4 Join videos; --transition fades mute video -> video Remove the audio track pad video -> video Fit into a frame with bars: --size 1080x1920 repeat video -> video Repeat a video: --count 3 plays it three times resize vid … 891 more characters
deft video info jellyfish.mp4 --jsonoutput
{"v":1,"ok":true,"op":"video.info","items":[{"ok":true,"inputs":["jellyfish.mp4"],"outputs":[],"facts":{"duration":10.01001,"width":1280,"height":720,"fps":29.97,"video_codec":"h264","audio_codec":null,"bitrate":837535},"warnings":[]}],"elapsed_ms":60}printf 'Duration: 10.01001 seconds\\nResolution: 1280x720\\n' > info.txt`jellyfish.mp4` is 10.01001 seconds long with a resolution of 1280×720. I wrote both details to [info.txt](info.txt).
Output
Duration: 10.01001 seconds Resolution: 1280x720
CodexWith deft, skill as AGENTS.mdPassed2026-11-05
- Time
- 13s
- New tokens
- 5.6k
- Total input
- 61.5k
- Output tokens
- 0.4k
- Commands
- 3
- Failed
- 0
Trace
I’ll inspect the video’s metadata, then write the duration in seconds and resolution to `info.txt` in the current directory.
deft videooutput
deft video - commands (input -> output) info video -> report Duration, size, frame rate, codecs compress video -> mp4 Smaller file: --level, --target-size, --max-height convert video -> video Change container and codec: --to mp4|webm|mov|mkv download url -> video Save a video: --resolution 720p, --to mp4|webm|mkv [net] extract-audio video -> audio Save the soundtrack: --to mp3|m4a|wav|flac|ogg frames video -> png|jpg... Save frames as images: --fps 1 or --at 0:05,0:10 merge video... -> mp4 Join videos in order (sizes are matched to the first) mute video -> video Remove the audio track resize video -> video Scale: --size 1280x, x720, 50% rotate video -> video Turn clockwise: --angle 90 split video -> video Cut out a part: --from 0:10 --to-time 0:25 to-gif video -> gif Animated GIF: --fps, --size, --from, --to-time More: deft video <command> --help
deft video info jellyfish.mp4 --jsonoutput
{"elapsed_ms":56,"items":[{"facts":{"audio_codec":null,"bitrate":837535,"duration":10.01001,"fps":29.97,"height":720,"video_codec":"h264","width":1280},"inputs":["jellyfish.mp4"],"ok":true,"outputs":[],"warnings":[]}],"ok":true,"op":"video.info","v":1}printf 'Duration: 10.01001 seconds\\nResolution: 1280x720\\n' > info.txt`jellyfish.mp4` is 10.01001 seconds long and has a resolution of 1280×720. I wrote this to [info.txt](info.txt).
Output
Its files were not kept in this run. The last line of the trace is its own report.
Claude Opus 5.5Without deftPassed2026-11-07
- Time
- 13s
- New tokens
- 8.9k
- Total input
- 56.5k
- Output tokens
- 0.4k
- Commands
- 0
- Failed
- 0
Trace
Output
Duration: 10.01 seconds Resolution: 1280x720
Claude Opus 5.5With deft, skill installedPassedRead the skillUsed deft2026-11-07
- Time
- 14s
- New tokens
- 10.5k
- Total input
- 75.9k
- Output tokens
- 0.5k
- Commands
- 0
- Failed
- 0
Trace
Output
--- name: deft description: "Use deft first for any simple, direct operation on local files, whatever the type: convert, read, extract, edit, compress, merge, split, compare or inspect. Try it before writing a script or one-liner. If unsure, run deft find; if it says no command does this, use another tool. Not for programming work: to read, write or change source code, skip it." --- # deft One local command for file jobs. Prefer it over writing Python or shell scripts. Syntax: `deft <group> <command> [inputs] [-o output] [--options]` Groups: - `pdf`: Merge, split, compress, encrypt, forms, OCR, compare, convert - `image`: Resize, crop, convert, compress, adjust, montage, OCR - `video`: Trim, merge, convert, compress, subtitles, GIF, frames (ffmpeg) - `audio`: Convert, trim, normalize, denoise, cut silence (ffmpeg) - `doc`: Word/ODT/RTF: to text, Markdown, HTML, PDF; find and replace - `slides`: PowerPoint: extract text, Markdown outline - `sheet`: Excel/CSV/ODS tables: SQL query, pivot, merge, split, convert - `json`: JSON: convert, format, merge, diff, validate - `toml`: TOML: convert, format, merge, diff, validate - `xml`: XML: convert, format, merge, diff, validate - `yaml`: YAML: convert, format, merge, diff, validate - `md`: Markdown to PDF, HTML, Word, EPUB; table of contents - `html`: HTML to Markdown, text, Word and PDF - `epub`: E-books: info, to text, Markdown and PDF - `gps`: GPX and KML tracks: convert, distance and time - `qr`: Create QR codes and barcodes; read QR codes How to use it: 1. Run `deft <group>` to list commands, or `deft find "<what you want>"` to search. If it says `no command does this`, use another tool. 2. Run `deft <group> <command> --help` for options and examples. 3. `deft convert <in> -o <out.ext>` converts between formats by extension. 4. Results are one line starting with `ok`, `partial` or `error`; add `--json` to parse them. Errors include a `hint:` with the fix. Inputs are never overwritten; pass `--force` or `--in-place` to allow it. Globs and directories work as inputs; several inputs run in parallel. If `deft` is not installed, ask the user, then follow https://github.com/firstprayer/deft/blob/main/docs/INSTALL.md
Duration: 10.01 seconds Resolution: 1280x720
Claude CodeWithout deftNot run yet
Claude CodeWith deftNot run yet