Evals / config

Validate

1 scenario, 1 run by an agent. Each run shows its result, time and new tokens.

ScenarioCodexwithout deftCodexwith deft, skill installedClaude Opus 5.5without deftClaude Opus 5.5with deft, skill installedClaude Codewithout deftClaude Codewith deft
Validate against a schemaDoes config.yaml have a service object? Make schema.json requiring one, then validate config.yaml against it and write yes or no to result.txt.pass21s · 7.6kpass28s · 13.3kpass18s · 9.2kpass18s · 9.5knot runnot run