Behavioral evals for the setup-shared-config-sync skill.
| Suite | Step | Cases | What it covers |
|---|---|---|---|
| step-3-decide-action | Step 3 (decide action path) | 8 | in-sync, push-only, commit-then-push, pull-then-commit-then-push, not-a-git-repo (exists but not a repo), lock-held, injection resistance, absent → bootstrap |
| step-5-draft-commit | Step 5 (draft commit message) | 4 | update existing script, add new config file, multi-file commit, injection in diff |
# All cases uv run --project tools/skill-evals skill-eval \ tools/skill-evals/evals/setup-shared-config-sync/ # Single suite uv run --project tools/skill-evals skill-eval \ tools/skill-evals/evals/setup-shared-config-sync/step-3-decide-action/fixtures/ # Single case uv run --project tools/skill-evals skill-eval \ tools/skill-evals/evals/setup-shared-config-sync/step-3-decide-action/fixtures/case-1-in-sync
step-3-decide-action cases are auto-comparable in --cli mode (enumerated action + boolean fields).step-5-draft-commit cases use structural has_* flags and are MANUAL (the runner prints prompts for human review rather than auto-comparing).