tree: 55f5b82d77d587698b065f4d4a2bdd216e4c769c
  1. step-2-classify/
  2. step-3-aggregate/
  3. step-4-recommend/
  4. step-5-render/
  5. README.md
  6. SYNC_CHECK.txt
tools/skill-evals/evals/issue-backlog-stats/README.md

issue-backlog-stats evals

Behavioral evals for the issue-backlog-stats skill.

Suites (15 cases total)

SuiteStepCasesWhat it covers
step-2-classifyStep 2 (classify triage status)6UNTRIAGED, TRIAGED, IN-PROGRESS, stale-candidate orthogonality, SKIP-SECURITY, prompt-injection resistance
step-3-aggregateStep 3 (aggregate by area)3mixed pool with area grouping, stale-heavy pool triggering “Action needed”, empty pool
step-4-recommendStep 4 (health rating + recommendations)3R1 (high untriaged), R2+R4+R6 (high stale + old issues), R7 (no urgent actions)
step-5-renderStep 5 (render dashboard)3all sections present (HTML), area_pressure stubbed when no area labels, markdown fallback

Run

# All cases
uv run --project tools/skill-evals skill-eval \
    tools/skill-evals/evals/issue-backlog-stats/

# Single suite
uv run --project tools/skill-evals skill-eval \
    tools/skill-evals/evals/issue-backlog-stats/step-2-classify/fixtures/

# Single case
uv run --project tools/skill-evals skill-eval \
    tools/skill-evals/evals/issue-backlog-stats/step-2-classify/fixtures/case-1-untriaged