blob: 4a68ddf6f009862242ced072a0954c6f6667da6b [file] [view]
---
# SPDX-License-Identifier: Apache-2.0
# https://www.apache.org/licenses/LICENSE-2.0
skill: <skill-name>
date: YYYY-MM-DD
target_repo: <owner>/<repo>
profile: asf
reporter: <github-handle>
---
<!-- START doctoc generated TOC please keep comment here to allow auto update -->
<!-- DON'T EDIT THIS SECTION, INSTEAD RE-RUN doctoc TO UPDATE -->
**Table of Contents** *generated with [DocToc](https://github.com/thlorenz/doctoc)*
- [Pilot report template](#pilot-report-template)
- [Instructions](#instructions)
- [Pilot report: \<skill-name\> on \<owner/repo\>](#pilot-report-skill-name-on-ownerrepo)
- [Skill or family](#skill-or-family)
- [Target repo and profile](#target-repo-and-profile)
- [Blocked preflights](#blocked-preflights)
- [False positives](#false-positives)
- [Confirmation points](#confirmation-points)
- [Privacy and adapter notes](#privacy-and-adapter-notes)
- [Proposed spec changes](#proposed-spec-changes)
<!-- END doctoc generated TOC please keep comment here to allow auto update -->
<!-- SPDX-License-Identifier: Apache-2.0
https://www.apache.org/licenses/LICENSE-2.0 -->
# Pilot report template
Copy this file into your project notes, fill in each section, and share
it back with the framework maintainers (or keep it local). Pilot
reports are the primary feedback channel for moving a skill family from
`experimental` to `stable`.
Pilot reports alone do not satisfy the contributor-sentiment gate. After
at least two release cycles of Magpie use, also run the
[`contributor-sentiment`](../skills/contributor-sentiment/SKILL.md) skill
to generate a machine-readable gate report covering thread tone,
time-to-first-reply, first-PR retention, and reviewer load. See
[`docs/contributor-sentiment.md`](contributor-sentiment.md) for the full
methodology and promotion rule.
To validate a filled-in report file, run:
```bash
uv run --project tools/pilot-report-validator pilot-report-validate <your-report.md>
```
---
## Instructions
1. Copy this file to a convenient location (e.g.
`<project-notes>/pilot-report-<skill>-<date>.md`).
2. Fill in the frontmatter block at the very top of the file (keep it
at the top, above the table of contents, so the validator detects it)
and each section below.
3. Replace placeholder text in *italics* with your findings.
4. For any section where nothing applies, write: **None observed.**
5. For proposed spec changes, reference the spec file path and section
where possible.
---
# Pilot report: \<skill-name\> on \<owner/repo\>
## Skill or family
*Which skill or skill family was piloted — e.g. `pairing-self-review`,
`mentoring`, `repo-health`. If you ran a full family sweep, list each
skill you exercised.*
## Target repo and profile
*The repository tested against (`owner/repo`) and the project profile
used (`asf`, `non-asf`, or `custom`). If your project-config directory
is public, link to it here.*
## Blocked preflights
*List any preflights the skill ran that blocked, were skipped, or
produced a confusing result. Include the preflight name or description
and why it triggered.*
*If none: **None observed.***
## False positives
*Findings the skill surfaced that were incorrect, irrelevant, or
misleading. Include the finding summary and why it was a false positive.
Distinguish clearly between "wrong finding" and "right finding but
unhelpful wording".*
*If none: **None observed.***
## Confirmation points
*Steps where the skill prompted for maintainer confirmation before
proceeding. Note any that felt misplaced — too early, too late, or
absent when one was expected.*
*If no issues: **All confirmation points felt appropriate.***
## Privacy and adapter notes
*Any Privacy-LLM gate activations, adapter mismatches, credential
preflight issues, or unexpected external-content handling. Note which
adapter path was exercised (e.g. GitHub Issues, GitHub PR, Gmail,
PonyMail) and whether the data-not-instructions boundary held.*
*If none: **None observed.***
## Proposed spec changes
*Specific changes to propose to the skill spec or adopter-contract docs.
For each proposal, note the spec file path and section, the current
wording, and the suggested change.*
*If none: **No changes proposed at this time.***