Testing Skill — Skill Validation Framework

Contract

• Every skill directory has a SKILL.md file
• Every SKILL.md has valid YAML frontmatter (name, description)
• Every SKILL.md has required sections (Contract, Anti-Patterns, Output Format)
• manifest.json lists every skill directory
• RESOLVER.md references every skill in the manifest
• No MECE violations (duplicate triggers across skills)

Phases

1. Walk skills directory. List all subdirectories containing SKILL.md.
2. Validate frontmatter. Parse YAML, check required fields.
3. Validate sections. Check for Contract, Anti-Patterns, Output Format headings.
4. Check manifest. Every skill directory must be listed in manifest.json.
5. Check resolver. Every manifest skill must have a RESOLVER.md entry.
6. Report results.

bun test test/skills-conformance.test.ts test/resolver.test.ts

Output Format

Skill Validation Report
========================
Skills found: N
Conformance: N/N pass
Manifest coverage: N/N
Resolver coverage: N/N
MECE violations: N

Issues:
- {skill}: {issue}

Anti-Patterns

• Skipping validation after adding a new skill
• Adding skills to manifest without adding to resolver
• Creating skills without the conformance template