Build Iterated Agentic Loop
Use this skill when the user wants to turn a repeatable agent task into a repo-local skill plus a GitHub Actions workflow that runs a coding agent on a schedule, manually, or both.
The target shape is an iterated agentic loop: a focused skill defines the agent's judgement, a workflow invokes a coding agent with a repo-specific prompt, an agent-memory file carries standing feedback between runs, and each workflow labels its PRs so only one open PR exists per loop. The
skill is the concrete reference pattern.
Outputs
Create or update these files in the target repo:
.claude/skills/<skill-name>/SKILL.md
for the repo-local agent behavior.
.github/workflows/agent-<task-name>.yml
for the recurring coding-agent automation.
.github/agent-memory/<task-name>.md
for stable feedback and scope constraints.
- Optional references under
.claude/skills/<skill-name>/references/
when the skill needs templates, examples, or long supporting material.
Workflow
1. Explore the target repo
Read before asking setup questions:
- Existing and to understand runner, checkout, dependency install, cache, and PR patterns.
- Package manager files such as , , , , , , , or , or other package management-related files
- Existing validation scripts, especially typecheck, lint, test, quality, format, and package-scoped commands.
- Existing and to avoid duplicating conventions.
Completion criterion: you can name the repo's package manager, install command, likely validation commands, and existing workflow conventions.
2. Ask setup questions
Walk the user through these decisions. Recommend defaults from repo evidence instead of presenting a blank form.
- Coding Agent: Claude Code, Codex, OpenCode, or CodeLayer. Explain the required secret and headless command for the recommended choice. Use
references/agent-runner-templates.md
. CodeLayer is Humanlayer's ultra-lightweight agent harness.
- Cadence: daily, weekly, weekdays, monthly, manual-only, or custom cron. Recommend a cadence based on task risk and review burden - most likely weekdays, daily, or weekly.
- Task: What task should the agent loop accomplish?
- Are there existing skills for doing this? (you can do research before asking the user this)
- Ask the user if you should look at recent PRs, git history, or other particular parts of the codebase for reference.
- Scope: which directories/packages the loop may change and which it may only inspect
- Validation: which commands must pass before the agent commits (You should propose this to the user based on your earlier research and ask them to confirm)
- PR bounding: Ask if scheduled runs should no-op when open PRs from this agent already exist, and if so, how many open PRs to allow before blocking new runs.
- Recommended: Yes, bound to 1 open PR per agent loop. This prevents the agent from creating unbounded work that piles up faster than humans can review. Without bounding, a daily agent could generate 5+ unreviewed PRs in a week, creating review fatigue and merge conflicts.
- The workflow uses a label (e.g., ) to identify PRs from each agent loop. Scheduled runs check
gh pr list --label <label> --state open
and skip if the count meets or exceeds the bound.
- Manual runs bypass the bound check, allowing forced runs when needed.
- PR metadata: label name, PR title prefix, and branch prefix.
- Suggest
[MM/DD][Agent: <Agent Name>]: <Concise Description>
as a template, e.g. [6/23][Agent: Effect Migrator]: Migrate XYZ module
- Response format: How should the CI agent format its final response (which becomes the PR body)?
- Show the user
references/response-template.md
for examples (fix/migration, generation, refactor).
- Ask what information reviewers need: summary stats, risk levels, verification steps, file lists, etc.
- Create a customized response template that the generated skill will reference in its directory
- Iteration behavior: whether comments should update the existing PR.
- If enabled, install
references/agent-iteration.ts
to the repo. Ask the user's preferred location: , , or .
- The script has two modes: (adds the PR body marker) and (builds the iteration prompt from PR context).
- If disabled, remove the trigger and iteration-only steps from the workflow.
Completion criterion: every placeholder in the workflow, prompt, and memory template has a chosen value or an explicit default.
3. Define the agent job
Extract the smallest repeatable job the agent should perform. Work through these three questions with the user:
What are we finding? How does the agent identify targets for this run?
- A CLI tool that reports issues (e.g., , )
- A search pattern (e.g., files matching without coverage, components using deprecated APIs)
- A diff or changelog (e.g., new dependencies since last release, changed files in a PR)
- An old pattern that should be replaced with a new pattern or migrated to a new framework
- A flaky test based on previous CI runs
What are we changing? What transformation does the agent apply to each target?
- Fix: resolve a reported issue in place
- Migrate: update code from one pattern to another
- Generate: create new files based on existing sources
- Refactor: restructure without changing behavior
How do we validate? What proves the change is correct?
- Build/typecheck passes
- Tests pass (or a specific subset)
- The same tool that found the issue now reports it resolved
- Linting or formatting checks pass
Completion criterion: you can state the job in one sentence, e.g., "Find 5 react-doctor violations, fix them, and verify typecheck and quality pass."
4. Write the skill
Write a repo-local skill that captures the agent's judgement for this task. The skill can include repo-specific paths, package names, and conventions since it lives in this repository.
Use these skill-writing rules:
- Put ordered behavior in in the skill directory ( or depending on repo patterns and user preferences) steps with checkable completion criteria
- Move long templates and examples into sibling reference files, then point to them from .
- Keep one source of truth for each rule; do not repeat the same guidance in the skill, prompt, and memory file.
- Include a response template as a reference file (e.g.,
references/response-template.md
under the skill directory) that defines how the CI agent should format its final output. The skill should instruct the agent to read and follow this template when formatting its final response which will be used as the PR body.
- Use the skill template in
references/skill-template.md
. An EXAMPLE skill can be found in references/example-skill.md
- You may refer to https://agentskills.io/specification to understand skill specification.
IMPORTANT: the
field in the
frontmatter must match the skill slug - e.g. a skill with name
must be in
.claude/skills/fix-eslint-issues/SKILL.md
or
.agents/skills/fix-eslint-issues/SKILL.md
Completion criterion: the skill explains how to do the job clearly enough that the agent can follow it without additional prompting, including how to format the final response.
5. Write the workflow prompt
Put repo-specific targeting in the GitHub Actions prompt, not in the generic skill. Include:
Begin by using the <skill-name> skill.
- Scope: directories/packages the agent may change and may inspect.
- Instructions: the reviewable unit of work, what to avoid, and how to validate.
- Validation commands in fenced bash if applicable
- Agent memory interpolation from
.github/agent-memory/<task-name>.md
.
- Finishing requirements: validate, commit, push, and return a PR-ready summary.
Use
references/workflow-template.yml
as the base template. Use
references/prompt-template.md
when drafting the embedded prompt.
Completion criterion: the prompt contains all repo-specific constraints needed for an unattended run.
6. Install the memory file
Create
.github/agent-memory/<task-name>.md
using
references/memory-template.md
as a starting point. The memory file carries standing feedback that should affect future runs. Keep it short.
Good memory entries:
- Permanent scope exclusions.
- Known false-positive areas.
- Review feedback that should change future agent selection.
Bad memory entries:
- One-off task instructions.
- Validation output from a single run.
- Rules already stated in the skill.
Completion criterion: deleting the memory file would lose useful future-run context, not just history.
7. Create the workflow
Create
.github/workflows/agent-<task-name>.yml
from
references/workflow-template.yml
and replace every placeholder.
Required customizations:
- Workflow name, cron, branch prefix, workflow id, agent label, PR title.
- Runner label and setup steps for the repo.
- Dependency install command.
- Coding-agent install, secret, and headless run command (from
references/agent-runner-templates.md
).
- Response extraction step: each agent outputs differently (JSON, stream-json, plain text). Use the agent-specific extraction from
references/agent-runner-templates.md
to get the final response into for the PR body.
- Skill name, scope, validation commands, and memory path.
- PR bounding gate: the workflow checks for open PRs with the agent label before running. Configure the bound based on the user's choice from step 2 (default: 1). The gate uses
gh pr list --label "$AGENT_LABEL" --state open
and compares the count. If bounding is disabled, remove the gate step entirely.
- If is enabled: install
references/agent-iteration.ts
to the user's preferred location and update the workflow paths to match. The script handles both PR footer generation and iteration prompt building. This file can be run with the user's preferred typescript toolchain (node with type-stripping, Bun (recommended), Deno, tsx, etc) or can at the user's request be rewritten into another language.
If
is disabled, remove the
trigger, the iteration-only steps, and skip installing
.
Completion criterion: the workflow can run from
without relying on files that do not exist.
8. Validate and verify
Validate workflow YAML: Before committing, parse the workflow file to catch syntax errors early. Use one of:
bash
# Node.js / bun (js-yaml)
bunx js-yaml .github/workflows/agent-<task-name>.yml > /dev/null && echo "Valid YAML"
# Python
python -c "import yaml; yaml.safe_load(open('.github/workflows/agent-<task-name>.yml'))"
# yq (if installed)
yq eval '.name' .github/workflows/agent-<task-name>.yml
If the parser fails, fix the YAML syntax before proceeding.
Verify references and paths: Check that every path named by the skill, workflow, and memory file exists or is intentionally created by this task.
Completion criterion: the workflow YAML parses without errors and all referenced files exist.
9. Dry-run the workflow
GitHub Actions workflows cannot be manually dispatched via
until they have run at least once. To bootstrap the workflow:
-
Temporarily add a
trigger for the current branch (if not main):
yaml
on:
push:
branches:
- <current-branch-name> # Remove after first run
schedule:
- cron: "0 13 * * *"
workflow_dispatch:
# ...
-
Commit and push all the new files (workflow, skill, memory file, scripts).
-
The workflow will trigger on push. Watch the Actions tab to verify it runs successfully.
-
After the first successful run, remove the temporary
trigger and push again. The workflow can now be dispatched manually via the Actions UI or
.
-
If the dry-run creates a PR, review it to verify the agent behavior, then close or merge as appropriate.
Completion criterion: the workflow appears in the Actions tab and can be triggered via
.
Reference Files
references/workflow-template.yml
- coding-agent GitHub Actions workflow skeleton.
references/agent-runner-templates.md
- headless commands and secrets for Claude Code, Codex, OpenCode, and CodeLayer.
references/agent-iteration.ts
- helper script for support (PR footer and iteration prompt building). Install to , , or based on user preference.
references/prompt-template.md
- embedded prompt structure for the workflow.
references/memory-template.md
- agent-memory file skeleton.
references/skill-template.md
- skill skeleton for the generated task skill.
references/response-template.md
- examples for how the CI agent should format its final response (PR body).
references/example-skill.md
- example skill