Agent Loop Engineering
Version: 1.1.0
中文快速说明
Agent Loop Engineering 是一个面向 AI Coding Agent 的编码循环总控 Skill。它把用户目标、验收标准、当前状态、待办、停止规则、完成判定和每轮记录保存在项目自己的 Docs/ 目录中,让 Codex、Claude Code、OpenCode、Cline、Qoder、CodeBuddy、Trae、Gemini CLI、Aider、GitHub Actions 等不同 Agent 可以接力同一个开发工作。
核心原则:
- 状态保存在项目文件里,不依赖聊天记忆。
- Runner 可以替换,
Docs/协议不变。 - 每轮只做一个有边界的 coding loop。
- 遇到密钥、账号、生产数据、系统安装、不可逆 Git 操作、技术栈替换或方向冲突时必须停止并问人。
- 只有自动验证和功能验证等证据足够时,才可以标记
Done。 - 多 Agent 共用时必须串行写入或使用文件锁,不能同时改同一套
Docs/状态文件。 - 多 Agent 项目中,Developer 以
WORK_ORDER.md为唯一任务来源;TARGET.md只守方向,ACCEPTANCE.md只守验收,状态和日志不能扩大任务。 ACCEPTANCE.md必须保持每个活动工单一个当前验收表;重复 AC、粘贴反馈、互相竞争的 AC 段都属于Invalid State。- 涉及本地/云端、provider、feature flag、真实设备、模型或 waived 条件的工单,必须在
WORK_ORDER.md写清环境模式和 Done 前必须验证的内容。
推荐入口:
- 编码循环、长期实现、自动化 Runner、Harness Engineering、AI Coding Production System、验证门禁、停止门禁:使用
agent-loop-engineering。 - 非编码研究、资料接入、知识治理:使用
ai-workflow-os或web-search-rules。 - 用户明确说 checkpoint、收工、交接:使用
daily-workflow,但要保留 Agent Loop Engineering 的 loop evidence。
Purpose
Use this skill as the top-level controller for AI coding work only. The goal is to turn development into a managed loop:
Target -> Plan -> Implement -> Verify -> Review -> Fix -> Evaluate -> Continue or Stop
Do not rely on chat history as memory. Persist the working state in the project's own Docs/ directory so any agent can resume after context loss, a new session, or a different runner.
For non-coding workflow governance, research intake, knowledge-base work, or cross-source synthesis, use ai-workflow-os. For coding-loop control, implementation direction, stop gates, and completion gates, this skill is authoritative.
Default Coding Semantics
Unless the user explicitly asks for analysis only, review only, planning only, or discussion only, treat a coding request as a request to complete the implementation loop:
Understand target -> Implement -> Verify -> Debug failures -> Re-verify -> Evaluate -> Continue or Stop
Do not stop after only one step when a safe next action remains. Stop only at:
DoneDone with RiskBlocked- Budget exhausted
No verification means no Done. Failed verification means continue debugging, report Done with Risk with explicit limits, or stop as Blocked when a stop rule or human decision is required.
Checker Done means the project-local loop state is valid. It does not, by itself, prove the product behavior is correct. Before accepting a completion claim, use real project verification and read references/checker-and-evidence.md when strict evidence, command exit codes, or cross-repo checking are relevant.
When the user asks to absorb feedback from a real project and update the CMS process, Skill, or references, do not automatically modify that project's active Docs/ state. First classify the feedback and update the reusable Skill/reference layer unless the user explicitly asks you to act as that project's Developer, Controller, or Acceptance agent. See references/host-runtime-integration.md.
Task Classification
Classify the task before choosing workflow and file set:
| Task type | Human engineering effort | AI loop budget | Agent roles | Default workflow |
|---|---|---|---|---|
| Small task | 0.5-2 person-days | 1-3 loops | 1 agent | Single-agent loop |
| Medium task | 3-10 person-days | 3-8 loops | Developer + Evaluator | Develop + independent evaluation |
| Large project | 2+ weeks | 8+ loops | Planner + Developer + Evaluator | Phase target + feedback loops |
| Product-level project | 1+ month | Multi-phase loops | Multi-agent + Runner + Rubric | Production system / harness |
Use human engineering effort to estimate complexity. Use AI loop budget to estimate automation cost. Use agent roles to decide whether independent evaluation is needed.
For small tasks, keep governance light. For medium and larger tasks, do not rely only on developer self-evaluation. For large or product-level work, keep final direction flexible but make the current phase target and acceptance criteria strict.
Core Rule
State is stable. Runner is replaceable. Stop rules are universal.
- Store project goals, acceptance criteria, status, pending work, evaluation, and loop history in
Docs/. - Treat each agent run as one bounded loop, not an unlimited session.
- Read only the minimum project state needed for the current loop.
- Stop when a hard gate, budget gate, direction gate, or validation gate is triggered.
- Mark completion only when evidence supports it.
- Resolve state conflicts in this order:
TARGET.md->ACCEPTANCE.md->STATUS.md->PENDING.md->NEXT_ACTIONS.md. - Use canonical
Docs/file names. Legacy aliases may be read for migration, but write canonical files only. - In multi-agent work,
WORK_ORDER.mdis the Developer's only task authority.TARGET.mdguards direction and non-goals,ACCEPTANCE.mddefines evidence gates, andSTATUS.md,NEXT_ACTIONS.md,LOOP_RUNS.jsonl, or chat context must not expand scope. - Keep one current acceptance table per active work order. Duplicate acceptance IDs, raw feedback pasted into acceptance rows, or competing AC sections are
Invalid Stateuntil Controller or the project maintainer cleans them up. - Treat CMS/process rules as maintainer-owned. Ordinary Developer, Controller, or Acceptance agents may propose rule changes, but must not edit reusable CMS settings unless the user explicitly assigns that maintainer role.
- If a work order depends on local/cloud mode, provider configuration, feature flags, unavailable devices/models, or waived criteria, it must name the environment mode, authoritative config, waived reason, and mandatory validation before
Done.
Flow
Bootstrap if Docs/ is missing
-> Loop Start
-> Verify target and acceptance
-> Discover project verification commands
-> Execute one bounded implementation loop
-> Run automatic and functional verification
-> Completion or stop gate
-> Write state and user report
Related Skills
Route to existing skills only when needed:
- Use
project-lifecycle-navigatorwhenDocs/TARGET.mdis missing, the user cannot state the goal in one sentence, multiple goals conflict, or MVP boundaries are unclear. If unavailable, use the bootstrap questions inreferences/bootstrap.mdand stop for confirmation when the target remains unclear. - Use
ai-workflow-osfor multi-source research decisions, knowledge intake governance, cross-module audits, or non-coding workflow governance. Do not route pure code verification or bug-fix loops to it. If unavailable, keep coding-loop state in this skill and record unresolved governance work inDocs/PENDING.md. - Use
daily-workflowwhen the user explicitly asks to checkpoint, wrap up, recover after context loss, or create a standalone handoff. During a coding loop, keep lightweight loop updates in this skill. If unavailable, writeDocs/HANDOFF.mdusingreferences/loop-state-protocol.md. - Use
web-search-ruleswhen using external web pages, API docs, uploaded files, or other sources that require trust and provenance handling. If unavailable, use primary sources where possible and record source limits inDocs/STATUS.md. In a coding loop, write the short research conclusion toDocs/STATUS.mdcompressed context orDocs/PENDING.md; use the full intake path only when the task is research/governance-heavy.
Do not load every related skill every loop. Load the narrow skill or reference file that answers the current question.
Host Runtime And Feedback Governance
Use references/host-runtime-integration.md when:
- a product host such as OpenCode, Cursor, Cline, WebBridge, Privacy Gateway, Memory, or a local runner needs to integrate Agent Loop state;
- feedback from a dogfooding project should be promoted into reusable CMS / Skill rules;
- there is risk of confusing development-process CMS (
Docs/) with product runtime CMS (.mywork/cms/{taskId}/or an equivalent store); - a reviewer needs a standard hook contract such as
ensureState,buildSystemContext,gateAction, andrecordRun; - evidence must be separated into
code_refs,validation_refs,doc_refs, andknown_limits.
Default boundary: updating this Skill or its references is not the same as acting on a live project's loop state. Do not edit an active project's Docs/ records unless that is the explicit current role and task.
Required Project State
Use project-local Docs/ files. Create missing files conservatively from the schemas in references/loop-state-protocol.md.
CMS Lite v0.1 test mode starts with this required state set:
Docs/TARGET.mdDocs/ACCEPTANCE.mdDocs/LOOP_STATE.mdDocs/LOOP_LOG.jsonl
Use the templates in templates/TARGET.md, templates/ACCEPTANCE.md, templates/LOOP_STATE.md, and templates/LOOP_LOG.example.jsonl when bootstrapping a new CMS Lite test task.
For CMS Lite testing, audit, or cross-agent review, create Docs/LOOP_LOG.jsonl from templates/LOOP_LOG.example.jsonl. This log records observable decision and evidence trace only: scenario guess, skill/templates used, files read or written, commands run, evidence collected, and checker result. Do not record hidden chain-of-thought.
After each CMS Lite test loop, run scripts/agent-loop-check.ps1 against the project workspace. The checker validates the four test-mode files, state enum, Done evidence, Continue next action, Blocked reason, stop-rule conflict, JSONL log fields, scenario guess, rough code size, and optional strict verification evidence. Treat Invalid State as a system state that must be repaired before continuing.
Use scripts/agent-loop-check.ps1 -Strict when judging Done. Strict mode requires machine-readable verification commands with successful exit codes in Docs/LOOP_LOG.jsonl.
For expanded/full Docs/ projects, use the read-only health checker when CMS state changed:
node scripts/agent-loop-health-check.mjs --workspace "D:\path\to\project"
It checks duplicate acceptance IDs, WORK_ORDER.md environment-note gaps, LOOP_RUNS.jsonl JSONL health, and obvious completion-gate contradictions. Checker errors mean Invalid State; the checker must not auto-edit project files.
Split Docs/LOOP_STATE.md into STATUS.md, NEXT_ACTIONS.md, PENDING.md, EVALUATION.md, and LOOP_RUNS.jsonl only when the task grows beyond CMS Lite or needs long-running handoff, runner automation, auditability, or multi-agent coordination.
Expanded or full protocol reused files:
Docs/TARGET.mdDocs/STATUS.mdDocs/PENDING.mdDocs/NEXT_ACTIONS.mdDocs/HANDOFF.mdwhen a standalone handoff is needed
Expanded or full Agent Loop Engineering files:
Docs/LOOP_CONFIG.mdDocs/ACCEPTANCE.mdDocs/EVALUATION.mdDocs/STOP_RULES.mdDocs/LOOP_RUNS.jsonlDocs/COMPLETED.md
Canonical file names are TARGET.md, STATUS.md, COMPLETED.md, PENDING.md, NEXT_ACTIONS.md, and HANDOFF.md. Read legacy aliases only for migration, such as PROJECT_TARGET.md, PROJECT_STATUS.md, COMPLETED_JOBS.md, PENDING_JOBS.md, NEXT_STEPS.md, or SCHEDULE.md; after migration, write the canonical files.
If Docs/ does not exist or both Docs/TARGET.md and Docs/ACCEPTANCE.md are missing, follow references/bootstrap.md before coding.
Loop Start
At the start of each loop:
- Read
Docs/LOOP_CONFIG.mdif it exists; otherwise use the default budget below. - Check file consistency using the priority order in Core Rule.
- Read
Docs/TARGET.mdandDocs/ACCEPTANCE.md. - Read only the latest compressed context in
Docs/STATUS.md. - Read only Immediate and Blockers sections from
Docs/PENDING.md. - Read
Docs/NEXT_ACTIONS.md. - Read project manifests such as
package.json,pyproject.toml,Makefile,Cargo.toml,go.mod,pom.xml, or repository docs to identify test, lint, build, typecheck, and functional verification commands. Record discovered commands inDocs/LOOP_CONFIG.md. - If the target or acceptance criteria are missing, create or propose them before coding.
- If the next action conflicts with the target, stop and ask for direction unless the user explicitly requested a target revision.
For role-based multi-agent projects, use the smaller role entry set when present:
| Role | Minimum project state |
|---|---|
| Developer | ACTIVE_LOOP.md, WORK_ORDER.md, STOP_RULES.md, relevant ACCEPTANCE.md rows, relevant TARGET.md non-goals |
| Controller / Evaluator | TARGET.md, ACCEPTANCE.md, WORK_ORDER.md, LOOP_CONFIG.md, STOP_RULES.md, latest 3-5 LOOP_RUNS.jsonl records |
| Acceptance / QA | ACCEPTANCE.md, REVIEW.md or evaluator notes, EVALUATION.md, evidence paths, latest 3-5 LOOP_RUNS.jsonl records |
If those files disagree about scope or status, report Invalid State instead of guessing.
Default budget:
protocol_version: 1
runner: generic
max_loops: 5
max_consecutive_failures: 2
max_runtime_minutes: 60
max_context_files_per_loop: 8
max_recent_loop_records: 5
require_double_evidence_for_done: true
core_verification: test
max_compressed_context_lines: 40
log_directory: .agent/logs
verification_commands:
test: null
typecheck: null
build: null
lint: null
functional: null
progress_signals:
- new passing verification
- narrower failing scope
- changed root cause with evidence
- implemented accepted next action
allow_parallel_tasks: false
allow_project_dependency_install: true
allow_project_config_changes: true
allow_system_install: false
allow_secret_access: false
allow_production_data_access: false
allow_destructive_changes: false
max_consecutive_failures counts only consecutive failures of core_verification. If core verification fails but a configured progress signal is present, do not increment the consecutive failure count for that loop. Other verification failures must be recorded in Docs/EVALUATION.md, but they do not consume this budget unless Docs/LOOP_CONFIG.md defines a stricter project-specific rule.
For simple bug fixes, use 3-5 loops. For multi-file features, 8-10 loops may be reasonable. Keep max_loops below 20 unless the user explicitly approves a longer run.
Loop Execution
For coding work, run one bounded cycle:
Select next action -> Implement minimal change -> Run verification -> Review result -> Fix if safe -> Evaluate status
The agent may automatically handle project-local problems listed in references/environment-escalation.md. The agent must stop and ask a human for anything outside that whitelist.
At the end of every loop, update the touched acceptance criteria in Docs/ACCEPTANCE.md under Current evidence. If a criterion is blocked, name the unmet criterion ID or heading in Docs/EVALUATION.md and Docs/PENDING.md.
Loop-end write contract:
- Append the gate decision and evidence to
Docs/EVALUATION.md. - Update
Docs/STATUS.mdcompressed context and latest verification. - Update
Docs/ACCEPTANCE.mdcurrent evidence for touched criteria. - Preserve blockers and decisions in
Docs/PENDING.md. - Keep exactly one immediate continuation in
Docs/NEXT_ACTIONS.md. - Append completed items to
Docs/COMPLETED.mdwhen a user-visible or verification-backed unit is finished. - Append one concise record to
Docs/LOOP_RUNS.jsonl.
Keep loop records concise and preferably runner-generated. Store command, result, key error summary, and artifact path; do not duplicate long logs, chat history, or repeated status across multiple files.
daily-workflow may create broader checkpoint or handoff summaries when explicitly triggered by the user, but it should not replace the loop-end write contract above.
If the user changes direction, classify it before editing:
scope_expansion: affects no more than 2Must Passitems and does not changeNon-Goals. Add or adjust affectedDocs/ACCEPTANCE.mditems and record the expansion inDocs/EVALUATION.md.target_revision: changes the user goal, changes anyNon-Goals, replaces the verification strategy, or affects more than 2Must Passitems. UpdateDocs/TARGET.md, regenerate affected acceptance criteria, append atarget_revisionentry toDocs/EVALUATION.md, and continue only after the new target is unambiguous.
If the classification is ambiguous, stop and ask.
Context Budget
Use progressive reading:
- Always start from the minimum
Docs/set. - Read
Docs/LOOP_RUNS.jsonlonly for the last 3-5 records unless debugging loop behavior. - Do not paste full logs into context. Record command, result, key error summary, and log path.
- Do not paste full conversation transcripts into
Docs/STATUS.md. - Keep
Docs/STATUS.mdto the latest 5-10 updates and archive older material. - Read detailed reference files only when their decision surface is active.
Read references/context-budget.md when context size becomes a risk or when designing a long-running loop.
Read references/checker-and-evidence.md when validating Done, adding strict evidence gates, running cross-repo checks, or explaining why checker Done does not equal product completion.
Read references/automation-runner.md when the user asks to add scheduled, repeated, local, CI, or runner-driven automation around the loop.
Read references/harness-engineering.md when designing a multi-agent AI coding harness with Planner / Developer / Evaluator separation, rubric scoring, quality vision, environment observability, or long-running feedback loops.
Read references/ai-coding-production-system.md when designing or auditing the control system for long-running, high-risk, multi-agent, production-grade, or quality-critical AI coding work.
Stop Rules
Stop immediately and report Blocked when the loop needs:
- Secrets, credentials, OAuth, account login, or browser session access.
- Production databases, real user data, paid cloud resources, or external account changes.
- System-level installs, administrator permissions, drivers, or host-level configuration.
- Destructive, irreversible, migration, deletion, overwrite, force-push, reset, history-rewrite, or other irreversible Git operations.
- Technology-stack replacement or major framework upgrade.
- A direction change that conflicts with
Docs/TARGET.md.
The built-in hard stops in this section and references/environment-escalation.md are authoritative. Docs/STOP_RULES.md may add stricter project rules. It may not loosen hard stops unless a human approval is recorded under Docs/STOP_RULES.md -> Overrides with scope and expiration, and that override still cannot permit secret exposure, production data access, or irreversible action without explicit human confirmation for that run.
The allow_* flags in Docs/LOOP_CONFIG.md cannot override hard stops. They only control whether otherwise safe, project-local whitelist actions are allowed by default.
Stop on budget when:
max_loopsis reached.max_consecutive_failuresis reached.max_runtime_minutesis reached.- Context cannot be reduced enough to continue safely.
Record every stop in Docs/EVALUATION.md, Docs/PENDING.md, Docs/NEXT_ACTIONS.md, and Docs/LOOP_RUNS.jsonl.
When max_context_files_per_loop would be exceeded, queue optional reads, summarize already-read material first, and continue only if the loop can still be completed safely. If the agent cannot decide without exceeding the budget, stop as Blocked.
Completion Gate
Use only these states:
Done: all success criteria are satisfied and at least two evidence classes support completion, including automatic verification and functional verification.Done with Risk: the core goal is met, but there are explicit unverified edges, skipped checks, or environment limits.Blocked: work cannot continue or completion cannot be judged without human input, permission, credentials, environment access, or a direction decision.Continue: bounded next action exists and no stop rule is triggered.
Read references/completion-gate.md before declaring Done or Done with Risk.
Before ending any loop, run the checklist in references/self-check.md.
Runner Adapters
This skill is runner-neutral. Use references/runner-adapters.md when adapting the loop to Codex, Claude Code, OpenCode, Cline, Qoder, CodeBuddy, Trae, Gemini CLI, Aider, GitHub Actions, or a local scheduler.
Use references/automation-runner.md when designing the outer automation mechanism that repeatedly starts one-loop agent runs, parses stop states, enforces budgets, and stops on human gates.
Use references/harness-engineering.md when the runner coordinates specialized agents, rubric evaluators, UI/E2E evidence, quality anchors, or stop-on-low-gain rules.
Use references/ai-coding-production-system.md when the runner needs production-system controls such as standard work, built-in quality, hazard analysis, critical control points, traceability, independent audit, or continuous improvement.
All adapters must:
- Load state from
Docs/. - Respect stop rules.
- Write evaluation and loop records before exiting.
- Avoid product-specific assumptions in project state files.
User Report
For each loop, report concisely:
Loop status: Continue / Done / Done with Risk / Blocked
- Target alignment:
- Work completed:
- Verification:
- Risks/blockers:
- Files updated:
- Next action:
Use the user's language by default.
The chat report is for the user. Also append the decision and evidence to Docs/EVALUATION.md.
