traceknot
Compare original and translation side by side
🇺🇸
Original
English🇨🇳
Translation
ChineseTraceknot
Traceknot
Evidence-bound QA for coding agents.
Run a host-neutral QA process. The harness owns agents, models, task graphs, concurrency, retries, worktrees, lifecycle, and final task completion. This Skill owns test analysis, verification obligations, evidence evaluation, defects, residual risk, and the QA verdict.
QA PASS面向编码Agent的基于证据的QA流程
运行与宿主无关的QA流程。Harness负责管理Agent、模型、任务图、并发、重试、工作树、生命周期及最终任务完成。本Skill负责测试分析、验证义务、证据评估、缺陷处理、残余风险评估及QA结论。
QA PASSTest principles
测试原则
Apply these guardrails throughout the workflow:
- Testing demonstrates defects and confidence; it does not prove defect absence.
- Exhaustive testing is infeasible; select tests from product risk and test basis.
- Analyze testability early, before implementation choices hide defects.
- Expand regression around defect clusters and repeatedly changed surfaces.
- Refresh tests and techniques when repeated checks stop revealing new information.
- Select techniques for the product, change, and operational context.
- A technically green build is not PASS when user or business acceptance criteria remain unmet.
在整个工作流程中遵循以下准则:
- 测试用于发现缺陷并建立信心,但无法证明不存在缺陷。
- exhaustive testing不可行;需基于产品风险和测试基准选择测试用例。
- 在实现决策隐藏缺陷前,尽早分析可测试性。
- 围绕缺陷集群和频繁变更的范围扩展回归测试。
- 当重复检查无法发现新问题时,更新测试方法和技术。
- 根据产品、变更及运营场景选择测试技术。
- 若用户或业务验收标准未满足,技术上的绿色构建不等于PASS。
Workflow
工作流程
1. Establish the test basis
1. 确立测试基准
Read repository instructions, build metadata, requirements, acceptance criteria, issue or defect context, public contracts, architecture invariants, security rules, and release policy. Assign a stable ID to every relevant basis item.
If no explicit acceptance criteria exist, derive observable criteria from the request and mark them as derived. Do not silently invent product behavior.
See .
references/test-process.md读取仓库说明、构建元数据、需求、验收标准、问题或缺陷上下文、公共契约、架构不变量、安全规则和发布策略。为每个相关基准项分配一个稳定ID。
若不存在明确的验收标准,需从需求中推导可观察的标准并标记为“推导得出”。不得凭空捏造产品行为。
详见。
references/test-process.md2. Challenge the declared risk universe
2. 挑战已声明的风险范围
Perform the universal cheap trigger scan in before finalizing product-risk classification. Every QA run records the scan, including an initially classified or change. A lower initial classification never exempts a material trigger.
references/adversarial-risk-discovery.mdR0R1Escalate to a bounded adversarial challenge for or , a material trigger, unknown scope, synthetic evidence that bypasses the changed contract, or an affected defect cluster. Use only runtime-advertised capabilities and select , , or execution guidance only from the capability handshake; see . Multi-agent execution is optional; a separate or current-context challenge remains valid when its independence limit is reported.
R2R3single-contextompcodexreferences/adversarial-risk-discovery.mdDistinguish coverage gaps, source candidates, confirmed defects, policy questions, non-applicable profiles, capability limits, and duplicate clusters. Promote material source candidates to confirmation obligations rather than calling unexecuted source reasoning a confirmed defect.
在最终确定产品风险分类前,执行中的通用低成本触发扫描。每次QA运行都需记录扫描结果,包括初始分类为或的变更。初始分类较低并不意味着可豁免重大触发项。
references/adversarial-risk-discovery.mdR0R1对于或级变更、重大触发项、未知范围、绕过变更契约的合成证据,或受影响的缺陷集群,需升级为有边界的对抗性挑战。仅使用运行时公开的能力,并仅根据能力握手选择、或执行指引;详见。多Agent执行为可选操作;当报告其独立性限制时,单独或当前上下文的挑战仍然有效。
R2R3single-contextompcodexreferences/adversarial-risk-discovery.md区分覆盖缺口、候选缺陷源、已确认缺陷、政策问题、不适用的配置文件、能力限制及重复集群。将重大候选缺陷源升级为确认义务,而非将未执行的源推理视为已确认缺陷。
3. Analyze product risk
3. 分析产品风险
Classify each affected surface:
- : documentation or inert metadata.
R0 - : localized low-impact implementation.
R1 - : runtime behavior, persistence, UI, concurrency, security, compatibility, or public contract.
R2 - : release, migration, destructive operation, production infrastructure, or unknown material scope.
R3
Unknown scope resolves upward. Record impact, likelihood, affected basis IDs, trigger-scan findings, and rationale. Use for repeatable decisions.
references/risk-classification.md对每个受影响的范围进行分类:
- :文档或惰性元数据。
R0 - :本地化低影响实现。
R1 - :运行时行为、持久化、UI、并发、安全、兼容性或公共契约。
R2 - :发布、迁移、破坏性操作、生产基础设施或未知重大范围。
R3
未知范围向上归类。记录影响程度、发生概率、受影响的基准ID、触发扫描结果及理由。使用确保决策的可重复性。
references/risk-classification.md4. Derive test conditions and techniques
4. 推导测试条件与技术
For every material basis or risk item, create at least one observable test condition with an expected result. Select techniques appropriate to the surface: equivalence partitions, boundary values, decision tables, state transitions, scenarios, negative tests, error guessing, compatibility, recovery, concurrency, or regression.
Use . Maintain bidirectional traceability:
references/test-techniques.mdtext
test basis ↔ risk ↔ test condition ↔ obligation ↔ evidence ↔ defect针对每个重大基准或风险项,创建至少一个带有预期结果的可观察测试条件。选择适合该范围的技术:等价类划分、边界值分析、决策表、状态转换、场景测试、负面测试、错误猜测、兼容性测试、恢复测试、并发测试或回归测试。
使用。维护双向可追溯性:
references/test-techniques.mdtext
test basis ↔ risk ↔ test condition ↔ obligation ↔ evidence ↔ defect5. Build mandatory verification obligations
5. 构建强制验证义务
Each obligation declares:
- stable ID and linked condition IDs;
- evidence type and expected result;
- mandatory or optional status;
- required execution surface;
- minimum independence level;
- entry criteria;
- completion criteria.
The Skill declares evidence requirements, not how the harness creates agents. The harness MAY satisfy independent evidence with a reviewer, isolated context, deterministic verifier, CI job, external approval, or another mechanism.
Minimum independence levels:
self-checkseparate-verification-contextindependent-producerexternal-approval
Default minimums: R0=, R1=, R2=, R3= plus explicit risk acceptance for unresolved material risk.
self-checkseparate-verification-contextindependent-producerindependent-producer每个义务需声明:
- 稳定ID及关联的条件ID;
- 证据类型及预期结果;
- 强制或可选状态;
- 所需执行范围;
- 最低独立级别;
- 进入标准;
- 完成标准。
Skill仅声明证据要求,不规定Harness如何创建Agent。Harness可通过评审人员、隔离上下文、确定性验证器、CI作业、外部审批或其他机制满足独立证据要求。
最低独立级别:
self-checkseparate-verification-contextindependent-producerexternal-approval
默认最低级别:R0=,R1=,R2=,R3=加上针对未解决重大风险的明确风险接受。
self-checkseparate-verification-contextindependent-producerindependent-producer6. Check entry criteria
6. 检查进入标准
Before execution confirm the target snapshot, environment, dependencies, test data, expected results, and required tools are available. A missing mandatory prerequisite makes the obligation , not PASS.
BLOCKED执行前确认目标快照、环境、依赖项、测试数据、预期结果及所需工具已就绪。缺失强制前置条件会导致义务标记为,而非PASS。
BLOCKED7. Execute and capture evidence
7. 执行并捕获证据
- Investigation: run the experiment and preserve its observed output.
- UI change: exercise the changed flow in a real browser and inspect the rendered result.
- Bug fix: reproduce the defect first, then rerun the same reproduction after the fix.
- Feature or API: execute tests covering the observable contract; add a test only for a new contract not already covered.
- Persistence or concurrency: test transaction boundaries, rollback, recovery, races, and stale operations as applicable.
- Release or infrastructure: run the repository's canonical release or deployment gate.
- Published Korean or English prose: apply the configured language-specific audit, and if remediation occurred, independently verify protected content and change boundaries. See .
references/prose-quality.md
Start with the direct changed path, then broaden to package or repository gates when shared contracts, public APIs, persistence, concurrency, security, build, or release behavior changed.
Record command or scenario identity, target snapshot, timestamps, exit status, structured counts, relevant output, artifacts, producer kind, and linked obligation ID. A timeout, cancellation, unavailable dependency, missing output, or unfinished mandatory obligation is not a pass.
- 调查:运行实验并保存观测输出。
- UI变更:在真实浏览器中执行变更流程并检查渲染结果。
- 缺陷修复:先复现缺陷,修复后再重新执行相同的复现步骤。
- 功能或API:执行覆盖可观察契约的测试;仅为未覆盖的新契约添加测试。
- 持久化或并发:根据情况测试事务边界、回滚、恢复、竞争条件及过期操作。
- 发布或基础设施:运行仓库的标准发布或部署闸门。
- 已发布的韩文或英文文案:应用配置的语言特定审计;若进行了修复,需独立验证受保护内容及变更边界。详见。
references/prose-quality.md
从直接变更路径开始,当共享契约、公共API、持久化、并发、安全、构建或发布行为发生变更时,扩展至包或仓库闸门。
记录命令或场景标识、目标快照、时间戳、退出状态、结构化统计、相关输出、工件、生产者类型及关联的义务ID。超时、取消、依赖项不可用、输出缺失或未完成的强制义务均不视为通过。
8. Record and manage defects
8. 记录与管理缺陷
Record every material anomaly using . Include expected and actual results, reproduction, severity, priority, environment, evidence links, owner, status, and disposition. Confirm fixes with the original reproduction and appropriate regression.
references/defect-lifecycle.md使用记录每个重大异常。包括预期与实际结果、复现步骤、严重程度、优先级、环境、证据链接、责任人、状态及处理方式。通过原始复现步骤及适当的回归测试确认修复效果。
references/defect-lifecycle.md9. Evaluate exit criteria and residual risk
9. 评估退出标准与残余风险
All mandatory obligations must reach a terminal state. Evaluate open defects, accepted exceptions, untested risks, coverage gaps, unavailable evidence, deviations, and regression scope.
Verdicts:
- : every mandatory obligation passed and no unaccepted material defect or residual risk remains.
PASS - : mandatory obligations passed and every remaining material risk has explicit, unexpired acceptance.
PASS_WITH_ACCEPTED_RISK - : a mandatory obligation failed or an unaccepted material defect remains.
FAIL - : a mandatory prerequisite or capability was unavailable.
BLOCKED - : mandatory work has not reached a terminal result.
INCOMPLETE
Precedence is → → → → .
FAILBLOCKEDINCOMPLETEPASS_WITH_ACCEPTED_RISKPASS所有强制义务必须达到终端状态。评估未解决的缺陷、已接受的例外情况、未测试的风险、覆盖缺口、不可用的证据、偏差及回归范围。
结论:
- :所有强制义务通过,且无未接受的重大缺陷或残余风险。
PASS - :强制义务通过,且所有剩余重大风险均有明确、未过期的接受记录。
PASS_WITH_ACCEPTED_RISK - :某一强制义务未通过,或存在未接受的重大缺陷。
FAIL - :强制前置条件或能力不可用。
BLOCKED - :强制工作未达到终端结果。
INCOMPLETE
优先级顺序为 → → → → 。
FAILBLOCKEDINCOMPLETEPASS_WITH_ACCEPTED_RISKPASS10. Produce the completion report
10. 生成完成报告
Follow . Report scope, basis, discovery mode and triggered profiles, risks, conditions, obligations, evidence, defects, deviations, coverage, material unknowns, capability limits, residual risk, exact commands or scenarios, observed counts, unavailable evidence, and final verdict. Separate observed facts from inference.
references/completion-report.md遵循。报告范围、基准、发现模式及触发的配置文件、风险、条件、义务、证据、缺陷、偏差、覆盖范围、重大未知项、能力限制、残余风险、具体命令或场景、观测统计、不可用的证据及最终结论。区分观测事实与推论。
references/completion-report.mdHost capability rule
宿主能力规则
Default to . A runtime handshake MAY advertise command execution, browser execution, artifact capture, snapshot binding, independent evidence, evidence persistence, or exception approval. The host name or model name never implies a capability or producer independence.
evidence-onlyThe Skill never:
- creates, selects, retries, stops, or coordinates subagents;
- chooses models or concurrency limits;
- owns task, job, mailbox, worktree, or delivery policy;
- infers global completion from task, turn, agent, or subagent terminal events;
- fabricates receipts, signatures, hashes, evidence, defects, or approvals;
- enables harness completion enforcement.
默认使用模式。运行时握手可声明命令执行、浏览器执行、工件捕获、快照绑定、独立证据、证据持久化或例外审批能力。宿主名称或模型名称绝不暗示任何能力或生产者独立性。
evidence-only本Skill绝不会:
- 创建、选择、重试、停止或协调子Agent;
- 选择模型或并发限制;
- 负责任务、作业、邮箱、工作树或交付策略;
- 从任务、轮次、Agent或子Agent的终端事件推断全局完成状态;
- 伪造收据、签名、哈希值、证据、缺陷或审批;
- 启用Harness完成强制执行。
Optional system integration
可选系统集成
The sibling validates canonical QA records and resolves deterministic QA verdicts. contains optional lifecycle, quiescence, lease, receipt, and terminal-authority contracts for hosts that explicitly integrate them. Ordinary Skill use does not require or activate that extension. Existing deterministic v1 callers can technically omit discovery because the v1 contracts do not enforce it; such runs are outside portable Skill compliance and must disclose the omission rather than claim discovery completed. This does not change , , or deterministic core semantics.
../system/core/../system/extensions/harness-completion-authority/verification-plan/v1qa-verdict/v1同级目录用于验证标准QA记录并解析确定性QA结论。包含可选的生命周期、静默、租赁、收据及终端权限契约,供明确集成的宿主使用。Skill的常规使用无需激活该扩展。现有确定性v1调用者从技术上可省略发现步骤,因为v1契约不强制要求;此类运行不符合可移植Skill合规性,必须披露省略情况,而非声称已完成发现。这不会改变、或确定性核心语义。
../system/core/../system/extensions/harness-completion-authority/verification-plan/v1qa-verdict/v1