assess-paper
Compare original and translation side by side
🇺🇸
Original
English🇨🇳
Translation
ChineseAssess Paper
Assess Paper
The single command that tells an author where they stand and explains why, so a non-expert isn't left staring at five separate tool outputs. It does not re-implement any check; it runs the specialist skills and turns their results into one readable Paper Health Report that leads with strengths, then risks, then a ranked to-do list.
Pairs with (which drives the full lifecycle) — is the read-only "where am I right now" snapshot you can run at any point. Copilot, not pilot: it reports and explains, it never edits the paper or submits anything.
orchestrate-paperassess-paper这是一个能告知作者当前论文状态并解释原因的单一命令,让非专业人士无需面对五个独立工具的输出结果。它不会重新实现任何检查功能,而是调用各类专业技能,并将结果整合为一份易读的Paper Health Report,内容依次为优势、风险以及优先级排序的待办事项清单。
它与搭配使用(后者负责驱动论文全生命周期管理)——是一个只读的“当前状态快照”工具,你可在任意阶段运行它。它是辅助工具而非主导工具:仅负责报告和解释,绝不会编辑论文或提交任何内容。
orchestrate-paperassess-paperWhen to use
适用场景
- The author wants one overview instead of running five skills and stitching the results together.
- Early ("how far off am I?") or late ("am I ready to submit?").
- A co-author or advisor wants a quick, honest state-of-the-paper.
- 作者希望获得一份综合概述,而非分别运行五个技能再自行整合结果。
- 论文撰写早期(“我还差多少?”)或后期(“我是否准备好提交了?”)。
- 合著者或导师想要快速、真实地了解论文的当前状态。
When NOT to use it (say this plainly)
不适用场景(直白说明)
- You want one specific check — run that skill directly (e.g. just citations → ).
verify-citations - You want fixes applied — this skill only diagnoses; hand each fix to the skill that owns it.
- You want an acceptance probability or award forecast — no tool can give one honestly; this skill refuses to.
- 你只需要某一项特定检查——直接运行对应的技能即可(例如仅检查引用→)。
verify-citations - 你希望自动应用修改——本工具仅负责诊断;需将每项修改任务交给对应的专业技能处理。
- 你想要论文录用概率或获奖预测——没有工具能给出真实的此类结果;本工具会拒绝提供这类预测。
Inputs
输入内容
- The draft: a source tree, a compiled PDF, or a readable draft. Processed transiently — never copied into this repo.
.tex - The target venue and track (what counts as "ready" differs by venue). Ask if unstated; run against the nearest family default and say so if no profile exists.
- Optional: (positioning) and
.paper-memory/profile.yml(recurring weaknesses), if present.lessons.md
- 论文草稿:源码目录、编译后的PDF文件或可阅读的草稿。仅临时处理——绝不会复制到本仓库中。
.tex - 目标会议/期刊及赛道(“就绪”的标准因不同平台而异)。若未明确说明则主动询问;若无对应配置文件,则使用最相近的默认配置并告知用户。
- 可选:若存在(定位配置)和
.paper-memory/profile.yml(常见薄弱点记录),可一并提供。lessons.md
What it consolidates
整合的评估维度
| Dimension | Skill it runs | What it contributes to the report |
|---|---|---|
| Will it get desk-rejected? | | compliance blockers (page limit, anonymization, missing sections) |
| Are the citations real? | | fabricated / retracted / duplicate references |
| Is it original? | | plagiarism / self-recycling overlap |
| Does it match strong work at the venue? | | venue-fit scorecard + weakest dimensions |
| What will reviewers say? | | strengths, weaknesses, rubric scores, decision-risk |
| 评估维度 | 调用的技能 | 为报告提供的内容 |
|---|---|---|
| 是否会被初审拒稿? | | 合规性障碍(页数限制、匿名性要求、缺失章节) |
| 引用是否真实有效? | | 伪造/撤回/重复引用情况 |
| 内容是否原创? | | 抄袭/自我重复的重叠度 |
| 是否符合目标平台的优质标准? | | 平台适配度评分卡 + 最薄弱维度 |
| 评审者会给出什么评价? | | 优势、不足、评分标准得分、录用风险 |
Process
执行流程
- Confirm the target (venue + track) and read if present, so the assessment matches the paper's positioning — a theory paper and an applied paper are judged differently.
.paper-memory/profile.yml - Run the checks that apply to the draft's stage. Compliance and citations/originality are integrity gates; benchmark and mock-review are quality reads. Skip and say so if an input is missing (e.g. no yet) — never fabricate a result to fill a gap.
.bib - Synthesize the Paper Health Report (do not dump five raw outputs):
- Overall read — one honest paragraph: roughly where the paper stands and the single most important thing to do next. Never an acceptance probability.
- Top strengths (lead with these) — 3–5 concrete things the paper does well, drawn from the mock review and benchmark, each tied to a section, so the author knows what to protect while editing.
- Biggest risks — ranked by impact × ease of fix, each linking to the skill that fixes it.
- Scorecard + gates — the venue-fit index, mock-review decision-risk band, and a clear pass / flag on each integrity gate (citations, originality, desk-reject).
- Do next — a short ordered checklist.
- Write the report to and present the summary in chat.
paper-workspace/review/paper-health-report.md
Any venue fact that flows through from the sub-skills (a page limit, a deadline, a required section) carries its source and confidence label exactly as the sub-skill reported it — do not restate a venue rule the underlying skill could not verify.
- 确认目标(会议/期刊 + 赛道),若存在则读取该文件,确保评估符合论文的定位——理论论文和应用论文的评判标准不同。
.paper-memory/profile.yml - 运行与草稿阶段匹配的检查。合规性、引用/原创性属于完整性门槛;对标评估和模拟评审属于质量评估。若缺少某项输入(例如还没有文件)则跳过并告知用户——绝不编造结果填补空白。
.bib - 生成Paper Health Report(不直接输出五个工具的原始结果):
- 整体评估——一段真实客观的描述:论文大致处于什么阶段,以及最首要的改进任务。绝不提及录用概率。
- 核心优势(优先展示)——3-5条论文的具体亮点,来自模拟评审和对标评估,每条都关联具体章节,让作者知道编辑时需要保留哪些内容。
- 主要风险——按影响程度×修复难度排序,每条都关联对应的修复技能。
- 评分卡与门槛——平台适配度指数、模拟评审的录用风险等级,以及各完整性门槛(引用、原创性、初审拒稿)的明确通过/标记状态。
- 下一步行动——简短的有序清单。
- 生成报告文件至,并在对话中展示摘要内容。
paper-workspace/review/paper-health-report.md
所有来自子技能的平台规则(如页数限制、截止日期、必填章节)都将完全保留子技能报告的来源和置信度标签——绝不重述底层技能无法验证的平台规则。
Worked mini-example
迷你示例
Input: a draft + , targeting (full track). The synthesized report opens like this:
paper.texrefs.bibsigspatial-2026markdown
undefined输入:草稿文件 + ,目标平台为(全论文赛道)。生成的报告开头如下:
paper.texrefs.bibsigspatial-2026markdown
undefinedPaper Health Report — paper.tex → SIGSPATIAL 2026 (full track) · 2026-06-21
Paper Health Report — paper.tex → SIGSPATIAL 2026 (full track) · 2026-06-21
Overall read
Overall read
Structurally this reads like a SIGSPATIAL full paper and the core method is
clearly framed. The one thing holding it back is the evaluation: a single
dataset with no significance test is the weakness every mock reviewer flagged.
Fix that before anything else.
Structurally this reads like a SIGSPATIAL full paper and the core method is
clearly framed. The one thing holding it back is the evaluation: a single
dataset with no significance test is the weakness every mock reviewer flagged.
Fix that before anything else.
Top strengths (protect these)
Top strengths (protect these)
- Crisp contribution list, 3 claims each mapped to a section (§1) — mock panel praised the framing.
- Strong, reproducible artifact: code + seeds released (§6) — benchmark scored reproducibility 9/10, above the exemplar median.
- Clear problem motivation tied to a real spatial workload (§2).
- Crisp contribution list, 3 claims each mapped to a section (§1) — mock panel praised the framing.
- Strong, reproducible artifact: code + seeds released (§6) — benchmark scored reproducibility 9/10, above the exemplar median.
- Clear problem motivation tied to a real spatial workload (§2).
Biggest risks (ranked by impact × ease)
Biggest risks (ranked by impact × ease)
- Single-dataset evaluation, no significance test — add a second dataset + variance. → simulate-reviewers (soundness), benchmark-paper (evaluation)
- 2 references unresolvable on Crossref/DBLP (likely wrong year). → verify-citations
- Page count at 9.3 / 9 — over the limit. → preflight-check, fit-page-limit
- Single-dataset evaluation, no significance test — add a second dataset + variance. → simulate-reviewers (soundness), benchmark-paper (evaluation)
- 2 references unresolvable on Crossref/DBLP (likely wrong year). → verify-citations
- Page count at 9.3 / 9 — over the limit. → preflight-check, fit-page-limit
Scorecard + gates
Scorecard + gates
- Venue-fit index: 7.1/10 — "structurally in line; evaluation is the gap"
- Mock decision-risk: borderline-reject (no champion)
- Gates: citations FLAG (2 unresolvable) · originality PASS · desk-reject FLAG (over page limit)
- Venue-fit index: 7.1/10 — "structurally in line; evaluation is the gap"
- Mock decision-risk: borderline-reject (no champion)
- Gates: citations FLAG (2 unresolvable) · originality PASS · desk-reject FLAG (over page limit)
Do next
Do next
- Resolve the 2 citations (verify-citations) — quick, removes an integrity flag.
- Trim to the page limit (fit-page-limit).
- Add the second dataset + significance test (the real lever).
undefined- Resolve the 2 citations (verify-citations) — quick, removes an integrity flag.
- Trim to the page limit (fit-page-limit).
- Add the second dataset + significance test (the real lever).
undefinedOutput
输出结果
A single : overall read → strengths → ranked risks → scorecard & gates → do-next checklist. Each finding names the underlying skill so the author can drill in. Plain language throughout — the goal is the author understanding their paper, not a wall of metrics.
paper-health-report.md生成一份单独的文件:内容依次为整体评估→优势→优先级排序的风险→评分卡与合规门槛→下一步行动清单。每个结论都会标注背后调用的技能,方便作者深入了解。全程使用通俗易懂的语言——目标是让作者理解自己的论文,而非堆砌一堆指标。
paper-health-report.mdGuardrails
约束规则
- Strengths are mandatory and come first. An assessment that is all problems misleads the author about what to preserve — surface what genuinely works, but never invent strengths to pad.
- Honest readiness read only — never a probability of acceptance or an award (see ,
benchmark-paper). Refuse if asked, and explain why.simulate-reviewers - Integrity gates (fabricated citations, plagiarism, desk-reject blockers) are reported as blockers, not averaged away by good scores elsewhere.
- It reports and explains; it never edits the paper or submits anything. Hand fixes to the specific skills.
- Process the paper transiently; never copy paper text into this repo.
- 必须先列出优势。全是问题的评估会误导作者不知道该保留哪些内容——要突出真正有效的部分,但绝不能编造优势来凑数。
- 仅提供真实的就绪度评估——绝不给出录用概率或获奖预测(详见、
benchmark-paper的说明)。若被要求提供此类预测,将拒绝并解释原因。simulate-reviewers - 完整性门槛(伪造引用、抄袭、初审拒稿障碍)会被标记为障碍,不会因其他方面的高分而被掩盖。
- 仅负责报告和解释;绝不会编辑论文或提交任何内容。修改任务需交给对应的专业技能处理。
- 仅临时处理论文内容;绝不会将论文文本复制到本仓库中。
Memory
记忆机制
Uses the shared convention described by .
.paper-memory/paper-memory-convention.md- At start: read (positioning) and
profile.yml(recurring weaknesses) so the report is personalized and tracks progress across drafts — lead with anylessons.mdweakness.recurring - At end: append durable takeaways in the shared format via
- [YYYY-MM-DD] (assess-paper | <scope>) finding -> recommendation'sreflect-and-improve(it dedupes and dates). A weakness that persists across drafts isreflect_log.py append; a one-time gap isrecurring. Log lasting takeaways, not the full report or per-run scores.this-paper - Create on demand; it is local-only and never uploaded.
.paper-memory/
遵循中描述的共享约定。
paper-memory-convention.md.paper-memory/- 启动时:读取(定位配置)和
profile.yml(常见薄弱点记录),让报告更贴合论文情况,并跟踪不同版本草稿的进展——优先展示标记为lessons.md的薄弱点。recurring - 结束时:通过的
reflect-and-improve方法,以共享格式reflect_log.py append添加持久化结论(该方法会自动去重并标注日期)。在多版草稿中持续存在的薄弱点标记为- [YYYY-MM-DD] (assess-paper | <scope>) finding -> recommendation;仅当前草稿存在的问题标记为recurring。仅记录长期结论,不保存完整报告或每次运行的评分。this-paper - 按需创建目录;该目录仅本地存在,绝不会被上传。
.paper-memory/