NeuroArxiv
Vibecoders don't waste hours because they lack skill. They waste hours
because they start building before checking whether the hard part has
already been solved and published, with the failure modes already known.
arXiv is the world's largest source of truth for "has anyone done this" —
and almost nobody about to write code actually reads it first. This skill
makes the agent read it first.
Pre-flight (run before Phase 1)
This skill is expensive: a real arXiv fetch plus roughly one isolated
Agent call per paper (typically 10-20), plus scoring, clustering, and
convergence. Do not pay that cost when there's no real prior art to find.
Step 1. Explicit invocation check.
If the user typed
, explicitly asked to "check arXiv", "check
prior art", or "run NeuroArxiv",
skip the rest of this section and go
straight to Phase 1. The user opted in.
Step 2. Self-judge (only if Step 1 did not match).
Ask yourself three questions. If the answer to any is no, ABORT.
- Is there a technical mechanism to research? Naming a variable,
wiring a CRUD form, or gluing two documented SDKs together has no
prior-art question worth asking. Designing a caching strategy, a
consensus/coordination scheme, a ranking or retrieval approach, an
ML training or inference technique, a novel protocol, or anything
where "the naive version breaks at scale" — does.
- Is the user about to commit real effort to it? A one-off script
doesn't earn a literature search. A component that will anchor the
architecture, or that's expensive to redo once built wrong, does.
- Did the user leave the approach open? If they already named the
specific algorithm/paper/library to use, or said "just implement it
the simple way", they've already converged — don't re-open it. Abort.
If all three checks pass, proceed to Phase 1.
If any fails, ABORT and proceed with the direct implementation. Optionally
append one sentence:
"If you want this checked against arXiv prior art
first, run /neuroarxiv <your problem>
."
The loop
Three phases. Fetching is not divergence — it's find real documents, then
read each in isolation, then converge. Skipping the isolation step turns
this into an LLM guessing about papers it hasn't actually read.
Phase 0 — Categorize
Map the build problem onto 3-5 arXiv subject categories and 3-6 concrete
search terms (the technical mechanism words — "cache invalidation", not
"caching system"). Pick from the table below, or name another category id
if you're confident of it.
| Category | Covers |
|---|
| cs.AI | general AI systems, agents, planning, knowledge representation |
| cs.LG | learning algorithms, training methods, model architectures |
| cs.CL | NLP, language models, text processing |
| cs.CV | image/video understanding, generation, perception |
| cs.IR | search, ranking, recommendation, retrieval-augmented systems |
| cs.DC | distributed systems, consensus, sharding, replication, scheduling |
| cs.DB | storage engines, query processing, indexing, transactions, consistency |
| cs.SE | development practices, testing, program analysis, tooling |
| cs.PL | language design, type systems, compilers, runtimes |
| cs.CR | protocols, authentication, adversarial robustness, privacy |
| cs.NI | routing, congestion control, edge/CDN |
| cs.OS | kernels, schedulers, memory management, virtualization |
| cs.HC | interface design, usability, interaction models |
| cs.MA | coordination, negotiation, emergent behavior among agents |
| cs.RO | control, perception, manipulation, motion planning |
| cs.DS | algorithmic techniques, complexity, data structure design |
| cs.GT | mechanism design, auctions, incentive-compatible systems |
| stat.ML | statistical learning theory, probabilistic models |
| eess.SP / eess.SY | signal processing / control theory |
| math.OC | optimization, scheduling, resource allocation |
If the problem is pure product/business framing with no obvious technical
mechanism, say so plainly — but still commit to a best-effort technical
angle. Most build problems have one (caching, consistency, ranking,
scheduling, retrieval) even unphrased.
Phase 1 — Fetch (real HTTP, no generation)
For each chosen category, call WebFetch against arXiv's real export
API — do not paraphrase this step from memory, actually fetch it:
https://export.arxiv.org/api/query?search_query=cat:<CATEGORY>+AND+(all:"<term1>"+OR+all:"<term2>")&start=0&max_results=4&sortBy=relevance&sortOrder=descending
Ask WebFetch to return, per
: the arXiv id, title, abstract,
authors, published date, and the
/
links — verbatim from the
feed, not summarized. This is a real Atom XML feed; treat every field as
ground truth, never invent a paper, id, or detail not present in the
response.
If a category returns fewer than 2 results, retry that category's query
with the search terms dropped (
alone) — don't pad the
result set with irrelevant hits to hit a target count. If everything
comes back thin, say so in the output rather than manufacturing findings.
Courtesy: arXiv asks for one request at a time with a few seconds
between calls. Fetch categories one after another, not concurrently.
Phase 2 — Diverge (read each paper in isolation)
For every paper collected in Phase 1, spawn a parallel Agent/Task
call. One per paper. Each Agent gets only:
- the build problem
- that ONE paper's title, abstract, authors, year — no other paper
- the instruction below
You are in DIVERGENT READ mode. You have exactly one paper's title and
abstract, and one build problem. You do not know what other papers
exist — do not assume, invent, or gesture at a broader survey.
Read this abstract as if scouting prior art for someone about to build
the stated thing from scratch. Never quote the abstract verbatim beyond
a few consecutive words — paraphrase in your own words.
Extract: approach (1-2 sentences, the core mechanism), borrow (1
sentence, the single most concrete implementable takeaway — imperative:
"Use X to do Y"; if too tangential, say so plainly), limitation (1
sentence, the load-bearing weakness or breaking condition), relevanceNote
(1 short clause on fit to the stated problem).
Output JSON only:
{"approach":"...","borrow":"...","limitation":"...","relevanceNote":"..."}
Critical invariant. These calls must be parallel and isolated. A read
that has seen other papers' abstracts starts summarizing the SET instead
of grounding in the ONE paper in front of it — that's a subtler failure
than ADHD's cross-talk collapse, and easy to miss because the output still
looks paper-specific.
Phase 3 — Converge (one path, not a shortlist)
After all reads return:
- Score. Rate each reading 0-10 on: relevance (fit to the stated
problem), practicality (buildable by a small team without exotic
infra), rigor (does the abstract itself show real evidence — benchmarks,
proofs, a shipped system — vs pure concept). Flag a "trap" when a
paper's own stated limitation implies a failure mode a builder would
otherwise rediscover the hard way. Always pair it with a "strength" —
the one concrete thing that paper's approach gets right.
- Cluster. Group readings into 3-6 clusters by underlying
architectural angle (not by paper, not by keyword): "cache-invalidation
plays", "consensus-free plays", "learned-index plays".
- Pick ONE. Choose the cluster with the strongest relevance +
practicality combination — not the most novel, not the most cited, the
one an engineer should actually build. This is the point of departure
from wide-open brainstorming: NeuroArxiv commits to a single
recommendation, because "here are 4 papers, you decide" is exactly the
time-wasting the skill exists to prevent.
- Synthesize. For the chosen cluster, produce: a 4-8 sentence
implementation sketch (actionable, not a lit-review summary), citations
(paper id + title + url + role — "primary mechanism" / "supporting
evidence" / "failure mode to avoid" — grounded only in fetched data),
the first concrete step, the load-bearing risk, and an "avoid" list
pulled from every paper's limitation (not just the winner's — a pitfall
named by a paper in a rejected cluster is still worth avoiding).
- Name the runner-ups. One honest sentence per non-chosen cluster on
the real trade-off that lost it the pick. Not a dismissal — the
builder should be able to switch paths later knowing why.
- One open thread. A question the read papers raise but don't
answer — worth a design-review checkpoint before shipping.
Output shape
- Searched. Categories, search terms, paper count.
- Papers read. Grouped by cluster. Each paper: id, title, one-line
approach, score chips .
- Prior-art pitfalls. Papers whose limitation flags a real trap —
listed separately as watch-outs, not verdicts.
- THE PATH. The one chosen cluster: sketch, citations, first step,
load-bearing risk, avoid-list. This is the deliverable — make it bold
and unmissable, not buried under the paper list.
- Alternates considered, not chosen. One line each.
- Open thread. The unanswered question.
Anti-patterns
- Cross-contaminated reads. If a paper's read mentions "compared to
the other papers here" or "collectively these show", isolation broke —
discard and re-run that read alone.
- Hallucinated citations. Never state a paper detail (a number, a
claim, a result) that wasn't actually in the fetched abstract. If
unsure, re-fetch rather than infer from the title.
- Shortlist-as-cop-out. Ending Phase 3 with "here are 3 good options"
instead of one recommendation defeats the purpose. Commit.
- Padding a thin result set. Zero or few relevant papers is a valid,
useful finding — it means the mechanism is either genuinely novel or the
search terms were wrong. Say so. Don't stretch tangential papers to look
like coverage.
- Treating a paper's abstract as the whole paper. The abstract is a
pointer, not ground truth about implementation details it doesn't state.
The "borrow" and "avoid" items should stay at the level of what the
abstract actually supports.
Calibration
- How many papers? Default 4 per category × 3-5 categories ≈ 12-20
papers. Scale down for narrow/well-known mechanisms (2 per category is
enough when the space is small), up for genuinely unclear territory.
- When to stop widening? If a category-only retry (terms dropped)
still returns nothing usable, say so and move on — don't cascade into
unrelated categories chasing a result count.
Cost
1 categorize + N isolated reads (typically 12-20) + 1 score + 1 cluster +
1 converge ≈ N+4 Agent-shaped calls, plus real arXiv HTTP fetches (~3s
courtesy delay between categories). Not for every design decision — for
the ones where getting the architecture wrong costs real rework.
Companion library and CLI
This repo also ships a Node/TS implementation (
) that runs the same
loop against real arXiv HTTP and the Claude Agent SDK — useful outside
Claude Code, for scripted/batch runs, or when you want the fetch and
parsing to be deterministic code instead of a WebFetch call.
npm install
npm run build
neuroarxiv "how should I cache LLM completions across requests?"
The skill above gives you the same loop inside Claude Code with no
install required.