indexing

Compare original and translation side by side

🇺🇸

Original

English
🇨🇳

Translation

Chinese

SEO Technical: Indexing

SEO Technical: 索引

Guides indexing troubleshooting and fix actions. For how to find and diagnose issues in GSC, see google-search-console.
When invoking: On first use, if helpful, open with 1–2 sentences on what this skill covers and why it matters, then provide the main output. On subsequent use or when the user asks to skip, go directly to the main output.
本技能指导索引问题排查和修复操作。如需了解如何在GSC中查找和诊断问题,请查看 google-search-console 技能。
调用规则首次使用时,如果有帮助,可以先用1-2句话介绍本技能覆盖的范围及其重要性,再提供核心输出内容。后续调用或用户要求跳过介绍时,直接输出核心内容即可。

Scope (Technical SEO)

适用范围(技术SEO)

  • Fix actions: noindex, robots.txt, canonical, content quality, URL Inspection
  • Noindex: Use when excluding pages intentionally; not all content needs indexing. Complements robots.txt (crawl control) and google-search-console (Coverage interpretation)
  • 修复操作:noindex、robots.txt、canonical、内容质量、URL检测
  • Noindex:用于主动排除不需要索引的页面,并非所有内容都需要被索引。是robots.txt(抓取控制)和google-search-console(覆盖率解读)的补充工具

Initial Assessment

初步评估

Check for product marketing context first: If
.claude/product-marketing-context.md
or
.cursor/product-marketing-context.md
exists, read it for site URL and indexing goals.
Identify issue from GSC (see google-search-console for Coverage report, issue types, diagnosis workflow). Then apply fix below.
优先检查产品营销上下文:如果存在
.claude/product-marketing-context.md
.cursor/product-marketing-context.md
文件,先读取文件获取站点URL和索引目标。
从GSC中识别问题(查看google-search-console技能了解覆盖率报告、问题类型、诊断工作流),然后采用下方的修复方案。

Crawled - Currently Not Indexed

已抓取 - 当前未索引

CauseAction
Low quality, duplicate, off-topicImprove content, fix duplicates, set correct canonical
Static assets (CSS/JS)See below
Feed, share URLs with paramsUsually OK to ignore; or noindex, canonical to main URL
Important content pagesUse URL Inspection, verify canonical/internal links/sitemap, Request indexing
原因处理方案
低质量、重复、主题不相关内容优化内容、修复重复问题、设置正确的canonical
静态资源(CSS/JS)见下方说明
Feed、带参数的分享URL通常可直接忽略;或设置noindex、指向主URL的canonical
重要内容页面使用URL检测工具,验证canonical/内链/站点地图,提交索引请求

Static Assets (Next.js / Vercel)

静态资源(Next.js / Vercel)

Vercel adds unique
dpl=
params to static assets per deploy, creating many "Crawled - currently not indexed" URLs.
DoDon't
Keep robots.txt allowing
/_next/
Do not block
/_next/
(breaks CSS/JS loading)
Accept static assets in GSC as expectedDo not block
/_next/static/css/
or
?dpl=
Use X-Robots-Tag for static assetsCSS/JS should not be indexed; no SEO impact
Static assets in "Crawled - currently not indexed" is normal and expected.
Vercel会在每次部署时给静态资源添加唯一的
dpl=
参数,生成大量「已抓取 - 当前未索引」URL。
推荐操作禁止操作
保留robots.txt对
/_next/
的允许规则
不要拦截
/_next/
(会导致CSS/JS加载失败)
接受GSC中静态资源的索引状态为预期结果不要拦截
/_next/static/css/
?dpl=
参数
给静态资源设置X-Robots-TagCSS/JS不需要被索引,不会影响SEO效果
静态资源显示「已抓取 - 当前未索引」是正常且符合预期的情况。

Other Issue Types (from GSC Coverage)

其他问题类型(来自GSC覆盖率报告)

IssueFix
Excluded by «noindex» tagRemove noindex if accidental; keep if intentional
Redirect / 404Fix URL or add redirect
Duplicate / CanonicalSet correct canonical; usually OK
问题修复方案
被「noindex」标签排除如果是误加就移除noindex;如果是主动设置则保留
重定向 / 404修复URL或添加重定向
重复内容 / Canonical问题设置正确的canonical;通常无负面影响

Noindex Usage

Noindex使用指南

  • When: Login, admin, duplicate content, low-value pages, legal boilerplate, thank-you pages
  • How:
    metadata.robots = { index: false }
    or X-Robots-Tag
  • Rationale: Not all site content should be indexed; noindex is a valid choice for many pages
  • Caution: Avoid noindex on important content pages
  • With robots.txt: robots.txt controls crawl access; noindex controls indexing. Use both: robots for paths (e.g. /admin/), noindex for specific pages. See robots-txt
  • 适用场景:登录页、后台页、重复内容、低价值页面、法律声明页、致谢页
  • 实现方式
    metadata.robots = { index: false }
    或 X-Robots-Tag
  • 设计逻辑:并非所有站点内容都需要被索引,noindex对很多页面来说是合理的选择
  • 注意事项:不要给重要内容页面设置noindex
  • 与robots.txt配合:robots.txt控制抓取权限,noindex控制索引权限。两者搭配使用:robots用于路径级控制(例如/admin/),noindex用于特定页面控制。参考robots-txt技能

Google Indexing API

Google Indexing API

TypeTypical use
JobPostingJob boards
BroadcastEventLive platforms
Requirements: Enable Indexing API, create service account, add owner in Search Console, request quota (default 200 URLs/day).
支持类型典型使用场景
JobPosting(招聘职位)招聘网站
BroadcastEvent(直播活动)直播平台
使用要求:启用Indexing API、创建服务账号、在Search Console中添加所有者权限、申请配额(默认每天200个URL)。

Output Format

输出格式

Related Skills

相关技能

  • google-search-console: Find and diagnose indexing issues in GSC
  • robots-txt: Ensure robots.txt does not block indexing
  • xml-sitemap: Submit and maintain sitemap
  • indexnow: Faster indexing for Bing
  • canonical-tag: Resolve duplicate content
  • google-search-console:在GSC中查找和诊断索引问题
  • robots-txt:确保robots.txt不会拦截索引
  • xml-sitemap:提交和维护站点地图
  • indexnow:实现Bing快速索引
  • canonical-tag:解决重复内容问题