firecrawl-build-crawl

Original：🇺🇸 English

Translated

Integrate Firecrawl `/crawl` into product code for bulk extraction across a site or site section. Use when a feature needs many related pages, such as documentation sets, help centers, or blogs, and page-by-page `/scrape` would be too manual.

207installs

Sourcefirecrawl/skills

Added on2026-04-10

NPX Install

npx skill4agent add firecrawl/skills firecrawl-build-crawl

SKILL.md Content

View Translation Comparison →

Firecrawl Build Crawl

Use this when the product needs many pages from the same site, not just one.

Use This When

the feature targets a docs section, blog, or help center
you need bulk extraction with path or depth boundaries
the product should ingest or refresh a site section at once

Guidance

Keep crawl scope narrow with path, depth, or page-count constraints.
Prefer
```
/crawl
```
over many manual
```
/scrape
```
calls when the site structure is stable.
Treat this as secondary to
```
/scrape
```
,
```
/search
```
, and
```
/interact
```
unless the feature is clearly site-wide.

When Not To Use It

If you only need one known URL, use firecrawl-build-scrape.
If you first need to discover URLs on a single site, start with firecrawl-build-map.

Docs (Source of Truth)

Read the docs for request/response schemas, parameters, and SDK examples before writing integration code:

docs.firecrawl.dev/features/crawl