blockchain-spider-toolkit

Compare original and translation side by side

🇺🇸

Original

English

🇨🇳

Translation

Chinese

BlockchainSpider — on-chain data collection toolkit

BlockchainSpider — 链上数据收集工具包

Reference skill. This repository does not vendor BlockchainSpider; read the upstream README and docs for install, spiders, and options.

Repository: github.com/wuzhy1ng/BlockchainSpider (MIT license)
Stack: Python, Scrapy spiders, CSV/JSON outputs under
```
./data
```
by default (paths per project config).

参考技能。本仓库并未内置BlockchainSpider；请阅读上游README和文档了解安装、爬虫及相关选项。

仓库地址： github.com/wuzhy1ng/BlockchainSpider（MIT许可证）
技术栈： Python、Scrapy爬虫，默认输出CSV/JSON格式文件至
```
./data
```
目录（路径可按项目配置调整）。

What it is for

适用场景

Typical capabilities described in the project (confirm against current docs):

Area	Examples
Transfer subgraph	Money-flow graph centered on a source address or transaction (e.g. `txs.blockscan` -style crawls).
EVM transactions	Block ranges, latest listener, receipts, logs, token transfers; multiple EVM-compatible providers.
Solana	Slot ranges or live streams via JSON-RPC providers.
Labels	Optional plugins (e.g. label-oriented crawls)—scope and ethics depend on source and law.

Academic background appears in project references (e.g. TRacer / transaction semantics papers—see repo Reference section).

项目中描述的典型功能（请以当前文档为准）：

领域	示例
转账子图	以源地址或交易为中心的资金流向图（例如 `txs.blockscan` 风格的爬取）。
EVM交易	区块范围、最新区块监听、收据、日志、代币转账；支持多个兼容EVM的提供商。
Solana	通过JSON-RPC提供商实现插槽范围爬取或实时流数据获取。
标签	可选插件（例如面向标签的爬取）——范围和合规性取决于数据源和法律规定。

项目参考资料中包含学术背景（例如TRacer / 交易语义相关论文——请查看仓库的Reference章节）。

Prerequisites

前置条件

Python environment and
```
pip install -r requirements.txt
```
from the cloned repo.
RPC / indexer API endpoints you are authorized to use (respect ToS, rate limits, and billing).
API keys for third-party explorers (Etherscan-class APIs, etc.) must be supplied by you—never commit keys or paste live keys into chats.

Python环境，以及从克隆的仓库中执行
```
pip install -r requirements.txt
```
安装依赖。
您已获授权使用的RPC / 索引器API端点（请遵守服务条款（ToS）、速率限制和计费规则）。
第三方浏览器（如Etherscan类API）的API密钥必须由您自行提供——切勿提交密钥或将可用密钥粘贴到聊天中。

Example command shapes (placeholders only)

示例命令格式（仅为占位符）

Upstream examples use

scrapy crawl <spider> -a ...

. Illustrative patterns (replace placeholders):

bash

undefined

上游示例使用

scrapy crawl <spider> -a ...

格式。以下为示例模式（请替换占位符）：

bash

undefined

EVM transfer / subgraph style (example spider name from upstream docs)

EVM转账/子图风格（示例爬虫名称来自上游文档）

scrapy crawl txs.blockscan -a source=<ADDRESS> -a apikeys=<YOUR_ETHERSCAN_API_KEY> -a endpoint=<ETHERSCAN_COMPATIBLE_API_URL>

EVM blocks / transactions over a range

指定区块范围的EVM区块/交易爬取

scrapy crawl trans.block.evm -a start_blk=<N> -a end_blk=<M> -a providers=<YOUR_ETH_HTTP_RPC_URL>

Solana slot range

Solana插槽范围爬取

scrapy crawl trans.block.solana -a start_slot=<S1> -a end_slot=<S2> -a providers=<YOUR_SOLANA_JSON_RPC_URL>


Exact **spider names** and **arguments** change with releases—always copy from the **current** README.