datasets
Compare original and translation side by side
🇺🇸
Original
English🇨🇳
Translation
Chinesedatasets
datasets
Buy the download instead of scraping. The Dataset Marketplace sells data that was already collected. Using it involves no scraping at all. The user buys a dataset and downloads it.
购买下载数据,而不是抓取。Dataset Marketplace 销售已经采集好的数据。使用它完全不涉及抓取。用户购买数据集并下载。
When this is the answer
何时适用
Three things must all be true. Anything less is a scraping job, not a purchase.
| Condition | Example that passes | Example that fails |
|---|---|---|
| A huge generic corpus, not specific inputs | "every US company with more than 50 staff" | "the follower count for instagram.com/nasa" |
| Needed once, or on a schedule a dataset subscription covers | a one-time training set | a nightly price feed |
| A few months old is fine | market research | live inventory |
Any one of them false and the answer is the skill. Need it once, or on a schedule a dataset subscription covers, buy the dataset. Need it fresher, or for specific inputs, scrape it.
scrape以下三个条件必须全部满足。只要有一个不满足,就属于抓取任务,而不是购买。
| 条件 | 符合的示例 | 不符合的示例 |
|---|---|---|
| 庞大的通用语料库,而非特定输入 | “美国所有员工超过 50 人的公司” | “instagram.com/nasa 的粉丝数量” |
| 只需使用一次,或使用数据集订阅所覆盖的周期 | 一次性训练集 | 每晚更新的价格信息流 |
| 数据滞后几个月也可以接受 | 市场调研 | 实时库存 |
只要有一个条件不满足,答案就是使用 skill。如果只需使用一次,或使用数据集订阅所覆盖的周期,就购买数据集。如果需要更新的数据,或需要抓取特定目标,就进行抓取。
scrapeThe agent's job: check and route
Agent 的职责:检查并路由
The agent checks whether the marketplace covers the ask, then hands off. It does not buy. Buying moves money, so a person does it in the control panel at , on their own account, after looking at a sample and the field coverage. There is no reason for an agent to be in that loop.
https://brightdata.com/cp/datasets/browseEvidence costs up to four calls: three free reads and one probe. The probe starts nothing for a download for sale or for a scraper with a required input, but it can start a billed job on a scraper with no required input. The exact calls, and which ids are safe to probe, are in . When the check hits, say it in one line:
references/marketplace.mdBright Data already sells a dataset that looks like this, priced per record, so buying the download may be cheaper and faster than scraping it. Browse it at brightdata.com/cp/datasets/browse. Say the word and I will scrape it instead.
Then stop and wait. Do not build a scraper in the background as a hedge, and do not ask the user for payment details.
The agent cannot price a purchase. gives a row's record count () but no price. The cost per record and the total appear on the order page in the control panel, so the person decides there.
GET /datasets/listsizeAgent 检查 Marketplace 是否涵盖用户的需求,然后进行转交。Agent 不负责购买。购买涉及资金转移,因此用户需要先查看样本和字段覆盖范围,再使用自己的账户在控制面板 中完成购买。Agent 没有必要参与这一流程。
https://brightdata.com/cp/datasets/browse获取证据最多需要四次调用:三次免费读取和一次 probe。对于待售的下载数据,或需要必填输入的 scraper,probe 不会启动任务;但对于没有必填输入的 scraper,probe 可能启动计费任务。具体的调用方式,以及哪些 id 可以安全执行 probe,请参阅 。检查成功后,用一行回复:
references/marketplace.mdBright Data 已经出售了一个与该需求相符的数据集,按记录计费,因此购买下载数据可能比抓取更便宜、更快。可在 brightdata.com/cp/datasets/browse 浏览。如果需要我改为抓取,请告诉我。
然后停止操作并等待。不要在后台构建 scraper 作为备用方案,也不要向用户索取支付信息。
Agent 无法为购买定价。 会给出条目的记录数量(),但不会提供价格。每条记录的价格和总价会显示在控制面板的订单页面中,因此由用户自行决定是否购买。
GET /datasets/listsizeA dataset_id the user already holds
用户已经持有 dataset_id
A user can arrive holding a that turns out to be a marketplace row and ask to trigger it. The first job is correcting the premise. It cannot be triggered, it is a download for sale. Then offer the two real paths: buy it in the control panel, or scrape a defined target list with a real scraper through the skill.
dataset_idscrapereferences/marketplace.md用户可能已经持有一个 dataset_id,并要求触发它,但该 id 实际上对应 Marketplace 的一条记录。首先需要纠正用户的前提认知。该任务无法触发,因为它是一个待售的下载数据。随后提供两条真正可行的路径:在控制面板中购买,或者通过 skill 使用真实的 scraper 抓取一份明确的目标列表。
scrapereferences/marketplace.md