apify-ecommerce
Compare original and translation side by side
🇺🇸
Original
English🇨🇳
Translation
ChineseE-commerce Data Extraction
电商数据抓取
Extract product data, prices, reviews, and seller information from any e-commerce platform using Apify's E-commerce Scraping Tool.
使用Apify的电商抓取工具从任意电商平台提取产品数据、价格、评论和卖家信息。
Prerequisites
前提条件
- file with
.env(atAPIFY_TOKEN)~/.claude/.env - Node.js 20.6+ (for native support)
--env-file
- 包含的
APIFY_TOKEN文件(路径为.env)~/.claude/.env - Node.js 20.6+(支持原生功能)
--env-file
Workflow Selection
工作流选择
| User Need | Workflow | Best For |
|---|---|---|
| Track prices, compare products | Workflow 1: Products & Pricing | Price monitoring, MAP compliance, competitor analysis. Add AI summary for insights. |
| Analyze reviews (sentiment or quality) | Workflow 2: Reviews | Brand perception, customer sentiment, quality issues, defect patterns |
| Find sellers across stores | Workflow 3: Sellers | Unauthorized resellers, vendor discovery via Google Shopping |
| 用户需求 | 工作流 | 适用场景 |
|---|---|---|
| 追踪价格、对比产品 | 工作流1:产品与定价 | 价格监控、MAP合规性检查、竞品分析。可添加AI总结获取洞察。 |
| 分析评论(情感或质量) | 工作流2:评论分析 | 品牌感知、客户情感、质量问题、缺陷模式分析 |
| 跨店铺寻找卖家 | 工作流3:卖家情报 | 发现未授权经销商、通过Google Shopping挖掘供应商 |
Progress Tracking
进度追踪
Task Progress:
- [ ] Step 1: Select workflow and determine data source
- [ ] Step 2: Configure Actor input
- [ ] Step 3: Ask user preferences (format, filename)
- [ ] Step 4: Run the extraction script
- [ ] Step 5: Summarize results任务进度:
- [ ] 步骤1:选择工作流并确定数据源
- [ ] 步骤2:配置Actor输入
- [ ] 步骤3:询问用户偏好(格式、文件名)
- [ ] 步骤4:运行抓取脚本
- [ ] 步骤5:总结结果Workflow 1: Products & Pricing
工作流1:产品与定价
Use case: Extract product data, prices, and stock status. Track competitor prices, detect MAP violations, benchmark products, or research markets.
Best for: Pricing analysts, product managers, market researchers.
使用场景: 提取产品数据、价格和库存状态。追踪竞品价格、检测MAP违规、产品基准测试或市场调研。
适用人群: 定价分析师、产品经理、市场研究员。
Input Options
输入选项
| Input Type | Field | Description |
|---|---|---|
| Product URLs | | Direct URLs to product pages (use object format) |
| Category URLs | | URLs to category/search result pages |
| Keyword Search | | Search term across selected marketplaces |
| 输入类型 | 字段 | 描述 |
|---|---|---|
| 产品URL | | 产品页面的直接URL(使用对象格式) |
| 分类URL | | 分类/搜索结果页面的URL |
| 关键词搜索 | | 在选定平台上按关键词搜索 |
Example - Product URLs
示例 - 产品URL
json
{
"detailsUrls": [
{"url": "https://www.amazon.com/dp/B09V3KXJPB"},
{"url": "https://www.walmart.com/ip/123456789"}
],
"additionalProperties": true
}json
{
"detailsUrls": [
{"url": "https://www.amazon.com/dp/B09V3KXJPB"},
{"url": "https://www.walmart.com/ip/123456789"}
],
"additionalProperties": true
}Example - Keyword Search
示例 - 关键词搜索
json
{
"keyword": "Samsung Galaxy S24",
"marketplaces": ["www.amazon.com", "www.walmart.com"],
"additionalProperties": true,
"maxProductResults": 50
}json
{
"keyword": "Samsung Galaxy S24",
"marketplaces": ["www.amazon.com", "www.walmart.com"],
"additionalProperties": true,
"maxProductResults": 50
}Optional: AI Summary
可选:AI总结
Add these fields to get AI-generated insights:
| Field | Description |
|---|---|
| Data points to analyze: |
| Custom analysis instructions |
Example with AI summary:
json
{
"keyword": "robot vacuum",
"marketplaces": ["www.amazon.com"],
"maxProductResults": 50,
"additionalProperties": true,
"fieldsToAnalyze": ["name", "offers", "brand"],
"customPrompt": "Summarize price range and identify top brands"
}添加以下字段以获取AI生成的洞察:
| 字段 | 描述 |
|---|---|
| 要分析的数据点: |
| 自定义分析指令 |
带AI总结的示例:
json
{
"keyword": "robot vacuum",
"marketplaces": ["www.amazon.com"],
"maxProductResults": 50,
"additionalProperties": true,
"fieldsToAnalyze": ["name", "offers", "brand"],
"customPrompt": "Summarize price range and identify top brands"
}Output Fields
输出字段
- - Product name
name - - Product URL
url - - Current price
offers.price - - Currency code (may vary by seller region)
offers.priceCurrency - - Brand name (nested in object)
brand.slogan - - Product image URL
image - Additional seller/stock info when
additionalProperties: true
Note: Currency may vary in results even for US searches, as prices reflect different seller regions.
- - 产品名称
name - - 产品URL
url - - 当前价格
offers.price - - 货币代码(可能因卖家地区而异)
offers.priceCurrency - - 品牌名称(嵌套在对象中)
brand.slogan - - 产品图片URL
image - 当时,会包含额外的卖家/库存信息
additionalProperties: true
注意: 即使是美国地区的搜索,结果中的货币也可能不同,因为价格反映了不同卖家的地区。
Workflow 2: Customer Reviews
工作流2:客户评论
Use case: Extract reviews for sentiment analysis, brand perception monitoring, or quality issue detection.
Best for: Brand managers, customer experience teams, QA teams, product managers.
使用场景: 提取评论用于情感分析、品牌感知监控或质量问题检测。
适用人群: 品牌经理、客户体验团队、QA团队、产品经理。
Input Options
输入选项
| Input Type | Field | Description |
|---|---|---|
| Product URLs | | Product pages to extract reviews from |
| Keyword Search | | Search for product reviews by keyword |
| 输入类型 | 字段 | 描述 |
|---|---|---|
| 产品URL | | 从中提取评论的产品页面 |
| 关键词搜索 | | 按关键词搜索产品评论 |
Example - Extract Reviews from Product
示例 - 从产品提取评论
json
{
"reviewListingUrls": [
{"url": "https://www.amazon.com/dp/B09V3KXJPB"}
],
"sortReview": "Most recent",
"additionalReviewProperties": true,
"maxReviewResults": 500
}json
{
"reviewListingUrls": [
{"url": "https://www.amazon.com/dp/B09V3KXJPB"}
],
"sortReview": "Most recent",
"additionalReviewProperties": true,
"maxReviewResults": 500
}Example - Keyword Search
示例 - 关键词搜索
json
{
"keywordReviews": "wireless earbuds",
"marketplacesReviews": ["www.amazon.com"],
"sortReview": "Most recent",
"additionalReviewProperties": true,
"maxReviewResults": 200
}json
{
"keywordReviews": "wireless earbuds",
"marketplacesReviews": ["www.amazon.com"],
"sortReview": "Most recent",
"additionalReviewProperties": true,
"maxReviewResults": 200
}Sort Options
排序选项
- - Latest reviews first (recommended)
Most recent - - Platform default relevance
Most relevant - - Highest voted reviews
Most helpful - - 5-star reviews first
Highest rated - - 1-star reviews first
Lowest rated
Note: Theoption may not work consistently across all marketplaces. For quality analysis, collect a large sample and filter by rating in post-processing.sortReview: "Lowest rated"
- - 最新评论优先(推荐)
Most recent - - 平台默认相关性排序
Most relevant - - 获赞最多的评论优先
Most helpful - - 五星评论优先
Highest rated - - 一星评论优先
Lowest rated
注意:选项可能并非在所有平台上都能稳定工作。如需质量分析,请收集大量样本并在后期处理中按评分筛选。sortReview: "Lowest rated"
Quality Analysis Tips
质量分析技巧
- Set high for statistical significance
maxReviewResults - Look for recurring keywords: "broke", "defect", "quality", "returned"
- Filter results by rating if sorting doesn't work as expected
- Cross-reference with competitor products for benchmarking
- 设置较高的以保证统计显著性
maxReviewResults - 寻找重复出现的关键词:"broke"、"defect"、"quality"、"returned"
- 如果排序功能未按预期工作,可按评分筛选结果
- 与竞品进行交叉对比以作基准测试
Workflow 3: Seller Intelligence
工作流3:卖家情报
Use case: Find sellers across stores, discover unauthorized resellers, evaluate vendor options.
Best for: Brand protection teams, procurement, supply chain managers.
Note: This workflow uses Google Shopping to find sellers across stores. Direct seller profile URLs are not reliably supported.
使用场景: 跨店铺寻找卖家、发现未授权经销商、评估供应商选项。
适用人群: 品牌保护团队、采购人员、供应链经理。
注意: 此工作流使用Google Shopping来跨店铺寻找卖家。直接的卖家主页URL无法被可靠支持。
Input Configuration
输入配置
json
{
"googleShoppingSearchKeyword": "Nike Air Max 90",
"scrapeSellersFromGoogleShopping": true,
"countryCode": "us",
"maxGoogleShoppingSellersPerProduct": 20,
"maxGoogleShoppingResults": 100
}json
{
"googleShoppingSearchKeyword": "Nike Air Max 90",
"scrapeSellersFromGoogleShopping": true,
"countryCode": "us",
"maxGoogleShoppingSellersPerProduct": 20,
"maxGoogleShoppingResults": 100
}Options
选项
| Field | Description |
|---|---|
| Product name to search |
| Set to |
| Set to |
| Target country (e.g., |
| Max sellers per product |
| Total result limit |
| 字段 | 描述 |
|---|---|
| 要搜索的产品名称 |
| 设置为 |
| 设置为 |
| 目标国家(例如: |
| 每个产品的最大卖家数量 |
| 总结果限制 |
Supported Marketplaces
支持的电商平台
Amazon (20+ regions)
亚马逊(20+地区)
www.amazon.comwww.amazon.co.ukwww.amazon.dewww.amazon.frwww.amazon.itwww.amazon.eswww.amazon.cawww.amazon.com.auwww.amazon.co.jpwww.amazon.inwww.amazon.com.brwww.amazon.com.mxwww.amazon.nlwww.amazon.plwww.amazon.sewww.amazon.aewww.amazon.sawww.amazon.sgwww.amazon.com.trwww.amazon.egwww.amazon.comwww.amazon.co.ukwww.amazon.dewww.amazon.frwww.amazon.itwww.amazon.eswww.amazon.cawww.amazon.com.auwww.amazon.co.jpwww.amazon.inwww.amazon.com.brwww.amazon.com.mxwww.amazon.nlwww.amazon.plwww.amazon.sewww.amazon.aewww.amazon.sawww.amazon.sgwww.amazon.com.trwww.amazon.egMajor US Retailers
美国主流零售商
www.walmart.comwww.costco.comwww.costco.cawww.homedepot.comwww.walmart.comwww.costco.comwww.costco.cawww.homedepot.comEuropean Retailers
欧洲零售商
allegro.plallegro.czallegro.skwww.alza.czwww.alza.skwww.alza.dewww.alza.atwww.alza.huwww.kaufland.dewww.kaufland.plwww.kaufland.czwww.kaufland.skwww.kaufland.atwww.kaufland.frwww.kaufland.itwww.cdiscount.comallegro.plallegro.czallegro.skwww.alza.czwww.alza.skwww.alza.dewww.alza.atwww.alza.huwww.kaufland.dewww.kaufland.plwww.kaufland.czwww.kaufland.skwww.kaufland.atwww.kaufland.frwww.kaufland.itwww.cdiscount.comIKEA (40+ country/language combinations)
宜家(40+国家/语言组合)
Supports all major IKEA regional sites with multiple language options.
支持所有主要宜家地区站点,包含多语言选项。
Google Shopping
Google Shopping
Use for seller discovery across multiple stores.
用于跨店铺发现卖家。
Running the Extraction
运行抓取脚本
Step 1: Set Skill Path
步骤1:设置技能路径
bash
SKILL_PATH=~/.claude/skills/apify-ecommercebash
SKILL_PATH=~/.claude/skills/apify-ecommerceStep 2: Run Script
步骤2:运行脚本
Quick answer (display in chat):
bash
node --env-file=~/.claude/.env $SKILL_PATH/reference/scripts/run_actor.js \
--actor "apify/e-commerce-scraping-tool" \
--input 'JSON_INPUT'CSV export:
bash
node --env-file=~/.claude/.env $SKILL_PATH/reference/scripts/run_actor.js \
--actor "apify/e-commerce-scraping-tool" \
--input 'JSON_INPUT' \
--output YYYY-MM-DD_filename.csv \
--format csvJSON export:
bash
node --env-file=~/.claude/.env $SKILL_PATH/reference/scripts/run_actor.js \
--actor "apify/e-commerce-scraping-tool" \
--input 'JSON_INPUT' \
--output YYYY-MM-DD_filename.json \
--format json快速结果(在聊天中显示):
bash
node --env-file=~/.claude/.env $SKILL_PATH/reference/scripts/run_actor.js \
--actor "apify/e-commerce-scraping-tool" \
--input 'JSON_INPUT'CSV导出:
bash
node --env-file=~/.claude/.env $SKILL_PATH/reference/scripts/run_actor.js \
--actor "apify/e-commerce-scraping-tool" \
--input 'JSON_INPUT' \
--output YYYY-MM-DD_filename.csv \
--format csvJSON导出:
bash
node --env-file=~/.claude/.env $SKILL_PATH/reference/scripts/run_actor.js \
--actor "apify/e-commerce-scraping-tool" \
--input 'JSON_INPUT' \
--output YYYY-MM-DD_filename.json \
--format jsonStep 3: Summarize Results
步骤3:总结结果
Report:
- Number of items extracted
- File location (if exported)
- Key insights based on workflow:
- Products: Price range, outliers, MAP violations
- Reviews: Average rating, sentiment trends, quality issues
- Sellers: Seller count, unauthorized sellers found
报告内容:
- 提取的条目数量
- 文件位置(若已导出)
- 基于工作流的关键洞察:
- 产品: 价格范围、异常值、MAP违规情况
- 评论: 平均评分、情感趋势、质量问题
- 卖家: 卖家数量、发现的未授权卖家
Error Handling
错误处理
| Error | Solution |
|---|---|
| Ensure |
| Verify Actor ID: |
| Check Apify console link in error output |
| Reduce |
| Verify URLs are valid and accessible |
| Check marketplace value matches supported list exactly |
| 错误 | 解决方案 |
|---|---|
| 确保 |
| 验证Actor ID: |
| 查看错误输出中的Apify控制台链接 |
| 减少 |
| 验证URL有效且可访问 |
| 检查平台值是否与支持列表完全匹配 |