

爬取任意 Shopify 商店的产品数据,包括标题、价格、描述、SKU、库存、图片等。支持从 sitemap 自动发现产品 URL、并发爬取、扩展输出函数和扩展爬取函数。
List of Shopify store URLs. The worker parses each store's robots.txt to discover sitemaps and crawl all products.
Maximum output items (products with variants) per store URL. Due to platform task splitting (b=startUrl), this limit applies independently to each subtask. Total max = URLs count × this value. Set to 0 for unlimited (may hit platform timeout).
Maximum number of concurrent requests.
Maximum retries for failed requests before giving up.
Check if the target site is a Shopify store. Even if robots.txt does not contain Shopify keywords, the script will still attempt sitemap parsing.
Fetch HTML pages before JSON API calls (slower, 2x requests). Default: JSON API only.
Enable verbose logging for debugging.
Custom JavaScript function to modify or filter output data. Return null to skip the item.
Custom JavaScript function to extend crawling logic (e.g. URL filtering, custom sitemaps).
Custom data object accessible in both extend functions.
探索商店中更多热门采集工具
by mn06pz6r
Ozon 商品详情采集任务。输入一个或多个商品链接。
by vew5uoxb
获取商品基础信息、商品价格信息、商品图片、商品规格属性、商品 SKU 信息、商品评分及评论信息、评论对应 SKU 信息、店铺基础信息。
by mn06pz6r
1688商品详情爬取
by Eric Lozaga
获取Thumbtack的评论及评论数据