- 基于 API 的爬取工具
使用我们的接口构建您的 API 请求 - 大规模自动化
构建自己的调度器以控制频率 - 数据交付
将数据传送到您首选的存储位置或直接下载
网站地图抓取工具 - 网站地图爬虫工具
抓取任何网站的 XML 网站地图，轻松提取所有页面类型的网站地图 URL，为您的数据采集项目服务。通过网站地图即可抓取整个网站，并降低遇到 301 或 404 状态码页面的几率。
- 专属客户经理
- 以多种格式获取结果
- 通过 API 或无代码抓取工具按需抓取网站地图
支持支付宝等多种支付方式
获得全球 超20000 位客户的信赖
获得全球 超20000 位客户的信赖
轻松爬取网站地图数据
网站地图爬取API
使用此 API 开始根据指定参数收集数据
网站地图无代码爬取工具
使用此“即插即用”爬取工具开始收集数据
- 基于控制面板的爬取工具
所有操作均在我们的控制面板中完成 - 简单易用
将您的输入添加到爬取工具，即可开始 - 从控制面板获取结果
可直接从控制面板下载结果
网页爬取工具
可用的网站地图爬取工具
无需开发和维护基础设施。只需提取大规模网页数据，并通过网页爬取 API 或无代码爬取工具确保可扩展性和可靠性。
LinkedIn people profiles
ID, Name, City, Country code, Position, About, Posts, Groups, and more.
2.5K+LinkedIn people profiles - Discover LinkedIn profiles by name
ID, Name, City, Country code, Position, About, Posts, Groups, and more.
Amazon products
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products - Collects products by best sellers category URL
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products - Collects products by specific category URL
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products - Collects products by specific keywords
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products - find products by using upc numbers
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
LinkedIn company information
ID, Name, Country code, Locations, Followers, Employees in linkedin, About, Specialties, and more.
Crunchbase companies information
Name, URL, ID, Cb rank, Region, About, Industries, Operating status, and more.
Crunchbase companies information - Searching data by keyword
Name, URL, ID, Cb rank, Region, About, Industries, Operating status, and more.
Instagram - Profiles
Account, Fbid, ID, Followers, Posts count, Is business account, Is professional account, Is verified, and more.
Linkedin job listings information
URL, Job posting id, Job title, Company name, Company id, Job location, Job summary, Applay link, and more.
Linkedin job listings information - Discover new jobs by keyword
URL, Job posting id, Job title, Company name, Company id, Job location, Job summary, Applay link, and more.
Linkedin job listings information - Discover jobs by company URL
URL, Job posting id, Job title, Company name, Company id, Job location, Job summary, Applay link, and more.
Zillow properties listing information
Zpid, City, State, HomeStatus, Address, IsListingClaimedByCurrentSignedInUser, IsCurrentSignedInAgentResponsible, Bedrooms, and more.
Zillow properties listing information - Discover by custom filters - location, home type and status
Zpid, City, State, HomeStatus, Address, IsListingClaimedByCurrentSignedInUser, IsCurrentSignedInAgentResponsible, Bedrooms, and more.
Zillow properties listing information - Search by parameters on zillow and use the direct link as input
Zpid, City, State, HomeStatus, Address, IsListingClaimedByCurrentSignedInUser, IsCurrentSignedInAgentResponsible, Bedrooms, and more.
Instagram - Posts
URL, User posted, Description, Hashtags, Num comments, Date posted, Likes, Photos, and more.
Instagram - Posts - Collects posts from a specific URLs by using profile URL
URL, User posted, Description, Hashtags, Num comments, Date posted, Likes, Photos, and more.
LinkedIn posts
URL, ID, User id, Use url, Title, Headline, Post text, Date posted, and more.
LinkedIn posts - Discover user's articles by URL
URL, ID, User id, Use url, Title, Headline, Post text, Date posted, and more.
LinkedIn posts - Discover posts by Profile URL
URL, ID, User id, Use url, Title, Headline, Post text, Date posted, and more.
LinkedIn posts - Discover new posts company URL
URL, ID, User id, Use url, Title, Headline, Post text, Date posted, and more.
X (formerly Twitter) - Posts
ID, User posted, Name, Description, Date posted, Photos, URL, Quoted post, and more.
X (formerly Twitter) - Posts - Collecting Twitter posts URLs
ID, User posted, Name, Description, Date posted, Photos, URL, Quoted post, and more.
Walmart - products
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Walmart - products - Find new products by using specific category URL
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Walmart - products - Collects products by specific keywords
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Walmart - products - Discover products by using sku numbers
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Facebook - Pages Posts by Profile URL
URL, Post id, User url, User username raw, Content, Date posted, Hashtags, Num comments, and more.
TikTok - Profiles
Account id, Nickname, Biography, Awg engagement rate, Comment engagement rate, Like engagement rate, Bio link, Predicted lang, and more.
TikTok - Profiles - Discover by search URL and country
Account id, Nickname, Biography, Awg engagement rate, Comment engagement rate, Like engagement rate, Bio link, Predicted lang, and more.
Amazon Reviews
URL, Product name, Product rating, Product rating object, Product rating max, Rating, Author name, Asin, and more.
Indeed job listings information
Jobid, Company name, Date posted parsed, Job title, Description text, Benefits, Qualifications, Job type, and more.
Indeed job listings information - Collect new jobs by keyword search in specific location
Jobid, Company name, Date posted parsed, Job title, Description text, Benefits, Qualifications, Job type, and more.
Indeed job listings information - Discover jobs by company URL
Jobid, Company name, Date posted parsed, Job title, Description text, Benefits, Qualifications, Job type, and more.
TikTok - Posts
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
TikTok - Posts - Input specific profile URL to get posts published by it
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
TikTok - Posts - Search posts by specific keyword or hashtag
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
TikTok - Posts - discover new records by TikTok discover URL
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
Airbnb Properties Information
Name, Price, Image, Description, Category, Availability, Discount, Reviews, and more.
Airbnb Properties Information - Search Airbnb by location
Name, Price, Image, Description, Category, Availability, Discount, Reviews, and more.
Airbnb Properties Information - Discover by search url
Name, Price, Image, Description, Category, Availability, Discount, Reviews, and more.
YouTube - Profiles
URL, Handle, Handle md5, Banner img, Profile image, Name, Subscribers, Description, and more.
YouTube - Profiles - Collects channel by keyword related to the channel or video's of the channel
URL, Handle, Handle md5, Banner img, Profile image, Name, Subscribers, Description, and more.
Glassdoor companies overview information
ID, Company, Ratings overall, Details size, Details founded, Details type, Country code, Company type, and more.
Glassdoor companies overview information - Search for companies by keyword
ID, Company, Ratings overall, Details size, Details founded, Details type, Country code, Company type, and more.
Glassdoor companies overview information - discover new companies by input filters
ID, Company, Ratings overall, Details size, Details founded, Details type, Country code, Company type, and more.
Glassdoor companies overview information - discover by search url
ID, Company, Ratings overall, Details size, Details founded, Details type, Country code, Company type, and more.
Youtube - Videos posts
URL, Title, Youtuber, Youtuber md5, Video url, Video length, Likes, Views, and more.
Youtube - Videos posts - Search new youtube videos by keyword
URL, Title, Youtuber, Youtuber md5, Video url, Video length, Likes, Views, and more.
Youtube - Videos posts - Discover videos by channel URL
URL, Title, Youtuber, Youtuber md5, Video url, Video length, Likes, Views, and more.
Youtube - Videos posts - Search videos by keyword and then apply relevant video filters
URL, Title, Youtuber, Youtuber md5, Video url, Video length, Likes, Views, and more.
Youtube - Videos posts - Collect YouTube posts by hashtags
URL, Title, Youtuber, Youtuber md5, Video url, Video length, Likes, Views, and more.
Yahoo Finance business information
Name, Company id, Entity type, Summary, Stock ticker, Currency, Earnings date, Exchange, and more.
Yahoo Finance business information - Discover records by keyword
Name, Company id, Entity type, Summary, Stock ticker, Currency, Earnings date, Exchange, and more.
X (formerly Twitter) - Profiles
X id, URL, ID, Profile name, Biography, Is verified, Profile image link, External link, and more.
Facebook - Comments
URL, Post id, Post url, Comment id, User name, User id, User url, Date created, and more.
Shein- Products
Product name, Description, Initial price, Final price, Currency, In stock, Color, Size, and more.
Shein- Products - Discovery new products by category URL
Product name, Description, Initial price, Final price, Currency, In stock, Color, Size, and more.
Amazon products global dataset
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products global dataset - Collects products by specific category URL
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products global dataset - Collecting products by keyword search
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products global dataset - Collect Amazon products by seller URL
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products global dataset - Collect products from Brands URLs
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Instagram - Reels
URL, User posted, Description, Hashtags, Num comments, Date posted, Likes, Shares, and more.
Instagram - Reels - Discover reels video from Instagram profile or direct search url
URL, User posted, Description, Hashtags, Num comments, Date posted, Likes, Shares, and more.
Instagram - Reels - Collect all Reels from Instagram profiles (without the post timestamp)
URL, User posted, Description, Hashtags, Num comments, Date posted, Likes, Shares, and more.
Glassdoor job listings information
URL, Company url overview, Company name, Company rating, Job title, Job location, Job overview, Company headquarters, and more.
Glassdoor job listings information - Collect new jobs by keyword search like the job title
URL, Company url overview, Company name, Company rating, Job title, Job location, Job overview, Company headquarters, and more.
Glassdoor job listings information - Discover jobs by company URL
URL, Company url overview, Company name, Company rating, Job title, Job location, Job overview, Company headquarters, and more.
Instagram - Comments
URL, Comment user, Comment user url, Comment date, Comment, Likes number, Replies number, Replies, and more.
Yelp businesses overview
Business id, Yelp biz id, Name, Updates from business, Overall rating, Reviews count, Is claimed, Categories, and more.
Zoominfo companies information
URL, ID, Name, Description, Revenue, Revenue currency, Revenue text, Stock symbol, and more.
Zoominfo companies information - discover records by search url
URL, ID, Name, Description, Revenue, Revenue currency, Revenue text, Stock symbol, and more.
Booking Hotel Listings
URL, Hotel id, Title, Location, Country, City, Metro railway access, Images, and more.
Booking Hotel Listings -
URL, Hotel id, Title, Location, Country, City, Metro railway access, Images, and more.
Google News
URL, Title, Publisher, Date, Category, Keyword, Country, Language, and more.
TikTok Shop
URL, Title, Available, Description, Currency, Initial price, Final price, Discount percent, and more.
TikTok Shop - category
URL, Title, Available, Description, Currency, Initial price, Final price, Discount percent, and more.
Google maps reviews
URL, Place id, Place name, Country, Address, Review id, Reviewer name, Reviews by reviewer, and more.
eBay
URL, Product id, Title, Seller name, Seller rating, Seller reviews, Breadcrumbs, Root category, and more.
eBay - Gather data on products using specified keywords
URL, Product id, Title, Seller name, Seller rating, Seller reviews, Breadcrumbs, Root category, and more.
eBay - Collect products from shops on eBay
URL, Product id, Title, Seller name, Seller rating, Seller reviews, Breadcrumbs, Root category, and more.
Glassdoor companies reviews
Overview id, Review id, Review url, Rating date, Pros, Cons, Count helpful, Count unhelpful, and more.
G2 software product overview
URL, Product name, Rating, Description, Product url, Seller, Ownership, Seller website, and more.
Reddit- Posts
Post id, URL, User posted, Title, Description, Num comments, Date posted, Community name, and more.
Reddit- Posts - Discover Reddit posts by Subreddit URL
Post id, URL, User posted, Title, Description, Num comments, Date posted, Community name, and more.
Reddit- Posts - Discovery by keyword of Reddit posts
Post id, URL, User posted, Title, Description, Num comments, Date posted, Community name, and more.
pitchbook companies information
URL, ID, Company name, Company socials, Year founded, Status, Employees, Latest deal type, and more.
Google Shopping
URL, Product id, Title, Product description, Rating, Reviews count, Images, Variations, and more.
Google Shopping - collects products from web using keywords
URL, Product id, Title, Product description, Rating, Reviews count, Images, Variations, and more.
Australia real estate properties
Rea property id, Property type, State, Postcode, Year built, Last sold date, Last sold agency, Bedrooms, and more.
Australia real estate properties - discover records by search url
Rea property id, Property type, State, Postcode, Year built, Last sold date, Last sold agency, Bedrooms, and more.
Australia real estate properties - Discover records by Listing type
Rea property id, Property type, State, Postcode, Year built, Last sold date, Last sold agency, Bedrooms, and more.
Github repository
URL, ID, Code language, Code, Num lines, User name, User url, Size, and more.
Github repository - Discover github code by repository URL
URL, ID, Code language, Code, Num lines, User name, User url, Size, and more.
Github repository - discover new records by search url
URL, ID, Code language, Code, Num lines, User name, User url, Size, and more.
Zara - Products
Category id, Category name, Product id, Product name, Price, Currency, Colour code, Colour, and more.
Facebook - Posts by group URL
URL, Post id, User url, User username raw, Content, Date posted, Hashtags, Num comments, and more.
Amazon sellers info
Seller id, URL, Seller name, Description, Detailed info, Stars, Feedbacks, Return policy, and more.
Google Play Store
URL, Title, Developer, Monetization features, Images, About, Data safety, Rating, and more.
G2 software - product reviews
Review id, Author id, Author, Position, Company size, Stars, Date, Title, and more.
Home Depot US
URL, Domain, Country code, Model number, Sku, Product id, Product name, Manufacturer, and more.
Home Depot US - Gather data on products using specified keywords
URL, Domain, Country code, Model number, Sku, Product id, Product name, Manufacturer, and more.
Booking Listings Search
URL, Location, Check in, Check out, Adults, Children, Rooms, ID, and more.
TikTok - Comments
URL, Post url, Post id, Post date created, Date created, Comment text, Num likes, Num replies, and more.
Facebook Marketplace
URL, Title, Initial price, Final price, Currency, Product id, Breadcrumbs, Condition, and more.
Facebook Marketplace - Collect Facebook marketplace listings by keyword
URL, Title, Initial price, Final price, Currency, Product id, Breadcrumbs, Condition, and more.
Facebook Marketplace - discover by url
URL, Title, Initial price, Final price, Currency, Product id, Breadcrumbs, Condition, and more.
Etsy
URL, Product id, Listing inventory id, Title, Rating, Reviews count shop, Reviews count item, Initial price, and more.
Etsy - Collect data on products using specified keywords
URL, Product id, Listing inventory id, Title, Rating, Reviews count shop, Reviews count item, Initial price, and more.
Etsy - Collects data from shop's URL
URL, Product id, Listing inventory id, Title, Rating, Reviews count shop, Reviews count item, Initial price, and more.
Lazada - Products
URL, ID, Title, Rating, Reviews, Sold, Initial price, Final price, and more.
Lazada - Products - Discover products by keyword
URL, ID, Title, Rating, Reviews, Sold, Initial price, Final price, and more.
Lazada - Products - Discover products by category URL or brand URL
URL, ID, Title, Rating, Reviews, Sold, Initial price, Final price, and more.
Lazada - Products - Discover products by seller URL
URL, ID, Title, Rating, Reviews, Sold, Initial price, Final price, and more.
Lazada - Products - Discover products by brand URL
URL, ID, Title, Rating, Reviews, Sold, Initial price, Final price, and more.
Facebook - Posts by post URL
URL, Post id, User url, User username raw, Content, Date posted, Hashtags, Num comments, and more.
Amazon products search
Asin, URL, Name, Sponsored, Initial price, Final price, Currency, Sold, and more.
Ikea - Products
Description, In stock, Color, Size, Reviews count, Main image, Category url, Category, and more.
Ikea - Products - Discovery new products by category URL
Description, In stock, Color, Size, Reviews count, Main image, Category url, Category, and more.
Best Buy products
URL, Product id, Title, Images, Final price, Currency, Discount, Initial price, and more.
Best Buy products - Collect data on products using specified keywords
URL, Product id, Title, Images, Final price, Currency, Discount, Initial price, and more.
Yelp businesses reviews
Business id, Review auther, Rating, Date, Content, Review image, Reactions, Replies, and more.
Yelp businesses reviews - Search for Yelp businesses by country, category and location
Business id, Review auther, Rating, Date, Content, Review image, Reactions, Replies, and more.
Zillow price history
URL, Zpid, Date, Event, Posting is rental, Price, Price change rate, Price per squarefoot, and more.
Target
URL, Product id, Title, Product description, Rating, Reviews count, Initial price, Discount, and more.
Target - Gather data on products using specified keywords
URL, Product id, Title, Product description, Rating, Reviews count, Initial price, Discount, and more.
Myntra products
URL, Product id, Title, Product description, Rating, Ratings count, Initial price, Discount, and more.
Myntra products - Collect products by category URL
URL, Product id, Title, Product description, Rating, Ratings count, Initial price, Discount, and more.
Myntra products - Collect products by keyword
URL, Product id, Title, Product description, Rating, Ratings count, Initial price, Discount, and more.
Myntra products - Collect products by brand URL
URL, Product id, Title, Product description, Rating, Ratings count, Initial price, Discount, and more.
Trustpilot business reviews
Company name, Review id, Review date, Review rating, Review title, Review content, Is verified review, Review date of experience, and more.
Sephora products
URL, ID, Name, Sku, In stock, Regular price, Actual price, Unit price, and more.
Reuters news
ID, URL, Author, Headline, Topics, Publication date, Updated last, Description, and more.
Reuters news - Reuters news article dataset discover new records by keyword search in website, include option to filter by Section,Date Range and sort option like in link https://www.reuters.com/site-search/?query=football
ID, URL, Author, Headline, Topics, Publication date, Updated last, Description, and more.
Reuters news - Discovery article by the publishing date and time
ID, URL, Author, Headline, Topics, Publication date, Updated last, Description, and more.
Indeed companies info
Name, Description, URL, Work happiness, Jobs categories, Website, Industry, Company size, and more.
Indeed companies info - By company list
Name, Description, URL, Work happiness, Jobs categories, Website, Industry, Company size, and more.
Indeed companies info - Discover companies by Industries and location (State) in US
Name, Description, URL, Work happiness, Jobs categories, Website, Industry, Company size, and more.
Indeed companies info - Search company by company name
Name, Description, URL, Work happiness, Jobs categories, Website, Industry, Company size, and more.
Zoopla properties listing information
URL, Property type, Property title, Address, Google map location, Virtual tour, Street view, URL property, and more.
Zoopla properties listing information - Discover by custom filters - location and property type
URL, Property type, Property title, Address, Google map location, Virtual tour, Street view, URL property, and more.
Ozon.ru products
URL, Sku, Breadcrumbs, Name, Rating, Review count, Description, Image, and more.
Reddit - Comments
URL, Comment id, User posted, Comment, Date posted, Post url, Post id, Community name, and more.
Owler companies information
CompanyID, Ownership, IndustrySectors, Revenue, Founded, CompanyName, Country, EmployeeCount, and more.
BBC news
ID, URL, Author, Headline, Topics, Publication date, Content, Videos, and more.
BBC news - Discover BBC articles by keyword
ID, URL, Author, Headline, Topics, Publication date, Content, Videos, and more.
Pinterest - Posts
URL, Post id, Title, Content, Date posted, User name, User url, User id, and more.
Pinterest - Posts - Collects posts by specific keywords
URL, Post id, Title, Content, Date posted, User name, User url, User id, and more.
Pinterest - Posts - Discover posts by using specific profile url
URL, Post id, Title, Content, Date posted, User name, User url, User id, and more.
Wikipedia articles
URL, Title, Table of contents, Raw text, Cataloged text, Images, See also, References, and more.
Wikipedia articles - Discover new articles by searching keywords in Wikipedia
URL, Title, Table of contents, Raw text, Cataloged text, Images, See also, References, and more.
H&M - Products
Category tree, Color, Country code, County of origin, Currency, Delivery, Description, Domain, and more.
H&M - Products - Discovery new products by category URL
Category tree, Color, Country code, County of origin, Currency, Delivery, Description, Domain, and more.
US lawyers directory
URL, Address, Admission, Areas of practice, Isln, Law school attended, Location, Name, and more.
US lawyers directory - Search on the website by attorney name, practice area, school, articles, or location
URL, Address, Admission, Areas of practice, Isln, Law school attended, Location, Name, and more.
Youtube - Comments
Comment id, Comment text, Likes, Replies, Username, Username md5, User channel, Date, and more.
Realtor international properties listings
URL, ID, Title, Price, Currency, Description, Images, Bedrooms, and more.
Webmotors Brasil - Cars Listings
ID SELLER, ID, URL, Tipo, Marca, Modelo, Ano, Variante, and more.
Webmotors Brasil - Cars Listings - Discover new records by category URL
ID SELLER, ID, URL, Tipo, Marca, Modelo, Ano, Variante, and more.
Facebook Company Reviews
Company name, Company id, Company url, URL, Review time, Recommends, Review content, Review attachments, and more.
Facebook - Reels by profile URL
URL, Post id, User url, User username raw, Content, Date posted, Hashtags, Num comments, and more.
Tokopedia Products
Product id, Title, URL, Currency, Delivery, Final price, Initial price, Seller name, and more.
Tokopedia Products - Search products by keyword
Product id, Title, URL, Currency, Delivery, Final price, Initial price, Seller name, and more.
Tokopedia Products - Collect URLs of products by category URLs
Product id, Title, URL, Currency, Delivery, Final price, Initial price, Seller name, and more.
Tokopedia Products - Collect Tokopedia's products by seller URL
Product id, Title, URL, Currency, Delivery, Final price, Initial price, Seller name, and more.
Lowes.com
URL, Domain, Marketplace pn, Sku, Other pn, Model number, Gtin ean pn, Product name, and more.
Lowes.com - Gather data on products using specified keywords
URL, Domain, Marketplace pn, Sku, Other pn, Model number, Gtin ean pn, Product name, and more.
CNN news
ID, URL, Author, Headline, Topics, Publication date, Updated last, Content, and more.
CNN news - Discover CNN articles by search URL
ID, URL, Author, Headline, Topics, Publication date, Updated last, Content, and more.
CNN news - Discovery article by the publishing date and time
ID, URL, Author, Headline, Topics, Publication date, Updated last, Content, and more.
Xing social network
Account id, FamilyName, Gender, Membership, Country code, Experience, Education, Languages, and more.
OLX Brazil - marketplace ads
Body, Subject, Currency, PriceValue, ProfessionalAnnouncement, Category, ParentCategoryName, CategoryName, and more.
Digikey - Products
Product url, Category url, Part number, Description, Manufacturer, Manufacturer url, Datasheet url, Rohs compliant, and more.
Digikey - Products - Discover by category url
Product url, Category url, Part number, Description, Manufacturer, Manufacturer url, Datasheet url, Rohs compliant, and more.
Wildberries.ru products
URL, Sku, Breadcrumbs, Name, Rating, Review count, Image, Brand, and more.
Mouser - Products
Product url, Category url, Mouser part num, Mfr part number, Manufacturer, Image, Image high, Manufacturer url, and more.
Mouser - Products - Discovery new products by category URL
Product url, Category url, Mouser part num, Mfr part number, Manufacturer, Image, Image high, Manufacturer url, and more.
Zalando products
Domain, Country code, URL, Sku, Condition, Gender, Product name, Brand, and more.
Zalando products - Discover products by domain
Domain, Country code, URL, Sku, Condition, Gender, Product name, Brand, and more.
Zalando products - Discover records by search keyword
Domain, Country code, URL, Sku, Condition, Gender, Product name, Brand, and more.
Zalando products - Discover products by category URL
Domain, Country code, URL, Sku, Condition, Gender, Product name, Brand, and more.
Zalando products - Collect products by brand URL
Domain, Country code, URL, Sku, Condition, Gender, Product name, Brand, and more.
Pitchbook People Profiles
URL, ID, Name, Biography, Primary position, Commpany, Company url, Education, and more.
Facebook Events
Event id, URL, Main image, Event date, Title, People responded, Event by, Location, and more.
Facebook Events - discover Facebook events search URL
Event id, URL, Main image, Event date, Title, People responded, Event by, Location, and more.
Facebook Events - Discover events by venue URL
Event id, URL, Main image, Event date, Title, People responded, Event by, Location, and more.
Asos - Products
URL, Name, Brand, Description, About me, Availability, Buy the look, Category, and more.
Asos - Products - Collect products by category URL
URL, Name, Brand, Description, About me, Availability, Buy the look, Category, and more.
Asos - Products - Collect products by keyword
URL, Name, Brand, Description, About me, Availability, Buy the look, Category, and more.
Asos - Products - Collect products by brand URL
URL, Name, Brand, Description, About me, Availability, Buy the look, Category, and more.
Lego - Products
Product name, Category, Description, Initial price, Final price, Currency, In stock, Availability, and more.
Lego - Products - Discovery new products by category URL
Product name, Category, Description, Initial price, Final price, Currency, In stock, Availability, and more.
Wayfair products
URL, Product id, Title, Rating, Reviews count, Initial price, Discount, Final price, and more.
Wayfair products - Gather data on products using specified keywords
URL, Product id, Title, Rating, Reviews count, Initial price, Discount, Final price, and more.
Apple App Store
URL, Title, Sub title, Developer, Top charts, Monetization features, Image, Screenshots, and more.
Pinterest - Profiles
URL, Profile picture, Name, Nickname, Website, Bio, Following count, Follower count, and more.
Pinterest - Profiles - Discover profiles by Keyword in profile name and profile posts
URL, Profile picture, Name, Nickname, Website, Bio, Following count, Follower count, and more.
Bluesky - Posts
URL, Post id, Post date, Posted by, Post text, Comments, Reposts, Likes, and more.
Bluesky - Posts - Collect posts from profile URL
URL, Post id, Post date, Posted by, Post text, Comments, Reposts, Likes, and more.
Chanel Products
Product name, Product description, Country, Currency, Color, Variations, Free sample, Image slider, and more.
Chanel Products - Discover new products in Chanel by category URL
Product name, Product description, Country, Currency, Color, Variations, Free sample, Image slider, and more.
Google Shopping products search US
URL, Product id, Title, Final price, Initial price, Currency, Rating, Reviews count, and more.
Lazada - Reviews
URL, Title, Rating, Reviews, Seller name, Sku, Mpn, Is super seller, and more.
Nordstrom products
URL, Domain, Country code, Marketplace pn, Other pn, Upc, Model number, Gtin ean pn, and more.
Google Play Store reviews
URL, Review id, Reviewer name, Review date, Review rating, Review, Found helpful, App url, and more.
Dior - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Dior - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Metrocuadrado - Properties Listings
URL, ID, Precio, Habitaciones, Banos, Dimension propiedad, Dimension terreno, Comuna Ciudad, and more.
VentureRadar company information
URL, Location, Name, Country code, Ownership, Score, Auto analyst score, Website popularity, and more.
Chileautos Chile - Cars Listings
URL, Marca, Modelo, Ano, Variante, Kilometraje, Condicion, Combustible, and more.
Quora posts
URL, Post id, Author name, Title, Post date, Originally answered, Over all answers, Post text, and more.
Inmuebles24 Mexico - Properties Listings
URL, Title, GeneratedTitle, Description, Seller, Precio, Publicado hace, CreatedDate, and more.
Home Depot CA
Domain, Country code, URL, Model number, Sku, Product name, Manufacturer, Description, and more.
Home Depot CA - Gather data on products using specified keywords
Domain, Country code, URL, Model number, Sku, Product name, Manufacturer, Description, and more.
Trustradius product reviews
URL, Product id, Product name, Review id, Review url, Review title, Review rating, Review date, and more.
AE.com - Complete Products
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Availability, and more.
AE.com - Complete Products - Discovery new products by category URL
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Availability, and more.
Vimeo - Videos posts
Video id, Title, URL, Uploader, Video url, Video length, Views, Likes, and more.
Vimeo - Videos posts - focus on licensed videos with "common creative" license
Video id, Title, URL, Uploader, Video url, Video length, Views, Likes, and more.
Vimeo - Videos posts - scrape videos by URL
Video id, Title, URL, Uploader, Video url, Video length, Views, Likes, and more.
Hermes- Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Hermes- Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Twitch - streams dataset
URL, Stream id, Streamer name, Verified partner, Stream title, Tags, Viewers number, Stream time, and more.
Twitch - streams dataset - Discover stream by a search term
URL, Stream id, Streamer name, Verified partner, Stream title, Tags, Viewers number, Stream time, and more.
Twitch - streams dataset - Discover stream by category url
URL, Stream id, Streamer name, Verified partner, Stream title, Tags, Viewers number, Stream time, and more.
Crawl API - Map all links from a given domain, collecting internal and external URLs for seamless analysis, auditing, or integration into your workflows.
Markdown, URL, Html2text, Page html, Ld json, and more.
Zonaprop Argentina - Properties Listing
URL, Title, GeneratedTitle, Imagenes, Numero de imagenes, Description, Precio, Currency, and more.
Zonaprop Argentina - Properties Listing - Discover products by domain
URL, Title, GeneratedTitle, Imagenes, Numero de imagenes, Description, Precio, Currency, and more.
Toctoc - Properties Listings
Imagen, No de imagenes, Descripcion, Precio, Currency, Ubicacion, Habitaciones, Banos, and more.
Yapo Chile - marketplace ads
Title, Description, Seller name, Root category id, Root category name, Parent category id, Parent category name, Active, and more.
Toysrus - Products
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Reviews count, and more.
Toysrus - Products - Discovery new products by category URL
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Reviews count, and more.
Apple App Store reviews
URL, Review id, Review title, Review rating, Reviewer name, Review date, Review, Developer response, and more.
Ashleyfurniture - Products
Product name, Brand, Initial price, Final price, Currency, In stock, Availability, Color, and more.
Ashleyfurniture - Products - sitemap
Product name, Brand, Initial price, Final price, Currency, In stock, Availability, Color, and more.
Ashleyfurniture - Products - Discovery new products by category URL
Product name, Brand, Initial price, Final price, Currency, In stock, Availability, Color, and more.
Lazada products search (GMV)
URL, Name, Price, Currency, Number sold, Sku, Image url, Rating, and more.
Mango Products
Product name, Price, Image, Size, Product article, Availability, Description, Colour code, and more.
Balenciaga.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Balenciaga.com - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Mediamarkt.de products
Brand, Description, Manufacturer, Ean, Sku, Initial price, Final price, In stock, and more.
Agoda Properties Listings
URL, Hotel id, Title, Location, Country, City, Metro railway access, Images, and more.
Agoda Properties Listings - collect properties by country
URL, Hotel id, Title, Location, Country, City, Metro railway access, Images, and more.
Fendi Products
Product id, URL, Product name, Product description, Short description, Image, Price, Currency, and more.
Fendi Products - Discover products by category URL
Product id, URL, Product name, Product description, Short description, Image, Price, Currency, and more.
Zara Home Products
Category id, Category key, Category name, Product id, Product name, Price, Price discount, Price with fillings, and more.
Ysl.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Infocasas Uruguay - Properties Listings
URL, ID, Imagen, Descripcion, Precio, Ubicacion, Habitaciones, Banos, and more.
Walmart - products zipcodes
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Walmart - products zipcodes - Collect data by category URL
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Walmart - products zipcodes - Collect data by Keyword
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Carters.com - Products
Product name, Description, In stock, Availability, Color, Size, Reviews count, Category url, and more.
Carters.com - Products - Discovery new products by category URL
Product name, Description, In stock, Availability, Color, Size, Reviews count, Category url, and more.
Prada.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Prada.com - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Fanatics.com - Products
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Color, and more.
Fanatics.com - Products - Discovery new products by category URL
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Color, and more.
Crateandbarrel - Products
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Availability, and more.
Crateandbarrel - Products - Discovery new products by category URL
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Availability, and more.
Bottegaveneta.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Bottegaveneta.com - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Properati Argentina and Colombia - Properties Listings
Type, Name, Estrato, Habitaciones, Banos, M2, Descripcion, Precio, and more.
Massimo Dutti - Products
URL, Title, Price, Product type, Family name, Subfamily name, Images, Size, and more.
Massimo Dutti - Products - Discovery new products by category URL
URL, Title, Price, Product type, Family name, Subfamily name, Images, Size, and more.
Loewe.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Loewe.com - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Sleepnumber.com - Products
Description, Initial price, Final price, Currency, In stock, Color, Size, Reviews count, and more.
Sleepnumber.com - Products - Discovery new products by category URL
Description, Initial price, Final price, Currency, In stock, Color, Size, Reviews count, and more.
Berluti.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Berluti.com - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Delvaux - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Delvaux - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Moynat.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Mybobs.com - Products
Product name, Initial price, Final price, Currency, In stock, Main image, Category tree, Country code, and more.
Mybobs.com - Products - Discovery new products by category URL
Product name, Initial price, Final price, Currency, In stock, Main image, Category tree, Country code, and more.
Celine.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Celine.com - Products - Discover new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Zillow Full Properties Information
URL, Photos, Responsive photos, Has vr model, Description, Home status, Contingent listing type, What i love, and more.
Zillow Full Properties Information - Discover zillow records by zillow search url
URL, Photos, Responsive photos, Has vr model, Description, Home status, Contingent listing type, What i love, and more.
llbean.com - Products
IDentity, Product name, URL, Description, Category tree, Color, Country code, County of origin, and more.
llbean.com - Products - Discovery new products by category URL
IDentity, Product name, URL, Description, Category tree, Color, Country code, County of origin, and more.
Montblanc - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Montblanc - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Raymourflanigan.com - Products
Product name, Seller name, Brand, Description, Initial price, Final price, Currency, In stock, and more.
Walmart sellers info
Seller id, URL, Catalog seller id, Seller name, Seller display name, Seller email, Seller phone, Seller about us, and more.
ChatGPT Search
URL, Prompt, Answer html, Answer text, Links attached, Citations, Recommendations, Country, and more.
Mattressfirm - Products
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Color, and more.
Mattressfirm - Products - Discovery new products by category URL
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Color, and more.
La-z-boy.com - Products
Product name, Description, Initial price, Final price, Currency, In stock, Size, Reviews count, and more.
La-z-boy.com - Products - Discovery new products by category URL
Product name, Description, Initial price, Final price, Currency, In stock, Size, Reviews count, and more.
Zillow properties search page
URL, Zpid, Zipcode, Description, City, Country, State, Address, and more.
219+LinkedIn people search
URL, Name, Subtitle, Location, Experience, Education, Avatar, First name, and more.
219+Walmart products search
ID, URL, Typename, Buy box suppression, Similar items, Us item id, Is bad split, Name, and more.
Perplexity Search
URL, Prompt, Answer html, Answer text, Sources, Country, Source html, and more.
TikTok - Posts by URL Fast API
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
TikTok - Posts by Profile Fast API
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
TikTok - Posts by Search URL Fast API
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
只想要数据？跳过爬取。购买任意网站的现成数据集。
更快部署
一次API调用，大量数据。
数据发现
检测数据结构和模式，以确保高效、有针对性的数据提取。
批量请求处理
减少服务器负载，并优化大规模抓取任务的数据收集。
数据解析
高效地将原始HTML转换为结构化数据，简化数据集成和分析。
数据验证
确保数据可靠性，节省手动检查和预处理的时间。
引擎盖下
再也不用担心代理和验证码了
- 自动IP轮换
- 验证码解决方案
- 用户代理轮换
- 自定义请求头
- JavaScript 渲染
- 住宅代理
定价
网站地图抓取API订阅计划
- 专属客户经理
- 定制套餐
- 高级服务水平协议
- 优先支持
- 个性化的使用流程引导
- 单点登录 (SSO)
- 定制化
- 审核日志
我们接受这些支付方式:
顶级用户体验
易于开始，更易扩展。
无与伦比的稳定性
依靠全球领先的代理基础设施，确保一致的性能并将故障降至最低。
简化的网页抓取
使用可投入生产的API将您的抓取任务自动化，节省资源并减少维护。
无限扩展性
轻松扩展您的抓取项目以满足数据需求，同时保持最佳性能。
用于无缝网站地图数据访问的API
全面、可扩展且合规的网站地图数据提取
灵活的
量身定制您的工作流程
通过Webhook或API交付，以JSON、NDJSON或CSV文件获取结构化的LinkedIn数据。
可扩展的
内置基础设施和解封功能
无需维护代理和解封基础设施，即可获得最大的控制和灵活性。轻松从任何地理位置抓取数据，同时避免验证码和封锁。
稳定的
经过实战验证的基础设施
Bright Data平台为全球超过超20000家公司提供支持，确保99.99%的正常运行时间，并提供覆盖195个国家的超15000万个真实用户IP。
合规的
行业领先的合规性
我们的隐私实践符合数据保护法律，包括欧盟数据保护法规框架、GDPR和CCPA，尊重行使隐私权的请求等。
网站地图抓取工具 - 网站地图爬虫工具 API 用例
抓取所有有效页面列表
网站地图信息通常相对最新
无需担心分页问题
仅抓取您所需的页面类型
为什么 超20000 位客户选择Bright Data
100%合规
抓取的数据是通过道德方式获取的，并符合所有隐私法律。
全球 24/7 支持
一支专注的数据专业团队随时为您提供帮助。
全面的数据覆盖
访问超15000万全球 IP，抓取任何网站的数据。
无与伦比的数据质量
先进的技术和验证方法确保高质量数据。
强大的基础设施
抓取大量数据而不被封锁。
定制化解决方案
获取量身定制的解决方案，以满足独特的需求和目标。
Sitemap 爬虫常见问题
为什么在抓取 Sitemap 时需要使用代理？
代理对于抓取 Sitemap 非常重要，因为它可以让爬虫保持匿名，避免 IP 被封锁，访问地理位置受限的内容，并提升抓取速度。
为什么在抓取 Sitemap 时需要具有防封锁解决方案？
在抓取 Sitemap 时，许多网站都可能具备防爬措施，封锁爬虫的 IP 地址或要求输入验证码。Bright Data 的网页抓取解决方案中采用防封锁技术，可以绕过这些障碍，实现数据采集的连续性。
我可以抓取哪些 Sitemap 数据？
在抓取 Sitemap 时，您只能抓取公开可访问的数据。基于我们对于隐私法的合规承诺，不允许抓取需要登录后才能访问的数据。
抓取 Sitemap 是否合法？
我们的隐私合规措施遵守欧洲数据保护监管框架、GDPR 以及 CCPA，并尊重行使隐私权的相关请求。