- 基于 API 的爬取工具
使用我们的接口构建您的 API 请求 - 大规模自动化
构建自己的调度器以控制频率 - 数据交付
将数据传送到您首选的存储位置或直接下载
新闻抓取工具 - 新闻爬虫工具
从 BBC、CNN、Reuters 和 Google News 抓取并收集数据,如 ID、URL、标题、作者、主题等。
- 专属客户经理
- 以多种格式获取结果
- 通过 API 或无代码抓取工具按需抓取新闻
轻松爬取新闻数据
- 基于控制面板的爬取工具
所有操作均在我们的控制面板中完成 - 简单易用
将您的输入添加到爬取工具,即可开始 - 从控制面板获取结果
可直接从控制面板下载结果
可用的新闻爬取工具
无需开发和维护基础设施。只需提取大规模网页数据,并通过网页爬取 API 或无代码爬取工具确保可扩展性和可靠性。
Yahoo Finance business information
Yahoo Finance business information - Discover records by keyword
Google News
Reuters news
Reuters news - Reuters news article dataset discover new records by keyword search in website, include option to filter by Section,Date Range and sort option like in link https://www.reuters.com/site-search/?query=football
Reuters news - Discovery article by the publishing date and time
BBC news
BBC news - Discover BBC articles by keyword
CNN news
CNN news - Discover CNN articles by search URL
CNN news - Discovery article by the publishing date and time
只想要数据?无需抓取。
直接购买新闻数据集
代码示例
轻松抓取新闻数据,无需担心被屏蔽。
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.bbc.com/news/articles/c0vveg0x594o","keyword":"Biden "},{"url":"https://www.bbc.com/sport/football/articles/cxx2n1y3xzro","keyword":""},{"url":"https://www.bbc.com/news/articles/c7274g1dzxeo","keyword":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_ly5lkfzd1h8c85feyh&format=json&uncompressed_webhook=true"
[
{
"db_source": "j_m96wwfz31upiqxy8hp",
"timestamp": "2025-04-07",
"id": "cly5e9repxyo",
"url": "https:\/\/www.bbc.com\/sport\/rugby-union\/articles\/cly5e9repxyo",
"author": "******",
"headline": "Parachutist: Sale v Toulouse delayed after paratrooper gets stuck in roof",
"topics": [
"Sale",
"Rugby Union"
],
"publication_date": "2025-04-06T19:08:19.389Z"
},
{
"db_source": "j_m96wwfz31upiqxy8hp",
"timestamp": "2025-04-07",
"id": "c24q7l0z11go",
"url": "https:\/\/www.bbc.com\/cymrufyw\/erthyglau\/c24q7l0z11go",
"author": "******",
"headline": "Cynllun grant i gynyddu\u0027r nifer o athrawon sy\u0027n siarad Cymraeg",
"topics": [
"Llywodraeth Cymru",
"Addysg",
"Ysgolion",
"Yr iaith Gymraeg"
],
"publication_date": "2025-04-07T05:00:23.144Z"
},
{
"db_source": "j_m96wwfz31upiqxy8hp",
"timestamp": "2025-04-07",
"id": "cp8k2jnk20ro",
"url": "https:\/\/www.bbc.com\/sport\/cricket\/articles\/cp8k2jnk20ro",
"author": "******",
"headline": "County Championship: Reece takes 10-for as Derbyshire beat Gloucestershire",
"topics": [
"Gloucestershire",
"Derbyshire",
"Cricket"
],
"publication_date": "2025-04-06T15:24:32.013Z"
},
{
"db_source": "j_m96wwfz31upiqxy8hp",
"timestamp": "2025-04-07",
"id": "cwyn71e3lz7o",
"url": "https:\/\/www.bbc.com\/sport\/rugby-union\/articles\/cwyn71e3lz7o",
"author": "******",
"headline": "British and Irish Lions: Caelan Doris has edge over Maro Itoje",
"topics": [
"British \u0026 Irish Lions",
"Rugby Union"
],
"publication_date": "2025-04-07T06:28:58.856Z"
},
{
"db_source": "j_m96wwfz31upiqxy8hp",
"timestamp": "2025-04-07",
"id": "c05nl2ve3nmo",
"url": "https:\/\/www.bbc.com\/sport\/football\/articles\/c05nl2ve3nmo",
"author": "******",
"headline": "Manchester United 0-0 Manchester City: Major changes needed at both clubs",
"topics": [
"Manchester United",
"Premier League",
"Manchester City",
"Football"
],
"publication_date": "2025-04-06T21:07:21.562Z"
}
]
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://news.google.com/","keyword":"Joe Biden","country":"US","language":""},{"url":"https://news.google.com/","keyword":"Politics news","country":"FR","language":""},{"url":"https://news.google.com/","keyword":"Premier league","country":"GB","language":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lnsxoxzi1omrwnka5r&format=json&uncompressed_webhook=true"
[
{
"db_source": "j_m937ca132myl2jlfri",
"timestamp": "2025-04-04",
"url": "https:\/\/www.ausa.org\/articles\/april-2025-book-reviews",
"title": "April 2025 Book Reviews",
"publisher": "Association of the United States Army",
"date": "2025-03-31T16:19:41.000Z",
"category": "News about Book",
"keyword": "Book Reviews"
},
{
"db_source": "j_m937ca132myl2jlfri",
"timestamp": "2025-04-04",
"url": "https:\/\/www.27east.com\/arts\/book-review-kevin-wades-crime-novel-johnny-careless-delves-into-the-world-of-small-town-poli...",
"title": "Book Review: Kevin Wade’s Crime Novel \u0027Johnny Careless\u0027 Delves Into the World of Small Town Police Work",
"publisher": "27 East",
"date": "2025-03-31T07:00:00.000Z",
"category": "News about Book",
"keyword": "Book Reviews"
},
{
"db_source": "j_m937ca132myl2jlfri",
"timestamp": "2025-04-04",
"url": "https:\/\/www.newyorker.com\/magazine\/2025\/03\/24\/original-sins-strike-notes-on-surviving-the-fire-and-there-lives-a-young-g...",
"title": "Briefly Noted Book Reviews",
"publisher": "The New Yorker",
"date": "2025-03-17T07:00:00.000Z",
"category": "News about Book",
"keyword": "Book Reviews"
},
{
"db_source": "j_m937ca132myl2jlfri",
"timestamp": "2025-04-04",
"url": "https:\/\/www.nytimes.com\/2025\/03\/16\/books\/review\/funny-because-its-true-the-onion-christine-wenc.html",
"title": "A Paper Where the News Really Is Fake, and That’s the Point",
"publisher": "The New York Times",
"date": "2025-03-17T07:00:00.000Z",
"category": "News about Book",
"keyword": "Book Reviews"
},
{
"db_source": "j_m937ca132myl2jlfri",
"timestamp": "2025-04-04",
"url": "https:\/\/bookmarks.reviews\/reviews\/the-snares\/",
"title": "Book Marks reviews of The Snares by Rav Grewal-Kök",
"publisher": "bookmarks.reviews",
"date": "2025-04-01T07:00:00.000Z",
"category": "News about Book",
"keyword": "Book Reviews"
}
]
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://edition.cnn.com/2024/07/08/politics/biden-fate-political-career/index.html"},{"url":"https://edition.cnn.com/2024/03/18/politics/video/biden-fundraising-campaign-thomas-gift-intv-031803aseg1-cnni-politics-fast"}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lycz8783197ch4wvwg&format=json&uncompressed_webhook=true"
[
{
"db_source": "j_m97p8eo4ak6v6ts91",
"timestamp": "2025-04-07",
"id": "https:\/\/www.cnn.com\/2025\/03\/28\/middleeast\/israel-young-people-extremist-views-intl-cmd\/index.html",
"url": "https:\/\/www.cnn.com\/2025\/03\/28\/middleeast\/israel-young-people-extremist-views-intl-cmd\/index.html",
"author": "Kar***ox",
"headline": "‘It starts at the top’: Extremist views are all that many young Israelis have ever known",
"topics": [
"world",
"middleeast"
],
"publication_date": "2025-03-28T09:26:23.769Z"
},
{
"db_source": "j_m97p8eo4ak6v6ts91",
"timestamp": "2025-04-07",
"id": "https:\/\/www.cnn.com\/2025\/03\/24\/middleeast\/israel-gaza-ground-offensive-intl\/index.html",
"url": "https:\/\/www.cnn.com\/2025\/03\/24\/middleeast\/israel-gaza-ground-offensive-intl\/index.html",
"author": "Jer*** Di***nd,*********er",
"headline": "Israel considers massive new ground offensive in Gaza as it ramps up pressure on Hamas",
"topics": [
"world",
"middleeast"
],
"publication_date": "2025-03-24T14:08:26.667Z"
},
{
"db_source": "j_m97p8eo4ak6v6ts91",
"timestamp": "2025-04-07",
"id": "https:\/\/www.cnn.com\/2025\/03\/23\/middleeast\/israel-intensifies-southern-gaza-offensive-intl\/index.html",
"url": "https:\/\/www.cnn.com\/2025\/03\/23\/middleeast\/israel-intensifies-southern-gaza-offensive-intl\/index.html",
"author": "Abe***Sal***,Je*********ond*********************rni************************************",
"headline": "Israel strikes southern Gaza hospital as it targets Hamas operative in escalation of renewed offensive",
"topics": [
"world",
"middleeast"
],
"publication_date": "2025-03-23T09:59:06.555Z"
},
{
"db_source": "j_m97p8eo4ak6v6ts91",
"timestamp": "2025-04-07",
"id": "https:\/\/www.cnn.com\/2025\/04\/02\/middleeast\/israel-expands-military-operations-gaza-intl-hnk\/index.html",
"url": "https:\/\/www.cnn.com\/2025\/04\/02\/middleeast\/israel-expands-military-operations-gaza-intl-hnk\/index.html",
"author": "Eug***a Y***f,K*********dde***************",
"headline": "Israel announces expansion of military operation in Gaza to seize ‘large areas’ of land, ordering residents to leave",
"topics": [
"world",
"middleeast"
],
"publication_date": "2025-04-02T04:27:18.869Z"
},
{
"db_source": "j_m97p8eo4ak6v6ts91",
"timestamp": "2025-04-07",
"id": "https:\/\/www.cnn.com\/2025\/03\/24\/middleeast\/israel-approves-proposal-to-facilitate-emigration-of-palestinians-from-gaza-in...",
"url": "https:\/\/www.cnn.com\/2025\/03\/24\/middleeast\/israel-approves-proposal-to-facilitate-emigration-of-palestinians-from-gaza-in...",
"author": "Nad*** Eb***im",
"headline": "Israel approves controversial proposal to facilitate emigration of Palestinians from Gaza",
"topics": [
"world",
"middleeast"
],
"publication_date": "2025-03-24T13:04:32.139Z"
}
]
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.reuters.com/sports/soccer/reaction-spains-victory-over-england-euro-2024-final-2024-07-14/"},{"url":"https://www.reuters.com/sports/soccer/england-miss-out-silverware-yet-again-earn-respect-2024-07-14/"}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lyptx9h74wtlvpnfu&format=json&uncompressed_webhook=true"
[
{
"db_source": "j_m97cc23n2jrej288ts",
"timestamp": "2025-04-07",
"id": "WP3Z4V3S5ZPJHD6MISWCGAXQIM",
"url": "https:\/\/www.reuters.com\/world\/middle-east\/israeli-soldiers-describe-clearance-kill-zone-gazas-edge-2025-04-07\/",
"author": "Jam***Mac***zie***",
"headline": "Israeli soldiers describe clearance of \u0027kill zone\u0027 on Gaza\u0027s edge",
"topics": [
"Soldiers sit on top of APC\u0027s, at the Israel-Gaza border",
"DeathInjrConft",
"legal",
"pol",
"DeathInjrConft",
"DeathInjrConft"
],
"publication_date": "2025-04-07T12:02:44.000Z"
},
{
"db_source": "j_m97cc23n2jrej288ts",
"timestamp": "2025-04-07",
"id": "SNGLZTA4TBKUZN233POKBMRJTQ",
"url": "https:\/\/www.reuters.com\/world\/middle-east\/uneasy-ties-between-palestinians-arab-states-2025-04-07\/",
"author": "Mic***l G***gy,*********uke***",
"headline": "The uneasy ties between Palestinians and Arab states",
"topics": [
"An Egyptian woman carries a food bag and walks next to painting of a map in old Cairo",
"DeathInjrConft",
"pol",
"DeathInjrConft"
],
"publication_date": "2025-04-07T12:27:12.000Z"
},
{
"db_source": "j_m97cc23n2jrej288ts",
"timestamp": "2025-04-07",
"id": "J3EXSRLGONLZVNLFUZSWX7TABI",
"url": "https:\/\/www.reuters.com\/world\/middle-east\/multiple-un-agencies-call-urgent-renewal-ceasefire-gaza-death-toll-mounts-2025...",
"author": "Oli*** Le***ide******",
"headline": "Multiple UN agencies call for urgent renewal of ceasefire in Gaza as death toll mounts",
"topics": [
"Aftermath of an Israeli strike on a house, in Deir Al-Balah in the central Gaza Strip",
"DeathInjrConft",
"hlth",
"legal",
"pol",
"DeathInjrConft"
],
"publication_date": "2025-04-07T16:26:49.000Z"
},
{
"db_source": "j_m97cc23n2jrej288ts",
"timestamp": "2025-04-07",
"id": "PKJMZW35SROHNIYNJFAUUTA7IM",
"url": "https:\/\/www.reuters.com\/world\/europe\/leaders-france-us-egypt-jordan-hold-call-discuss-gaza-france-says-2025-04-07\/",
"author": "Reu***s",
"headline": "Leaders of France, US, Egypt, Jordan hold call to discuss Gaza, France says",
"topics": [
"General view of destroyed buildings in North Gaza, as seen from the Israel-Gaza border",
"DeathInjrConft",
"pol",
"DeathInjrConft"
],
"publication_date": "2025-04-07T16:49:20.000Z"
},
{
"db_source": "j_m97cbnz6i0xjsjc9l",
"timestamp": "2025-04-07",
"id": "7MHCRJT66ZPJJJHR7BDP3VIIEE",
"url": "https:\/\/www.reuters.com\/world\/middle-east\/hamas-tight-grip-gaza-complicates-plan-for-lasting-peace-2025-01-22\/",
"author": "Nid***Al-***hra***",
"headline": "Hamas\u0027 tight grip on Gaza complicates plan for lasting peace",
"topics": [
"Palestinian Hamas policemen keep guard at their destroyed headquarters in Gaza City",
"DeathInjrConft",
"pol",
"DeathInjrConft"
],
"publication_date": "2025-01-22T19:42:38.000Z"
}
]
一次API调用,大量数据。
数据发现
检测数据结构和模式,以确保高效、有针对性的数据提取。
批量请求处理
减少服务器负载,并优化大规模抓取任务的数据收集。
数据解析
高效地将原始HTML转换为结构化数据,简化数据集成和分析。
数据验证
确保数据可靠性,节省手动检查和预处理的时间。
再也不用担心代理和验证码了
- 自动IP轮换
- 验证码解决方案
- 用户代理轮换
- 自定义请求头
- JavaScript 渲染
- 住宅代理
定价
新闻抓取API订阅计划
易于开始,更易扩展。
无与伦比的稳定性
依靠全球领先的代理基础设施,确保一致的性能并将故障降至最低。
简化的网页抓取
使用可投入生产的API将您的抓取任务自动化,节省资源并减少维护。
无限扩展性
轻松扩展您的抓取项目以满足数据需求,同时保持最佳性能。
用于无缝新闻数据访问的API
全面、可扩展且合规的新闻数据提取
量身定制您的工作流程
通过Webhook或API交付,以JSON、NDJSON或CSV文件获取结构化的LinkedIn数据。
内置基础设施和解封功能
无需维护代理和解封基础设施,即可获得最大的控制和灵活性。轻松从任何地理位置抓取数据,同时避免验证码和封锁。
经过实战验证的基础设施
Bright Data平台为全球超过超20000家公司提供支持,确保99.99%的正常运行时间,并提供覆盖195个国家的超15000万个真实用户IP。
行业领先的合规性
我们的隐私实践符合数据保护法律,包括欧盟数据保护法规框架、GDPR和CCPA,尊重行使隐私权的请求等。
热门新闻抓取 API
CNN 抓取工具 API
抓取 CNN 以收集数据,如标题、作者、主题、发布日期、内容、图片、相关文章等。
Google News 抓取工具 API
抓取 Google News 以收集数据,如标题、主题、类别、作者、日期、来源等。
路透社抓取工具 API
抓取路透社以收集数据,如ID、URL、作者、标题、话题、发布日期、主题等。
BBC 抓取工具 API
抓取 BBC 以收集数据,如标题、作者、主题、发布日期、内容、图片、相关文章等。
还有更多......
新闻抓取工具 - 新闻爬虫工具 API 的用例
为您的研究抓取新闻
收集有关网站新闻发布量的数据
确定热门主题
根据竞争对手的数据优化自身新闻网站的写作
为什么 超20000 位客户选择Bright Data
100%合规
全球 24/7 支持
全面的数据覆盖
无与伦比的数据质量
强大的基础设施
定制化解决方案
新闻抓取工具 - 新闻爬虫工具 API 常见问题
什么是新闻抓取 API?
新闻抓取 API 是一款强大的工具,旨在自动从新闻网站提取数据,使用户能够高效地收集和处理大量数据,以满足各种使用需求。
新闻爬虫 API 是如何工作的?
新闻爬虫 API 通过向新闻网站发送自动请求,提取所需的数据点,并以结构化格式提供。这一过程确保了数据收集的准确性和快速性。
新闻抓取 API 是否符合数据保护法规?
是的,新闻抓取 API 设计符合数据保护法规,包括 GDPR 和 CCPA。它确保所有数据收集活动均以合乎道德和法律的方式进行。
我可以使用新闻抓取 API 进行竞争分析吗?
绝对可以!新闻抓取 API 非常适合用于竞争分析,帮助您收集有关竞争对手在新闻网站上的活动、趋势和策略的洞察。
如何将新闻爬虫 API 集成到我现有的系统中?
新闻爬虫 API 可以无缝集成到各种平台和工具中。您可以将其与现有的数据管道、CRM 系统或分析工具结合使用,以提高数据处理能力。
新闻抓取 API 的使用限制是什么?
新闻抓取 API 没有特定的使用限制,为您提供了按需扩展的灵活性。价格从每条记录 $0.001 起,确保您的网页抓取项目具有成本效益的可扩展性。
您提供新闻抓取 API 的支持吗?
是的,我们为新闻抓取 API 提供专门的支持。我们的支持团队全天候 24/7 可随时为您解答在使用 API 过程中遇到的任何问题。
有哪些交付方式可用?
Amazon S3、Google Cloud Storage、Google PubSub、Microsoft Azure Storage、Snowflake 和 SFTP。
有哪些文件格式可用?
JSON、NDJSON、JSON lines、CSV 和 .gz 文件(压缩)。