4.6 out of five star rating on Trustpilot

GitHub 抓取工具 - GitHub 爬虫工具

Name: Bright Data
Rating: 4.6 (823 reviews)

抓取 GitHub 并收集公开数据，如用户名、URL、编程语言、代码、代码行数、大小、问题数量等。

专属客户经理
以多种格式获取结果
通过 API 或无代码抓取工具按需抓取 GitHub

开始免费试用用Gmail账号注册

支持支付宝等多种支付方式

深受超20000 位全球客户信赖

轻松爬取 GitHub 数据

GitHub 爬取API

使用此 API 开始根据指定参数收集数据

基于 API 的爬取工具
使用我们的接口构建您的 API 请求
大规模自动化
构建自己的调度器以控制频率
数据交付
将数据传送到您首选的存储位置或直接下载

GitHub 无代码爬取工具

使用此“即插即用”爬取工具开始收集数据

基于控制面板的爬取工具
所有操作均在我们的控制面板中完成
简单易用
将您的输入添加到爬取工具，即可开始
从控制面板获取结果
可直接从控制面板下载结果

网页爬取工具

可用的 GitHub 爬取工具

无需开发和维护基础设施。只需提取大规模网页数据，并通过网页爬取 API 或无代码爬取工具确保可扩展性和可靠性。

Github repository

URL, ID, Code language, Code, Num lines, User name, User url, Size, and more.

665+

44+

Get API Key

Github repository - Discover github code by repository URL

URL, ID, Code language, Code, Num lines, User name, User url, Size, and more.

665+

44+

Get API Key

Github repository - discover new records by search url

URL, ID, Code language, Code, Num lines, User name, User url, Size, and more.

665+

44+

Get API Key

只想要 Github 数据？无需抓取，直接购买 Github 数据集

代码示例

轻松抓取 GitHub 数据，且无屏蔽之忧。

输入

JSON

curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://github.com/TheAlgorithms/Python/blob/master/divide_and_conquer/power.py"},{"url":"https://github.com/AkarshSatija/msSync/blob/master/index.js"},{"url":"https://github.com/WerWolv/ImHex/blob/master/main/gui/source/main.cpp"}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lyrexgxc24b3d4imjt&format=json&uncompressed_webhook=true"

输出

JSON

[
  {
    "db_source": "1743768686863",
    "timestamp": "2025-04-04",
    "url": "https:\/\/github.com\/openvinotoolkit\/openvino\/blob\/master\/src\/common\/low_precision_transformations\/tests\/normalize_dequant...",
    "id": "153097643@src\/common\/low_precision_transformations\/tests\/normalize_dequantization_transformation.cpp",
    "code_language": "C++",
    "code": [
      "\/\/ Copyright (C) 2018-2025 Intel Corporation",
      "\/\/ SPDX-License-Identifier: Apache-2.0",
      "\/\/",
      "",
      "#include \u0022layer_transformation.hpp\u0022",
      "",
      "#include \u003Cstring\u003E",
      "#include \u003Cmemory\u003E"
    ],
    "num_lines": 243,
    "user_name": "openvinotoolkit"
  },
  {
    "db_source": "1743768686863",
    "timestamp": "2025-04-04",
    "url": "https:\/\/github.com\/xuhongv\/StudyInEsp8266\/blob\/master\/11_ESP8266_CSDN_MQTT_2\/examples\/IoT_Demo\/user\/user_main.c?raw=true",
    "id": "105225851@11_ESP8266_CSDN_MQTT_2\/examples\/IoT_Demo\/user\/user_main.c",
    "code_language": "C",
    "code": [
      "\/*",
      " * ESPRESSIF MIT License",
      " *",
      " * Copyright (c) 2016 \u003CESPRESSIF SYSTEMS (SHANGHAI) PTE LTD\u003E",
      " *",
      " * Permission is hereby granted for use on ESPRESSIF SYSTEMS ESP8266 only, in which case,",
      " * it is free of charge, to any person obtaining a copy of this software and associated",
      " * documentation files (the \u0022Software\u0022), to deal in the Software without restriction, including"
    ],
    "num_lines": 142,
    "user_name": "xuhongv"
  },
  {
    "db_source": "1743768686863",
    "timestamp": "2025-04-04",
    "url": "https:\/\/github.com\/openjdk\/jfx\/blob\/master\/modules\/javafx.web\/src\/main\/native\/Source\/JavaScriptCore\/b3\/B3Effects.cpp?raw...",
    "id": "185199202@modules\/javafx.web\/src\/main\/native\/Source\/JavaScriptCore\/b3\/B3Effects.cpp",
    "code_language": "C++",
    "code": [
      "\/*",
      " * Copyright (C) 2015-2017 Apple Inc. All rights reserved.",
      " *",
      " * Redistribution and use in source and binary forms, with or without",
      " * modification, are permitted provided that the following conditions",
      " * are met:",
      " * 1. Redistributions of source code must retain the above copyright",
      " *  notice, this list of conditions and the following disclaimer."
    ],
    "num_lines": 115,
    "user_name": "openjdk"
  },
  {
    "db_source": "1743768686863",
    "timestamp": "2025-04-04",
    "url": "https:\/\/github.com\/apache\/guacamole-website\/blob\/main\/doc\/1.0.0\/guacamole-ext\/org\/apache\/guacamole\/net\/auth\/class-use\/Ac...",
    "id": "57191357@doc\/1.0.0\/guacamole-ext\/org\/apache\/guacamole\/net\/auth\/class-use\/ActivityRecordSet.html",
    "code_language": "HTML",
    "code": [
      "\u003C!DOCTYPE HTML PUBLIC \u0022-\/\/W3C\/\/DTD HTML 4.01 Transitional\/\/EN\u0022 \u0022http:\/\/www.w3.org\/TR\/html4\/loose.dtd\u0022\u003E",
      "\u003C!-- NewPage --\u003E",
      "\u003Chtml lang=\u0022en\u0022\u003E",
      "\u003Chead\u003E",
      "\u003C!-- Generated by javadoc (1.8.0_191) on Fri Dec 21 13:21:36 PST 2018 --\u003E",
      "\u003Cmeta http-equiv=\u0022Content-Type\u0022 content=\u0022text\/html; charset=UTF-8\u0022\u003E",
      "\u003Ctitle\u003EUses of Interface org.apache.guacamole.net.auth.ActivityRecordSet (guacamole-ext 1.0.0 API)\u003C\/title\u003E",
      "\u003Cmeta name=\u0022date\u0022 content=\u00222018-12-21\u0022\u003E"
    ],
    "num_lines": 294,
    "user_name": "apache"
  },
  {
    "db_source": "1743768686863",
    "timestamp": "2025-04-04",
    "url": "https:\/\/github.com\/apple\/turicreate\/blob\/main\/src\/external\/boost\/boost_1_68_0\/libs\/graph_parallel\/test\/distributed_short...",
    "id": "112676803@src\/external\/boost\/boost_1_68_0\/libs\/graph_parallel\/test\/distributed_shortest_paths_test.cpp",
    "code_language": "C++",
    "code": [
      "\/\/ Copyright (C) 2005, 2006 The Trustees of Indiana University.",
      "",
      "\/\/ Use, modification and distribution is subject to the Boost Software",
      "\/\/ License, Version 1.0. (See accompanying file LICENSE_1_0.txt or copy at",
      "\/\/ http:\/\/www.boost.org\/LICENSE_1_0.txt)",
      "",
      "\/\/  Authors: Douglas Gregor",
      "\/\/       Andrew Lumsdaine"
    ],
    "num_lines": 214,
    "user_name": "apple"
  }
]

更快部署