Topic

scraping

Repositories (1837)

educative.io-downloader
educative.io-downloader shihabmridha TypeScript

Free Palestine. 📖 This tool is to download course from educative.io for offline usage. It uses your login credentials and download the course.

226
spidercreator
spidercreator carlosplanchon Python

Automated web scraping spider generation using Browser Use and LLMs. Streamline the creation of Playwright-based spiders with minimal manual coding. I...

224
vlrggapi
vlrggapi axsddlr Python

An Unofficial REST API for vlr.gg, a site for Valorant Pro Esports match results and news.

224
SouqScraper
SouqScraper enghamzasalem Python

Simple scripts for Level UP your scraping Skills, and source code for Level UP playlist on Youtube

216
Dorkify
Dorkify hhhrrrttt222111 Python

Perform Google Dork search with Dorkify

213
awesome-python-primer
awesome-python-primer zkqiang Python

自学入门 Python 优质中文资源索引,包含 书籍 / 文档 / 视频,适用于 爬虫 / Web / 数据分析 / 机器学习 方向

213
WebScrapper
WebScrapper nuhmanpk Python

Powerful Telegram bot for web scraping and crawling. Fast, easy, and loved by thousands!

211
transistor
transistor bomquote Python

Transistor, a Python web scraping framework for intelligent use cases.

210
Grawler
Grawler A3h1nt PHP

Grawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them...

210
blinkist-scraper
blinkist-scraper leoncvlt Python

📚 Python tool to download book summaries and audio from Blinkist.com, and generate some pretty output

209
rayobrowse
rayobrowse rayobyte-data Python

Stealth Chromium browser for web scraping and AI agents.

206
xword-dl
xword-dl thisisparker Python

▞ Command line tool to scrape crosswords from online solvers and save them as .puz files ▚

205
estela
estela bitmakerla TypeScript

estela, an elastic web scraping cluster 🕸

202
linkedin-learning-downloader
linkedin-learning-downloader liranbg Python

Linkedin Learning videos downloader

200
jsonframe-cheerio
jsonframe-cheerio gahabeen JavaScript

simple multi-level scraper json input/output for Cheerio

198
Email-extractor
Email-extractor DiegoCaraballo Python

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de...

197
Prism-platform
Prism-platform NovaCode37 Python

All-in-one OSINT platform — 22+ modules, AI analysis, real-time dashboard, OPSEC scoring. Scan domains, IPs, emails, phones, usernames.

195
lazy-json-pages
lazy-json-pages cerbero90 PHP

📜 Framework-agnostic API scraper to load items from any paginated JSON API into a Laravel lazy collection via async HTTP requests.

195
kameleo
kameleo kameleo-io C#

Anti-detect browser for web scraping and automation. Engine-level fingerprint masking for Chromium and Firefox. Self-hosted, Docker-ready. Integrates...

192
SpotiFile
SpotiFile Michael-K-Stein Python

Spotify scraper

188
UdemyCourseGrabber
UdemyCourseGrabber keethesh Python

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [i...

186
instagram-media-scraper
instagram-media-scraper ahmedrangel JavaScript

A simple Node.js code to get public information and media from every Instagram post or reel URL without API. Working 2025

186
Python-Selenium-Action
Python-Selenium-Action MarketingPipeline Python

Run Selenium with Python via Github Actions using Headless or Non-Headless browsers!

186
DotnetCrawler
DotnetCrawler mehmetozkaya C#

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library des...

183
deepsearch-academic
deepsearch-academic iblameandrew Python

An implementation of Google Deep Search with support for 1000+ references, local inference, chatting with your scraping session using RAPTOR, and re...

183
agentql-mcp
agentql-mcp tinyfish-io JavaScript

Model Context Protocol server that integrates AgentQL's data extraction capabilities.

179
scrapers
scrapers Police-Data-Accessibility-Project Python

Code relating to scraping public police data.

179
tiktok-trending-data
tiktok-trending-data antiops

Scraping the TikTok discovery web API every 15 minutes using Github Actions to view changes

179
JsonGenius
JsonGenius semanser Go

Get structured JSON data from any page.

177
VPSLab-Free-Proxy-List
VPSLab-Free-Proxy-List VPSLabCloud

Free proxy list updated every 15 minutes | HTTP, HTTPS, SOCKS4, SOCKS5, elite & anonymous proxies. Powered by VPSLab.

176
apify-sdk-python
apify-sdk-python apify Python

Apify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing,...

175
languagepod101-scraper
languagepod101-scraper nedlir Python

Python scraper for Language Pods such as Japanesepod101.com :japanese_ogre: :japan: :sushi: Compatible with Japanese, Chinese, French, German, Italian...

173
fantasy-basketball
fantasy-basketball KengoA Jupyter Notebook

Scraping statistics, predicting NBA player performance with neural networks and boosting algorithms, and optimising lineups for Draft Kings with gene...

172
shadow-useragent
shadow-useragent lobstrio Python

Pick the most common user-agents on the Internet 👻

172
FredsRoadtripStoryteller
FredsRoadtripStoryteller realityexpander Kotlin

Hear local historical markers as you travel on your road-trip. 100% Shared Compose UI, Kotlin native cross-platform codebase. Includes Cocoapods, Goog...

170
search-engine-google
search-engine-google serp-spider PHP

:spider: Google client for SERPS

169
Leetcode-Questions-Scraper
Leetcode-Questions-Scraper Bishalsarang Python

Scrape Algorithm Questions from leetcode and generate html and epub file

165
Upwork-AI-jobs-applier
Upwork-AI-jobs-applier kaymen99 Python

AI tool for automating Upwork job applications using AI agents to find and qualify jobs, write personalized cover letters, and prepare for interviews...

163
rebrowser-bot-detector
rebrowser-bot-detector rebrowser JavaScript

Modern tests to detect automated browser behavior. Cover most important leaks from Puppeteer and Playwright.

160
instagram-users-scraper
instagram-users-scraper floriandiud TypeScript

Instagram Scraper. Scrape Instagram followers, following list, and post authors. Download CSV files with Instagram users from followers, following, ta...

157
xquery
xquery antchfx Go

Extract data or evaluate value from HTML/XML documents using XPath

156
tweetdrop
tweetdrop Anish-Agnihotri TypeScript

Generate dispersable airdrops from Twitter threads.

156
Movies-and-Series-Scraper
Movies-and-Series-Scraper yousefkotp Python

A console application to scrape a valid watching links for any movie or series with exact season and episode number, you can also download a whole sea...

155
jimutmap
jimutmap Jimut123 Python

API to get enormous amount of high resolution satellite images from satellites.pro quickly through multi-threading! create map your own map dataset. B...

154
scrapy-scrapingbee
scrapy-scrapingbee ScrapingBee Python

JavaScript support and proxy rotation for Scrapy with ScrapingBee.

153
decipher-research-agent
decipher-research-agent mtwn105 TypeScript

Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.

152
proxifier
proxifier rookmoot Go

A fast, modern and intelligent proxy rotator perfect for crawling and scraping public data.

152
go-crawler
go-crawler lizongying Go

A web crawling framework implemented in Golang, it is simple to write and delivers powerful performance. It comes with a wide range of practical middl...

149
WebReaper
WebReaper alex-on-ai C#

AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.

148
GoodreadsScraper
GoodreadsScraper havanagrawal Python

Scrape data from Goodreads using Scrapy and Selenium :books:

148