Topic

scraping

Repositories (1766)

copycat
copycat gidlov PHP

A PHP Scraping Class

73
TikScraperPHP
TikScraperPHP pablouser1 JavaScript

Wrapper for TikTok API

73
free-proxy-list
free-proxy-list iplocate

⚡️ Free Verified HTTP, SOCKS5, & SOCKS4 Proxy List ⏰ Updated every 30 minutes

72
DexScreener-Scraping
DexScreener-Scraping greengod63 Python

When a specific token pair from DEX Screener is given, this script will fetch pair address, liquidity, total supply and etc. And then, this bot will...

72
bet365-api-scraper
bet365-api-scraper davccavalcante Python

This project is a scraper of the Bet365 API to collect data from live matches, matches and future games using Python.

71
SourceScraper
SourceScraper OpenByteDev TypeScript

Simple library which helps you to retrieve the source of various video streaming sites.

70
Jobs_Scraper_Global
Jobs_Scraper_Global Benevanio JavaScript

Simplifique sua busca por emprego. Todas as oportunidades do mercado reunidas em uma plataforma inteligente e automatizada.

70
scrapegraph-py
scrapegraph-py ScrapeGraphAI Jupyter Notebook

Official Python SDK for the ScrapeGraph AI API. Smart scraping, search, crawling, markdownify, agentic browser automation, scheduled jobs, and s...

70
rubium
rubium vifreefly Ruby

Antidetect Headless Chrome Browser for Ruby Web Scraping and Automation

69
Tor_Spider
Tor_Spider absingh31 Python

Python project to crawl and scrap the lesser known deep web or one can say dark web. Just provide the onion link and get started.

68
foundation
foundation prescience-data TypeScript

🧱 A uniform template to use as a foundation for Puppeteer bot construction.

68
powhttp-mcp
powhttp-mcp usestring Go

MCP server enabling agents to debug HTTP requests better (using powhttp)

68
proxy-scraper
proxy-scraper TeaByte Python

Scraping from x75 websites asynchronously

68
worldometer
worldometer matheusfelipeog Python

Get live, population, geography, projected, and historical data from around the world 🌍

68
web_scraping_freecodecamp
web_scraping_freecodecamp GEJ1 Jupyter Notebook

Curso de web scraping con Python creado por Gustavo Juantorena para freeCodeCamp https://www.freecodecamp.org/espanol/news/aprende-web-scraping-con-py...

67
mangalivre-api
mangalivre-api nezzzumi JavaScript

API não-oficial do mangá livre feita com Node.js e Express.js.

67
maps-to-lead
maps-to-lead jhowbhz JavaScript

Esse projeto tem como objetivo obter leads em formato JSON e enviar para um webhook

67
pycaching
pycaching tomasbedrich Python

A Python 3 interface for working with Geocaching.com website.

66
justapk
justapk TheQmaks Python

Download any APK by package name. 6 sources, automatic fallback, Cloudflare bypass. CLI + Python API.

66
datasette-scraper
datasette-scraper cldellow Python

Add website scraping abilities to Datasette

66
Ecole-Directe-Plus
Ecole-Directe-Plus Magic-Fish-Labs JavaScript

A better EcoleDirecte (unaffiliated): more pleasant, functional, and improved experience.

65
PyLex
PyLex techcentaur Python

Perform lexical analysis on words, one word at a time.

64
medium-crawler
medium-crawler NISH1001 Python

A crawler for scraping posts from medium.com

64
datacrawl
datacrawl DataCrawl-AI Python

A simple and easy to use web crawler for Python

64
instagram-without-api-node
instagram-without-api-node orsifrancesco JavaScript

A simple Node.js code to get unlimited instagram public pictures by every user without api, without credentials.

64
daenerys
daenerys dongweiming Python

Scraping and Web Crawling Framework For Zhihu Live

63
scrapegraph-mcp
scrapegraph-mcp ScrapeGraphAI Python

ScapeGraph MCP Server

63
scrapit
scrapit joaobenedetmachado Python

A (really) easy way to web scrape

63
pythonista-chromeless
pythonista-chromeless umihico Python

Serverless selenium which dynamically execute any given code.

63
angel.co-companies-list-scraping
angel.co-companies-list-scraping iamtodor Python
62
scraping-reviews-from-googlemaps
scraping-reviews-from-googlemaps MajideND Python

This is a simple script with python to scrap Google Maps reviews and ratings.

62
google-search-scraper
google-search-scraper tkattkat TypeScript

TypeScript library for Google search scraping using http requests with proxy support, pagination, and regional customization. Built for web scraping a...

61
conformist
conformist tatey Ruby

Bend CSVs to your will with declarative schemas.

60
ksoup
ksoup fcannizzaro Kotlin

Kotlin Wrapper for Jsoup

60
playlist2links
playlist2links pierlauro Shell

This bash script allows to extract video links from a youtube playlist

60
scrapy-distributed
scrapy-distributed Insutanto Python

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy...

60
greenlight
greenlight bosniankicks Go

A Golang based Undetected Web Automation Framework

60
pomp
pomp estin Python

Screen scraping and web crawling framework

59
imslp
imslp jlumbroso Python

🎼 The clean and modern way of accessing IMSLP data and scores programmatically. 🎶

59
pge-outages-pre-2024
pge-outages-pre-2024 simonw Python

Tracking PG&E outages

58
proxycrawl-python
proxycrawl-python crawlbase Python

ProxyCrawl Python library for scraping and crawling

58
whatsapp-tracking
whatsapp-tracking TomyCesaille JavaScript

Scraping the status of WhatsApp contacts

58
hyper-sdk-py
hyper-sdk-py Hyper-Solutions Python

Python SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada, and DataDome. No browsers required. Solve challenges and generate valid sen...

58
marktplaats-py
marktplaats-py jensjeflensje Python

Small Python package to request listings & users from marktplaats.nl

58
Pahe.ph-Scraper
Pahe.ph-Scraper roofman2008 C#

Pahe.ph [Pahe.in] Movies Website Scraper

58
SearchEngineScrapy
SearchEngineScrapy naqushab Python

Scrape data from Google.com, Bing.com, Baidu.com, Ask.com, Yahoo.com, Yandex.com

57
facebook-page-info-scraper
facebook-page-info-scraper wael-sudo2 Python

Free Facebook pages MetaData Scraping Library - Unlimited Calls

57
python
python joaopauloaramuni HTML

Repo Python

57
coches-net-dashboard
coches-net-dashboard franloza Python

Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market

57
actor-facebook-scraper
actor-facebook-scraper pocesar TypeScript

Scrape public Facebook pages, posts, reviews and comments

56