Topic

scraping

Repositories (1837)

pypatent
pypatent daneads Python

Search for and retrieve US Patent and Trademark Office Patent Data

85
Whatsapp-Net
Whatsapp-Net OfirKP JavaScript

Generate a network graph of connections from your WhatsApp groups data

84
linkedin-scrapper
linkedin-scrapper info3g Python

LinkedIn scrapper is advanced search result scrapper script build with python selenium and beautifulsoup modules to find all people of different profi...

84
mangahook-api
mangahook-api kiraaziz JavaScript

free open source manga api , including fetch all manga , single manga also support search . beside od next js demo .

83
introWebScraping
introWebScraping ksahin Java

Code exemple for my blog posts

82
justapk
justapk TheQmaks Python

Download any APK by package name. 6 sources, automatic fallback, Cloudflare bypass. CLI + Python API.

82
api-client
api-client online-judge-tools Python

API client to develop tools for competitive programming

82
undetected_geckodriver
undetected_geckodriver bytexenon Python

A custom Firefox Selenium-based Webdriver. Passes all bot mitigation systems

82
lightweight-tweet-scraper
lightweight-tweet-scraper nermalcat69 JavaScript

Scrape Tweets while Scrolling

82
powhttp-mcp
powhttp-mcp usestring Go

MCP server enabling agents to debug HTTP requests better (using powhttp)

81
Solana_Twitter_Token_NFT_Sniper_Bot
Solana_Twitter_Token_NFT_Sniper_Bot solagent99 TypeScript

🔥Solana Token/NFT snipping Bot w/ twiter - Raydium, Pumpfun Snipping Bot w/ scrapping Twitter.

81
google-covid19-mobility-reports
google-covid19-mobility-reports vitorbaptista HTML

Data extraction of Google's COVID-19 Mobility Reports

80
webforai
webforai inaridiy TypeScript

The best HTML to Markdown library, A esm-native & Useful Utilities with simple, lightweight and epic quality.

80
linkedin-scraper
linkedin-scraper fabriziomiano Python

Tool to scrape linkedin

79
bet365-api-scraper
bet365-api-scraper davccavalcante Python

This project is a scraper of the Bet365 API to collect data from live matches, matches and future games using Python.

79
UltimateTab
UltimateTab BenoitBellegarde TypeScript

Enhanced, ads-free and fast responsive interface to browse guitar tabs scraped from Ultimate Guitar.

79
DexScreener-Scraping
DexScreener-Scraping greengod63 Python

When a specific token pair from DEX Screener is given, this script will fetch pair address, liquidity, total supply and etc. And then, this bot will...

79
requests-random-user-agent
requests-random-user-agent DavidWittman Python

Configures the requests library to randomly select a desktop User-Agent

78
Captcha-Tools
Captcha-Tools Matthew17-21 Go

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha, Anticaptcha, and Capsolver API's!

78
Pasta
Pasta Kr0ff Python

A PasteBin scrapper that doesnt rely on the PasteBin scrape API

77
venom
venom PreferredAI Java

Your preferred open source focused crawler for the deep web.

76
gsocanalyzer
gsocanalyzer Sparsh1212 JavaScript

A blazingly fast tool to analyze all the selected organizations in Google Summer of Code in the form of graphical analytics.

76
Miyou
Miyou debsishu JavaScript

An anime discovery, streaming site made with React.js. It uses AniList API and video data from GogoAnime. No ads and no VPN required.

76
Google-Patents-Scraper
Google-Patents-Scraper wenyalintw Python

Automatically download all PDF files of searching results & their patent families found on Google Patents.

76
linkpreview
linkpreview linkpreview JavaScript

Open Graph, Twitter Card, Oembed preview. Shows visual cards that mimic link previews in Social Media like facebook, twitter, vk and other sites that...

75
TikScraperPHP
TikScraperPHP pablouser1 JavaScript

Wrapper for TikTok API

75
Website-Crawler
Website-Crawler pc8544 Java

Extract data from websites in LLM ready JSON or CSV format. Crawl or Scrape entire website with Website Crawler

75
webdext
webdext seagatesoft HTML

Intelligent Web Data Extractor

74
silkworm
silkworm BitingSnakes Python

Async web scraping framework on top of Rust. Works with Free-threaded Python (`PYTHON_GIL=0`).

74
Ecole-Directe-Plus
Ecole-Directe-Plus Magic-Fish-Labs JavaScript

A better EcoleDirecte (unaffiliated): more pleasant, functional, and improved experience.

74
Instagram-downloader
Instagram-downloader fernandod1 Python

Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!

74
selectorlib
selectorlib scrapehero HTML

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

73
chegg-scraper
chegg-scraper ThreeGiantNoobs HTML

Download Chegg homework-help questions to self-sufficient HTML files

73
copycat
copycat gidlov PHP

A PHP Scraping Class

72
marktplaats-py
marktplaats-py jensjeflensje Python

Small Python package to request listings & users from marktplaats.nl

72
SourceScraper
SourceScraper OpenByteDev TypeScript

Simple library which helps you to retrieve the source of various video streaming sites.

71
worldometer
worldometer matheusfelipeog Python

Get live, population, geography, projected, and historical data from around the world 🌍

71
rubium
rubium vifreefly Ruby

Antidetect Headless Chrome Browser for Ruby Web Scraping and Automation

70
Tor_Spider
Tor_Spider absingh31 Python

Python project to crawl and scrap the lesser known deep web or one can say dark web. Just provide the onion link and get started.

70
selector-forge
selector-forge Intuned TypeScript

Browser extension to create reliable selectors (CSS and Xpath) using AI

70
ultrastar-cli
ultrastar-cli martiinii TypeScript

Download any song from biggest database of UltraStar songs for your karaoke party!

69
maps-to-lead
maps-to-lead jhowbhz TypeScript

Esse projeto tem como objetivo obter leads em formato JSON e enviar para um webhook

69
pycaching
pycaching tomasbedrich Python

A Python 3 interface for working with Geocaching.com website.

68
foundation
foundation prescience-data TypeScript

🧱 A uniform template to use as a foundation for Puppeteer bot construction.

68
imslp
imslp jlumbroso Python

🎼 The clean and modern way of accessing IMSLP data and scores programmatically. 🎶

68
proxy-scraper
proxy-scraper TeaByte Python

Scraping from x75 websites asynchronously

68
hyper-sdk-py
hyper-sdk-py Hyper-Solutions Python

Python SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada, and DataDome. No browsers required. Solve challenges and generate valid sen...

68
hyper-sdk-go
hyper-sdk-go Hyper-Solutions Go

Go SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada, and DataDome. No browsers required. Solve challenges and generate valid sensors...

67
facebook-page-info-scraper
facebook-page-info-scraper wael-sudo2 Python

Free Facebook pages MetaData Scraping Library - Unlimited Calls

67
web_scraping_freecodecamp
web_scraping_freecodecamp GEJ1 Jupyter Notebook

Curso de web scraping con Python creado por Gustavo Juantorena para freeCodeCamp https://www.freecodecamp.org/espanol/news/aprende-web-scraping-con-py...

67