scraping

JavaScript / TypeScript SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada, and DataDome. No browsers required. Solve challenges and g...

A collection of cookbooks to help developers get started quickly with the Firecrawl API.

Download papers pdfs and other info from main AI conferences

Scrapfly Python SDK for headless browsers and proxy rotation

🧄🧛 protect your website from being scraped by bots.

youtube & tiktok analysis + youchoose recommendation custmizer. backend, extensions, and tooling

Scrapinghub Learning Center. Report issues in Jira: Report issues in Jira: https://scrapinghub.atlassian.net/projects/WEB

scrapers for building your own image databases

A UDP torrent tracker scraper library written in Python 3

Its a Scarper api that will give you direct movie data in ur local machine without needing to watch and ads . It now supports netmirror.

Public, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores

:sparkles: :ramen: Scrape webpage metadata using BeautifulSoup.

AWS-based application for scraping the Maryland Judiciary Case Search

A simple comic viewer for Dilbert by Scott Adams

A guide on how to scrape JavaScript rendered websites with Python and BeautifulSoup.

Scraping the TikTok Discovery Data API every 1 hour using Github Actions to view changes

Final Year project, scraping data of e-commerce stores and display in ReactJS app.

Automatically check for GDPR/CCPA and cookie consent by running a Playwright headless browser to check for marketing and analytics scripts firing befo...

Full-stack LinkedIn OSINT toolkit. Four-phase funnel: discover companies by region, batch scrape employees, classify roles by hierarchy/department, an...

A simple PHP code to get unlimited instagram public pictures by every user without api, without credentials.

Does nothing... except everything that matters.

Dataset and scripts for scraping the news articles from popular sources along with the summary of the article.

HTML parsing and processing tool for PowerShell.

🦩 A NextJS data parser, to scrape peacefully

Listen for and interact with Android notifications from Flutter.

Free proxy list, verified around the clock: HTTP, HTTPS, SOCKS4 and SOCKS5 proxies with country, anonymity, latency and uptime on every row, updated s...

看理想 Python 客户端 / 下载器，下载看理想的音频和文稿

A scraper built with puppeteer that auto renew free domains on Freenom and send discord message using bot

🕺 Humanizer functions for Puppeteer

Official Python library for interacting with Kameleo Client

Python for scraping and processing tennis match data from the ATP Tour website.

DeepSearchJobs is a job-discovery engine that uncovers hidden, niche, and low-competition opportunities not found on major platforms. It uses smart sc...

API Python para consulta na base de dados oficial do e-MEC

This script will dump youtube video comments to a CSV from youtube video links. Video links can be placed inside a variable or list or CSV

Spin up Tor containers and then proxy HTTP requests via these Tor instances

This project is an open-source API for retrieving multimedia content such as anime, movies and series, news, and manga in both Spanish and English.

A simple CLI tool to browse GitHub's trending repositories from your terminal.

Repository for the Mastering Web Scraping in Python: Scaling to Distributed Crawling blogpost with the final code.

Detect antibot protection from 30+ providers — Cloudflare, Akamai, DataDome, PerimeterX, and more.

Permaculture design app built on scraped plant databases. Drag-n-drop GUI with detailed design plan generator.

Overwatch API library for player details and career stats

⛏ A versatile Web scraper for Node.js

Download images from Google Image Search

Ethical Facebook and Gmail bruteforce... Bonus, proxy rotation for every attack based on user preference setting and also a web scrapping tool

🤖 A Versatile Telegram Bot

🦊 Anti-detection browser CLI powered by Camoufox — browse, screenshot, search, extract, crawl with C++ level fingerprint spoofing

DOM Based Content Extraction via Text Density

Node.js and PHP files to automatically downloading pictures from instagram by https://orsi.me/sniffagram

Official JavaScript/TypeScript library for interacting with Kameleo Client

PubMed scraper for async search on a list of keywords and concurrent extraction of all found URLs, returning a DataFrame/CSV containing all article da...