scraping
Repositories (1766)
:card_index: Extract social media profiles and more with regular expressions
Comic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, co...
Dive into web scraping and build a Next.js 13 eCommerce price tracker within a single video that teaches you data scraping, cron jobs, sending emails,...
Claude engineer that captures traffic, writes documentation and automatically generates API clients. Reverse engineer APIs!
The simplest demo of chrome automation by python and selenium in AWS Lambda
Python 3 script to dump/scrape/extract company employees from LinkedIn API
Free Web Scraping Tool with Java
A universal web-util for PHP.
n8n node for browser automation using Puppeteer
An API to scrape American court websites for metadata.
Universal Reddit Scraper - Works on any Subreddit or User
Scrapy Extension for monitoring spiders execution.
This Python application is an OSINT (Open Source Intelligence) tool called "Ominis OSINT - Web Hunter." It performs online information gathering by qu...
Jekyll-based static site for The Programming Historian
Analyze facebook copy of your data with ruby language. Download zip file from facebook and get info about friends ranking by message, vocabulary, con...
The REST API for Jikan
`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.
SQL Runtime without any database
A framework for creating semi-automatic web content extractors
A libre front-end for Quora
Anime Streaming, Discovery API made with Cheerio and Express. Uses data from Gogoanime
Web scraping library made by the Phantombuster team. Modern, simple & works on all websites. (Deprecated)
Unleash Metadata Intelligence with MetaDetective. Your Assistant Beyond Metagoofil.
Lightweight package to query popular search engines and scrape for result titles, links and descriptions
Kemono Downloader is a fast, powerful PyQt5 app for archiving content from a wide array of sites, including Kemono, Coomer, Bunkr, Erome, Saint2.su, n...
List of major web + mobile browser user agent strings. +1 Bonus script to scrape :)
Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for eac...
A free & open source IMDb front-end.
🧶 Extract data from any website without code, just clicks.
dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators
ScraperAI is an open-source, AI-powered tool designed to simplify web scraping for users of all skill levels.
GoogleBard - A reverse engineered API for Google Bard chatbot for NodeJS
A python wrapper for the public & private Spotify API
Functional HTML scraping and rewriting with CSS in OCaml
An Unofficial API for 1337x, Piratebay, Nyaasi, Torlock, Torrent Galaxy, Zooqle, Kickass, Bitsearch, MagnetDL,Libgen, YTS, Limetorrent, TorrentFunk, G...
Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
Build and deploy a machine learning app from scratch 🚀
Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup
The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.
Library for Rapid (Web) Crawler and Scraper Development
Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
COVID-19 Coronavirus data scraped from government and curated data sources.
Crawl telegra.ph searching for nudes!
reborn of https://bitbucket.org/rflechner/scrapysharp
Scrape any website, article or RSS/Atom Feed with ease!
Scrape emails, phone numbers and social media accounts from a website.
Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.
(InstaTools 2.0 soon to come 👀) 🧰 A collection of automation tools for Instagram 📱| Written in Python 🐍 | Don't forget to ⭐ the repo !
Topic wise PDFs of Geeks for Geeks articles. (Last updated in October 2018)