scraping
Repositories (1766)
:card_index: Extract social media profiles and more with regular expressions
Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
Claude engineer that captures traffic, writes documentation and automatically generates API clients. Reverse engineer APIs!
Dive into web scraping and build a Next.js 13 eCommerce price tracker within a single video that teaches you data scraping, cron jobs, sending emails,...
The simplest demo of chrome automation by python and selenium in AWS Lambda
Free Web Scraping Tool with Java
A universal web-util for PHP.
Python 3 script to dump/scrape/extract company employees from LinkedIn API
n8n node for browser automation using Puppeteer
An API to scrape American court websites for metadata.
This Python application is an OSINT (Open Source Intelligence) tool called "Ominis OSINT - Web Hunter." It performs online information gathering by qu...
Scrapy Extension for monitoring spiders execution.
Jekyll-based static site for The Programming Historian
Analyze facebook copy of your data with ruby language. Download zip file from facebook and get info about friends ranking by message, vocabulary, con...
`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
The REST API for Jikan
Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.
SQL Runtime without any database
A framework for creating semi-automatic web content extractors
Anime Streaming, Discovery API made with Cheerio and Express. Uses data from Gogoanime
Web scraping library made by the Phantombuster team. Modern, simple & works on all websites. (Deprecated)
A libre front-end for Quora
Lightweight package to query popular search engines and scrape for result titles, links and descriptions
Universal Reddit Scraper - Works on any Subreddit or User
Kemono Downloader is a fast, powerful PyQt5 app for archiving content from a wide array of sites, including Kemono, Coomer, Bunkr, Erome, Saint2.su, n...
List of major web + mobile browser user agent strings. +1 Bonus script to scrape :)
Unleash Metadata Intelligence with MetaDetective. Your Assistant Beyond Metagoofil.
Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for eac...
🧶 Extract data from any website without code, just clicks.
dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators
A free & open source IMDb front-end.
GoogleBard - A reverse engineered API for Google Bard chatbot for NodeJS
A python wrapper for the public & private Spotify API
Functional HTML scraping and rewriting with CSS in OCaml
An Unofficial API for 1337x, Piratebay, Nyaasi, Torlock, Torrent Galaxy, Zooqle, Kickass, Bitsearch, MagnetDL,Libgen, YTS, Limetorrent, TorrentFunk, G...
Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
Build and deploy a machine learning app from scratch 🚀
ScraperAI is an open-source, AI-powered tool designed to simplify web scraping for users of all skill levels.
Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup
The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.
Library for Rapid (Web) Crawler and Scraper Development
Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
COVID-19 Coronavirus data scraped from government and curated data sources.
Crawl telegra.ph searching for nudes!
reborn of https://bitbucket.org/rflechner/scrapysharp
Scrape any website, article or RSS/Atom Feed with ease!
Scrape emails, phone numbers and social media accounts from a website.
Topic wise PDFs of Geeks for Geeks articles. (Last updated in October 2018)
Lightweight web scraping toolkit for documents and structured data.
Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.