scraping
Repositories (1626)
Anime Streaming, Discovery API made with Cheerio and Express. Uses data from Gogoanime
SQL Syntax without any database
`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
The REST API for Jikan
Lightweight package to query popular search engines and scrape for result titles, links and descriptions
Python 3 script to dump/scrape/extract company employees from LinkedIn API
A libre front-end for Quora
List of major web + mobile browser user agent strings. +1 Bonus script to scrape :)
dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators
A blazing-fast Python HTTP Client with TLS fingerprint
🧶 Extract data from any website without code, just clicks.
Python package for scraping real estate property data
GoogleBard - A reverse engineered API for Google Bard chatbot for NodeJS
An API to scrape American court websites for metadata.
This Python application is an OSINT (Open Source Intelligence) tool called "Ominis OSINT - Web Hunter." It performs online information gathering by qu...
n8n node for browser automation using Puppeteer
Functional HTML scraping and rewriting with CSS in OCaml
Build and deploy a machine learning app from scratch 🚀
Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for eac...
Library for Rapid (Web) Crawler and Scraper Development
Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
COVID-19 Coronavirus data scraped from government and curated data sources.
🕵️ Unleash Metadata Intelligence with MetaDetective. Your Assistant Beyond Metagoofil.
Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup
reborn of https://bitbucket.org/rflechner/scrapysharp
An Unofficial API for 1337x, Piratebay, Nyaasi, Torlock, Torrent Galaxy, Zooqle, Kickass, Bitsearch, MagnetDL,Libgen, YTS, Limetorrent, TorrentFunk, G...
A free & open source IMDb front-end.
Scrape any website, article or RSS/Atom Feed with ease!
Topic wise PDFs of Geeks for Geeks articles. (Last updated in October 2018)
Lightweight web scraping toolkit for documents and structured data.
🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)
Stealth browser with a modified Chromium core, bypassing Cloudflare, Shape, PerimeterX, Datadome, Akamai, Kasada, hCaptcha, and reCAPTCHA reliably
Crawl telegra.ph searching for nudes!
The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.
一个灵活、友好的爬虫框架
Tools to build web AI agents that can authenticate, interact with and extract data from any website.
Automate webpages at scale, scrape web data completely and accurately with high performance, distributed RPA.
In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move...
Scrape emails, phone numbers and social media accounts from a website.
Scrapes all the data of followers of any instagram account
Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchre...
Crawl all unique internal links found on a given website, and extract SEO related information - supports javascript based sites
scan for webcams on the internet
Continuous reconnaissance network scanner designed for large-scale scans, collecting information on all Internet assets.
A python wrapper for the public & private Spotify API
A modern Python library for writing maintainable web scrapers.
OWASP D4N155 - Intelligent and dynamic wordlist using OSINT