scraping
Repositories (1626)
Deals Scraper is a Canadian tool to find good deals on websites like Facebook Marketplace, Kijiji, Ebay, Amazon and Lespacs
ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different website...
Plugin based RSS feed generator for sites that don't offer any. Serves RSS, Atom and JSON Feeds.
Extract structured data from Shopify websites.
legacy backend for Open States
extract data from html table
Newser is a simple utility to generate a pdf with you favorite news articles
Spiderbuf 是一个专注于 Python 爬虫练习的网站。提供丰富的爬虫教程、爬虫案例解析和爬虫练习题。Python爬虫开发强化练习，在矛与盾的攻防中不断提高技术水平，...
Scape top GitHub repositories and users based on keywords
Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt
Code exemple for my blog posts
The code used to create and update the Open Australian Legal Corpus, the first and only multijurisdictional open corpus of Australian legislative and...
Generate a network graph of connections from your WhatsApp groups data
Automate your LinkedIn Outreach with Selenium and GeckoDriver.
🔥Solana Token/NFT snipping Bot w/ twiter - Raydium, Pumpfun Snipping Bot w/ scrapping Twitter.
Data extraction of Google's COVID-19 Mobility Reports
Search for and retrieve US Patent and Trademark Office Patent Data
Configures the requests library to randomly select a desktop User-Agent
Scraping and listing text and image searches on Google, Bing, DuckDuckGo, Baidu, Yahoo japan.
Automated web scraping spider generation using Browser Use and LLMs. Streamline the creation of Playwright-based spiders with minimal manual coding. I...
Enhanced, ads-free and fast responsive interface to browse guitar tabs scraped from Ultimate Guitar.
Tool to scrape linkedin
Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blo...
⬇️ A simple all-in-one CLI tool to download EVERYTHING from a URL (like youtube-dl/yt-dlp, forum-dl, gallery-dl, simpler ArchiveBox). 🎭 Uses headless...
Instagram Scraper. Scrape Instagram followers, following list, and post authors. Download CSV files with Instagram users from followers, following, ta...
A high-performance proxy rotation engine with automated IP management and real-time health monitoring
Crawl sites for RSS, Atom, and JSON feeds.
Model Context Protocol server that integrates AgentQL's data extraction capabilities.
An anime discovery, streaming site made with React.js. It uses AniList API and video data from GogoAnime. No ads and no VPN required.
A open source tool for collating publically available contact information for businesses.
🌱 goClone - clone websites in seconds
Open Graph, Twitter Card, Oembed preview. Shows visual cards that mimic link previews in Social Media like facebook, twitter, vk and other sites that...
A blazingly fast tool to analyze all the selected organizations in Google Summer of Code in the form of graphical analytics.
The library provides convenient access to the Outscraper API from applications written in the Python language. Allows using Outscraper's services from...
Intelligent Web Data Extractor
Your preferred open source focused crawler for the deep web.
Download Chegg homework-help questions to self-sufficient HTML files
A PHP Scraping Class
All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha, Anticaptcha, and Capsolver API's!
Website scraper for getting invoices automagically as pdf (useful for taxes or DMS)
API client to develop tools for competitive programming
Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!
LinkedIn scrapper is advanced search result scrapper script build with python selenium and beautifulsoup modules to find all people of different profi...
A custom Firefox Selenium-based Webdriver. Passes all bot mitigation systems
API não-oficial do mangá livre feita com Node.js e Express.js.
Simple library which helps you to retrieve the source of various video streaming sites.
Modern tests to detect automated browser behavior. Cover most important leaks from Puppeteer and Playwright.
A simple Node.js code to get unlimited instagram public pictures by every user without api, without credentials.
Wrapper for TikTok API
Automatically save transactions from all major Israeli banks and credit card companies, using GitHub actions (or a self hosted docker image)