scraping
Repositories (1766)
OCaml functional web scraping library
The library provides convenient access to the Outscraper API from applications written in the Python language. Allows using Outscraper's services from...
Crawl sites for RSS, Atom, and JSON feeds.
Apify API client for Python
Newser is a simple utility to generate a pdf with you favorite news articles
An infinite Pinterest crawler/scraper. Crawl image with inifnite-scroll!
ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different website...
extract data from html table
Plugin based RSS feed generator for sites that don't offer any. Serves RSS, Atom and JSON Feeds.
This whitepaper describes a new concept for building serverless microapps called Actors, which are easy to develop, share, integrate, and build upon....
Scape top GitHub repositories and users based on keywords
A open source tool for collating publically available contact information for businesses.
Extract structured data from Shopify websites.
Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blo...
legacy backend for Open States
Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt
Scraping and listing text and image searches on Google, Bing, DuckDuckGo, Baidu, Yahoo japan.
A Flexible Rust Crate for DOM Querying and Manipulation
Playwright PHP library for browser automation: navigation, E2E tests, assertions, screenshots, and so much more!
Search for and retrieve US Patent and Trademark Office Patent Data
Generate a network graph of connections from your WhatsApp groups data
Scrape Tweets while Scrolling
Code exemple for my blog posts
A custom Firefox Selenium-based Webdriver. Passes all bot mitigation systems
🔥Solana Token/NFT snipping Bot w/ twiter - Raydium, Pumpfun Snipping Bot w/ scrapping Twitter.
A script that can be used to capture various porn novels for machine learning / 一个可以用于抓取各类色情小说用于机器学习的脚本
Data extraction of Google's COVID-19 Mobility Reports
Python tool that automatically create outlook account with auto-captcha
Scrape and parse search engine results using SerpApi.
API client to develop tools for competitive programming
LinkedIn scrapper is advanced search result scrapper script build with python selenium and beautifulsoup modules to find all people of different profi...
Tool to scrape linkedin
Enhanced, ads-free and fast responsive interface to browse guitar tabs scraped from Ultimate Guitar.
Configures the requests library to randomly select a desktop User-Agent
The best HTML to Markdown library, A esm-native & Useful Utilities with simple, lightweight and epic quality.
The most comprehensive cryptocurrency API. Real-time prices, OHLCV, order books & market cap for 10,000+ tokens across 500+ exchanges. DeFi TVL, yield...
All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha, Anticaptcha, and Capsolver API's!
Your preferred open source focused crawler for the deep web.
Open Graph, Twitter Card, Oembed preview. Shows visual cards that mimic link previews in Social Media like facebook, twitter, vk and other sites that...
A blazingly fast tool to analyze all the selected organizations in Google Summer of Code in the form of graphical analytics.
A PasteBin scrapper that doesnt rely on the PasteBin scrape API
Automatically download all PDF files of searching results & their patent families found on Google Patents.
An anime discovery, streaming site made with React.js. It uses AniList API and video data from GogoAnime. No ads and no VPN required.
Intelligent Web Data Extractor
REST API streaming dan download Anime subtitle Indonesia | sub Indo
A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them
free open source manga api , including fetch all manga , single manga also support search . beside od next js demo .
Extract data from websites in LLM ready JSON or CSV format. Crawl or Scrape entire website with Website Crawler
Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!
Download Chegg homework-help questions to self-sufficient HTML files