Most popular scraping repositories and open source projects

scrapyteer

Web crawling & scraping framework for Node.js on top of headless Chrom...

0   19   19  

rebrowser-puppeteer

A drop-in replacement for puppeteer patched with rebrowser-patches. It...

5   19   19  

hShop-downloader

A python script to download all hShop content

2   19   19  

mobile-de-car-data-collector

Crawl, scrape and persist Mobile.de car listings data in a smart & res...

3   19   19  

YiraBot-Crawler

YiraBot: Simplifying Web Scraping for All. A user-friendly tool for de...

0   19   19  

Spy.pet-Info

This repository serves as an index for all info the community has gath...

1   18   18  

OSINTLAB

This script automates the installation of 50 OSINT tools for reconnais...

0   18   18  

locations

An expanding collection of data scrapers designed to gather location d...

2   18   18  

raggy

scraping and querying documents for LLMs

0   18   18  

everand-downloader

This is everand book downloader

2   18   18  

Ebay-Scraper

Get the average price of a product on eBay or a list of products on sa...

5   18   18  

sg-food-ml

This script is used to scrap images from the Internet to classify 5 c...

1   18   18  

crawler

Web Crawler created with Node.js and Puppeteer

1   18   18  

instagram_explorer

:camera: An app to scrap instagram posts and analyze data.

5   18   18  

instatag

Extract Instagram Users from tags (Public , Without API and Login)

3   18   18  

ScrapeBot

A Selenium-driven tool for automated website interaction and scraping.

7   18   18  

lazyscraper

Lazy helper tool to make easier scraping with simple tasks

2   18   18  

ScrapIn

LinkedIn Scraper

4   18   18  

PyCarGr

PyCarGr - Unofficial car.gr API

14   18   18  

Bookshelf-Reader

An android application that provides information for books kept in a b...

9   18   18  

PressScraper

A scraper application for crawling press releases of US government age...

4   18   18  

cli

Ferret CLI

5   18   18  

moviestills

A small CLI app to scrap high-quality movie snapshots from various web...

1   18   18  

CMScrape

A simple python CardMarket price scraper.

3   18   18  

instagram-scraping-fish

A tutorial for scraping Instagram profile information and posts using...

2   18   18  

Scrape-GettyImages-Using-Selenium

Using python and selenium download images from gettyimages.com

5   18   18  

webscraping-benchmark

Web scraping API benchmark

3   18   18  

dynamic-scraping

Selenium Dynamic Website Scraping based on .NET & C#

5   18   18  

autoemploi-fsm

A script that automates the tedious process finding where you pass you...

1   18   18  

Instagram-Tools

Little php class for instagram.

4   18   18  

cloudfire

A proxy server to bypass cloudflare I am under attack mode using playw...

4   18   18  

scraper

Python web scrapers

8   17   17  

outscraper-php

The library provides convenient access to the Outscraper API from appl...

6   17   17  

AnimeDl

⚡️An API for downloading or streaming your favorite anime.

1   17   17  

SERP-Scraping-API

SERP Scraping API code examples for Python, PHP and Node.js

4   17   17  

Elektra-Auto-Checkout

Toolkit to assist in stock checking and checkout automation of various...

2   17   17  

fastcrawler

Modern, fast (high-performance) asynchronous scraping framework based...

2   17   17  

BrowserProxy

Allows to bypass Cloudflare checks

4   17   17  

dynamic-rendering-ultra-generation__webpack-vue

Advanced SEO for Webpack + VueJS Project

0   17   17  

tdk-12-kindle

Güncel Türkçe Sözlük'ün 12. baskısı, JSON ve MOBI formatında.

0   17   17  

rebrowser-playwright

A drop-in replacement for playwright patched with rebrowser-patches. I...

1   17   17  

ig-dm-reels-autodownload

A Python script that auto downloads all reels sent to your Instagram D...

8   17   17  

namigo

Your naming pal, written in Go 🐶

0   17   17  

yahoo-auction-alert-discord-bot

Get a Discord alert when a new item is posted on Yahoo Auction or Merc...

7   17   17  

instagram-sentiment-tutorial

walks through scraping and analyzing comment text

2   17   17  

WebHere

HTML scraping for Objective-C.

6   17   17  

hass-multiscrape

Home Assistant custom component for scraping multiple values (from a s...

4   17   17  

scrapyd-mongodb

Library designed to replace the SQLite backend by a MongoDB backend on...

9   17   17  

skrapr

DotNet Core based declarative web scraping using the Chrome Debugger P...

3   17   17  

deephotel

scraping TripAdvisor, Booking.com with Scrapy

10   17   17