Most popular scraping repositories and open source projects

lazyscraper

Lazy helper tool to make easier scraping with simple tasks

2   16   16  

deephotel

scraping TripAdvisor, Booking.com with Scrapy

10   16   16  

google-search-results-php

Scrape and parse Google search results in PHP

9   16   16  

dzone-refcardz-downloader

Downloads all refcardz from https://dzone.com/refcardz

2   16   16  

Joble

This Platform Search Thousands Of Job Boards In Different Technologie...

12   16   16  

aiohttp-scraper

A robust asynchronous web scraping client using aiohttp.

4   16   16  

vogue-runway-scraper

This application was built to help scrape the fashion looks from diffe...

1   16   16  

scraper-auto-trader

A web scraper for extracting car ads data from Auto Trader

6   16   16  

ted-scraper

💬 TED Talks web scraper

7   16   16  

Discord-Qr-Code-Token

Generate a QR code of connection and introduce it automatically on a b...

6   16   16  

Zeiver

A Scraper, Downloader, & Recorder for static open directories.

1   16   16  

EinsteinBot

🤖 A Discord bot that allows you to access solutions to homework proble...

12   16   16  

chrome-extensions-tiktok-scraping-downloader

This is a Chrome extensions that scrapes and posts Tiktok web pages.

4   16   16  

scrapy-zyte-api

Zyte API integration for Scrapy

12   16   16  

autoemploi-fsm

A script that automates the tedious process finding where you pass you...

2   16   16  

turtle

Instagram Photo Downloader

8   15   15  

spb-unofficial-wrapper

Unofficial NodeJS wrapper for the ScrapingBee API

0   15   15  

scotch-scraping-node

Simple app for scraping author profiles and tutorials from Scotch.io -...

2   15   15  

COVID-19-ANGOLA

Um app para colecta de dados sobre o COVID-19 em Angola.

1   15   15  

monitor_web_page_changes

I thought it would be nice to get an email alert when a new job postin...

4   15   15  

schedule-tweet

Schedules tweets using TweetDeck

1   15   15  

qddate

Quick and dirty date parsing Python library to parse HTML dates really...

2   15   15  

webscrapper

Scrap BTC addresses and balances from bitkeys.work

7   15   15  

Emails-Scraper

:ram: Simple PHP Email Grabber to get emails from a txt file containin...

12   15   15  

pastebin-bisque

Download all of a given user's public Pastebin pastes

5   15   15  

gwaripper

Tool for conveniently downloading audios from r/gonewildaudio and simi...

2   15   15  

YouTubeScraper

Scraping YouTube Video Description and Video Likes and Comments and Ti...

3   15   15  

DeCryPt_ProxyScraper_v1

Scrapes: [HTTP, HTTPS, SOCKS4, and SOCKS5] || "Bypasses" and scrapes p...

9   15   15  

python-overwatch

A simple API for scraping Overwatch stats

5   14   14  

scrawler

Scala web crawling and scraping using fs2 streams

2   14   14  

SeleniumSample

a set of samples about Login & Cookie with PhantomJS

11   14   14  

nightmareHeadlessTest

test project to execute nightmare in headless mode

2   14   14  

scavenger

Scrape and take screenshots of dynamic and static webpages

2   14   14  

skrapr

DotNet Core based declarative web scraping using the Chrome Debugger P...

3   14   14  

subscene_scraper

Library to download subtitles from subscene.com

6   14   14  

baking-lyrics

Random lyrics generator.

1   14   14  

gochanges

**[ARCHIVED]** website changes tracker 🔍

6   14   14  

locust

Distributed web data discovery and collection framework built for serv...

1   14   14  

Temphael

A Tumblr-scraping text post bot

3   14   14  

-Competitive-Coding-Problem-Classifier-and-Recommender

Competitive Coding Problem Classifier and Problem Recommendation

6   14   14  

InstaScraper

A Simple Scraper for Instagram public accounts' E-mail addresses using...

5   14   14  

Python-scraper-tutorial

Short introduction to scraping with given steps an example of a scrape...

3   14   14  

ScrapIn

LinkedIn Scraper

4   14   14  

proxycrawl-ruby

ProxyCrawl API ruby gem for scraping and crawling

1   14   14  

VITask

VITask is a Dynamic API server for VTOP with Moodle Integration. This...

6   14   14  

playstore-scraper

🏷️ A simple and fast way to get search results and more from Google Pl...

0   14   14  

puppeteer-humanize

🕺 Humanizer functions for Puppeteer

3   14   14  

duckduckgo

A simple DuckDuckGo URL scraper.

2   14   14  

scraperlite

Scrape text and HTML based on CSS selectors and save contents to a SQL...

0   14   14  

scraper-instagram

Scrape data from Instagram without applying for the authenticated API...

2   14   14