Most popular scraping repositories and open source projects

schedule-tweet honzajavorek Python

Schedules tweets using TweetDeck

15 1 15

reddit-top-posts-scrapy alysivji Python

Scrape top posts from list of subreddits and insert into MongoDB

15 3 15

javawebscrapinghandbook_code ksahin Java

15 15 15

-Competitive-Coding-Problem-Classifier-and-Recommender ParasAvkirkar Python

Competitive Coding Problem Classifier and Problem Recommendation

14 6 14

Linkedin-Job-Postings-Visualization-and-Analysis-Python DmytroNorth Jupyter Notebook

This Python script scrapes up to 100 most recent Linkedin job postings of any job title and creates sentiment visualization in a form of a word cloud.

14 1 14

Investopedia-Bot bassel27 Python

Pick the best stocks and automate Investopedia

14 10 14

python-overwatch alexbotello Python

A simple API for scraping Overwatch stats

14 5 14

scrapy-twitter BurnzZ Python

Web scraper based on Scrapy to fetch tweets from a list of user accounts

14 3 14

scotch-scraping-node gladchinda JavaScript

Simple app for scraping author profiles and tutorials from Scotch.io - https://scotch.io.

14 2 14

COVID-19-ANGOLA EmanuelJoseCandido PHP

Um app para colecta de dados sobre o COVID-19 em Angola.

14 1 14

SeleniumSample qwefgh90 Python

a set of samples about Login & Cookie with PhantomJS

14 11 14

worker MontFerret Go

Containerized Ferret worker

14 7 14

short-term-rentals-warehouse rsanjabi Python

Pipeline, warehouse, and visualization tools for investigating the impact of Airbnb short-term rentals on world cities.

14 1 14

Sreality JirkaZelenka Jupyter Notebook

Sreality, Scraping, Analysis, Python

14 7 14

scholar-scrap nainiayoub Python

Extract relevant information of research papers, into a downloadable CSV file, from Google Scholar based on user input.

14 3 14

scraperlite danp Go

Scrape text and HTML based on CSS selectors and save contents to a SQLite database.

14 0 14

kirinuki-core rike422 TypeScript

Kirinuki is a library that convert any html to JSON using CSS selectors.

14 2 14

prntscraper ItzBlinkzy Python

An effective random image scraper for the website image hosting and sharing website (https://prnt.sc)

14 2 14

scavenger pietrovismara JavaScript

Scrape and take screenshots of dynamic and static webpages

14 2 14

Faceapp-Gender-Swap-Detection moaaztaha Jupyter Notebook

Detecting fake photos generated by FACEAPP gender swap feature using Deep Learning.

14 2 14

Dataset-Indian-Companies mratanusarkar Jupyter Notebook

Web Scraping "List of companies in India" from AmbitionBox Website using Python and Beautiful Soup

14 8 14

playstore-scraper LuanRT JavaScript

🏷️ A simple and fast way to get search results and more from Google Play Store.

14 0 14

manifold Guilherme-B Python

Manifold is a plug-and-play end-to-end real estate asset tracker, from web scraping to ETL (data warehouse) using Python, Go, Apache Airflow/Spark, AW...

14 0 14

BestCarDeal TheAhmadOsman HTML

:moneybag: Scraping, Visualizing, and Analyzing 1,700,000 Entries of Used Cars for Sale on Craigslist to Find The Best Car Deal :car:

14 5 14

Web-Resource-Downloader mehmetkahya0 Python

This is a Python script that downloads all resources (images, scripts, stylesheets, etc.) from a given website.

14 3 14

LLM_InformationRetrieval yaminivibha Python

extracting "structured" information that is embedded in natural language text on the web using iterative set expansion, spanBERT, and openAI API

14 2 14

tradingview.com-scraper svetlozardraganov Jupyter Notebook

A python project that scrapes data from www.tradingview.com stores it into database and visualize financial parameters like revenue, net income and et...

14 2 14

volleystats claromes Python

🏐 Command-line tool to scrape volleyball statistics from Data Project Web Competition websites

14 0 14

idealista_data_extraction laurabarredaagusti Python

Data extraction from Idealista, using their API and web scraping (python). It contains both the datasets and the extraction files.

14 8 14

browse windsorio JavaScript

browse is a declerative programming language for web scraping, automation and UI testing

14 5 14

NewApkPure Alnyz Python

Search and download applications from apkpure.com

14 2 14

ToKillATweetingBird zer0Percent Python

A Twitter scraper to retrieve tweets and users from X (formerly Twitter) without using the API.

14 4 14

uruguayan_parliamentary_session_diary d4tagirl R

Code for my blog post about text mining uruguayan Parliamentary sessions 🇺🇾

14 3 14

amazon-wishless andre-st Python

The more and longer wishlists you have, the less you look for buying opportunities arising from price trends. This filters your Amazon lists by (used)...

14 3 14

Temphael NoraCodes Python

A Tumblr-scraping text post bot

14 3 14

nightmareHeadlessTest gabrielperales JavaScript

test project to execute nightmare in headless mode

14 2 14

InstaScraper supmanyu Python

A Simple Scraper for Instagram public accounts' E-mail addresses using Python and BeautifulSoup

14 5 14

cfr-iris-scraper FlashWebIT CSS

Live train information: scrape-powered API with JSON endpoints for the Romanian national railway infrastructure company CFR S.A's realtime information...

13 2 13