Most popular crawling repositories and open source projects

PyWebCrawling

Web scraping and automation using python

1   3   3  

aiocrawler

WIP Asynchronous web scraping heavily inspired by scrapy

2   3   3  

daily-menu

Scraper utility tool to fetch daily menus.

5   3   3  

CourseraCrawler

This python script crawls course title, ratings, description and instr...

1   3   3  

Yogiyo-Review-Crawling-with-Selenium

요기요 api를 활용한 좌표기반 리뷰데이터 크롤러입니다.

0   3   3  

dss_prjt_crawling

맛집사이트와 지도 크롤링으로, 경로 내 중간지점의 맛집을 추천 알고리즘...

7   3   3  

Amazon_Check

An Amazon price tracker written in python. This Skript was written by...

0   3   3  

SMART-SEARCH-ENGINE

This repository includes implementation of an Intelligent Search Engin...

1   3   3  

docker-torsocks

Runs tor client and wraps the CMD into torsocks

2   3   3  

wikipedia-philosophy-game

Clicking on the first link in the main text of a Wikipedia article, an...

1   3   3  

scraping-cnbcindonesia-api

Indonesia news api by scraping from CNBC Indonesia

2   3   3  

crawling-from-scratch

Repository for the Mastering Web Scraping in Python: Crawling from Scr...

1   3   3  

Github-Commits-Crawling

Scraping all of the GitHub-commits dates of a given user

0   3   3  

price-extract

Performant way to extract price amount and metadatas (currency, decima...

0   3   3  

MissingSemester_Crawling

2021 HUFS Missing Semester : Crawling

0   3   3  

Dawrly

Crawler based search engine that demonstrates the main features of a s...

0   3   3  

Study-Python

Python Framework & Libary

0   3   3  

wikicrawl

Semantic data processing pipeline.

0   3   3  

guphago

친구에게 파이썬 알려주기 --실습(끝말잇기)

0   3   3  

GetMarketInfo

crawling sample for YahooFinance(japan)

0   3   3  

Kikfriender.com-BOT

A multifunctional bot that increases your likes and hotness points, as...

1   3   3  

SentiNews

뉴스 감성 분석 Django 프로젝트입니다.

0   3   3  

mediawikiextractor

一个用于从 MediaWiki 网站中提取数据并保存为json的 Python 脚本。|A Pyth...

0   3   3  

ATSProofResume

AI-powered tool that optimizes resumes for Applicant Tracking Systems....

1   3   3  

Crawling-Data-From-Tokopedia

Repositori ini berisi proyek web scraping atau crawling data dari situ...

1   3   3  

otorecon

Reconnaissance Toolkit

0   3   3  

browserbro

Turn any website into an API with BrowserBro.

0   3   3  

craw-DataPrakiraanCuaca

crawling and scrapping weather data from BMKG website

0   3   3  

google-image-crawling-extension

Google Image Auto Download Chrome Extension. 구글 이미지 자동 다운로드...

0   3   3  

craw-TheMoscowTimes

scraping pada situs berita TheMoscowTimes

0   3   3  

quality_crawling

Document Quality Scoring for Web Crawling. Presented at WOWS2025.

0   3   3  

Airput

CLI tool for populating Airsequel with data. Includes a crawler for Gi...

0   3   3  

Analysis_Sentiment_Twitter_Free_Sex_In_Indonesian

Analysis Sentiment on Twitter Free Sex In Indonesia

0   3   3  

tider

A fast, simple, extensible and powerful framework for web crawling.

0   3   3  

FHM-Crawler-freehardmusic.com

Crawls download urls of albums from freehardmusic.com website

2   3   3  

RoboNope-nginx

Take control of your own content. Enforce access to disallowed web URL...

0   3   3  

OnionCrawler

Tool to crawl .onion websites. Console & Web UI

0   3   3  

SpiderSel

Python 3 script to crawl and spider websites for keywords via selenium

0   3   3  

Job-scraper_to_Notion

✅ DataEngineer Daily Crawling Project / Notion-api와 Notion Database...

0   3   3  

craw-dataset-kominfo

web scraping pada situs kominfo untuk mengambil dataset

0   3   3  

AI-Scraper

AI Scraper : scrap and extract data from website in any format (CSV, J...

1   3   3  

Booklify.me

Booklify.me is an open-source platform for keeping track of everything...

0   3   3  

trawler-csharp

The successor of https://github.com/somnisomni/twitter-account-data-cr...

0   3   3  

search-engine-shopee

Search Engine on Shopee apply Image Retrieval

1   2   2  

LYRICS_DATA_ANALYSIS

2019부터 2021까지 멜론 주간차트 100위 내의 음원 가사 감정어 추출 후,...

0   2   2  

GeckoFXInterceptRequestCaptureResponse

[GeckoFX/Firefox]: Shows how to Intercept request(s), capture response...

0   2   2  

malaga-parking-data

Histórico de datos sobre aparcamientos públicos de Málaga (Andalucía,...

1   2   2  

Python-Basic

🚀 Python 기초 🚀

0   2   2  

Uni_Market

2022산학프로젝트_유니마켓조

1   2   2  

most-profitable-actors

Finds the list of actors with the most boxoffice profit using TMDB API...

0   2   2