Topic

scraping

Repositories (1766)

Soplay-beta
Soplay-beta professorDeveloper Kotlin

SoMovie which you can watch movies in uzbek language

25
is-antibot
is-antibot microlinkhq JavaScript

Detect anti-bot protection from 20+ providers — CloudFlare, Akamai, DataDome, PerimeterX, Kasada, Imperva, reCAPTCHA, hCaptcha, Turnstile, and more.

25
MTGA_Swapper
MTGA_Swapper BobJr23 Python

Edit, Swap, or Export any assets in MTG Arena (Sleeves, Card Art, Battlefield, Emotes, Pets). Unlock any card styles, including Spiderman cards

25
picwish
picwish d60 Python

PicWish T2I, Photo Enhancer and Background Remover for Python

25
CodeChef-Gitter
CodeChef-Gitter aedorado Python

:books: Save all and update solutions submitted on Codechef to github.

25
Telegram-search
Telegram-search TeaByte Python

Simple web scrapping to search from telegram

25
GitStats
GitStats R055A Python

Generate regularly updated visualizations of personalized GitHub statistics. Filter by owner/organisation, repository, type, language, etc. Secure and...

25
Reddit-Content-Research-Agent
Reddit-Content-Research-Agent codingforentrepreneurs Python

Build a Reddit Content Research Agent with LLMs, LangChain, SERP, Jupyter, Django, Bright Data, Celery, Django QStash, and much more.

25
crawlbase-python
crawlbase-python crawlbase Python

Fast python library for the Crawlbase API

25
hShop-downloader
hShop-downloader Ghost0159 Python

A python script to download all hShop content

25
letterboxd-justwatch
letterboxd-justwatch sidward35 Python

Scans your Letterboxd watchlist and shows you where you can watch those movies using JustWatch

25
kenya-news-scrapper
kenya-news-scrapper alfiepoleon Python

It scrapes various kenyan news sites and returns top news from each and a summary of each news item

25
MacroTrends-Scraping
MacroTrends-Scraping capuccino26 Python

Web scraping and managing data from MacroTrends

25
automation-samples
automation-samples automation9417 Python

Using clicknium to automate platforms like Linkedin, twitter, Slack, Youtube in python.

25
master-to-pythonista
master-to-pythonista phuocding Python

A list of awesome beginners-friendly projects.

25
amazon_tracker
amazon_tracker edoardottt Python

A simple amazon tracker that sends you an email when prices of your followed products fall down!

25
raspagem-de-dados-fatec
raspagem-de-dados-fatec lidimayra Jupyter Notebook

:notebook: Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí

25
scraper-auto-trader
scraper-auto-trader kurt213 Python

A web scraper for extracting car ads data from Auto Trader

25
scraper
scraper capturr TypeScript

All In One API to easily scrape data from any website, without worrying about captchas and bot detection mecanisms.

25
Babler
Babler gidim Java

Data Collection System For NLP/Speech Recognition

25
cw-wizard
cw-wizard BenSouchet Python

Cardmarket Wantlist Wizard 🧙🏼‍♂️🪄 Easily find the sellers with the most cards you are looking for!

25
youtube-comment-scraper
youtube-comment-scraper itslab-kyushu JavaScript

Scraping comments from Youtube.

24
first-puppeteer-scraper-example
first-puppeteer-scraper-example gaelgthomas JavaScript

Project built part of the "Web Scraping in JavaScript – How to Use Puppeteer to Scrape Web Pages" article.

24
ptt-crawler
ptt-crawler WayneChang65 TypeScript

ptt-crawler is a web crawler module designed to scarpe data from Ptt.

24
quora-plus-bypass
quora-plus-bypass NitinN77 Python

A python script to extract answers to any question on Quora (Quora+ included)

24
cli
cli MontFerret Go

Ferret CLI

24
Emails-Scraper
Emails-Scraper pH-7 PHP

:ram: Simple PHP Email Grabber to get emails from a txt file containing the list of urls (add one url per line).

24
nest
nest d-oliveros JavaScript

High-level, robust framework for web scraping in Node.js

24
tradingview-script-downloader
tradingview-script-downloader hasnocool Python

This Python script automates the extraction of PineScript codes from the most popular strategies on TradingView, using Selenium for web navigation and...

24
househunterbot
househunterbot dheavy Python

Use Python, Google Spreadsheet, Google Shortener and CALLR API to automate your apartment search in Paris.

24
osint-series
osint-series kownet Python

Source codes related to the articles about OSINT. Using social media APIs and Python language.

24
YouTubeScraper
YouTubeScraper palahsu Python

Scraping YouTube Video Description and Video Likes and Comments and Times and Replies! It's Automatically Extracting Data from Video.

24
elata-vsm-system-4
elata-vsm-system-4 Elata-Biosciences TypeScript

AI-powered intelligence platform aggregating breakthroughs in neurotech and BCI

24
Philia
Philia MaximumOverflow TypeScript

An easy to use imageboard scraper.

24
raggy
raggy zzstoatzz Python

scraping and querying documents for LLMs

24
ToKillATweetingBird
ToKillATweetingBird zer0Percent Python

A Twitter scraper to retrieve tweets and users from X (formerly Twitter) without using the API.

24
Realestate
Realestate mboles01 Python

Contains a set of Python scripts for real estate data analysis, visualization, and fitting.

24
BrowserProxy
BrowserProxy aioke JavaScript

Allows to bypass Cloudflare checks

23
presentable-soup
presentable-soup lpil Gleam

Querying, scraping, and parsing of HTML. Good for snapshot testing too!

23
linkedin-osint-toolkit
linkedin-osint-toolkit michaelelizarov Python

Full-stack LinkedIn OSINT toolkit. Four-phase funnel: discover companies by region, batch scrape employees, classify roles by hierarchy/department, an...

23
web-fetcher.js
web-fetcher.js isdk TypeScript

A web automation library that lets AI agents browse the web using declarative JSON, with a unified dual-engine API and powerful anti-bot evasion.

23
hodor
hodor CompileInc Python

🕷Configuration based html scraper

23
scraper-supermercados
scraper-supermercados matiasinsaurralde Go

Pequeño programa para realizar scraping de precios de supermercados de Paraguay.

23
proxycrawl-node
proxycrawl-node crawlbase JavaScript

ProxyCrawl Node library for scraping and crawling

23
anime-scraper
anime-scraper areebbeigh Python

[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3

23
Statball
Statball somdeep C#

Statball - Football soccer stats analyser from top 5 european leagues with data obtained by web scraping from Fbref and Statsbomb

23
zcrawl
zcrawl zcrawl Go

An open source web crawling platform

23
yahoo-auction-alert-discord-bot
yahoo-auction-alert-discord-bot vlourme Python

Get a Discord alert when a new item is posted on Yahoo Auction or Mercari

23
autopahe
autopahe haxsysgit Python

Automatically download all your favorite anime from AnimePahe

23
autoscout24_scraping
autoscout24_scraping lorenzoelia Python

Python-based web scraping and data analysis tool designed to collect vehicle listings from the Autoscout24 website.

23