Topic

scraping

Repositories (1626)

letterboxd-justwatch
letterboxd-justwatch sidward35 Python

Scans your Letterboxd watchlist and shows you where you can watch those movies using JustWatch

19
webscrapper
webscrapper zioneo Python

Scrap BTC addresses and balances from bitkeys.work

19
scrapyteer
scrapyteer miroshnikov TypeScript

Web crawling & scraping framework for Node.js on top of headless Chrome browser

19
socials-api
socials-api lorey Python

👨‍👩‍👧‍👦 (Rest) API to extract social media profiles from websites or specific URLs

19
abx-spec-behaviors
abx-spec-behaviors ArchiveBox JavaScript

🧩 Proposal to allow user scripts like "expand comments", "hide popups", "fill out this form", etc. to be reusable across pure browser environments, p...

19
YiraBot-Crawler
YiraBot-Crawler OwenOrcan Python

YiraBot: Simplifying Web Scraping for All. A user-friendly tool for developers and enthusiasts, offering command-line ease and Python integration. Ide...

19
mobile-de-car-data-collector
mobile-de-car-data-collector robertciotoiu Java

Crawl, scrape and persist Mobile.de car listings data in a smart & responsible way

19
hShop-downloader
hShop-downloader Ghost0159 Python

A python script to download all hShop content

19
rebrowser-puppeteer
rebrowser-puppeteer rebrowser

A drop-in replacement for puppeteer patched with rebrowser-patches. It allows to pass modern automation detection tests.

19
moviestills
moviestills kinoute Go

A small CLI app to scrap high-quality movie snapshots from various websites.

18
cli
cli MontFerret Go

Ferret CLI

18
CMScrape
CMScrape DrankRock Python

A simple python CardMarket price scraper.

18
instagram-scraping-fish
instagram-scraping-fish mateuszbuda Jupyter Notebook

A tutorial for scraping Instagram profile information and posts using Scraping Fish API: https://scrapingfish.com

18
Scrape-GettyImages-Using-Selenium
Scrape-GettyImages-Using-Selenium KryeKuzhinieri Python

Using python and selenium download images from gettyimages.com

18
webscraping-benchmark
webscraping-benchmark mateuszbuda Python

Web scraping API benchmark

18
dynamic-scraping
dynamic-scraping markulie C#

Selenium Dynamic Website Scraping based on .NET & C#

18
autoemploi-fsm
autoemploi-fsm medanisjbara Python

A script that automates the tedious process finding where you pass your exam in FSM + basic web app

18
Instagram-Tools
Instagram-Tools Incognito-Coder PHP

Little php class for instagram.

18
cloudfire
cloudfire midmit Python

A proxy server to bypass cloudflare I am under attack mode using playwright, written in python

18
PressScraper
PressScraper TonyxSun Python

A scraper application for crawling press releases of US government agencies and major think tanks for analytical purposes.

18
instagram_explorer
instagram_explorer jpmondoni Python

:camera: An app to scrap instagram posts and analyze data.

18
lazyscraper
lazyscraper ivbeg Python

Lazy helper tool to make easier scraping with simple tasks

18
instatag
instatag Moduland Python

Extract Instagram Users from tags (Public , Without API and Login)

18
Bookshelf-Reader
Bookshelf-Reader LakshyaKhatri Java

An android application that provides information for books kept in a bookshelf by recognizing their spines from images.

18
scrapingai
scrapingai Agenty TypeScript

Build web scraping agents using AI to auto-extract the data from websites, capture screenshot, generate pdf from URL and web crawling with Agenty

18
crawler
crawler alinebastos JavaScript

Web Crawler created with Node.js and Puppeteer

18
ScrapeBot
ScrapeBot MarHai Python

A Selenium-driven tool for automated website interaction and scraping.

18
sg-food-ml
sg-food-ml DtCarrot Python

This script is used to scrap images from the Internet to classify 5 common noodle "mee" dishes in Singapore. Wanton Mee, Bak Chor Mee, Lor Mee, Prawn...

18
Spy.pet-Info
Spy.pet-Info ThatSINEWAVE JavaScript

This repository serves as an index for all info the community has gathered on the Spy.pet situation and as well as my own tables and tools written for...

18
OSINTLAB
OSINTLAB Purpl3-Dev Shell

This script automates the installation of 50 OSINT tools for reconnaissance and information gathering.

18
locations
locations stiles Jupyter Notebook

An expanding collection of data scrapers designed to gather location details on prominent stores, restaurants and other consumer destinations across t...

18
raggy
raggy zzstoatzz Python

scraping and querying documents for LLMs

18
Ebay-Scraper
Ebay-Scraper alexis-brosseau Python

Get the average price of a product on eBay or a list of products on sale.

18
fastcrawler
fastcrawler fast-crawler

Modern, fast (high-performance) asynchronous scraping framework based on standard Python type hints and Pydantic.

18
AnimeDl
AnimeDl jerry08 C#

⚡️An API for downloading or streaming your favorite anime.

17
hass-multiscrape
hass-multiscrape danieldotnl Python

Home Assistant custom component for scraping multiple values (from a single HTTP request) with a separate sensor for each value.

17
scraper
scraper nirantak Python

Python web scrapers

17
WebHere
WebHere rdlopes Objective-C

HTML scraping for Objective-C.

17
SERP-Scraping-API
SERP-Scraping-API Smartproxy PHP

SERP Scraping API code examples for Python, PHP and Node.js

17
Elektra-Auto-Checkout
Elektra-Auto-Checkout Johnw7789 Go

Toolkit to assist in stock checking and checkout automation of various retail sites.

17
instagram-sentiment-tutorial
instagram-sentiment-tutorial madelinekinnaird

walks through scraping and analyzing comment text

17
yahoo-auction-alert-discord-bot
yahoo-auction-alert-discord-bot vlourme Python

Get a Discord alert when a new item is posted on Yahoo Auction or Mercari

17
namigo
namigo huangsam Go

Your naming pal, written in Go 🐶

17
ig-dm-reels-autodownload
ig-dm-reels-autodownload kelvinthh Python

A Python script that auto downloads all reels sent to your Instagram DM

17
rebrowser-playwright
rebrowser-playwright rebrowser

A drop-in replacement for playwright patched with rebrowser-patches. It allows to pass modern automation detection tests.

17
outscraper-php
outscraper-php outscraper PHP

The library provides convenient access to the Outscraper API from applications written in the PHP language. Allows using Outscraper's services from yo...

17
alibaba_scraper
alibaba_scraper ScrapingAnt Python

Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt

17
deephotel
deephotel gkzz Python

scraping TripAdvisor, Booking.com with Scrapy

17
puppeteer-boiler
puppeteer-boiler clouedoc TypeScript

🛢 A batteries included boilerplate for puppeteer-extra. Automate all the things!

17
scrapyd-mongodb
scrapyd-mongodb Tiago-Lira Python

Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management

17