scraping

🤖 A Discord bot that allows you to access solutions to homework problems from Chegg.

Contains a set of Python scripts for real estate data analysis, visualization, and fitting.

Fast python library for the Crawlbase API

Collection of scripts to help with web based ctfs.

JustDial Scraper to scrap all the requested data which includes their name, address, email address and phone number.

Timetable Grabber - SIT is a tool that allows you to grab and export your trimester's timetable to the .ics format where you can import it to your fav...

eCommerce Scraping API code examples for Python, PHP and Node.js

Scrape structured data from HTML documents automatically

Scraping Code4rena contest audits reports for stats, fun (and profit ?)

A Udemy Course Scraper built with bs4 and selenium, that fetches udemy course information. Get udemy course information and convert it to json, csv or...

Easily crawl news portals or blog sites using Storm Crawler.

search engine for python (Query and scrape search engines)

node.js library for scraping GitHub trending repositories.

Este paquete proporciona funciones para extraer datos de X/Twitter, incluidos tweets, usuarixs y metadatos asociados sin necesidad de usar API. || Thi...

Dataset and visualizations of Nintendo Games and ratings, scraped from metacritic.com

ProxyCrawl PHP library for scraping and crawling websites

Price Tracker app for Android and iOS. Built with Flutter

A python library for scraping videos from JW Player

Web scraping and managing data from MacroTrends

Quick and dirty date parsing Python library to parse HTML dates really fast

Scrapes: [HTTP, HTTPS, SOCKS4, and SOCKS5] || "Bypasses" and scrapes paid proxies

collection of 100k+ audio books, radio porgrams, music etc from archive.org in a easy to listen m3u playlist format

API for scrapping common 🇵🇱 meme sites

Download papers pdfs and other info from main AI conferences

Code examples and general information

Google's Bard ChatBot Unofficial NodeJS API

🦀 Scraping & crawling websites using Rust, and ReasonML

Projet pour générer la page http://clementgrimal.fr/darwin/

CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages

This program uses a GoLang Google Maps Scraper to scrape Google Maps for places and then scrapes the email for each place based on their website.

A 100% working Justdial scrapper, Just enter the url and it'll extract business info from it

CLI INTERACTIVE + WORKER + CONCURRENCY + SCRAPING

Scraping Facebook information

Easily download the main content of a web page in html, markdown, and/or epub format from command line.

ptt-crawler is a web crawler module designed to scarpe data from Ptt.

Scraper de Zonaprop

Scrape data from Instagram without applying for the authenticated API 🎯

Includes data about over 250 NFT Collections

Scraping of 5 types of fuel :fuelpump: from 8 different fuelcompanies in Denmark :denmark:.

Method For Establishing Database For Global Value Chain For Parts Procurement

A Scrapy extension to log items coverage when the spider shuts down

Get all the tweets from your favorite twitter accounts.

Scrape and parse Google search results in PHP

PyCarGr - Unofficial car.gr API

A robust asynchronous web scraping client using aiohttp.

Scans your Letterboxd watchlist and shows you where you can watch those movies using JustWatch

A drop-in replacement for puppeteer patched with rebrowser-patches. It allows to pass modern automation detection tests.

Scrap BTC addresses and balances from bitkeys.work

Web crawling & scraping framework for Node.js on top of headless Chrome browser

👨‍👩‍👧‍👦 (Rest) API to extract social media profiles from websites or specific URLs