scraping
Repositories (1766)
Python script for scraping WhatsApp Web.
Rocket League Garage API in Python
r/HPfanfiction archived in plain-text org-mode (good for, e.g., doing offline full-text searches)
Python script that downloads the list of all the public addresses that have interacted with the NFT Escrow Algorand address.
Modules Woob pour l'intranet et autres sites Scouts et Guides de France (SGDF).
🗺️ statum, a Twitch streamer-related website. Written in Python + Flask, with MongoDB. Current features include Twitch OAuth integration, personalized...
An Email scrapper to extract all the emails from the given website and store them in a CSV file.
Scrap linkedin
A simple tool to iterate center coordinates within given boundaries
Telegram Group scraper and A Bot to send messages!!!!
Scraping no IMDb dos 100 filmes mais populares do momento. Feito com Beautiful Soup, Requests e Python.
Lightweight XPath parser for extracting structured data from HTML and XML documents.
Get_User_Agent is an easy-to-use rust CLI program and library for extracting the latest user agents of all browsers on Windows, Mac, Linux, Android, a...
This repository contains all the files related to project's data collection, data normalization / cleansing and database management.
Web Scraping Projects
Pirate's Creek
Fund portfolio optimization in Bibit App
Código para scrappear la pagina de Rosario, descargar su contenido y analizar cambios.
Django Dynamic Scraper (DDS) is an app for Django which builds on top of the scraping framework Scrapy and lets you create and manage Scrapy spiders v...
A script to quickly scrap translations from swedish dictionaries (Lexin and SAOL)
Program sederhana yang dibuat dengan bahasa pemrograman python3. menggunakan metode scrapping untuk mendapatkan informasi web dan menampilkan kembali...
Scrapes and visualizes data from https://marvel.fandom.com/wiki/. Shows the network of characters.
中央競馬に出走する母父キングヘイローの競走馬を一覧にしたページ
Userscript for Tampermonkey that automates the use of Mudae bot in Discord
An URL crawler created by go-rod.
Automatismo que mediante github actions, se crea un cron-job para scrapear la página de consulta del tiempo que tarda un autobús, y enviando una notif...
A basic python web scrapper for Ebay-Kleinanzeigen.
Raw data from NAS 2021 report
Scraping tool to automatically collect tick data from the Bitmex Orderbook, store it into a Mongo database and convert it into the desired timeframe (...
Random WOD from https://crossfit.com/. Available here: https://igorkosta.github.io/crossfit-wod/
CLI and client library for scrapyd. Done right.
Easy to use JQuery-Like API for Web Scraping/Crawling.
画像をダウンロードするよ
TV Guide with a CLI.
World Bank Climate Change Data Collector
A Pastebin scraper that uses scraping APIs
This document contains the process of scraping data from Bukalapak website including an analysis and visualization process using Altair.
Async website scrapper tool like scrapy built with reactphp.
A simple tool to download accepted codes from Lightoj online judge
Raions - it's a simple Ukrainian realty estimation service.
Python package for altering CSS selector names across CSS, HTML and JavaScript files.
A sample web automation project to ease daily login and logout of Office Intranet built using Selenium Java and Maven.
Scrapping prices from Ukrainian online whisky shops
4chan web scraper
[UNDER DEVELOPING] A Ruby library for Web scraping. It allows to describe scraping nodes and text structurally and declaratively.
Data scraping project for Comiko.
Get any website OG tags using Puppeteer
python网络数据采集一书代码，使用Python 3，并修改书籍中大量错误
Ecommerce Perú Scrap CLI is a project open source that extract products data by category and export to csv, json and other structure format files
A compact scraping library for the major newspapers of Chile