scraping

Random WOD from https://crossfit.com/. Available here: https://igorkosta.github.io/crossfit-wod/

CLI and client library for scrapyd. Done right.

Easy to use JQuery-Like API for Web Scraping/Crawling.

画像をダウンロードするよ

TV Guide with a CLI.

World Bank Climate Change Data Collector

A Pastebin scraper that uses scraping APIs

This document contains the process of scraping data from Bukalapak website including an analysis and visualization process using Altair.

Async website scrapper tool like scrapy built with reactphp.

A simple tool to download accepted codes from Lightoj online judge

Raions - it's a simple Ukrainian realty estimation service.

Python package for altering CSS selector names across CSS, HTML and JavaScript files.

A sample web automation project to ease daily login and logout of Office Intranet built using Selenium Java and Maven.

Scrapping prices from Ukrainian online whisky shops

4chan web scraper

[UNDER DEVELOPING] A Ruby library for Web scraping. It allows to describe scraping nodes and text structurally and declaratively.

Data scraping project for Comiko.

Get any website OG tags using Puppeteer

python网络数据采集一书代码，使用Python 3，并修改书籍中大量错误

Ecommerce Perú Scrap CLI is a project open source that extract products data by category and export to csv, json and other structure format files

A compact scraping library for the major newspapers of Chile

A research tool to understand and explore the hashtag's dynamics on Instagram.

download images from web page

CLI Nim app that extracts metadata out of HTML. Extremely fast, but might not handle edge cases.

Script to download and join Audm.com's back catalogue

Análise de tabelas de vendas de álbuns e lançamentos discográficos em Portugal

Search Telegram Bots with another Telegram Bot

Public repo of Automatio.co for reporting bugs, fixes, issues and reading Faq, Docs, etc

Automation for report downloading from the Thomson One database using Python and Selenium

Programmatic web browser/crawler in Python. Alternative to Mechanize, RoboBrowser, MechanicalSoup and others. Strict power of Request and Lxml. Some f...

Web scraping library

Collecting data about movies using web-scraping. A comparison of the rating with kinopoisk.ru & IMDB.com

compare the product with different online store and buy the best one

Practice project UOC. Data science project about cryptocurrencies and stock indexs.

aws-gcp-squid-config-dotfile

Scraped data for previously selected organizations in GSoC, in spreadsheets

🕶⏲Watcher for ICBC Web booking

Scrapping travel website using CasperJs

Real estate data gathering and notification

Este projeto contém scripts de raspagem de dados que extraem dados de versões do Minecraft de alguns sites com uma ferramenta fácil de usar. No fundo...

Django-based web app developed for the UofM Bioinformatics Dept, now in development at Beaumont School of Medicine. Uses latent semantic analysis, tex...

User-friendly client designed for browsing real estates with dynamically calculated ratings based on price, quality of photos as well as public transi...

:mag_right: This application parses sites and retrieves data associated with failures of public services to display districts' prestige

Repository of python based web scrapers for numerous websites.

An app to geographically visualize and organize tattoo artist information.

Pulls repairability scores for various devices from iFixit, which are then displayed on a website in a few categories.

This simple script crawl wallpepers site Simpledesktops.com and download them all in the specified directory.

APIとスクレイピングを学んでいたので作ってみました。自身では初めての成果物です。