Topic

scraping

Repositories (1626)

photo-dataset-scraper
photo-dataset-scraper damianmoore Python

Tools to create a labelled dataset of photos for deep learning image classification

4
news-lens
news-lens pkipsy Jupyter Notebook

Filtering Political Bias in American News Media

4
naruto-name-generator
naruto-name-generator andraderaul Python

Foi treinada uma rede neural recorrente (RNN) em um conjunto de dados contendo todos os nomes, ou quase todos, de personagens do Naruto e usado o mode...

4
srcget
srcget dellelce Shell

Download latest *stable* source

4
data-scraper
data-scraper complexorganizations Go

❤️ The data scraper for big data

4
mojok_archive
mojok_archive naftalent

Website archiving project for Mojok.co website, based on scrapping.

4
bitsky-builder
bitsky-builder bitskyai Shell

Build BitSky Desktop Application, Web Application, and Docker images

4
YTscheduledVideos2Ical
YTscheduledVideos2Ical jy95 JavaScript

Extract your scheduled videos publish date to a ical file so that it allows you to to see your scheduling in your favorite calendar app

4
node-itunes-rss
node-itunes-rss dweinstein JavaScript

Overengineered iTunes rss feed lister https://rss.itunes.apple.com/

4
samehadaku.sh
samehadaku.sh laztname Shell

link graber for samehadaku.tv

4
youcos
youcos seungguini Python

:rocket: A simple Python package for scraping YouTube videos and comments!

4
spider_project
spider_project lorien Makefile

Template of scraping project using Grab scraping framework

4
scielo-scraping
scielo-scraping LibreCodeCoop PHP

Download all files from SciELO

4
piculet
piculet uyar Python

Extract data from XML or HTML documents using XPath.

4
Scrapy-Middleware
Scrapy-Middleware Decodo Python

Scrapy Middleware for proxy authentication with Decodo

4
OLX-Crawler
OLX-Crawler iam-mhaseeb Python

This repository contains code of olx crawler to extract public phone numbers.

4
comicthread
comicthread aldnav Python

Get random comics from multiple sources (XKCD, Commitstrip, ...)

4
yahoo-login
yahoo-login galiarmero Python

Gobble up an authenticated Yahoo session by mechanizing the login process

4
scrape-x
scrape-x alexleen C#

Simple .NET library that provides generic web scraping abilities using XPaths.

4
site-pages-graph
site-pages-graph kilgoretrout1985 Python

Site pages into graph for some SEO-analysis.

4
chrome-vision
chrome-vision daabr Go

Advanced cross-platform web automation with a convenient Go API

4
MappingYoutube
MappingYoutube nvalis Python

Generate a visual map of youtube by using channel relations.

4
hltb-scraper
hltb-scraper KasumiL5x Python

A web spider that crawls HowLongToBeat to extract game and completion time data.

4
search_it
search_it EdmundMartin HTML

Asyncio package for scraping major Search Engines, supports pagination and other features.

4
mnemonic-maker-backend
mnemonic-maker-backend Jackmt9 Ruby

A web scraping application that generates acrostic mnemonic devices by mapping user input to song lyrics.

4
classify
classify olesho Go

Classify is an efficient tool for extraction of structured field sequences from HTML/XML data sources. It finds repetitive patterns and returns sequen...

4
searchpro
searchpro arunvemana Python

gives top 5 results of google,yahoo,bing

4
Python-Regex
Python-Regex zawster Python

Regular expressions using re Python module

4
web-scraping-with-playwright
web-scraping-with-playwright RayzaOliveira JavaScript

🎭 Playwright allows for reliable end-to-end testing for web applications.

4
Ebay-Web-Scrapper
Ebay-Web-Scrapper VincentGerard Python

A basic python web scrapper for Ebay-Kleinanzeigen.

4
bus_arrival_time
bus_arrival_time sebas2409 Go

Automatismo que mediante github actions, se crea un cron-job para scrapear la página de consulta del tiempo que tarda un autobús, y enviando una notif...

4
crawler
crawler abtswath Go

An URL crawler created by go-rod.

4
biblescholar
biblescholar turtlemonvh Go

Tools for multi-translation Bible search over voice apis (currently alexa).

4
EzScraper
EzScraper issamoxix Python

Scrape table from website and save them to a .csv file

4
swiftui-web-scraping-tool
swiftui-web-scraping-tool 256hax Swift

Web Scraping Tool for iOS App with SwiftUI and CoreData.

4
scrape_whatsapp
scrape_whatsapp juyalpriyank Python

Python script for scraping WhatsApp Web.

4
r_HPfanfiction
r_HPfanfiction NightMachinery

r/HPfanfiction archived in plain-text org-mode (good for, e.g., doing offline full-text searches)

4
statum
statum k9mil Python

🗺️ statum, a Twitch streamer-related website. Written in Python + Flask, with MongoDB. Current features include Twitch OAuth integration, personalized...

4
Email-scrapper
Email-scrapper gurjeet29 Python

An Email scrapper to extract all the emails from the given website and store them in a CSV file.

4
ScrapMyLinkedin
ScrapMyLinkedin Just1truc Python

Scrap linkedin

4
sinta2-scraper-OBSOLETE
sinta2-scraper-OBSOLETE rendicahya Python

Retrieves information from Sinta (https://sinta.kemdikbud.go.id) via scraping.

4
Telegram_BotScraper
Telegram_BotScraper azraf122312 Python

Telegram Group scraper and A Bot to send messages!!!!

4
scraping-imdb
scraping-imdb RakelMacedo Python

Scraping no IMDb dos 100 filmes mais populares do momento. Feito com Beautiful Soup, Requests e Python.

4
PI202202-alako-data
PI202202-alako-data PedroChaparro Jupyter Notebook

This repository contains all the files related to project's data collection, data normalization / cleansing and database management.

4
Web-Scraping-Projects
Web-Scraping-Projects kailashnegi Jupyter Notebook

Web Scraping Projects

4
pirates-creek
pirates-creek mystery-z Python

Pirate's Creek

4
Scrapper_Sueldos_Municipales
Scrapper_Sueldos_Municipales rodrigotesone1997 Python

Código para scrappear la pagina de Rosario, descargar su contenido y analizar cambios.

4
django-dynamic-scraper
django-dynamic-scraper xmas7 Python

Django Dynamic Scraper (DDS) is an app for Django which builds on top of the scraping framework Scrapy and lets you create and manage Scrapy spiders v...

4
SvenskaScraper
SvenskaScraper juanluisrto Python

A script to quickly scrap translations from swedish dictionaries (Lexin and SAOL)

4
web-of-marvel-characters
web-of-marvel-characters meee-low HTML

Scrapes and visualizes data from https://marvel.fandom.com/wiki/. Shows the network of characters.

4