Topic

scraping

Repositories (1626)

automation-samples
automation-samples automation9417 Python

Using clicknium to automate platforms like Linkedin, twitter, Slack, Youtube in python.

25
dynamic-rendering-ultra-generation__vite-react
dynamic-rendering-ultra-generation__vite-react anhchangvt1994 TypeScript

Advanced SEO for Vite + ReactJS Project

25
youtube-comment-scraper
youtube-comment-scraper itslab-kyushu JavaScript

Scraping comments from Youtube.

24
anime-scraper
anime-scraper areebbeigh Python

[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3

24
raspagem-de-dados-fatec
raspagem-de-dados-fatec lidimayra Jupyter Notebook

:notebook: Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí

24
househunterbot
househunterbot dheavy Python

Use Python, Google Spreadsheet, Google Shortener and CALLR API to automate your apartment search in Paris.

24
NBA-Fantasy-Optimizer
NBA-Fantasy-Optimizer owenauch Python

NBA Daily Fantasy Lineup Optimizer for FanDuel Using Python

24
lookout_hunter
lookout_hunter mileswwatkins JavaScript

Find availability on Recreation.gov to camp in decommissioned fire-lookout towers

24
first-puppeteer-scraper-example
first-puppeteer-scraper-example gaelgthomas JavaScript

Project built part of the "Web Scraping in JavaScript – How to Use Puppeteer to Scrape Web Pages" article.

24
scrape-facebook-by-playwright
scrape-facebook-by-playwright eslamaboushashaa Python

This is web app by streamlit, this app scrape facebook page and show some statictic and visualize the date

24
rebrowser-puppeteer-core
rebrowser-puppeteer-core rebrowser TypeScript

A drop-in replacement for puppeteer-core patched with rebrowser-patches. It allows to pass modern automation detection tests.

24
chrome-extensions-tiktok-scraping-downloader
chrome-extensions-tiktok-scraping-downloader silverbirder JavaScript

This is a Chrome extensions that scrapes and posts Tiktok web pages.

24
YouTubeScraper
YouTubeScraper palahsu Python

Scraping YouTube Video Description and Video Likes and Comments and Times and Replies! It's Automatically Extracting Data from Video.

24
Champ
Champ umangahuja1 Python

A Telegram bot combined with python to serve some basic functions like weather, music charts, cricket score and much more.

23
github-languages
github-languages alex-benoit Ruby

Tiny little ruby on rails website that crawls though your public github repos to find out what your favourite languages are.

23
nest
nest d-oliveros JavaScript

High-level, robust framework for web scraping in Node.js

23
fb-github-trends
fb-github-trends bumbeishvili JavaScript

Automatically post Github trends on Facebook page

23
shotstars
shotstars snooppr Python

A unique and over fab tool to track stars on Github.

23
SearchEnginesBookmarklet
SearchEnginesBookmarklet medialab JavaScript

Extract list of results from search engines pages as CSV with a bookmarklet directly within the browser

23
hodor
hodor CompileInc Python

🕷Configuration based html scraper

23
scraper-supermercados
scraper-supermercados matiasinsaurralde Go

Pequeño programa para realizar scraping de precios de supermercados de Paraguay.

23
proxycrawl-node
proxycrawl-node crawlbase JavaScript

ProxyCrawl Node library for scraping and crawling

23
apracticalguidetoevil
apracticalguidetoevil fallaciousreasoning Python

A tool for creating Pandoc compatible markdown files of https://practicalguidetoevil.wordpress.com/ and https://palelights.com/ which can be converted...

23
email-scraper
email-scraper kichik Python

Simple Python library to scrape email addresses from HTML

23
helix-importer-ui
helix-importer-ui adobe JavaScript
23
Joble
Joble Python-World Python

This Platform Search Thousands Of Job Boards In Different Technologies From Over The World .

23
scraping_zap_imoveis
scraping_zap_imoveis ziggy-data Jupyter Notebook

Faz web scraping no site Zap-Imoveis, ETL, RegEx, análise de dados, dashboard e modelo preditivo.

23
Web-Scraping-API
Web-Scraping-API Smartproxy JavaScript

Web Scraping API code examples for Python, PHP and Node.js

23
quora-plus-bypass
quora-plus-bypass NitinN77 Python

A python script to extract answers to any question on Quora (Quora+ included)

23
Emails-Scraper
Emails-Scraper pH-7 PHP

:ram: Simple PHP Email Grabber to get emails from a txt file containing the list of urls (add one url per line).

23
ETF-Scraper
ETF-Scraper nikulpatel3141 Python

Scrape public ETF and Mutual Fund holdings information

23
scraper-auto-trader
scraper-auto-trader kurt213 Python

A web scraper for extracting car ads data from Auto Trader

23
package-bot
package-bot szkf TypeScript

A Discord Parcel Tracking Bot

23
Statball
Statball somdeep C#

Statball - Football soccer stats analyser from top 5 european leagues with data obtained by web scraping from Fbref and Statsbomb

23
scraping-berita
scraping-berita bagusindrayana JavaScript

scraping berita dari beberapa portal berita indonesia

23
scrapman
scrapman danielnieto JavaScript

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

22
exoskeleton
exoskeleton RuedigerVoigt Python

A Python framework to build polite, but tenacious crawlers / scrapers with a MariaDB backend

22
chopper
chopper jurismarches Python

Chopper is a tool to extract elements from HTML by preserving ancestors and CSS rules

22
Goirate
Goirate haath Go

[DEPRECATED] Pillaging the seven seas for torrents, pieces of eight and other bounty.

22
PrawWallpaperDownloader
PrawWallpaperDownloader nikolajlauridsen Python

Download images from reddit

22
crawlbase-python
crawlbase-python crawlbase Python

Fast python library for the Crawlbase API

22
timetable-grabber-sit
timetable-grabber-sit JustBrandonLim TypeScript

Timetable Grabber - SIT is a tool that allows you to grab and export your trimester's timetable to the .ics format where you can import it to your fav...

22
kenya-news-scrapper
kenya-news-scrapper alfiepoleon Python

It scrapes various kenyan news sites and returns top news from each and a summary of each news item

22
master-to-pythonista
master-to-pythonista phuocding Python

A list of awesome beginners-friendly projects.

22
eCommerce-Scraping-API
eCommerce-Scraping-API Smartproxy PHP

eCommerce Scraping API code examples for Python, PHP and Node.js

22
EinsteinBot
EinsteinBot DouglasTaylorSupportGroup Python

🤖 A Discord bot that allows you to access solutions to homework problems from Chegg.

22
web-ctf-help
web-ctf-help xnomas Python

Collection of scripts to help with web based ctfs.

22
puppeteer-table-parser
puppeteer-table-parser Tomas2D TypeScript

Scrape and parse HTML tables with the Puppeteer table parser.

22
udemyscraper
udemyscraper sortedcord Python

A Udemy Course Scraper built with bs4 and selenium, that fetches udemy course information. Get udemy course information and convert it to json, csv or...

22
Justdial-Scraper
Justdial-Scraper yatin94 Python

JustDial Scraper to scrap all the requested data which includes their name, address, email address and phone number.

22