Topic

scraping

Repositories (1626)

outscraper-php
outscraper-php outscraper PHP

The library provides convenient access to the Outscraper API from applications written in the PHP language. Allows using Outscraper's services from yo...

17
WebHere
WebHere rdlopes Objective-C

HTML scraping for Objective-C.

17
scraper
scraper nirantak Python

Python web scrapers

17
scrapyd-mongodb
scrapyd-mongodb Tiago-Lira Python

Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management

17
Elektra-Auto-Checkout
Elektra-Auto-Checkout Johnw7789 Go

Toolkit to assist in stock checking and checkout automation of various retail sites.

17
scrawler
scrawler KadekM HTML

Scala web crawling and scraping using fs2 streams

16
pyReptile
pyReptile xyjw Python

web crawling & scraping framework for Python

16
Discord-Qr-Code-Token
Discord-Qr-Code-Token AstraaDev Python

Generate a QR code of connection and introduce it automatically on a background of "Fake Nitro".

16
zenrows-node-sdk
zenrows-node-sdk ZenRows TypeScript

SDK to access ZenRows API directly from Node.js. We handle proxies rotation, headless browsers and CAPTCHAs for you.

16
autobet
autobet dbrojas Jupyter Notebook

Soccer outcome modeling and algorithmic betting system

16
Shaman.Dokan.Warc
Shaman.Dokan.Warc antiufo C#

Mounts WARC files on Windows

16
SocialNetworkScraper
SocialNetworkScraper breadrock1 Python

Web scraping is simply the process of using a social media web scraper to gather data automatically. It saves users time, effort and sometimes money s...

16
quora-scraper
quora-scraper Theminijohn Ruby

Quora Question Scraper - Find & Export relevant Questions 10x faster

16
precios-claros
precios-claros martjanz Python

Precios Claros (http://preciosclaros.gob.ar) scraper / data downloader

16
locust
locust achannarasappa JavaScript

Distributed web data discovery and collection framework built for serverless

16
monitor_web_page_changes
monitor_web_page_changes nyavramov Python

I thought it would be nice to get an email alert when a new job posting appears on a website, so I can use this to check for the newest job openings o...

16
Redbubble-automatisation-bot
Redbubble-automatisation-bot clementjuventin JavaScript

Upload automatisation for RedBubble

16
telegram_members_scrapper
telegram_members_scrapper gurjeet29 Python

Python Script to scrape members from a selected Telegram group.

16
scrapy-scraper
scrapy-scraper ivan-sincek Python

Web crawler and scraper based on Scrapy and Playwright's headless browser.

16
socialblade-com-api
socialblade-com-api DavideViolante JavaScript

Unofficial APIs for socialblade.com website.

16
Impressionist
Impressionist Plato-solutions JavaScript

Impressionist is a JavaScript library that allows you to scrape data in less time.

16
Zeiver
Zeiver ZimCodes Rust

A Scraper, Downloader, & Recorder for static open directories.

16
tradingview-script-downloader
tradingview-script-downloader hasnocool Python

This Python script automates the extraction of PineScript codes from the most popular strategies on TradingView, using Selenium for web navigation and...

16
gochanges
gochanges edoardottt Go

**[ARCHIVED]** website changes tracker 🔍

16
google-images-scraper
google-images-scraper pruthvik-sheth Python

Google images scrapper in full resolution with multi threading speed.

16
go-scrapy
go-scrapy kabelsea Go

Web crawling and scraping framework for Golang

16
crawlbase-php
crawlbase-php crawlbase PHP

A lightweight, dependency free PHP class that acts as wrapper for Crawlbase API

16
langchain-scrapegraph
langchain-scrapegraph ScrapeGraphAI Python

ScrapeGraph client langchain integration

16
streamlit-selenium-chrome
streamlit-selenium-chrome snehankekre Python

Scrape the web with Selenium and Chrome on Streamlit's Community Cloud

16
ensembledata-python
ensembledata-python EnsembleData Python

Python library to scrape social media data via the EnsembleData API.

16
elata-vsm-system-4
elata-vsm-system-4 Elata-Biosciences TypeScript

AI-powered intelligence platform aggregating breakthroughs in neuroscience, computational psychiatry, and mental health research. Built with Next.js,...

16
israeli-supermarket-scarpers
israeli-supermarket-scarpers OpenIsraeliSupermarkets Jupyter Notebook

A python package with client to scrape the israeli supermarkets data

16
CBBpy
CBBpy dcstats Python

A Python-based web scraper for NCAA basketball.

16
Bootleg_Macro
Bootleg_Macro HelloThereMatey Jupyter Notebook

A simple tool-kit written in python for sourcing and displaying macroeconomic and financial data.

16
autoscout24_scraping
autoscout24_scraping lorenzoelia Python

Python-based web scraping and data analysis tool designed to collect vehicle listings from the Autoscout24 website.

15
baking-lyrics
baking-lyrics arukavina Python

Random lyrics generator.

15
spb-unofficial-wrapper
spb-unofficial-wrapper gkoniaris TypeScript

Unofficial NodeJS wrapper for the ScrapingBee API

15
turtle
turtle serhattsnmz Python

Instagram Photo Downloader

15
javawebscrapinghandbook_code
javawebscrapinghandbook_code ksahin Java
15
web-scraping
web-scraping HouariZegai Java

Code samples of web scraping using Java.

15
reddit-top-posts-scrapy
reddit-top-posts-scrapy alysivji Python

Scrape top posts from list of subreddits and insert into MongoDB

15
schedule-tweet
schedule-tweet honzajavorek Python

Schedules tweets using TweetDeck

15
proxycrawl-ruby
proxycrawl-ruby crawlbase Ruby

ProxyCrawl API ruby gem for scraping and crawling

15
internet-affordability
internet-affordability vinibrsl Jupyter Notebook

🌍 Did you know that internet costs >20% of the average income in some countries?

15
data-engineering-challenge-th
data-engineering-challenge-th Wittline Python

Dockerizing a Python Script for Web Scraping and consume the scraped data using FastApi (www.metroscubicos.com)

15
re-employment-kraken
re-employment-kraken uschtwill JavaScript

re-employment-kraken scrapes (job) sites, remembers what it saw and notifies downstream systems of any new sightings.

15
amazon-data-scraper
amazon-data-scraper ShantanuJalkote Python

A Python script that uses Selenium and BeautifulSoup to scrape data from Amazon websites. This script can be used to extract information such as Produ...

15
gunaydin
gunaydin OmarElgabry JavaScript

Your good mornings ☀️

15
Exploring-the-Landscape-of-the-Egyptian-Software-Market
Exploring-the-Landscape-of-the-Egyptian-Software-Market Mostafa-wael Jupyter Notebook

A Data-driven Approach. Our story begins with a quest for knowledge. The information we obtained from LinkedIn offers us unprecedented insights into t...

15
Chrome-extension-web-scraping-in-bc-
Chrome-extension-web-scraping-in-bc- Teymur-Babayev JavaScript

Chrome extension(Web Scraping) in BC

15