Topic

scraping

Repositories (1766)

socials-api
socials-api lorey Python

👨‍👩‍👧‍👦 (Rest) API to extract social media profiles from websites or specific URLs

18
occupancy-epfl
occupancy-epfl antoninfaure TypeScript

Backend of Occupancy FLEP, an interface of edu.epfl.ch useful for finding free rooms or schedule by studyplan, at EPFL.

18
instatag
instatag Moduland Python

Extract Instagram Users from tags (Public , Without API and Login)

18
CLIs-Applications
CLIs-Applications EkoEdyP Go

CLI INTERACTIVE + WORKER + CONCURRENCY + SCRAPING

18
scrappey_proxy
scrappey_proxy AnthonyRAFFY Python

Drop-in replacement for FlareSolverr using Scrappey.com to bypass Cloudflare protection.

18
sortir.in
sortir.in leorolland Go

Your local {films, events, activities...} search engine 🧭

18
mtg
mtg mazz3rr Python

Scrape data on MtG decks

18
instagram-sentiment-tutorial
instagram-sentiment-tutorial madelinekinnaird

walks through scraping and analyzing comment text

18
namigo
namigo huangsam Go

Your naming pal, written in Go 🐶

18
autoemploi-fsm
autoemploi-fsm medanisjbara Python

A script that automates the tedious process finding where you pass your exam in FSM + basic web app

17
socialblade-com-api
socialblade-com-api DavideViolante JavaScript

Unofficial APIs for socialblade.com website.

17
cloudfire
cloudfire libmid Python

A proxy server to bypass cloudflare I am under attack mode using playwright, written in python

17
Scraping-Jumia-Ecommerce
Scraping-Jumia-Ecommerce krizten Python

Using the Scrapy framework to scrape data consisting of name, brand, rating, price, product URL and image URLs of laptops on Jumia e-commerce (https:/...

17
go-scrapy
go-scrapy kabelsea Go

Web crawling and scraping framework for Golang

17
Investopedia-Bot
Investopedia-Bot bassel27 Python

Pick the best stocks and automate Investopedia

17
dramabox-scraper
dramabox-scraper giienew JavaScript

Dramabox Scraper ( Original Apps Latest Version)

17
scraper
scraper nirantak Python

Python web scrapers

17
crawlee-cloud
crawlee-cloud crawlee-cloud TypeScript

Self-hosted, open-source platform for running Apify Actors. Drop-in compatible with the Apify SDK.

17
webscrape-tutorial
webscrape-tutorial octobug1 Python

A basic tutorial to web scraping using python for beginners

17
Awesome-Web-Scraping
Awesome-Web-Scraping luminati-io

A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from...

17
YiraBot-Crawler
YiraBot-Crawler OwenOrcan Python

YiraBot: Simplifying Web Scraping for All. A user-friendly tool for developers and enthusiasts, offering command-line ease and Python integration. Ide...

17
pyjpboatrace
pyjpboatrace hmasdev Python

pyjpboatrace :speedboat: provides you with useful tools for data analysis and auto-betting for boatrace.

17
hass-multiscrape
hass-multiscrape danieldotnl Python

Home Assistant custom component for scraping multiple values (from a single HTTP request) with a separate sensor for each value.

17
telegram_members_scrapper
telegram_members_scrapper gurjeet29 Python

Python Script to scrape members from a selected Telegram group.

17
chaindl
chaindl dhruvan2006 Python

Download crypto on-chain data with a single line of code

17
scrapyd-mongodb
scrapyd-mongodb Tiago-Lira Python

Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management

17
Zeiver
Zeiver ZimCodes Rust

A Scraper, Downloader, & Recorder for static open directories.

17
dynamic-rendering-ultra-generation__webpack-vue
dynamic-rendering-ultra-generation__webpack-vue anhchangvt1994 TypeScript

Advanced SEO for Webpack + VueJS Project

17
cfr-iris-scraper
cfr-iris-scraper FlashWebIT CSS

Live train information: scrape-powered API with JSON endpoints for the Romanian national railway infrastructure company CFR S.A's realtime information...

17
scrapy-scraper
scrapy-scraper ivan-sincek Python

Web crawler and scraper based on Scrapy and Playwright's headless browser.

17
deephotel
deephotel gkzz Python

scraping TripAdvisor, Booking.com with Scrapy

17
file-scraper
file-scraper ivan-sincek Python

Scrape files for sensitive information, and generate an interactive HTML report. Based on Rabin2.

17
web-scraping-lvl1
web-scraping-lvl1 FirasKahlaoui Jupyter Notebook

The "web-scraping-lvl1" project is a beginner-level exercise in web scraping using Python's Beautiful Soup library and Requests module.

17
LLM_InformationRetrieval
LLM_InformationRetrieval yaminivibha Python

extracting "structured" information that is embedded in natural language text on the web using iterative set expansion, spanBERT, and openAI API

17
Web-Resource-Downloader
Web-Resource-Downloader mehmetkahya0 Python

This is a Python script that downloads all resources (images, scripts, stylesheets, etc.) from a given website.

17
undetectedselenium
undetectedselenium bramar2 Java

Java implementation of python library undetected-chromedriver and selenium-stealth

17
scrapemed
scrapemed danielfrees Python

ScrapeMed: Data scraping for PubMed Central.

17
python-selenium-scraper-template
python-selenium-scraper-template therealthoren Python

Watch your python scraper with selenium in a docker container

17
skrapr
skrapr BaristaLabs C#

DotNet Core based declarative web scraping using the Chrome Debugger Protocol

17
Scrape-GettyImages-Using-Selenium
Scrape-GettyImages-Using-Selenium KryeKuzhinieri Python

Using python and selenium download images from gettyimages.com

17
SocialNetworkScraper
SocialNetworkScraper breadrock1 Python

Web scraping is simply the process of using a social media web scraper to gather data automatically. It saves users time, effort and sometimes money s...

17
zenrows-node-sdk
zenrows-node-sdk ZenRows TypeScript

SDK to access ZenRows API directly from Node.js. We handle proxies rotation, headless browsers and CAPTCHAs for you.

17
langchain-scrapegraph
langchain-scrapegraph ScrapeGraphAI Python

ScrapeGraph client langchain integration

17
LeadGenerationAPI
LeadGenerationAPI Ambitious-Concepts-Labs Python

This API is built for lead generation and provides users with a streamlined platform for capturing and tracking leads, which integrates with existing...

16
Earnings_Call_Analyzed_By_NLP
Earnings_Call_Analyzed_By_NLP nilijing Jupyter Notebook

Earnings Call Sentiment Analysis. This repository includes my work on extracting the focus area of companies from their earnings calls transcripts.

16
Impressionist
Impressionist Plato-solutions JavaScript

Impressionist is a JavaScript library that allows you to scrape data in less time.

16
Redbubble-automatisation-bot
Redbubble-automatisation-bot clementjuventin JavaScript

Upload automatisation for RedBubble

16
nautiljon-scraper
nautiljon-scraper barthofu JavaScript

🍙 An unofficial scraping tool for https://nautiljon.com, a french anime and manga data website

16
wallet-finder
wallet-finder pywallet-cli

Find wallet.dat online scraping

16
WebRunner
WebRunner sp34rh34d Python

Web scraping | Website cloner | Path Traversal Scanner

16