scraping

Curated list of common web crawler and bot User-Agent strings used across the internet.

Integrates Supabase with Crawl4AI and AI Chat to create a powerful web crawling and semantic search solution. Streamlit supabase data visualization. R...

A Python-based web scraper for NCAA basketball.

Social Media Scraping API code examples for Python, PHP and Node.js

A user-friendly python-based GUI which provides sentiment analysis of users' reviews toward a specific TripAdvisor facility

Minimalistic library to scrape emails from websites with headless browser support.

Scrape discord channels

A tool for creating Pandoc compatible markdown files of https://practicalguidetoevil.wordpress.com/ and https://palelights.com/ which can be converted...

📉 Uptime and error monitoring CLI

Scrape Instagram

Extract HTML elements from the command line using CSS selectors or XPath. Pipe-friendly Python CLI.

A Python tool that scrapes detailed metadata from IMDb based on the links you provide.

A GUI for Instaloader to scrape users and hashtags with on Instagram

This is web app by streamlit, this app scrape facebook page and show some statictic and visualize the date

Python (asyncio) wrapper for hackernews api

Scans your Letterboxd watchlist and shows you where you can watch those movies using JustWatch

Web Scaper for RSI

Iranian politicians twitter dataset persian | دیتاست کامل توییت های سیاسیون ایرانی در توییتر برای کارهای پردازش متن

📰 Web app built with Flask that given a stock ticker will scrape dozens of articles off of Nasdaq.com and run them through a machine learning model f...

Scraper de Zonaprop

This Platform Search Thousands Of Job Boards In Different Technologies From Over The World .

A Chrome extension for quick scraping of elements from web pages.

A Python script that uses Selenium and BeautifulSoup to scrape data from Amazon websites. This script can be used to extract information such as Produ...

CLI + SDK to automate, scrape, and extract from the web — for AI agents and humans. Cloud or local browser, one command.

This Python code scrapes Google search results then applies sentiment analysis, generates text summaries, and ranks keywords.

This is an application that scrapes various Proxy API Endpoints, then compiles the proxies into files within the "/proxies/" directory.

📇 A collection of html2rss feed configs.

Github follower and following

Real-Time Anime Streaming Data REST API — scrape anikototv.to with 38 endpoints, M3U8 proxy, smart caching, and one-click Vercel deploy

Find availability on Recreation.gov to camp in decommissioned fire-lookout towers

Herramienta de recuperación de credenciales WiFi guardados para entornos Windows con un solo click.

Delegate complex tasks to Manus AI - web research, report generation, code building, data scraping. Task templates, monitoring, cost tracking. OpenCla...

A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from...

Scrapping Facebook with JavaScript.

AgentQL's integrations with workflow automation tools and AI agent frameworks let you extract structured data from web pages using queries or natural...

An intelligent generator of well-balanced meals.

Command-line utility to convert HTML tables into CSV files

PicWish T2I, Photo Enhancer and Background Remover for Python

Techniques for Scraping the Web in Python

Free proxy list by country: verified SOCKS5, SOCKS4, HTTP and HTTPS proxies, rechecked every 30 minutes, as TXT, JSON and CSV.

Репозиторій містить JSON-дані про відключення електроенергії та згенеровані зображення розкладів для кожної групи та загальне зображення для всіх груп...

Cardmarket Wantlist Wizard 🧙🏼‍♂️🪄 Easily find the sellers with the most cards you are looking for!

Trypophobia images detector based on deep neural networks and utilities

This Python script automates the extraction of PineScript codes from the most popular strategies on TradingView, using Selenium for web navigation and...

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

A Udemy Course Scraper built with bs4 and selenium, that fetches udemy course information. Get udemy course information and convert it to json, csv or...

A simple amazon tracker that sends you an email when prices of your followed products fall down!

Scraping YouTube Video Description and Video Likes and Comments and Times and Replies! It's Automatically Extracting Data from Video.

A simple, fast tool to peek under the hood of any website. See servers, security, colors, and files in one clean dashboard.