spidercreator

Automated web scraping spider generation using Browser Use and LLMs. Streamline the creation of Playwright-based spiders with minimal manual coding. Ideal for large enterprises with recurring data extraction needs.

scraping crawling

View on GitHub Website

79 Stars

11 Forks

79 Watchers

Python Language

agpl-3.0 License

Cost to Build

$246.2K

Market Value

$572.5K

How is this calculated?

Growth over time

2 data points · 2025-04-10 → 2025-07-23

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about spidercreator

Question copied to clipboard

What is the carlosplanchon/spidercreator GitHub project? Description: "Automated web scraping spider generation using Browser Use and LLMs. Streamline the creation of Playwright-based spiders with minimal manual coding. Ideal for large enterprises with recurring data extraction needs.". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone spidercreator

Clone via HTTPS

git clone https://github.com/carlosplanchon/spidercreator.git

Clone via SSH

[email protected]:carlosplanchon/spidercreator.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the spidercreator issue tracker:

Open GitHub Issues

Similar to spidercreator

scrapy requests-html webmagic colly headless-chrome-crawler Embed artoo instagram-scraper django-dynamic-scraper scrapy-cluster Lulu newcrawler panther facebook_data_analyzer ImageScraper scrapple parsel nickjs jsoup-annotations jekyll Sasila Musoq goose-parser arachnid lambdasoup crawler geeksforgeeks.pdf scrapy-zyte-smartproxy sqrape comic-dl