crawl4ai

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

open-source crawler

View on GitHub Website

84.3k Stars

8.7k Forks

419 Watchers

Python Language

apache-2.0 License

100 SrcLog Score

Cost to Build

$8.62M

Market Value

$69.33M

How is this calculated?

Growth over time

2 data points · 2026-09-26 → 2026-09-27

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about crawl4ai

Question copied to clipboard

What is the unclecode/crawl4ai GitHub project? Description: "Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone crawl4ai

Clone via HTTPS

git clone https://github.com/unclecode/crawl4ai.git

Clone via SSH

[email protected]:unclecode/crawl4ai.git

Download ZIP

Download main.zip

Found an issue?

Report bugs or request features on the crawl4ai issue tracker:

Open GitHub Issues

Similar to crawl4ai

godot open-source-mac-os-apps uppy Awesome-Linux-Software Kap docusaurus startbootstrap SwifterSwift awesomo startbootstrap-sb-admin-2 MonoGame MahApps.Metro server opensource.guide cas lila github typescript-book first-contributions mycroft-core gameplay urho3d blog thanks react-native-dribbble-app android-demos ksql startbootstrap-sb-admin openui5 material-design-data