Open-source agentic AI web scraping pipeline for discovering, extracting, deduplicating, and reviewing structured data from public websites using Azure Functions, Cosmos DB, Azure OpenAI, and Microsoft Foundry.
What is the flo7up/ai-web-scraping-pipeline GitHub project? Description: "Open-source agentic AI web scraping pipeline for discovering, extracting, deduplicating, and reviewing structured data from public websites using Azure Functions, Cosmos DB, Azure OpenAI, and Microsoft Foundry.". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
Clone via HTTPS
Clone via SSH
Download ZIP
Download main.zipReport bugs or request features on the ai-web-scraping-pipeline issue tracker:
Open GitHub Issues