2 repositories on SrcLog
A scrapy extension to invoke an aws lambda function with the scraped item
A redis queue with asyncio implemented on top of aioredis