apache/stormcrawler
A scalable, mature and versatile web crawler based on Apache Storm
1k stars297forks6issuespushed
Merge plancoming soon
Worth your time
Outside contributors get real replies here, and their work gets merged.
24 of 25outside PRs merged (96%)
checked