Web Scrapers
Written — Updated
- SDKs
- https://sdk.apify.com/ looks like the best option I've seen so far. Supports both Cheerio and Puppeteer crawlers with the same API.
- Services
- Original list by Kumar Thangdu (@datarade on twitter)
- http://scrapinghub.com
- http://www.outwit.com/products/hub/
- http://webroots.io
- http://grabby.io
- http://fullcontact.com
- http://emailhunter.co
- http://clearbit.com
- http://toofr.com
- http://import.io
- http://apifier.com (Kumar's number one favorite)
- http://elink.club
- http://www.eliteproxyswitcher.com/ - ;)
- http://www.uipath.com/
- http://diffbot.com
- DiffBot Crawly
- http://cloudscrape.com
- https://commoncrawl.org/
- http://www.fminer.com/
- https://scraperwiki.com/
- http://nutch.apache.org/
- http://www.ubotstudio.com/index7
- http://mozenda.com
- http://fivefilters.org/
- https://data-miner.io
Thanks for reading! If you have any questions or comments, please send me a note on Twitter. And if you enjoyed this, I also have a newsletter where I send out interesting things I read and the occasional nature photo.