Were looking for Highly Experienced Web Scrapping Developer

Profile

Were looking for Highly Experienced Web Scrapping Developer
Were looking to create thousands of scrappers to scrape public sites (clerk of courts, property appraisers, etc). We are looking to extract text and documents.
In terms of desired developer must have the following experience:
- AWS
- NodeJS
- Machine learning ( e.g. TensorFlow) big plus
- Knowledge dealing with site changes, CAPCHAS, IP blocks
- Knowledge in tracking the health of the crawlers
Again were looking to create crawlers for thousand of websites.
These sites, are always updating their code, have CAPTCHAS, may temporarily ban/throttle IPs
Were looking for an experienced developer with web scraping experience that can help us scrape dockets from court websites. These websites are always changing and put in mechanisms to not scrape them. Therefore, the developer must have experience with these type issues. Lastly, developer must have experienced in Ruby, SQL, and MongoDB.
Skills:
Elasticsearch
, Amazon Web Services
, NoSQL Couch & Mongo
, Web Scraping
, node.js

Company info

Sign Up Now - WashingtondcCrossing.com