We show jobs from every employer career page, job board and news source we can find.
Salary
$250-750
Location
Brooklyn, NY, United States
Posted on
Apr 16, 2020
Profile
Build scraper for news headlines, then display data on website
Hi all - This project involves scraping data from news websites (e.g., [login to view URL], [login to view URL]) and displaying the scraped data on a separate website. See the task list below and PLEASE READ THOROUGHLY BEFORE BIDDING. Thank you!
(1) Build a python scraper that will scrape two objects from news websites: (A) the top headline and (B) the top image of that headline.
--- 1.1 - This scraper should be hosted on an AWS instance and very inexpensive to run.
--- 1.2 - The AWS instance should be EC2 or whatever is best for this project. Your choice!
--- 1.3 - This scraper should have a CRON job, running at set intervals of 15 minutes.
--- 1.4 - This scraper should take two data objects from each website: (A) the top news headline, and (B) the top image. See Example Image #1.
--- 1.5 - Data objects A and B should be displayed on a website. See task #3.
(2) Build back end interface that allows an admin to delete or add new websites for scraping.
--- 2.1 - This interface can be a .py file or some other codebase, with a section to easily add websites. OR this interface can also be a simple webpage that is password protected. Your choice!
(3) Display collected data on a very simple HTML Bootstrap website in grid/list format.
--- 3.1 - Each grid/list item should contain the websites top headline, and the websites banner image. See Example Image #2.
--- 3.2 - The website should be able to toggle between list and grid views. See this codebase as an example: [login to view URL]
(4) List of websites to include in scrape list:
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
Thanks for reading and let me know if you have questions!
-Ryan
Skills:
Python
, Web Scraping
, Web Hosting
, Amazon Web Services
, Website Build
Company info
Sign Up Now - WashingtondcCrossing.com
Recruiter job
90 Day Old Job