style='position: relative;float: left;'
Job added in hotlist
Applied job
Contract job
90-day-old-job
part-time-job
Recruiter job
Employer job
Expanded search
Apply online not available
View more jobs in Brooklyn, NY
View more jobs in New York

Job Details

Build scraper for news headlines then display data on website

Salary
$250-750

Location
Brooklyn, NY, United States

Posted on
Apr 16, 2020

Apply for this job






Profile

Build scraper for news headlines, then display data on website
Hi all - This project involves scraping data from news websites (e.g., [login to view URL], [login to view URL]) and displaying the scraped data on a separate website. See the task list below and PLEASE READ THOROUGHLY BEFORE BIDDING. Thank you!
(1) Build a python scraper that will scrape two objects from news websites: (A) the top headline and (B) the top image of that headline.
--- 1.1 - This scraper should be hosted on an AWS instance and very inexpensive to run.
--- 1.2 - The AWS instance should be EC2 or whatever is best for this project. Your choice!
--- 1.3 - This scraper should have a CRON job, running at set intervals of 15 minutes.
--- 1.4 - This scraper should take two data objects from each website: (A) the top news headline, and (B) the top image. See Example Image #1.
--- 1.5 - Data objects A and B should be displayed on a website. See task #3.
(2) Build back end interface that allows an admin to delete or add new websites for scraping.
--- 2.1 - This interface can be a .py file or some other codebase, with a section to easily add websites. OR this interface can also be a simple webpage that is password protected. Your choice!
(3) Display collected data on a very simple HTML Bootstrap website in grid/list format.
--- 3.1 - Each grid/list item should contain the websites top headline, and the websites banner image. See Example Image #2.
--- 3.2 - The website should be able to toggle between list and grid views. See this codebase as an example: [login to view URL]
(4) List of websites to include in scrape list:
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
Thanks for reading and let me know if you have questions!
-Ryan
Skills:
Python
, Web Scraping
, Web Hosting
, Amazon Web Services
, Website Build

Company info

Sign Up Now - WashingtondcCrossing.com

I was facing the seven-year itch at my previous workplace. Thanks to EmploymentCrossing, I'm committed to a fantastic sales job in downtown Manhattan.
Joseph L - New York, NY
  • All we do is research jobs.
  • Our team of researchers, programmers, and analysts find you jobs from over 1,000 career pages and other sources
  • Our members get more interviews and jobs than people who use "public job boards"
Shoot for the moon. Even if you miss it, you will land among the stars.
WashingtondcCrossing - #1 Job Aggregation and Private Job-Opening Research Service — The Most Quality Jobs Anywhere
WashingtondcCrossing is the first job consolidation service in the employment industry to seek to include every job that exists in the world.
Copyright © 2026 WashingtondcCrossing - All rights reserved. 169 192