Job added in hotlist
Applied job
Contract job
90-day-old-job
part-time-job
Recruiter job
Employer job
Expanded search
Apply online not available
Similar Jobs
Tort Defense Attorney
BCG Attorney Search
New York City, NY
Apply Now >
Trusts and Estates Planning Associate
BCG Attorney Search
Uniondale, NY
Apply Now >
Mid-Level Commercial Real Estate Associate
BCG Attorney Search
New York City, NY
Apply Now >
Senior Tax Associate
BCG Attorney Search
New York City, NY
Apply Now >
Trusts and Estates Planning Associate
BCG Attorney Search
New York City, NY
Apply Now >
View more jobs in Brooklyn, NY
View more jobs in New York

Job Details

Build scraper for news headlines then display data on website

Salary
$250-750

Location
Brooklyn, NY, United States

Posted on
Apr 16, 2020

Apply for this job






Profile

Build scraper for news headlines, then display data on website
Hi all - This project involves scraping data from news websites (e.g., [login to view URL], [login to view URL]) and displaying the scraped data on a separate website. See the task list below and PLEASE READ THOROUGHLY BEFORE BIDDING. Thank you!
(1) Build a python scraper that will scrape two objects from news websites: (A) the top headline and (B) the top image of that headline.
--- 1.1 - This scraper should be hosted on an AWS instance and very inexpensive to run.
--- 1.2 - The AWS instance should be EC2 or whatever is best for this project. Your choice!
--- 1.3 - This scraper should have a CRON job, running at set intervals of 15 minutes.
--- 1.4 - This scraper should take two data objects from each website: (A) the top news headline, and (B) the top image. See Example Image #1.
--- 1.5 - Data objects A and B should be displayed on a website. See task #3.
(2) Build back end interface that allows an admin to delete or add new websites for scraping.
--- 2.1 - This interface can be a .py file or some other codebase, with a section to easily add websites. OR this interface can also be a simple webpage that is password protected. Your choice!
(3) Display collected data on a very simple HTML Bootstrap website in grid/list format.
--- 3.1 - Each grid/list item should contain the websites top headline, and the websites banner image. See Example Image #2.
--- 3.2 - The website should be able to toggle between list and grid views. See this codebase as an example: [login to view URL]
(4) List of websites to include in scrape list:
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
--- [login to view URL]
Thanks for reading and let me know if you have questions!
-Ryan
Skills:
Python
, Web Scraping
, Web Hosting
, Amazon Web Services
, Website Build

Company info

Sign Up Now - WashingtondcCrossing.com

Similar Jobs:
Mining Associate - Energy and Transition
Location : New York City, NY
Job OverviewA law firm seeks a mid- to senior-level Mining Associate for their office in New York City, NY. The ideal candidate will have substantial experience in mining infrastructure and be involved in various financing transac...
Job Overview A law firm seeks a Senior Associate or Counsel to join its Labor & Employment Department in New York. This role involves advising on complex employment matters related to corporate transactions, executive mobility, an...
Trial Attorney
Location : Newark, NJ
Job Overview A law firm seeks a Trial Attorney in Newark, NJ, to manage personal injury litigation and advocate for clients seeking maximum compensation. The role involves handling cases from intake through trial, ensuring compass...
I was facing the seven-year itch at my previous workplace. Thanks to EmploymentCrossing, I'm committed to a fantastic sales job in downtown Manhattan.
Joseph L - New York, NY
  • All we do is research jobs.
  • Our team of researchers, programmers, and analysts find you jobs from over 1,000 career pages and other sources
  • Our members get more interviews and jobs than people who use "public job boards"
Shoot for the moon. Even if you miss it, you will land among the stars.
WashingtondcCrossing - #1 Job Aggregation and Private Job-Opening Research Service — The Most Quality Jobs Anywhere
WashingtondcCrossing is the first job consolidation service in the employment industry to seek to include every job that exists in the world.
Copyright © 2026 WashingtondcCrossing - All rights reserved. 21 192