Scraping Engine and Generator Products

Project Title: Scraping Engine and Generator Products

Project Description:
Scope: Scrape retailer websites for pricing information across product types and brands for the last 2 or 3 years (whichever data is available through live site and cached websites).

For historical data, use Wayback Machine https://archive.org/web/ and Google Cached websites. Open to other suggestions for historical data.

Output: Database or excel file showing prices overtime for each product category organized by brand by date from each website

Websites:
• Home Depot
• Lowe’s
• Menards
• https://www.electricgeneratorsdirect.com/
• https://norwall.com/
• https://apelectric.com/
• PowerEquipmentDirect.com

Product types:
• Generator
• Engine (will find both gas and electric engines)

Engine Brands:
• Kohler
• Kubota
• Briggs & Stratton
• Kawasaki
• Honda
• Deutz

Generator Brands:
• Kohler
• Generac
• Doosan
• John Deere
• Scania

Data to collect:
• Website
• Brand
• Name of product
• Product Item#
• Model#
• Average price (plus sales price if available)
• Date
• Number of reviews (if available)
• Average review rating (if available)
• Can we track page views?

For similar work requirements feel free to email us on info@webscrapingexpert.com.