Web Scraping of Car Parts Website

Project Title: Web Scraping of Cars Parts

Project Description:
The task is to extract from the website of the auto parts marketplace information about all the goods existing on this resource. The resource has about 29 million pages.

Example page:
https://exist.ua/search/?product_id=24326283

Example of a detail card:
https://exist.ua/trw-brand/kolodki-tormoznye-diskovye-komplekt-gdb3200-24326095/

Each page can be opened using the product_id parameter in the range from 0 to 29,000,000 Namely:
1) Part number,
2) Part manufacturer,
3) a description of the part,

Additional information from the product card such as:
(tab all about the product)
4) Height,
5) Length,
6) Width,
7) Weight,
(tab original numbers)
8) Original part manufacturer
9) A list of original part numbers (tab analogs substitutes)
10) Substitute manufacturer
11) Part number of the substitute(tab original numbers)
12) URL picture details

There is a runtime program that performs the first three points of this task, but the problem is that it takes a very long time, approximately 100 pages per minute are processed, based on this speed, the processing of the entire resource will take about a year.

For similar work requirements feel free to email us on info@webscrapingexpert.com.