Develop Scraper to Scrape Real Estate Industry Data

Project Title: Develop Scraper to Scrape Real Estate Industry Data

Project Description:
I work in the UK land and real estate field and have a data led approach to lead/ development site identification. What I am looking for is a scraper that obtains information from the 324 local authorities across the UK that have to make information on planning applications publicly available. They do this by way of a local authority planning portal (one per local authority) often based on a platform provided by Idox. The format of these websites are all very similar. I would like to extract the data from all 324 locations on a weekly basis.

An example of the information I wish to scrape is the following page:
https://planning.lichfielddc.gov.uk/online-applications/weeklyListResults.do?action=firstPage

At present many business are manually checking these websites individually and manually which strikes me as incredibly inefficient.

Once the data is scraped I wish to be able to filter and analyse, producing automated reports that will then be issued to clients of Foster, Brown + Green to allow clients of mine to identify new construction leads.

I have follow on projects that will begin to automate the next phase of the process for real estate developers including market research, demographic information etc. Most of this follow on phase will utilize API’s although there will still be some scraping.

Initially I want to discuss the planning portal scraping but want to make clear that I see this as the first phase of a number of projects applying data to real estate functions.

For similar work requirement feel free to email us on info@webscrapingexpert.com.