18
Feb

Scrape Australian Local Government Websites

Posted By admin
MOBILE.DE Data Scraping

Project Title: Scrape Australian Local Government Websites

Project Description:
I need to scrape several hundred websites. These websites are Australian local government (LGA) websites listing planning applications and approvals.

These websites, while very similar, aren’t all the same. They have different layouts and data points.

I will provide you with the LGA’s landing page and a brief of the datapoints I want and filters I wanted employed. But in essence, your script will need to:

List all planning applications submitted over the last 3 years where the activity relates to subdivision, new dwellings or multiple dwellings; and; Scrape those applications not previously scraped.

Here are a few landing pages. These will be our initial target.

– https://pdonline.brisbane.qld.gov.au/MasterPlan/default.aspx
– http://pdonline.ipswich.qld.gov.au/pdonline/modules/applicationmaster/default.aspx
– http://eplanning.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx
– https://eservices.cairns.qld.gov.au/eservice/daEnquiryInit.do
– https://developmenti.sunshinecoast.qld.gov.au/

I need the results to be returned in JSON format.

For similar work requirements feel free to email us on info@webscrapingexpert.com.

Comments

Add a comment