Web Scraping Lawsociety.org.uk

Project Title: Web Scraping Lawsociety.org.uk

Project Description:
We want a list of businesses that match specific criteria scraping from a website.

We have 2 sets of criteria (so can be done as 2 lists of data for ease).

The 2 URL’s to be scraped:

https://solicitors.lawsociety.org.uk/search/results?Pro=True&Type=0&IncludeNlsp=True&AreaOfPractice1=PRE&Accreditation=CQS&Language=

2,893 results

https://solicitors.lawsociety.org.uk/search/results?Pro=True&Type=0&IncludeNlsp=True&AreaOfPractice1=PRE&Language=

6,242 results

It appears the pages are limited to 30 pages, with 20 results per page. However, if a variable is input into the location field, ie. a postcode/zip code, then I believe all areas can be rotated through. I can provide a list of postcodes.

If all postcodes are scraped, it may provide some duplicates, but a simple de-duplicate should result in 2 lists each with the above number of records.

Data to be scraped:
Company name
Law society link to their law society page (example: https://solicitors.lawsociety.org.uk/office/599859/828-law-ltd)
Phone number (where listed)
Address
Email (where listed)

Any questions please let me know.

For similar work requirements feel free to email us on info@webscrapingexpert.com.