07
Jan

Scraping Real Estate Websites

Posted By admin
MOBILE.DE Data Scraping

Project Title: Scraping Real Estate Websites

Project Description:
I am looking for help creating a script to scrape specific information off different real estate websites.

Some of the websites will require a login which we will provide.

I will provide a table to standardize the field names among the websites (see below).

The script will be run daily, so it needs to include this for duplicate management: Each record should have “Date Added” as the original creation date.

If there is a change to the record, the “Date Updated” should be updated. If there is no change to the record, nothing happens (no new record is created).

Additionally, the script needs to be automated so it runs on its own (without someone having to start it). You can use anything you like (within reason).

The data needs to be saved in a MySQL database. I’ll provide you will access to ours.

Here are the websites:
https://docs.google.com/spreadsheets/d/1WbkIjy6IIJOvIXGkHGPKpjRRKrVgDIPknFyS7fAVTqs/edit?usp=sharing

Here is the title we need:
COLUMN, UID, Website, ID, URL, Status, Date added, Date updated, Credit Rating, Property Type, Subtype, Tenant, Address, City, State, Zipcode, Price, Cap Rate, NOI, Lease Type, Lease Term, Lease Commencement, Years Remaining, Lease Expiration, Rent Increases, Renewal Options, Square Footage, Lot Size (acres), Lot Size (sq ft), Number of Buildings, Number of Floors, County, Submarket, Percent Occupied, Building Status, Year Built, Sprinklers, Primary Constr., Opportunity Zone (OZ), Sanitary Sewer , Water , Natural Gas, Lot Depth, Lot Width, Zoning, Vacant (Y?N), Broker 1 Name, Broker 1 Company, Broker 1 Phone, Broker 1 Email, Broker 2 Name, Broker 2 Company, Broker 2 Phone, Broker 2 Email, Price/sqft, Corporate Guarantee (Y/N), Franchise (Y/N), Google Rating, Yelp Rating, Tenancy, Year Renovated 1, Year Renovated 2, Description, Highlights, Status (Available)

This will end up being a long term engagement. Aside from adding more websites to the list, there will be other data type of projects I will need help with. (For instance, I also want to pull the Yelp and Google rating for the business address at that specific location.) But we can work on that later.

If you have any query in this work, then you can ask and move forward on this matter.

For smililar work requirement feel free to email us on info@webscrapingexpert.com.

Comments
  • 6 months ago Kelsey Nicole

    Have you ever extracted data from the website movoto.com? If so, please provide a sample to review.

    Reply
  • 6 months ago Danielle Marie

    Let me know your best quote to scrape details of properties that are listed new daily for sale on zoopla.co.uk?

    Reply
  • 6 months ago Jocelyn Dopson

    We are looking for an expert to scrape property listings from various websites like remax.com.

    Reply
  • 6 months ago Stephanie Torres

    What would be charge of scraping data from realtor.com. How will you deliver the data?

    Reply
  • 6 months ago Blair Lindsey

    I would also like to schedule a call with you so that we can discuss detailed requirements. I want to scrape data from homes.com.

    Reply
  • 6 months ago Corinne Huston

    Are you able to scrape apartment details from apartments.com? What data you guys can extract?

    Reply
  • 6 months ago Kurt A

    I want to extract property owners contact from Trulia.com, Realtor.com, Homes.com, Rent.com. Please get back to me.

    Reply

Add a comment