Scraping Real Estate Websites
Project Title: Scraping Real Estate Websites
I am looking for help creating a script to scrape specific information off different real estate websites.
Some of the websites will require a login which we will provide.
I will provide a table to standardize the field names among the websites (see below).
The script will be run daily, so it needs to include this for duplicate management: Each record should have “Date Added” as the original creation date.
If there is a change to the record, the “Date Updated” should be updated. If there is no change to the record, nothing happens (no new record is created).
Additionally, the script needs to be automated so it runs on its own (without someone having to start it). You can use anything you like (within reason).
The data needs to be saved in a MySQL database. I’ll provide you will access to ours.
Here are the websites:
Here is the title we need:
COLUMN, UID, Website, ID, URL, Status, Date added, Date updated, Credit Rating, Property Type, Subtype, Tenant, Address, City, State, Zipcode, Price, Cap Rate, NOI, Lease Type, Lease Term, Lease Commencement, Years Remaining, Lease Expiration, Rent Increases, Renewal Options, Square Footage, Lot Size (acres), Lot Size (sq ft), Number of Buildings, Number of Floors, County, Submarket, Percent Occupied, Building Status, Year Built, Sprinklers, Primary Constr., Opportunity Zone (OZ), Sanitary Sewer , Water , Natural Gas, Lot Depth, Lot Width, Zoning, Vacant (Y?N), Broker 1 Name, Broker 1 Company, Broker 1 Phone, Broker 1 Email, Broker 2 Name, Broker 2 Company, Broker 2 Phone, Broker 2 Email, Price/sqft, Corporate Guarantee (Y/N), Franchise (Y/N), Google Rating, Yelp Rating, Tenancy, Year Renovated 1, Year Renovated 2, Description, Highlights, Status (Available)
This will end up being a long term engagement. Aside from adding more websites to the list, there will be other data type of projects I will need help with. (For instance, I also want to pull the Yelp and Google rating for the business address at that specific location.) But we can work on that later.
If you have any query in this work, then you can ask and move forward on this matter.
For smililar work requirement feel free to email us on email@example.com.