Scraping Property Listings and Real Estate Agents
Project Title: Real Estate Website Scraping – HOMES FOR SALE listings, Realtors
1st Requirement: What we need is a WEEKLY scraping of the HOMES FOR SALE listings. These are available on websites.
We need the address and asking price. We need a new file every week
Can you suppress names previously provided? In other words, 123 Main Street is on the market for 15 weeks. I only want to pay for it the first time it appears.
The first week would have every home on the market. Then, subsequent weeks would only give NEW listings
Also. Can you identify single-family homes vs coop or condo apartments?
There are many websites that list ‘homes for sale’ on a nationwide basis.
There is obviously huge duplication on these. My goal is to identify on a WEEKLY the previous week’s new listings. On a nationwide basis, there are around 4 million homes… About 100,000 are listed each week (and about 100,000 drop off each week). I want the 100,000 that were just listed.
No one website has all of the listings… So you need to scrap as many websites as possible so my list is the most complete. I do not know if the NEW LISTINGS are flagged – in which case you simply scrub around 100,000 names of each website and merge them together and remove the duplicates — leaving us with a unique list of around 100,000 listings that were all listed within the past 7 days. Because each source will have different dates you’ll still need to merge them and take out the duplicates. As a final step this week’s data has to be compared to last weeks data, so we do not duplicate week-to-week.
If the sources do not have “new listing” flags, then we need to scrape the entire file. Then instead of merging a couple of million records, you’re merging 75 million+ records. Then de-duping them, and comparing them to last week’s file for a clean file of this week’s records.
At the minimum we need to capture the complete address, asking price and date of the listing.
Can you do this? It would be an ongoing project.
Can you please give me a quote, I am interested in building a list of Residential Real Estate agents (name, company, mailing address and email). I could easily buy a list of real estate agents, but I am looking for the agents who earned the most revenue or sold the most homes.
Is this something you can assist with or have experience with? However I am interested only in Realtors that have sold the most homes; in other words the top 5 – 10% of Realtors based on their revenue and ratings. Do you have a way of filtering out the less successful agents? This is our 2nd requirement.
For smililar work requirement feel free to email us on firstname.lastname@example.org