HomedexBot

Seen HomedexBot/1.0 (+https://homedex.uk/bot) in your logs? Here's what it does.

• It reads the websites of estate agents who have said yes to Homedex. In some areas, it also reads the listings pages of local agents who haven't joined yet, for the basic facts only (price, bedrooms, type, street, status, the link and the address of one photo), never their descriptions or contact details (for agents). It never reads Rightmove, Zoopla or OnTheMarket.
• It reads one page at a time, mostly at night.
• It obeys robots.txt, even on sites that said yes.
• To stop it, add this to your robots.txt: User-agent: HomedexBot then Disallow: /. If an agent who hasn't joined does that, we take their homes off Homedex, delete what we hold, and don't come back.
• It also downloads public data from HM Land Registry and postcodes.io.

Are you an agent who wants it to stop, or to join? Email agents@homedex.uk. We stop within 24 hours.