Original Summary

Side project that got out of hand: I set an AI agent on the Western Cape for-sale market and it scraped, merged and normalised every listing it could reach into one table. The result: 52,894 properties, 33 columns, one clean sheet (plus SQLite and an 11-sheet Excel workbook). It merges both major portals - 26,484 rows from Property24 and 26,410 from Private Property - and de-duplicates the same house appearing on both. What the data actually says: - median asking price R2,850,000 (range R52,500 to R345,000,000) - 25,826 houses, 13,379 vacant plots, 9,930 apartments - 2,060 distinct agencies across 130 towns - average 179 days on market The engineering bit that ate the time: the portals genuinely resist anonymous bulk access. Private Property advertises 26,876 Western Cape listings but only serves about 210 rows to a request that is not logged in; Property24 paginates deep (I ended up scraping pages 2 to 61) because page 1 is all premium tiles with different markup. So it is not a one-endpoint job - it is two schemas, two pagination quirks, and a lot of currency and area normalisation. Why I built it: estate agents price on gut feel, and a comparative market analysis takes 3 to 4 hours by hand. This builds the comp set in minutes. Whoever wants the property data, the way in is email dominus@quantanova.net . I filmed the whole pipeline if you want to see it rather than read it (scrape, parse, database, workbook, dashboard): https://youtu.be/XYhXm1NBEFU Feedback welcome, especially on what else you would want a per-suburb dataset to carry.   submitted by   /u/Outrageous-Ad1080 [link]   [comments]

  • 情报分类：工作与职业机会
  • 分类依据：内容涉及招聘、求职或职业发展
  • 信息来源：Reddit · SideProject
  • 发布时间：2026/10/17 00:42:36