+ $HjeRt^RIHt^RIHtHt^RIHtHt^RI H t ]!RR44t ]!RR44t !R R ]4t !R R ] 4tR #)adProperty-source contract. Every source module in this directory exposes one class that implements `Source`. The orchestrator (search_v2.py) discovers them, calls health() to gate pre-flight, then iterates search() per campaign. Adding a new platform = drop a new file in here + register it in sources/__init__.py registry + add to campaigns.yaml. No orchestrator changes. Design constraints (6L): - Sources MUST NOT touch the store directly; they yield normalized dicts and the orchestrator handles persistence + dedup. - Sources SHOULD apply upstream criteria filters in their URL/payload when the platform supports it. Downstream filtering is wasteful. - Sources MUST distinguish 'genuinely no results' from 'query failed'. health() should fail loud when the platform is unreachable, so the orchestrator can skip cleanly rather than record empty results. ) annotations)ABCabstractmethod) dataclassfield)Iteratorc]tRt^t$RtR]R&RtR]R&RtR]R&RtR]R &Rt R]R &Rt R]R &Rt R]R &Rt R]R &^t R]R&RtR]R&RtR#)SearchCriteriazUnified search filters. Sources translate these into platform-specific URLs/payloads. Attributes left as None mean 'no constraint'. country is required because most platforms are single-country. strcountryN str | Noneregion department int | None min_price max_price min_land_m2min_building_m2 min_bedroomsint max_pageslimit)__name__ __module__ __qualname____firstlineno____doc____annotations__r rrrrrrrr__static_attributes__rU/Users/jonathan/Documents/Zakelijk/ClaudeOS/03_Lab/farmmatch/scraper/sources/_base.pyr r sh LFJ!J ! Iz  Iz "K""&OZ&#L*#IsE:r r c]tRt^.t$RtR]R&R]R&RtR]R&RtR]R &RtR]R &Rt R]R &Rt R]R &Rt R]R &Rt R]R&Rt R]R&RtR]R&RtR]R&]!]R7tR]R&RRltRtR#) PropertyHitaNormalized property record yielded by Source.search(). Only `url` and `source` are required. Everything else is best-effort. The orchestrator upserts these into the store; downstream pipeline steps (geocode, amenities, analyze, enrich, score) fill the rest. r urlsourceNr titlerpricecityr building_size land_sizebedroomsrooms thumbnail search_region)default_factorydictextracV^8dQhRR/#)returnr0r)formats"r! __annotate__PropertyHit.__annotate__Ds   r c RVPRVP/pRFp\W4pVfKW1V&K VP'dVP VP4V#)z6Convert to the flat dict shape store.upsert() expects.r$r%) r&r'r(r r)r*r+r,r-r.)r$r%getattrr1update)selfoutkvs& r!to_store_fieldsPropertyHit.to_store_fieldsDs\dhh$++6EA A}A E ::: JJtzz " r r)rrrrrrr&r'r(r r)r*r+r,r-r.rr0r1r?rrr r!r#r#.s H KE:E:D*GZ $M:$ Iz HjE: Iz $M:$-E4-  r r#cn]tRt^Qt$RtR]R&R]R&RtR]R&]R R l4t]RR R ll4t Rt R #)Sourcez*Contract every property source implements.r name list[str] countriesFbool requires_authcV^8dQhRR/#r3r4ztuple[bool, str]r)r5s"r!r6Source.__annotate__Ys  ( r c R#)a4Preflight reachability check. Returns (ok, reason). Called once before any search() calls in a run. If ok=False, orchestrator SKIPS this source's searches and reports the reason in the health line. Examples of failure reasons: 'auth expired', 'HTTP 403 (Cloudflare)', 'DataDome CAPTCHA', 'connect timeout'. Nrr;s&r!health Source.healthXr Nc$V^8dQhRRRRRR/#r3criteriar known_urlszset[str] | Noner4zIterator[PropertyHit]r)r5s"r!r6rJds#  ~ * 6K r c R#)ubYield matching properties for a single campaign×region combination. Sources SHOULD respect criteria.limit and criteria.max_pages to bound the crawl. SHOULD apply upstream filters (price/size) in the URL/payload when the platform supports it. Args: criteria: filters to apply. known_urls: optional set of URLs the orchestrator has already seen. Sources should skip these EARLY (before HTTP fetch when possible, else before yielding) so that limit semantics measure FRESH discoveries, not re-discoveries of cached data. When None, the source treats all results as new. Nrr;rRrSs&&&r!search Source.searchcrOr rN) rrrrrrrGrrMrVrrr r!rBrBQs@4 IM4    r rBcB]tRt^vtRtRRltRRltR RRlltR tR#) DisabledSourcezBase class for parked sources (e.g. bot-blocked platforms). Useful for: making blocked sources visible in the orchestrator + yaml config without requiring conditional imports or special-casing. c$V^8dQhRRRRRR/#)r3rCr rErDreasonr)r5s"r!r6DisabledSource.__annotate__|s!''S'Y''r c *WnW nW0nR#rX)rCrE_disabled_reason)r;rCrEr\s&&&&r!__init__DisabledSource.__init__|s " &r cV^8dQhRR/#rIr)r5s"r!r6r]s;;(;r c $RRVP 23#)Fz disabled: )r_rLs&r!rMDisabledSource.healths 4#8#8"9:::r Nc$V^8dQhRRRRRR/#rQr)r5s"r!r6r]s#~*6Kr c \R4#)Nr)iterrUs&&&r!rVDisabledSource.searchs Bxr )r_rErCrX) rrrrrr`rMrVrrr r!rZrZvs ' ;r rZN)r __future__rabcrr dataclassesrrtypingrr r#rBrZrr r!rmsd&##(  $  D" S" JVr