+ Si/Rt^RIt^RIt^RIHt^RIHt^RIHtH t H t H t H t H t .ROt.ROtRtRtRtRtR tR tR tR tR tRtRtRtRt]R8Xd ]!4R#R#)u FarmMatch Quality Report — Data completeness, score integrity, outcome metrics. Three layers: 1. Data Completeness Matrix — per-source field coverage 2. Score Integrity Checks — hallucinated/blocked analysis, uniform scores 3. Pipeline Outcome Metrics — score distribution, top-10 confidence Usage: python3 quality_report.py # Terminal summary (default) python3 quality_report.py --detail # Per-property flags python3 quality_report.py --json # Machine-readable output N)Counter)Path)load is_active detect_source get_score short_urlSTATUS_REMOVEDcj\VPRR44pVR8wdVP4#R#)z%Get display name for property source.urlunknownOther)rgettitle)propsrcs& V/Users/jonathan/Documents/Zakelijk/ClaudeOS/03_Lab/farmmatch/scraper/quality_report.py prop_sourcers/ + ,C*399;77cVPV4pVfR#\V\4'dVP4R8XdR#\V\4'd\ V4^8XdR#R#)z6Check if a property has a non-empty value for a field.Fr T)r isinstancestrstripdictlen)rfieldvals&& r has_fieldr"sQ ((5/C {#s r 1#tSQ rcVPR4;'gRP4pVPR4;'gRpRV9gRV9dR#\V4^28dR#R#)z0Check if GPT analysis is real (not bot-blocked).rr analysisz just a momentzchecking your browserFT)rlowerr)rrr s& ris_analysis_okr".s\ XXg  $ $" + + -Exx #))rH%#:e#C 8}r rc /pVFp\V4pW19dR^R\Uu/uFqD^bK upR^/W&W,R;;,^, uu&\F8p\W%4'gKW,R,V;;,^, uu&K: \V4'gKW,R;;,^, uu&K V#uupi)zPer-source field coverage.countfields analysis_ok)rCOMPLETENESS_FIELDSrr")props by_sourceprfrs& rcompleteness_matrixr,;sI !n  %q(CV4WCVaTCV4WYfhijINw1$(E""x(/14/) !   N= )Q . ) 5Xs C c,.pVFp\V4'gVPVR,4K.VPR4'dKG/'dKQVPR4;'g^^8gKsVPVR,4K V#)z6Flag properties where GPT analyzed a bot-blocked page.r criteria overall_score)r"appendr)r(blockedr*s& rdetect_blocked_analysisr2MsnG a  NN1U8 $%% ##rro0F0K0K!q/P NN1U8 $  Nrc\4p/pVFpVPR4;'g/pV'gK(\\RVP 4444pV'gK[W;;,^, uu&VP V.4P VR,4K /pVP 4F6wrWV^8gKRVRW%,R,/V\\V44&K8 V#)zBFind criteria patterns that repeat 5+ times (likely hallucinated).r.c3h"TF(wr\V\\34'gK#W3xK* R#5iN)rintfloat).0kvs& r (detect_uniform_scores..as)b2B$!jQRUXZ_T`Favv2Bs 2 2r r$urlsNN) rrtuplesorteditems setdefaultr0rr)r(patternsurl_by_patternr*r.pattern suspiciousr$s& rdetect_uniform_scoresrHXsyHN 55$** b(..2Bbbc 7   "   % %gr 2 9 9!E( CJ"..* A:/3.Js4=) *+ rca.pVFso\S4pV^8gK\;QJdV3RlR4F 'gK RM RM!V3RlR44pV'dK[VPSR,4Ku V#)z 0 but price/land/beds all null.c3<<"TFp\SV4xK R#5ir5r)r8r+r*s& rr;-detect_scores_without_data..vsY3Xa)Aq//3XsTFr )price land_size_m2bedrooms)ranyr0)r(flaggedscorehas_anyr*s& @rdetect_scores_without_datarTps`G !  19cY3XYcccY3XYYG7qx(  Nrc R^R^R^R^/pVF}p\V4pVR8dVR;;,^, uu&K,VR8dVR;;,^, uu&KJVR8dVR;;,^, uu&KhVR;;,^, uu&K V#)zScore distribution buckets.z4.0+z3.0-4.0z2.0-3.0z<2.0g@g@g@r) scored_propsbucketsr*ss& rscore_histogramrZ~sq)Q 1fa@G  aL 8 FOq O #X I ! #  #X I ! #  FOq O Nrca.p\V3Rl\44pV^8:dVPR4SPR4V9dVPR4SPR4'gVPR4SPR4'gVPR4V'gR V.3#RV9gV^8XdR W23#R W23#) z7Rate confidence in a property's score: high/medium/low.c3P<"TFp\SV4'gK^xK R#5iNrKr8r+rs& rr;$assess_confidence..s @)1YtQ-?QQ)& & thin_datar blocked_analysisrMno_pricelatno_coordinateshighlowmedium)sumCONFIDENCE_FIELDSr0r)r blocked_urlsflagsdcsf& rassess_confidenceros E @) @ @B Qw [! xx,& '( 88G   Z 88E?? %& r2~U"bAgb R rc\VP44pVUu.uFp\V4'gKVNK pp\V4\V4, p\ V4p\ V4p\ V4p\V4pVUu.uFp\V4'gKVNK p p\V 4p \V4p Rp \WR7R,p V Uu.uFq".\W+4O5NK ppR\V4R\V4RVRVR\V4R VR VR \V4R VR \V 4RV RV/ #uupiuupiuupi)zGenerate full quality report.c\V4)#r5rV)xs&r!generate_report..s )A,r)key:N Ntotalactiveremoved completeness blocked_countrluniform_patternsunverifiable_countunverifiable_urls scored_count histogramtop10) listvaluesrrr,r2rHrTrrZsetrAro)storer(r*rxrymatrixr1uniform unverifiablescoredr blocked_setsort_keyr top10_confs& rgenerate_reportrs@  E /A)A,aaF /%j3v;&G! (F&f-G#F+G-f5L 0A9Q!D>EcX \4\R4\RRK 24\RVR, RVR, RVR, R 24\R VR , 24\4\R 4\RRL 24RR R RRR RRR RRR RRR RRR RRR RRR 2p\V4\RRL 24R^R\Uu/uFq"^bK upR^/p\VR,P44EFpVR,V,pVR,pVR;;,V, uu&VR;;,VR,, uu&.p\FjpVR,V,pVR,P V^4V,VR,V&TP V'dV^d,V,R R2MR4Kl V'dVR,^d,V,R R2MRp \RVR RVR RRP VR ,4 RV 24EK VR,pV'd\RRL 24\Uu.uF$q#R,V,^d,V,R R2NK& ppVR,^d,V,R R2p \RR!R RVR RRP VR ,4 RV 24\4\R"4\RRL 24VR#,'d\R$VR#, R%24VR&,'dJ\R'VR&,P444p \R$V R(\VR&,4 R)24VR*,'d\R$VR*, R+24VR#,'g*VR&,'gVR*,'g \R,4\4\R-4\RRL 24VR.,'d!\VR.,P44M^p VR.,P4F<wrRV ^,\V ^4,,p\RV R/ RVR0 RV 24K> \4\R14\RRL 24\VR2,4Fwpwpppp\V4p\VR3,^#4pVR48XdR5M VR68XdR7MR8pV'dR9R:P V4 R;2MR RVR? R@V RAV V 2 4K \4.pVR#,'dVP RBVR#, RC24\RDVR2,44pV'dVP V RE24\RFVR2,44pV'dVP V RG24V'dQ\RH4\RRL 24\V4Fwpp\RV^, RIV 24K \4\RRK 24RJ#uupiuupi)Mz Print terminal-friendly summary.z QUALITY REPORT z Properties: rwz total | rxz active | ryz removedz Scored: rz' DATA COMPLETENESS (active properties)Sourcez<18 #z>4rMz>6landrebedscritGPTr$r%r&rzz>5%u —r>Totalz SCORE INTEGRITYr{z !! z. properties with blocked/hallucinated analysisr|c32"TF qR,xK R#5i)r$N)r8r:s& rr; print_summary..sT0S1gJJ0Ssz properties share z repeated score patternsr}z* properties scored without supporting dataz! OK No integrity issues detectedz SCORE DISTRIBUTIONrz>8z<30z TOP 10 CONFIDENCErr rgOKrhz!!z??z (, )r z #z>2z.1fz data=z/5 z Re-analyze z= blocked properties after enrich_leggett scrapes real contentc3>"TFwrr4RV9gK^xK R#5i)rdNrr8r*cdr+s& rr;rsJq*/11  u= top-10 properties missing price — manual check recommendedc3>"TFwrr4VR8XgK^xK R#5i)rhNrrs& rr;rsEq!u*11ruC top-10 properties have LOW confidence — verify before presentingz RECOMMENDED ACTIONSz. N<============================================================u────────────────────────────────────────────────────────────)printr'rAkeysrr0joinrjrrmaxrB enumeraterr)reportheaderr+totalsrdatanpctsr:gpt_pct total_uniform max_countbucketr$barirconfrnrmrR url_shorticonflag_stractionsrdlow_confactions& r print_summaryrs G  Bxj/ OF7O,IfX6F5GzRXYbRcQddl mn OF>23 45 G 35 Bzl (3qR72,ar{!E":QvVXkYZ[abdZeefglmofp qF &M Bzl q(3F$G3FaT3F$GXY ZFf^,1134n%c* Mw1}m!44$AXq!A"("2"6"6q!"%:;T-(,a/315  3s)1QrF"TYYtBx%8$9G9EF5 wA :, =PQ=P(#A&s*A-b13=PQM*3.1"5Q7 73-q2b48)<(=RyIJ G  Bzl  o f_-..\]^  !!T7I0J0Q0Q0STT  m_$6s6BT;U7V6WWopq "## f1233]^_ / " "62D+E+EfUiNjNj 13 G " Bzl 5;K5H5HF;'..01aI ,224 URZ3y!#445 6"+RCy5'235 G ! Bzl &/w&@" "D$E$d5k2. v~t45=4d05S5)*!,2 4&1Q3r("U3Kwrd$yk(TU 'A  GG oVO%<$==z{|JvgJJH(#`abEvgEEH(#fgh %' :, "7+IAv Bqse2fX& ',  Bxj/U%H"Rs X" *X'ca\VR,4p\VR,4p\R4\RR 24\VP44EFwpo\ S4'gK.pWB9dVP R4WC9dVP R4SP R4'gVP R4SP R 4'gVP R 4\V3R l\44pV^8:dVP R V R 24V'gK\V^24p\RRPV4R RV 24EK R#)zPrint per-property flags.rlr~z PROPERTY DETAIL FLAGSrBLOCKED UNVERIFIABLErMrdre no_coordsc3P<"TFp\SV4'gK^xK R#5ir]rKr_s& rr;print_detail..=sD-q41C-razdata=z/5r30sNr) rrrArBrr0rrjrkrr) rrrunverifiable_setr rmrnrrs && @r print_detailr)sf^,-K6"567 %' Bxj/EKKM* T    LL #  " LL (xx  LL $xx LL % D-D D 7 LL5B ( 5!#r*I Btyy',Byk: ;#+rcn\P!RR7pVPRRRR7VPRRRR7VP4p\ 4pV'g\ R4R #\ V4pVP'dm/VCpVR ,UUUUu.uF"wrVrxR VR ,R \V4R VRVRV/NK$ uppppVR &VRVR\ \P!V^R74R #VP'd\V4\W24R #\V4R #uuppppi)zFarmMatch Quality Report) descriptionz--detail store_truezShow per-property flags)rhelpz--jsonzMachine-readable JSON outputz-No properties in store. Run migrate.py first.Nrr rR confidencedata_completenessrmrlr~)indent) argparseArgumentParser add_argument parse_argsrrrjsonrdumpsdetailrr) parserargsrroutputr*rrnrms rmainrEs  $ $1K LF  <>WX  U #F yyyF'-Wo '6"AeHgy| 4!4b'5 J&5 w > " & ' djj*+ fV#f s(D/ __main__)rMrNrerOr.r)rMrNrerObuilding_size_m2)__doc__rr collectionsrpathlibrrrrrrrr r'rkrrr"r,r2rHrTrZrorrrr__name__rrrrs  VVXT8  $0   ,%PZz<8> zFr