+ h?Rt^RIt^RIt^RIt^RIt^RIt^RIHt^RI H t ^RI H t ^RI HtHt^RIHtHt^RIHt] !4] !]P*!R4R 7t!R R ]4tR tR tRtRtR RltR!RRlltRt]R8Xd^RI t ]!!] PD4^8d] PD^,R8XdRt#]$!R]# R24RR/t%]PL!]#]%^R7t']'PP^8XdI]!]#]'PR4t*]$!R#4]$!R4]$!R"4]$!]PV!]*^RR74R#]$!R]'PP 24R#]!4R#R#)$z GPT Analysis with Structured Outputs Uses OpenAI's structured outputs feature for guaranteed valid JSON responses Combines with pre-extracted property facts for higher quality and lower cost N)Path)OpenAI) load_dotenv) BaseModelField)LiteralOptional)PropertyFactsExtractorOPENAI_API_KEY)api_keycfa]tRt^toRt]!^^RR7t]!^RR7t]!^^RR7t]!^RR7t ]!^^RR7t ]!^R R7t ]!^^R R7t ]!^R R7t ]!^^R R7t]!^R R7t]!^^RR7t]!^RR7t]!RR7t]!^RR7t]!RRR7tV3RltRtVtR#)PropertyCriteriaz2Structured schema for property evaluation criteriazjRegenerative market garden potential: soil quality, sun exposure, water access, size (1=poor, 5=excellent))gele descriptionz)Brief explanation for market garden score) max_lengthrzqGuest accommodation/B&B potential: tranquility, setting, accessibility, existing facilities (1=poor, 5=excellent)z/Brief explanation for guest accommodation scorez_Workshop/food processing potential: existing buildings, space, facilities (1=poor, 5=excellent)z$Brief explanation for workshop scorezfIndependent rental units potential: separate buildings, conversion possibilities (1=poor, 5=excellent)z(Brief explanation for rental units scorezeLocation quality: distance to coast/cities/airports, accessibility, area appeal (1=poor, 5=excellent)z$Brief explanation for location scorezbLocal market access: farmers markets, farm shops, direct sales opportunities (1=poor, 5=excellent)z(Brief explanation for local market scorezOverall investment risk: Laag=low renovation/clear usage, Gemiddeld=moderate work needed, Hoog=major renovation or unclear viability)rz%Brief explanation for risk assessmenti,zDConcise overall assessment highlighting key strengths and weaknessesc<V^8dQh/S[;R&S[;R&S[;R&S[;R&S[;R&S[;R&S[;R&S[;R&S[;R &S[;R &S[;R &S[;R &S[R,;R &S[;R&S[;R&#) market_gardenmarket_garden_reasoningguest_accommodationguest_accommodation_reasoningworkshopworkshop_reasoning rental_unitsrental_units_reasoninglocationlocation_reasoning local_marketlocal_market_reasoning risk_profilerisk_reasoningoverall_assessment)Laag GemiddeldHoog)intstrr)format __classdict__s"f/Users/jonathan/Documents/Zakelijk/ClaudeOS/03_Lab/farmmatch/scraper/analyze_with_structured_output.py __annotate__PropertyCriteria.__annotate__s! $'!*+23<=D ENOVW`ah ir56sxyBCN)__name__ __module__ __qualname____firstlineno____doc__rrrrrrrrrrrrrr r!r"__annotate_func____static_attributes____classdictcell__)r)s@r*r r s6< AM$)?$ % H */E*!  uH$:  |L#(>#  {H$:  xL#(># :?[:L ;N $ZCr-r aYou are an expert in evaluating rural properties for regenerative agriculture and sustainable lifestyle projects. Analyze this property for the following use cases: 1. **Regenerative market garden** - Growing vegetables/herbs using sustainable methods 2. **Guest accommodation** - Short-stay rentals, B&B, retreat hosting 3. **Workshop/food processing** - Value-added production (jams, preserves, etc.) 4. **Rental income** - Long-term or short-term rental units 5. **Location appeal** - Proximity to attractions, accessibility 6. **Local market access** - Ability to sell products locally {property_facts} {custom_criteria_data} Evaluate each criterion on a 1-5 scale: - 1 = Very poor / Not viable - 2 = Poor / Significant limitations - 3 = Acceptable / Some limitations - 4 = Good / Minor limitations - 5 = Excellent / Ideal conditions Assess risk based on: - **Laag** (Low): Property is move-in ready or requires minimal work, clear value proposition - **Gemiddeld** (Medium): Some renovation needed, moderate uncertainty - **Hoog** (High): Major renovation required, significant uncertainty, or questionable viability Provide practical, realistic assessments based on the facts provided.z gpt_cost_tracker_structured.jsonc\PP\4'd:\ \R4;_uu_4p\ P !V4uuRRR4#RRR^R./# +'giL;i)zLoad cost tracking datarN total_costtotal_requestsruns)ospathexistsCOST_TRACKER_FILEopenjsonload)fs r*load_cost_trackerrEs] ww~~'(( #S ) )Q99Q<* ) c! * )s A++ A; c\\R4;_uu_4p\P!W^R7RRR4R# +'giR#;i)zSave cost tracking dataw)indentN)rAr@rBdump)trackerrDs& r*save_cost_trackerrKs/  % % 'Q' & % % %s < A cRRRRR/RRRRR//pVPW#R,4pVR , VR,,pVR , VR,,pWV,#) zEstimate cost for GPT models gpt-4o-miniinputg333333?outputg333333?zgpt-4o@g$@i@Bget) input_tokens output_tokensmodelpricingrates input_cost output_costs&&& r* estimate_costrZsk x67D(E2G KK}5 6E*eGnVR?VR@R-V P6R/V P8R1V P:R2V P<R4V P>R6V P@/RAR-V PBR/V PDR1V PFR2V PHR4V PJR6V PLRBV PN/RCV P2RDV PPREVRFRGV RHV RIV/RJV / #)Mz Analyze property using structured outputs Args: url: Property URL html_content: Raw HTML from property page custom_data: Optional custom criteria data Returns: Dictionary with analysis results including structured criteria u& 📄 Extracting structured facts...u 📊 Extracted z characters of structured data custom_scorez? OBJECTIVE DATA (Climate & Location): - Custom criteria score: z.1fz/5.0 - Growing season length: growing_season_dayszN/Az days - Annual sunshine: annual_sunshine_hoursz hours - Frost-free period: frost_free_daysz days - Distance to coast: distance_to_coast_kmz km - Airport distance: nearest_airport_kmz6 km Consider this objective data in your assessment. z%[No objective climate data available])property_factscustom_criteria_datau6 🤖 Calling GPT-4o-mini with structured outputs...rMrolesystemcontentzrYou are an expert property evaluator for regenerative agriculture projects. Provide honest, practical assessments.userg333333?)rUmessagesresponse_format temperature)rUu 💰 Cost: $.6fz (z in + z out tokens)u ⏱️ Duration: z.2fs12345rg@rrPrrg?rg@rr:r#g?r$g?r%gffffff?r\structured_factscriteria reasoningriskr r"weighted_scoretokensrNrOcostduration_seconds))printr extract_allto_prompt_textlenrRSTRUCTURED_PROMPT_TEMPLATEr(timeclientbetachat completionsparser choicesmessageparsedusage prompt_tokenscompletion_tokensrZitemsgetattrr'r roundrrrrrrrrrrrrr!r")r\r]r^ extractorfactsri custom_text final_prompt start_time completiondurationrzrSrTr score_weightscriteria_weights total_score total_weight criterionweight score_valueweighted risk_factors risk_factorr}s&&& r*analyze_property_structuredrs 24&|9I  ! ! #E--/N s>233Q RSK{~q9A=%//.!MsCC KL-335 6h 2  [!12V;x  6Cc63?L""8#8#8#>KMY\]M]UK,6+EqIcdN sE X33 !8#?#? )) H11 )) H11    X== !8#I#I 33 H;; 33 H;; H++  --h99. \ m D H9 r-c< RpRpRp/p\PPV4'de\VR4;_uu_4p\P !V4pVUu/uF qfR,VbK pp\ R\V4 R24RRR4\P!V4p\4p \PPV4'dO\P!V4p \V R ,P44p \ R \V 4 R 24R R/p \4p R\P!R4R^RRR^R^/p .p\V4\V 4, p\ RV R24\!VP#4^4EFwppVP$pVV 9d \ RV R\V4 RV 24K9\ RV R\V4 RV 24\&P(!VV ^R7pVP*^8wd\ RVP* R24KVP)V/4p\-VVP.V4pV R;;,^, uu&V R;;,VR ,R!,, uu&V R;;,VR ,R",, uu&V R;;,VR ,R#,, uu&VP1R VR$VR%,P)R&R'4R(VR%,P)R)/4P)R*R'4R+VR%,P)R,4R-VR.,R-,R/VR.,R/,R0VR.,R0,R1VR.,R1,R)VR.,R),R2VR.,R2,R3VR3,R4VR4,R5VR6,/ 4V'dC\P2!V4pVP5VR7R8R97\ R:\V4 R;24\P6!^4EK V'dC\P2!V4pVP5VR7R8R97\ R=\V4 R>24V'd\9R?V44M^V R@&V RA,P1V 4V R;;,V R,, uu&V RB;;,V R,, uu&\;V 4\ RN4\ RC4\ RM4\ RDV R, 24\ REV R,RF 24\ RGV R,\=^V R,4, RF 24\ RHV R,RI 24\ RJV R,RI 24\ RKV R,RL 24\ RM4R#uupi +'giEL:;i \dp\ R T 24Rp?EL\Rp?ii;i \dp\ R)analyze_all_properties..s&UWuu-?'C'CWs rr<r;u💰 COST REPORTzProperties analyzed: z Total cost: $rrzAverage per property: $zInput tokens: ,zOutput tokens: z All-time total: $z.4fF======================================================================G ======================================================================)r=r>r?rArBrCrr Exceptionpdread_csvsettolistrErstrftime enumerate itertuplesrrequestsrR status_codertextappend DataFrameto_csvsleepsumrKmax) input_file output_file enriched_fileproperty_data_by_urlrD enriched_datapropedf analyzed_urls existing_dfr cost_trackerrun_dataresultstotal_to_analyzeidxrowr\responser^analysis results_dfs r*analyze_all_propertiesr+s/J2K(M ww~~m$$ EmS))Q $ ! FS'TmdU T(9m$'T S)=%>$??bcd* Z BEM ww~~k""kk+. K.5578  c-())EFG \G %&LT]]#67qc HG2w]!33 34D3E] STbmmoq1Sgg -  IcU!CG9,@F G 1  HSE3r7)=> ? ||C"EH##s* X%9%9$:+FG/223;K33 {SH * +q 0 + \ "hx&8&@ @ " ^ $(:7(C C $ _ %();H)E E % NNs"4599'2F8$67;;JKOOPVXZ["4599'B*!5o!F%x ';rsZ  %$9  "23 4DyDRI<7 ( $DRAH z 388}qSXXa[F2_ "8*B/0 ` <<'2F   3 &08==IF / " # $ (O $**VAEB C *8+?+?*@A B  /r-