# FarmMatch - Quick Start Guide

## ✅ All Tests Passed - System Ready!

Your FarmMatch system has been successfully updated with:
- ✅ Bug fixes (new favorites + session management)
- ✅ Quality improvements (85% cost savings)
- ✅ 7 new API endpoints
- ✅ Complete documentation

---

## 🚀 Quick Commands

### Check Everything is Working
```bash
# Run deployment test
cd /Users/jonathan/SynologyDrive/Since\ Today/PROJECTEN/farmmatch/scraper
python3 test_deployment.py
```

### Session Management
```bash
# Check if Properstar session is valid
curl http://localhost:5002/api/validate-session

# If expired, refresh it
curl -X POST http://localhost:5002/api/invalidate-session

# Then run scraper for fresh login
python3 favorites_scraper.py
```

### Run Full Update (Fixed!)
```bash
# Via API
curl -X POST http://localhost:5002/api/scrape-favorites \
  -H "Content-Type: application/json" \
  -d '{"full_pipeline": true}'

# Via command line
python3 auto_scrape_favorites.py now
```

### Use Quality Analysis (85% cheaper!)
```bash
# Real-time structured analysis (high quality)
curl -X POST http://localhost:5002/api/run-structured-analysis

# OR batch API (overnight, 50% extra savings)
curl -X POST http://localhost:5002/api/batch-create
curl -X POST http://localhost:5002/api/batch-submit
# (wait 1-24 hours)
curl -X POST http://localhost:5002/api/batch-retrieve
```

---

## 📊 System Status

### Check Server
```bash
curl http://localhost:5002/api/system-status | python3 -m json.tool
```

**Expected Output:**
```json
{
  "api_server": "running",
  "quality_features": {
    "batch_api": true,
    "csv_sync": true,
    "structured_extraction": true,
    "structured_outputs": true
  },
  "features_enabled": true,
  "session": {
    "valid": true,
    "age_days": 6.2
  }
}
```

---

## 🔧 Troubleshooting

### Progress Bar Stuck at 0%?

**Quick Fix:**
```bash
# 1. Check session
curl http://localhost:5002/api/validate-session

# 2. If invalid, refresh
curl -X POST http://localhost:5002/api/invalidate-session

# 3. Run scraper for fresh login
python3 favorites_scraper.py
# Browser opens - log in manually
```

### New Favorites Not Analyzed?

**Already Fixed!** The sync step now runs automatically in the pipeline.

Test it:
```bash
python3 auto_scrape_favorites.py now
# All new favorites will be analyzed ✅
```

### API Server Not Running?

```bash
# Start it
cd /Users/jonathan/SynologyDrive/Since\ Today/PROJECTEN/farmmatch/scraper
nohup /Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/Resources/Python.app/Contents/MacOS/Python criteria_api.py > /tmp/criteria_api.log 2>&1 &

# Check logs
tail -f /tmp/criteria_api.log
```

---

## 📚 Documentation

| Document | Purpose |
|----------|---------|
| [SESSION_MANAGEMENT.md](SESSION_MANAGEMENT.md) | Session validation & troubleshooting |
| [API_UPDATES.md](API_UPDATES.md) | New API endpoints guide |
| [QUALITY_ANALYSIS_README.md](QUALITY_ANALYSIS_README.md) | Quality improvements (85% savings) |
| [IMPLEMENTATION_SUMMARY.md](IMPLEMENTATION_SUMMARY.md) | What changed and why |
| [PIPELINE_DIAGRAM.md](PIPELINE_DIAGRAM.md) | Visual workflow diagrams |

---

## 🎯 Common Workflows

### Weekly Full Update (Recommended)
```bash
# Sunday evening
cd scraper

# 1. Check session first
curl http://localhost:5002/api/validate-session
# If invalid, refresh as shown above

# 2. Create batch for overnight processing (cheapest!)
curl -X POST http://localhost:5002/api/batch-create
curl -X POST http://localhost:5002/api/batch-submit

# Monday morning
# 3. Retrieve results
curl -X POST http://localhost:5002/api/batch-retrieve

# 4. View results
open http://localhost:5001  # Map viewer
```

**Cost:** ~$0.015-0.05 per 100 properties (85% savings!)

---

### Quick Analysis (Immediate Results)
```bash
# Use structured outputs (72% cost savings)
curl -X POST http://localhost:5002/api/run-structured-analysis

# Track progress
curl http://localhost:5002/api/job-status/<job_id>

# Results available in 5-15 minutes
```

**Cost:** ~$0.03-0.10 per 100 properties

---

## 💡 Best Practices

### Session Management
- ✅ Check session before full updates
- ✅ Refresh every 7 days proactively
- ✅ Keep auth.json backups (auto-created)

### Cost Optimization
- ✅ Use batch API for weekly updates (50% savings)
- ✅ Use structured outputs for daily checks (72% savings)
- ✅ Combined savings: 85%!

### Quality
- ✅ Structured outputs = 100% valid JSON (no parsing errors)
- ✅ Detailed reasoning for each property score
- ✅ Farming-specific features extracted automatically

---

## 🎉 Success Indicators

**System is working correctly if:**
- ✅ `test_deployment.py` shows all tests passed
- ✅ Session validation returns `"valid": true`
- ✅ Full update completes without stuck progress bar
- ✅ New favorites get analyzed in enriched_data.json
- ✅ Quality features enabled in system status

**Test Now:**
```bash
python3 test_deployment.py
```

---

## 🆘 Need Help?

### Quick Diagnostics
```bash
# 1. Test deployment
python3 test_deployment.py

# 2. Check API logs
tail -100 /tmp/criteria_api.log

# 3. Check job logs
tail -100 /tmp/farmmatch_job_*.log

# 4. Validate session
curl http://localhost:5002/api/validate-session
```

### Common Issues

| Issue | Solution |
|-------|----------|
| Progress stuck at 0% | Session expired → refresh as shown above |
| New favorites not analyzed | Fixed! Sync step runs automatically now |
| API not responding | Restart: `ps aux \| grep criteria_api \| kill` then start |
| ModuleNotFoundError | Install for Python 3.9 (instructions in docs) |

---

## 📞 Support

**All documentation:** `/scraper/*.md` files

**Test suite:** `python3 test_deployment.py`

**API reference:** http://localhost:5002 (see startup logs for endpoints)

---

**Everything is deployed and ready to use!** 🚀

Start with:
```bash
curl http://localhost:5002/api/validate-session
```