Rug Munch Media LLC 90b19230e2 docs(pry): refresh CONTRIBUTING and AGENTS to reflect Phase 0 hardening complete

- STATUS.md: last_updated 2026-07-06, status flipped to production-ready,
  recent activity logs which phase 0 commits were cherry-picked/skipped and why
- AGENTS.md: last_updated 2026-07-06 + phase_0_hardening_complete flag;
  Components section lists routers/, pry_mcp/, pry_x402/, pry_<name>.py
  added in the dedup refactor; Dependencies lists the 5 newly-wired libs
  (cloudscraper, aiohttp-socks, pyjwt, apify, playwright-stealth)
- CONTRIBUTING.md: 'Working with Archived Work' rewritten with a table
  showing the per-commit cherry-pick decisions and reasoning (subsumed /
  conflicts / wrong-target / cherry-picked)

2026-07-06 19:19:57 +07:00

4 KiB

Raw Blame History

STATUS.md — PryScraper

Where we are RIGHT NOW. Update before every commit.

Last Updated

2026-07-06 - Phase 0 hardening complete; cherry-picked cli recursion + missing deps; ready for production deploy

Current Status

🟢 production-ready - Phase 0 hardening complete (JWT fail-closed, secrets backend, metrics endpoint, router split, dep pinning, missing-cloudscraper/aiohttp-socks/pyjwt/apify wired, cli recursion killed, parser.tmp deleted). Canonical main aligned with upstream.

Deployment Status

Last deploy: TBD (next deploy picks up Phase 0 hardening)
Current version: 3.0.0
Health: TBD
Uptime (30d): TBD
Active branch: main (aligned with upstream/main)

Open Issues

None — track in forgejo issues

Recent Activity

2026-07-02: Repository created from fleet-template
2026-07-03: Split scraping endpoints from api.py into routers/scraping.py + deps.py
2026-07-03: Split template endpoints into routers/templates.py + added POST /v1/templates/batch
2026-07-03: Added e2e tests for scraping and template routers (23 new/passing)
2026-07-03: Added reusable Apify actor schema builder (apify_schema.py)
2026-07-03: Set PRY_API_KEY in Talos /srv/pry/.env; auth now active on restart
2026-07-03: Added /v1/templates/batch to x402 paid endpoints + pricing
2026-07-03: Added /metrics endpoint + Prometheus counters/histograms for requests and scrapes
2026-07-03: Added Redis + Postgres services to docker-compose.yml
2026-07-03: Fixed Ollama URL to Talos (100.104.130.92:11434)
2026-07-03: Added LLMRegistry.complete_or_empty() graceful fallback
2026-07-03: Regenerated requirements.txt; added pinned requirements.lock
2026-07-06: Phase 0 hardening cherry-picked onto main: JWT fail-closed (already subsumed by canonical), secrets_backend integration, captcha_solver wire-in, validate_live.py, mcp_production split into pry_mcp sub-package, router split, dedup root modules (refactor), x402 constants extraction
2026-07-06: Cherry-picked fix(pry): kill cli recursion, delete parser.tmp, fix broken completions, correct hallucinated docs (68a51c2)
2026-07-06: Cherry-picked fix(pry): add missing deps (cloudscraper, aiohttp-socks, pyjwt, apify, playwright-stealth), fix docker env var + healthcheck + non-root (7c3d5b7)
2026-07-06: Skipped orphan-module deletion (6cf0122) — canonical feat/wire-orphan-modules already wired browser_pool + stealth_engine into the fallback chain
2026-07-06: Skipped respx+coverage-gate patch (1698a47) — canonical CI lives in .forgejo/workflows/ci.yml, not .github/

Known Issues / Tech Debt

Deploy at /srv/pry/ is out of sync with repo (needs pull + restart to activate Phase 0 hardening)
feat/phase0-rebased branch reconciles infra-hardening commits on top of latest main
pry-flaresolverr host port moved from 8191 to 8192 to avoid conflict with rmi-flaresolverr
All 80+ site templates unverified - only ~30-40% known to work end-to-end. Run templates/validate_templates.py before claiming template coverage.
State storage in ~/.pry/*.json - no concurrency safety, no transactions. See plan to migrate to SQLite/Postgres.
PRY_X402_WALLET, PRY_X402_FACILITATOR env vars unset in deploy - x402 payments not active.
License collision resolved 2026-07-03: dual MIT (core) + BSL 1.1 (stealth/anti-detection). See ADR-0002.
mcp_production.py and x402.py exist in repo but are NOT deployed. Top priority for next deploy.

Quick Links

Status Indicators

Use these in commit messages + status updates:

🟢 healthy — deployed, monitored, no issues
🟡 degraded — running but with known issues
🔴 down — service unavailable
🚧 in-development — pre-production, expect breakage
⏸️ paused — work intentionally stopped

4 KiB Raw Blame History