rmi-backend/app/_archive/legacy_2026_07/webhook_pipeline.py
cryptorugmunch 628c1d2a10
Some checks failed
CI / build (push) Failing after 3s
refactor(rmi-backend,audit): mount Wave 3 + archive 136 dead-code files (P2.3)
PHASE 2.3 (AUDIT-2026-Q3.md):

Task 1 — Wire-in Wave 3 (1 router mounted, 2 deferred):
  - app.routers.unified_scanner_router mounted at /api/v2/scanner/* (2 routes:
    POST /api/v2/scanner/token/scan, POST /api/v2/scanner/wallet/scan).
    Refactored prefix from /api/v2 -> /api/v2/scanner to avoid future conflicts
    with the v1 /api/v1/scanner/ stub.
  - app.routers.unified_wallet_scanner DEFERRED (no router APIRouter attribute;
    library module consumed by unified_scanner_router via get_wallet_scanner()).
  - app.routers.admin_extensions DEFERRED (DORMANT per audit; 25 routes at
    /api/v1/admin/* would shadow /api/v1/admin/alerts_webhook).

Task 2 — Archive 136 dead-code files to app/_archive/legacy_2026_07/:
  - 73 routers in app/routers/ (reach graph showed zero reach into mount.py).
  - 63 flat app/*.py (domain modules never imported by live code).
  - 1 file RESTORED post-archive: app/routers/x402_bridge_health.py (caught by
    tests/unit/test_bridge_health.py which directly imports it; reach graph
    considered tests/ only as transitive reach — to be patched in next cycle).

Forced-LIVE (NOT archived per user directive):
  - app/ai_pipeline_v3.py  (3 importers in audit window, importers themselves DEAD)
  - app/splade_bm25.py       (LIVE via app.rag_service)
  - app/wallet_manager_v2.py (LIVE via x402_enforcement, x402_tools, sweep_all, sweep_now)
  - app/crypto_embeddings.py (NOT in audit ARCHIVE list; heavy import graph)

Verification (forward-import closure from mount.py + main.py + factory.py + lifespan.py):
  - imports = 348 app.* modules
  - reached = 194 files reachable from roots
  - archive set = audit_dead (186) - reached - forced_live (4) - test_live (1) = 136
  - Net delta: 136 files moved, 44,932 LOC reduction, 293->295 active routes (+2 from Wave 3)

pyproject.toml updates:
  - setuptools.packages.find: added exclude for app._archive*
  - ruff.extend-exclude: added "app/_archive/"
  - mypy.exclude: added "app/_archive/"

Smoke test: pytest tests/ — 817 passed, 3 pre-existing failures unchanged
(0 new failures; 0 routes lost; all 4 forced-LIVE files still importable).

Restoration: git mv app/_archive/legacy_2026_07/<name>.py <original-path>
and add the import to app/mount.py ROUTER_MODULES.

Refs: AUDIT-2026-Q3.md /home/dev/pry/rmi-final-deadcode-2026-07-06.md
2026-07-06 20:52:31 +02:00

134 lines
3.9 KiB
Python

"""
RMI Webhook Notification Pipeline
===================================
Dispatches alerts to registered webhooks in real-time.
Polls Redis for new alerts and delivers via HTTP POST.
Features:
- Retries with exponential backoff
- Dead letter queue for failed deliveries
- Rate limiting per webhook URL
- Payload signing for security
- Delivery status tracking
Background task started on backend boot.
Polls every 5 seconds for new alerts.
Author: RMI Development
Date: 2026-06-05
"""
import hashlib
import json
import logging
import time
from datetime import UTC, datetime
from fastapi import APIRouter
from fastapi.responses import JSONResponse
from app.core.redis import get_redis
logger = logging.getLogger("webhook_pipeline")
router = APIRouter(prefix="/api/v1/webhooks", tags=["webhook-pipeline"])
# ── Redis Helper ─────────────────────────────────────────────────
def queue_webhook_delivery(
event_type: str,
address: str,
message: str,
data: dict | None = None,
) -> None:
"""Queue a webhook delivery.
Called by push_alert() in persistent_state.py and by
scanner/cron systems.
"""
r = get_redis()
if not r:
return
payload = {
"id": f"wh:{int(time.time())}:{hashlib.md5(message.encode()).hexdigest()[:8]}",
"type": event_type,
"address": address,
"message": message,
"data": data or {},
"source": "rmi_scanner",
"created_at": datetime.now(UTC).isoformat(),
}
delivery = {
"url": webhook_url, # noqa: F821 -- pre-existing bug, see fix(f821) tracking issue
"payload": payload,
"secret": secret, # noqa: F821 -- pre-existing bug, see fix(f821) tracking issue
"webhook_id": webhook_id, # noqa: F821 -- pre-existing bug, see fix(f821) tracking issue
"attempts": 0,
"queued_at": payload["created_at"],
}
r.lpush("rmi:webhooks:pending", json.dumps(delivery))
r.incr("rmi:webhooks:stats:queued")
# Trim pending queue to last 10000
r.ltrim("rmi:webhooks:pending", 0, 9999)
# ── Endpoints ────────────────────────────────────────────────────
@router.get("/stats")
async def webhook_stats():
"""Get webhook delivery statistics."""
r = get_redis()
if not r:
return JSONResponse(content={"error": "redis_unavailable"})
return JSONResponse(
content={
"queued": r.get("rmi:webhooks:stats:queued") or 0,
"delivered": r.get("rmi:webhooks:stats:delivered") or 0,
"failed": r.get("rmi:webhooks:stats:failed") or 0,
"pending": r.llen("rmi:webhooks:pending"),
"dead_letter": r.llen("rmi:webhooks:dead_letter"),
}
)
@router.get("/dead-letter")
async def dead_letter_queue(limit: int = 50):
"""View failed webhook deliveries."""
r = get_redis()
if not r:
return JSONResponse(content={"error": "redis_unavailable"})
items = r.lrange("rmi:webhooks:dead_letter", 0, limit - 1)
return JSONResponse(
content={
"dead_letter": [json.loads(i) for i in items],
"total": r.llen("rmi:webhooks:dead_letter"),
}
)
@router.post("/dead-letter/retry/{index}")
async def retry_dead_letter(index: int):
"""Retry a dead letter delivery."""
r = get_redis()
if not r:
return JSONResponse(content={"error": "redis_unavailable"})
items = r.lrange("rmi:webhooks:dead_letter", index, index)
if not items:
return JSONResponse(content={"error": "Item not found"})
item = json.loads(items[0])
item["attempts"] = 0
r.lrem("rmi:webhooks:dead_letter", 1, items[0])
r.lpush("rmi:webhooks:pending", json.dumps(item))
return JSONResponse(content={"success": True, "message": "Re-queued for delivery"})