RugMunchMedia/pryscraper
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

feat(sql): migrate intelligence, monitor, and referrals to SQLAlchemy #4

Merged
cryptorugmunch merged 2 commits from feat/sql-migration-top3 into main 2026-07-03 01:29:59 +02:00
Conversation 0 Commits 2 Files changed 9 +1081 -399
cryptorugmunch commented 2026-07-03 01:25:34 +02:00
Owner
Copy link

Migrates the top 3 JSON file stores to SQLAlchemy tables:

  • intelligence.py -> IntelSnapshot
  • monitor.py -> Monitor + MonitorRun
  • structure_monitor.py -> StructureSnapshot
  • referrals.py -> ReferralClick + ReferralConversion + ReferralInAppUsage

Also extends db.py models and import_json_stores. All public API signatures remain unchanged.

  • 475 tests passing
  • ruff clean
  • mypy clean
Migrates the top 3 JSON file stores to SQLAlchemy tables: - intelligence.py -> IntelSnapshot - monitor.py -> Monitor + MonitorRun - structure_monitor.py -> StructureSnapshot - referrals.py -> ReferralClick + ReferralConversion + ReferralInAppUsage Also extends db.py models and import_json_stores. All public API signatures remain unchanged. - 475 tests passing - ruff clean - mypy clean
cryptorugmunch added 2 commits 2026-07-03 01:25:34 +02:00
feat(sql): migrate intelligence, monitor, and referrals to SQLAlchemy
All checks were successful
CI / lint (pull_request) Successful in 59s
Details
CI / typecheck (pull_request) Successful in 7m34s
Details
CI / Secret scan (gitleaks) (pull_request) Successful in 1m59s
Details
CI / test (pull_request) Successful in 8m59s
Details
CI / Security audit (bandit) (pull_request) Successful in 1m3s
Details
232dc16924 
- intelligence.py: IntelSnapshot table, JSONL replaced with queries.
- monitor.py: Monitor + MonitorRun tables, JSON files replaced.
- structure_monitor.py: StructureSnapshot table for selector history.
- referrals.py: ReferralClick + ReferralConversion + ReferralInAppUsage tables.
- db.py: extended models and import_json_stores for the three domains.
- Added/updated tests: 475 passing.
cryptorugmunch merged commit 85dea0cb4c into main 2026-07-03 01:29:59 +02:00
cryptorugmunch deleted branch feat/sql-migration-top3 2026-07-03 01:29:59 +02:00
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: RugMunchMedia/pryscraper#4
No description provided.
Delete branch "feat/sql-migration-top3"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?