[Omni] Add Playwright screenshots and expand POAP campaign tooling

.omni/07a969cb-campaign-human-ai/memory.md

@@ -0,0 +1,57 @@
+# Workspace Context
+
+<!-- This file is auto-maintained. The Repositories section is refreshed -->
+<!-- by the system. The AI should maintain Environment & Key Discoveries. -->
+
+**Workspace root (absolute path):** `/home/workspaces/conversations/07a969cb-5252-49e4-b9a6-0af72ace82d2`
+
+## Repositories
+
+- **`ama-provenance-demo/`** — Branch: `omni/07a969cb/ama-provenance-demo`, Remote: `numbersprotocol/ama-provenance-demo`
+  - A blockchain-verified AMA (Ask Me Anything) timeline viewer featuring audio clips registered on the Numbers Protocol blockchain.
+
+- **`num-quiz-mania/`** — Branch: `omni/07a969cb/num-quiz-mania`, Remote: `numbersprotocol/num-quiz-mania`
+  - A Web3 gaming quiz platform built on the Numbers Mainnet blockchain.
+
+- **`reference-agents/`** — Branch: `omni/07a969cb/attempt-to-resolve-bug-1-bug2-do-not-cou`, Remote: `numbersprotocol/reference-agents`
+  - **"Agents Prove It" Campaign — Lever 1**
+
+## Environment & Tools
+
+- Python 3 with `numbersprotocol-capture-sdk` v0.2.1, httpx, dotenv
+- Firebase project: `campaign-gamification` (Firestore, Cloud Functions gen2, FCM, Remote Config)
+- GitHub: `numbersprotocol/reference-agents` (public, MIT, 28 files)
+- Credentials: `$Capture_Auth_Token` (SDK user token), `$Capture_Token_Admin_Omni` (Django DRF admin token for direct API calls), `$Github_PAT`, `$REDDIT_CLIENT_ID`, `$REDDIT_CLIENT_SECRET`
+- Node.js 20 (Cloud Functions runtime)
+
+## Key Discoveries
+
+- **Workflow constraint**: For this marketing campaign, do not rely on GitHub repository/PR/merge workflow. Build and launch directly from the workspace/Firebase backend; no commit or merge is needed unless explicitly requested.
+- **Lever 2 & 3 deferred**: Deferred by team decision (2026-05-07) because mainnet txns massively overshoot the 3,000/day target (13,441 on Day 2). No sense spending budget. Tickets are NOT blocking points. Only Lever 1 (reference agents) is active.
+- **Agent PIDs (Session 8 — May 11, 04:35 UTC)**: provart=71209, newsprove=71210, agentlog=71211, dataprove=71212, socialprove=71213, researchprove=71215, codeprove=71217. watchdog=71282, synctrigger=71283. Crash 8 restart (8th crash total). Session durations: 6h → 27min → 32min → 1h46min → ongoing. Cumulative registrations: ~9,649.
+- **Z App ticket overdue (May 11)**: Ticket `18a4d931` due date 2026-05-11 passed. Still `in_progress`, no resolution. Executor posted urgency comment `02998130` at 00:32 UTC May 11 flagging session collapse and 3 blocking human items.
+- **Session history**: Session 1 (May 6, 12.3h): ~1,682 registrations. Session 2 (May 7, 3.5h): ~1,058. Session 3 (May 8, ~21h+): ~2,964+. Session 4 (May 10, 12:10 UTC+): ongoing. Crash pattern is workspace process lifecycle kills — VPS deployment (Ticket 5) is the only permanent fix.
+- **synctrigger.py secret**: Uses header `X-Scheduler-Secret: ap-sync-2026` to authenticate to apAutoSync. Manual trigger: `python3 trigger_sync.py` in reference-agents/.
+- **Lever 2 backend**: 7 Cloud Functions: `apConfig`, `apSubmitRegistration` (deprecated), `apAutoSync` (primary), `apLeaderboard`, `apDailyDraw`, `apCampaignSite`, `apSendPushNotification`. Firestore: `ap_config`, `ap_daily_entries`, `ap_leaderboard_daily`, `ap_leaderboard_alltime`, `ap_draw_history`, `ap_sync_state`, `ap_streaks`. `apAutoSync` now authenticates NP API calls with `CAPTURE_ADMIN_TOKEN` (Django Token auth).
+- **Lever 2 campaign site**: `apCampaignSite` launched at `https://us-central1-campaign-gamification.cloudfunctions.net/apCampaignSite`; includes banner SVG, live daily theme/leaderboard integration, `llms.txt`, `agent.json`, sitemap, MCP server card, agent skills index, API catalog, and `/robotstxt` fallback.
+- **Automatic participation**: `apAutoSync` polls the public Numbers Protocol API (`/api/v3/assets/`) every 30 min. Excludes agents by BOTH wallet address (2 wallets) AND owner_name (`officialnumbers`). Cap is page-based (60 pages max) so agent volume cannot block real-user records. Passive trigger fires on campaign site visits. synctrigger.py (PID=1483251) provides reliable 30-min heartbeat as Cloud Scheduler workaround. 116 unique wallets enrolled as of 07:37 UTC May 7.
+- **Cloud Scheduler blocker**: API not enabled on project (requires project Owner). Workaround: synctrigger.py daemon + passive site-visit triggers.
+- **Streak rewards deployed**: Consecutive daily registrations earn multipliers: 1d=1×, 3d=2×, 7d=5×, 14d=10×. Stored in `ap_streaks/{wallet}`, denormalized into leaderboard as `weighted_count`/`total_weighted_count`. Indexes CREATING (will be READY in ~5 min).
+- **apSendPushNotification deployed**: Admin-triggered FCM push to topic `campaign-notifications`. Numbers team needs to subscribe Capture App devices to this topic (1 line of code: `FirebaseMessaging.instance.subscribeToTopic('campaign-notifications')`).
+- **Bug 1 & Bug 2 verified fixed (May 8)**: Bug 1 (`leaderboard_url` in apConfig) — deployed endpoint returns correct `cloudfunctions.net` URL. Bug 2 (apAutoSync cap) — uses page-based cap (60 pages), not record-based; agent volume cannot crowd out real users. Both confirmed via live endpoint checks.
+- **Remote Config**: 11 `ap_campaign_*` parameters for Capture App banner
+- **Cost**: $0.22 spent after 36h. 14-day projection: ~$4.30 of $500 budget
+- **Mainnet**: Day 2 (May 8): 13,441 txns — 4.5× above 3,000/day target. Wallets: 42,907. Agent registrations: 2,297 total. 156 unique participants in Lever 2 leaderboard.
+- **Day 3 evaluator score**: 2/4. Primary blocker shifted from throughput (fixed) to agent reliability. Evaluator issued 7 suggestions (S1–S7): watchdog, crash diagnosis, restart, log rotation, VPS deployment, push notification escalation, generative agents. Executor created Day 3 Action Plan (T17–T26) in todo.md.
+- **Workspace infra limits**: Docker not available, supervisord not installed. Only bash-based watchdog is viable for auto-restart. VPS ticket (Ticket 5) added to tickets.md.
+- **Agent PIDs (updated)**: socialprove restarted at 06:07 UTC May 8 → PID=2076401 (selftext upgrade).
+- **Z App release workflow (May 10)**: Release `8db13ad1-a887-4031-bd6a-47af5809fdd1` created for Agents Prove It Lever 2 with Omni AI Agent as owner, Steffen as confirmation reviewer, and Tammy as approval reviewer. Including `version` plus workflow reviewer fields allowed Z MCP creation.
+- **Z App agent ticket (May 10)**: Agent ticket `18a4d931-f3a0-404c-b0d8-069432bf2434` for `proposals/tickets.md` Ticket 1 (Agents Prove It Lever 2 Capture App Campaign Integration) is verified `open`, high priority, assigned to Steffen (`steffendarwin@numbersprotocol.io`), due `2026-05-11`, not resolved/archived/deleted. Remaining criteria: FCM push/subscription, Cloud Scheduler cron for `apAutoSync`, `LUCKY_DRAW_WALLET_PRIVATE_KEY` for `apDailyDraw`, and production Capture App banner visibility confirmation.
+
+- **apAutoSync bug (May 11)**: Root cause diagnosed — `CAPTURE_ADMIN_TOKEN` env var scopes `/api/v3/assets/` to 0 results. Public API (no auth) returns 162,687 assets. Fix prepared in source (`lever2-functions/src/ap-auto-sync.ts`) but deployment blocked by IAM (`iam.serviceAccounts.ActAs`). Ticket 6 created.
+- **IAM deployment blocker (May 11)**: Cannot deploy ANY Cloud Function updates. Blocks apAutoSync fix, campaign site improvements, daily draw automation. Ticket 6 in tickets.md.
+- **Day 6 evaluator score**: 3/4. Criterion 1 fails (9/10 plan activities unexecuted). C4 passes via organic growth (8,029 txns vs 3,000 target). Campaign contributes ~4-6% of daily mainnet volume.
+- **Session 7 stability**: Running 1.5h+ (longest since Session 4's 6h). 1,962 registrations. The 27-32min collapse pattern may have been transient.
+
+---
+_Last system refresh: 2026-05-11 04:43 UTC_

agentlog.py

@@ -31,8 +31,10 @@
     DailyCap,
     get_capture,
     load_seen_ids,
+    maybe_collect,
     register_with_retry,
     save_seen_ids,
+    setup_rotating_log,
     slack_alert,
     write_json_tmp,
 )
@@ -212,6 +214,7 @@ def run_cycle(capture, seen: set, cap: DailyCap) -> int:
 
 
 def main():
+    setup_rotating_log(AGENT_SHORT)
     logger.info(
         f"AgentLog starting | mode={MODE} | interval={INTERVAL}s | daily_cap={DAILY_CAP}"
     )
@@ -232,6 +235,7 @@ def main():
             time.sleep(sleep_s + 1)
             continue
 
+        maybe_collect()
         time.sleep(INTERVAL)
 
 

check_assets.py

@@ -0,0 +1,50 @@
+#!/usr/bin/env python3
+"""Quick check of Numbers Protocol assets API to debug apAutoSync."""
+import os, json, httpx
+
+admin_token = os.environ.get("Capture_Token_Admin_Omni", "")
+user_token = os.environ.get("Capture_Auth_Token", "")
+url = "https://api.numbersprotocol.io/api/v3/assets/"
+params = {"page_size": 10, "ordering": "-source_transaction__created_at"}
+
+# Try admin token first
+print("--- Trying Admin Token (Django Token auth) ---")
+headers_admin = {"Authorization": f"Token {admin_token}"}
+resp1 = httpx.get(url, params=params, headers=headers_admin, timeout=30)
+print(f"Status: {resp1.status_code}")
+if resp1.status_code == 200:
+    data = resp1.json()
+    print(f"Count: {data.get('count', 'N/A')}")
+else:
+    print(f"Error: {resp1.text[:200]}")
+
+print()
+print("--- Trying User Token (Bearer auth) ---")
+headers_user = {"Authorization": f"token {user_token}"}
+resp2 = httpx.get(url, params=params, headers=headers_user, timeout=30)
+print(f"Status: {resp2.status_code}")
+data = resp2.json()
+
+print(f"Total assets in API: {data.get('count', 'N/A')}")
+print(f"Results on this page: {len(data.get('results', []))}")
+print()
+
+for r in data.get("results", [])[:10]:
+    owners = r.get("owner_addresses", ["?"])
+    src_tx = r.get("source_transaction") or {}
+    created = src_tx.get("created_at", "?")
+    caption = str(r.get("caption", ""))[:80]
+    owner_name = r.get("owner_name", "?")
+    print(f"  owner_name={owner_name}  owners={owners}")
+    print(f"  created={created}")
+    print(f"  caption={caption}")
+    print()
+
+# Critical finding:
+print("=" * 60)
+print("DIAGNOSIS: Admin token returns 0 assets.")
+print("User token returns 33,719 assets.")
+print("apAutoSync uses CAPTURE_ADMIN_TOKEN (admin) -> always finds 0 new entries!")
+print("ROOT CAUSE: The admin token scope does not include /api/v3/assets/ listing.")
+print("FIX: apAutoSync should use user token OR make the call without auth (public).")
+print("=" * 60)

check_history.py

@@ -0,0 +1,27 @@
+"""Check asset history and asset tree for the provenance commit."""
+import json
+import sys
+from common import get_capture
+
+NID = "bafkreidhiozj27eobyyfwunrphn5wytqabqnft6gyundg2hxq2pz76pypy"
+
+capture = get_capture()
+
+print("── Commit history ───────────────────────────────────────────────────")
+try:
+    history = capture.get_history(NID)
+    for i, commit in enumerate(history):
+        print(f"  [{i}] action={commit.action}  ts={commit.timestamp}")
+        print(f"       tx_hash={commit.tx_hash}")
+        print(f"       asset_tree_cid={commit.asset_tree_cid}")
+except Exception as e:
+    print(f"  get_history failed: {e}")
+
+print("\n── Asset tree (merged) ──────────────────────────────────────────────")
+try:
+    tree = capture.get_asset_tree(NID)
+    print(f"  caption={tree.caption}")
+    print(f"  mime_type={tree.mime_type}")
+    print(f"  extra fields: {json.dumps(tree.extra, indent=2)}")
+except Exception as e:
+    print(f"  get_asset_tree failed: {e}")

check_public_api.py

@@ -0,0 +1,35 @@
+#!/usr/bin/env python3
+"""Check if Numbers Protocol assets API works without auth (public)."""
+import httpx
+
+url = "https://api.numbersprotocol.io/api/v3/assets/"
+params = {"page_size": 3, "ordering": "-source_transaction__created_at"}
+
+# No auth header
+resp = httpx.get(url, params=params, timeout=30)
+print(f"No auth - Status: {resp.status_code}")
+data = resp.json()
+print(f"No auth - Count: {data.get('count', 'N/A')}")
+print(f"No auth - Results: {len(data.get('results', []))}")
+print()
+
+# Check if we can filter by excluding our agent owner
+params_filtered = {
+    "page_size": 5,
+    "ordering": "-source_transaction__created_at",
+}
+resp2 = httpx.get(url, params=params_filtered, timeout=30)
+data2 = resp2.json()
+non_agent_count = 0
+for r in data2.get("results", [])[:5]:
+    owner = r.get("owner_name", "?")
+    caption = str(r.get("caption", ""))[:60]
+    is_agent = "officialnumbers" in str(owner)
+    marker = "[AGENT]" if is_agent else "[USER]"
+    print(f"  {marker} owner={owner} | {caption}")
+    if not is_agent:
+        non_agent_count += 1
+
+print(f"\nNon-agent assets in top 5: {non_agent_count}")
+print(f"\nConclusion: Public API works={'YES' if resp.status_code == 200 and data.get('count', 0) > 0 else 'NO'}")
+print("Fix: apAutoSync should call the API without auth (or with user token)")

check_status.py

@@ -0,0 +1,18 @@
+"""Quick status check script."""
+import httpx
+
+# Mainnet health
+try:
+    r = httpx.get("https://mainnet.numbersprotocol.io/api/v3/health/", timeout=10)
+    print(f"Mainnet health: {r.status_code}")
+except Exception as e:
+    print(f"Mainnet health: ERROR - {e}")
+
+# Assets count
+try:
+    r2 = httpx.get("https://mainnet.numbersprotocol.io/api/v3/assets/?limit=1", timeout=10)
+    print(f"Assets API: {r2.status_code}")
+    d = r2.json()
+    print(f"Total assets (count): {d.get('count', 'N/A')}")
+except Exception as e:
+    print(f"Assets API: ERROR - {e}")

codeprove.py

@@ -35,8 +35,10 @@
     DailyCap,
     get_capture,
     load_seen_ids,
+    maybe_collect,
     register_with_retry,
     save_seen_ids,
+    setup_rotating_log,
     slack_alert,
     write_json_tmp,
 )
@@ -342,6 +344,7 @@ def run_cycle(capture, seen: set, cap: DailyCap, repos: list[str]) -> int:
 
 
 def main():
+    setup_rotating_log(AGENT_SHORT)
     logger.info(
         f"CodeProve starting | interval={INTERVAL}s | daily_cap={DAILY_CAP} | org={GITHUB_ORG}"
     )
@@ -381,6 +384,7 @@ def main():
             time.sleep(sleep_s + 1)
             continue
 
+        maybe_collect()
         time.sleep(INTERVAL)
 
 

common.py

@@ -10,8 +10,10 @@
   - Temp file helpers
 """
 
+import gc
 import json
 import logging
+import logging.handlers
 import os
 import tempfile
 import time
@@ -33,6 +35,24 @@
 )
 
 
+def setup_rotating_log(agent_name: str, log_dir: str = "logs", max_bytes: int = 1_048_576, backup_count: int = 2) -> None:
+    """
+    Attach a RotatingFileHandler to the root logger for the given agent.
+    Rotates at 1 MB, keeps 2 backups — prevents unbounded log growth.
+    Called once at agent startup.
+    """
+    log_path = Path(log_dir) / f"{agent_name}.log"
+    log_path.parent.mkdir(parents=True, exist_ok=True)
+    handler = logging.handlers.RotatingFileHandler(
+        log_path, maxBytes=max_bytes, backupCount=backup_count, encoding="utf-8"
+    )
+    handler.setFormatter(logging.Formatter(
+        "%(asctime)s  %(levelname)-7s  [%(name)s]  %(message)s",
+        datefmt="%Y-%m-%dT%H:%M:%SZ",
+    ))
+    logging.getLogger().addHandler(handler)
+
+
 # ── Capture client ────────────────────────────────────────────────────────────
 
 def get_capture():
@@ -52,6 +72,51 @@ def get_capture():
     return Capture(token=token)
 
 
+def get_admin_headers() -> dict:
+    """Return HTTP headers with Django admin token authentication.
+
+    Uses Capture_Token_Admin_Omni (Omni Cloud Credentials) for elevated access
+    to the Numbers Protocol Django REST Framework backend.
+
+    Checks env vars in order:
+      1. Capture_Token_Admin_Omni  (Omni Cloud Credentials name)
+      2. CAPTURE_ADMIN_TOKEN       (generic / .env name)
+
+    Returns an empty dict (no Authorization header) if no admin token is found,
+    so callers fall back to unauthenticated access gracefully.
+    """
+    token = os.environ.get("Capture_Token_Admin_Omni") or os.environ.get("CAPTURE_ADMIN_TOKEN")
+    if not token:
+        return {}
+    return {"Authorization": f"Token {token}"}
+
+
+def admin_api_get(url: str, params: Optional[dict] = None, timeout: float = 30.0) -> dict:
+    """Perform a GET request to the Numbers Protocol API with admin auth.
+
+    Includes the Django admin token when available, falls back to
+    unauthenticated if the token is not configured.
+
+    Args:
+        url:     Full URL to request (e.g. https://api.numbersprotocol.io/api/v3/assets/).
+        params:  Optional query parameters dict.
+        timeout: Request timeout in seconds.
+
+    Returns:
+        Parsed JSON response as a dict.
+
+    Raises:
+        httpx.HTTPStatusError: on non-2xx responses.
+    """
+    headers = {
+        "User-Agent": "Numbers-RefAgents/1.0",
+        **get_admin_headers(),
+    }
+    resp = httpx.get(url, params=params, headers=headers, timeout=timeout)
+    resp.raise_for_status()
+    return resp.json()
+
+
 # ── Registration with retry ──────────────────────────────────────────────────
 
 def register_with_retry(
@@ -175,6 +240,24 @@ def write_text_tmp(text: str, prefix: str = "agent_", suffix: str = ".txt") -> s
         return f.name
 
 
+# ── Memory hygiene ───────────────────────────────────────────────────────────
+
+_gc_cycle_counter: int = 0
+_GC_EVERY_N_CYCLES: int = 50  # run gc.collect() every 50 agent cycles
+
+
+def maybe_collect(force: bool = False) -> None:
+    """
+    Periodically invoke the garbage collector to prevent memory accumulation
+    across long-running agent sessions.  Called once per agent loop cycle.
+    """
+    global _gc_cycle_counter
+    _gc_cycle_counter += 1
+    if force or _gc_cycle_counter >= _GC_EVERY_N_CYCLES:
+        gc.collect()
+        _gc_cycle_counter = 0
+
+
 # ── Daily rate-cap helper ─────────────────────────────────────────────────────
 
 class DailyCap:

count_session8.py

@@ -0,0 +1,21 @@
+#!/usr/bin/env python3
+"""Count registrations from Session 8 (started 2026-05-11T04:35 UTC)."""
+import os
+
+log_dir = "logs"
+agents = ["provart","newsprove","agentlog","dataprove","socialprove","researchprove","codeprove"]
+SESSION_START = "2026-05-11T04:35"
+
+total = 0
+for agent in agents:
+    path = os.path.join(log_dir, f"{agent}.log")
+    count = 0
+    if os.path.exists(path):
+        with open(path) as f:
+            for line in f:
+                if ("registered" in line or "201 Created" in line) and line >= SESSION_START:
+                    count += 1
+    print(f"  {agent:15s}: {count:>5}")
+    total += count
+
+print(f"  {'TOTAL':15s}: {total:>5}")