Skip to content

[codex] Improve screen reliability and debug visibility#4

Open
devon7y wants to merge 1 commit intoethanplusai:mainfrom
devon7y:codex/upstream-reliability-debug
Open

[codex] Improve screen reliability and debug visibility#4
devon7y wants to merge 1 commit intoethanplusai:mainfrom
devon7y:codex/upstream-reliability-debug

Conversation

@devon7y
Copy link
Copy Markdown

@devon7y devon7y commented Apr 3, 2026

What changed

  • added screenshot preparation and recompression so screen-analysis requests stay under the vision image limit
  • widened screen intent detection for phrasings like what is on my screen
  • added a live debug-log stream on the backend plus a debug drawer in the frontend UI
  • expanded project discovery beyond ~/Desktop to common local dev roots and the current repo
  • replaced the fixed St. Petersburg weather lookup with IP-based location detection, Celsius output, and optional env overrides
  • made calendar account preference updates apply immediately without restarting the server
  • added focused regression tests for screen handling, debug log streaming, project discovery, weather, and calendar configuration

Why

Several user-visible paths were brittle or misleading:

  • screen requests often fell back to window-title summaries because screenshots exceeded the vision upload limit or specific phrasings missed the fast screen route
  • debugging background behavior in the UI required watching backend logs directly
  • project resolution only scanned ~/Desktop, which broke prompts against repos stored in normal local dev directories
  • weather was hardcoded to St. Petersburg, FL instead of reflecting the actual user location
  • calendar account changes required a restart before taking effect

Impact

  • screen descriptions are more reliable and easier to debug in real time
  • JARVIS can find local projects in common developer directories without manual relocation
  • weather output now follows the actual environment or an explicit override
  • settings changes for calendar accounts take effect immediately

Validation

  • pytest -q tests/test_calendar_access.py tests/test_debug_log_stream.py tests/test_lookup_reporting.py tests/test_project_discovery.py tests/test_screen.py tests/test_screen_detection.py tests/test_weather.py
  • npm ci && npm run build

@devon7y devon7y marked this pull request as ready for review April 3, 2026 19:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants