feat(agent): expand AI assistant with deeper agentic capabilities

[NicholaiVogel]

Overview

The AI agent harness (memory, GitHub, audio, feedback, rich UI) is in place. This issue tracks the next wave of capabilities to make the assistant a truly powerful agentic tool — not just a dashboard narrator, but a project engineer who never sleeps.

Proposed Capabilities

1. Direct Mutations with Confirmation

• Add tool-level write operations for core data (projects, customers, vendors, invoices, bills, schedules)
• Agent should be able to execute actions like "mark invoice as paid" or "update project budget" directly, with a confirmation step
• Remove the requirement to render a form for every mutation

2. File & Document Intelligence

• Give the agent read/search access to uploaded files and documents
• Support summarization of plans, submittals, RFIs, specs, and change orders
• Enable queries like "What's the latest revision on the structural drawings?" or "Summarize last month's change orders"

3. Proactive Notifications & Scheduled Alerts

• Allow the agent to initiate conversations, not just respond
• Threshold-based alerts (e.g., overdue invoices, slipping schedules)
• Scheduled check-ins (daily/weekly project summaries)

4. Multi-Step Workflow Chains

• Support chaining multiple actions in a single conversation
• Example: "Create a new project, add 3 vendors, set up a preliminary schedule, and send the customer a kickoff email"

5. Email & Communication

• Draft and send emails, RFI responses, schedule updates
• Notify team members and vendors from within the assistant
• Construction PMs spend half their day on correspondence — this is high-impact

6. Deeper Schedule Intelligence

• Critical path analysis
• Flag slipping milestones automatically
• Suggest schedule compression strategies
• Construction-specific reasoning beyond simple task listing

7. Photo & Field Report Integration

• Ingest jobsite photos, daily reports, and inspection logs
• Tie media to schedule phases, punch list items, and project records
• Bridge field-to-office communication via mobile upload

Suggested Priority

1. Direct mutations with confirmation — let the agent act, not just display
2. Document/file intelligence — search, summarize, cross-reference
3. Proactive scheduled alerts — agent works even when the user isn't chatting