Skip to content

feat(agent): add Gmail workflow affordance#512

Open
Hindol Roy Choudhury (Hindolch) wants to merge 1 commit into
browseros-ai:mainfrom
Hindolch:feat/gmail-workflow-affordance
Open

feat(agent): add Gmail workflow affordance#512
Hindol Roy Choudhury (Hindolch) wants to merge 1 commit into
browseros-ai:mainfrom
Hindolch:feat/gmail-workflow-affordance

Conversation

@Hindolch
Copy link
Copy Markdown

@Hindolch Hindol Roy Choudhury (Hindolch) commented May 15, 2026

Summary

Adds a lightweight site affordance layer for BrowserOS workflows, with Gmail compose as the first cached workflow.

This lets agent-facing flows discover higher-level site actions instead of always relying on low-level browser primitives like take_snapshot, click, and fill. The new-tab BrowserOS query path can now recognize email drafting requests and route them into the BrowserOS agent flow instead of treating them as Google searches.

What Changed

  • Added site affordance registry and recipe types
  • Added affordance tools:
    • site_describe
    • site_intents
    • site_open
    • gmail_compose_draft
  • Registered the affordance tools with the server tool registry
  • Updated chat mode tool allowlist for affordance discovery
  • Added Gmail compose recipe support
  • Added new-tab workflow detection for email drafting prompts
  • Routed matching new-tab prompts into BrowserOS agent mode
  • Added affordance docs

Why

The current browser automation surface is powerful but low-level. For common workflows, the agent has to rediscover the same site capabilities and click paths repeatedly.

This PR adds a first step toward cached browser workflows: the agent can ask what affordances exist for a site/task and call a direct workflow tool when available.

Example:

Recording.2026-05-16.001152.mp4
draft me an email to [someone@gmail.com](mailto:someone@gmail.com) asking to review my pull request

@greptile-apps
Copy link
Copy Markdown
Contributor

greptile-apps Bot commented May 15, 2026

PR author is not in the allowed authors list.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant