Skip to content

Add temporal Gemini video analysis and CloudEvents publishing pipeline#12

Draft
Copilot wants to merge 2 commits intomainfrom
copilot/link-gemini-api-apache-eventmesh
Draft

Add temporal Gemini video analysis and CloudEvents publishing pipeline#12
Copilot wants to merge 2 commits intomainfrom
copilot/link-gemini-api-apache-eventmesh

Conversation

Copy link
Contributor

Copilot AI commented Jan 28, 2026

Implements the direct YouTube URL → Gemini analysis → structured events → EventMesh/OpenWhisk execution path, including timestamped temporal extraction and JSON-structured outputs. Adds APIs and documentation to expose these capabilities end-to-end.

  • Ingestion & temporal understanding

    • Adds temporal video analysis module with timestamp-focused prompt strategies and segment controls.
    • Exposes temporal analysis endpoints for event extraction and timeline generation.
  • Structured output

    • Extends Gemini structured response handling to return JSON event payloads via a dedicated API endpoint.
  • Eventing & execution

    • Introduces CloudEvents publisher with EventMesh-style HTTP publishing and OpenWhisk action routing.
  • Surface area

    • Adds advanced API routes, unit tests for temporal analysis and CloudEvents, and updated docs/examples.

Example (structured event extraction request):

payload = {
    "video_url": "https://www.youtube.com/watch?v=auJzb1D-fag",
    "prompt": "Describe key events and include timestamps",
    "response_schema": {
        "type": "object",
        "properties": {
            "events": {
                "type": "array",
                "items": {
                    "type": "object",
                    "properties": {
                        "timestamp": {"type": "string"},
                        "event": {"type": "string"}
                    },
                    "required": ["timestamp", "event"]
                }
            }
        },
        "required": ["events"]
    }
}

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

@vercel
Copy link

vercel bot commented Jan 28, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Review Updated (UTC)
event-relay-web Error Error Jan 28, 2026 6:56am
v0-uvai Error Error Jan 28, 2026 6:56am

Co-authored-by: groupthinking <154503486+groupthinking@users.noreply.github.com>
Copilot AI changed the title [WIP] Integrate Gemini API with Apache EventMesh for video ingestion Add temporal Gemini video analysis and CloudEvents publishing pipeline Jan 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants