Skip to content

Phase 1: Tech Trends Agent with Web Search#1

Merged
san360 merged 8 commits into
mainfrom
feature/phase1-web-search
May 15, 2026
Merged

Phase 1: Tech Trends Agent with Web Search#1
san360 merged 8 commits into
mainfrom
feature/phase1-web-search

Conversation

@san360
Copy link
Copy Markdown
Owner

@san360 san360 commented May 15, 2026

Summary

  • Initial agent deployment with Bing Grounding (web search) capability
  • System prompt defines structured research analyst behaviour
  • Evaluation runs Phase 1 queries only (5 test cases)

What to check

  • evaluate.yml triggers and deploys to TEST
  • All 4 evaluator scores meet thresholds
  • PR comment shows eval results
  • After merge, deploy-prod.yml fires and commits artifact

Phase

Phase 1 of 3 — web search only. Phase 2 adds code interpreter.

@github-actions
Copy link
Copy Markdown
Contributor

Agent Evaluation Results

Phase:
Model: gpt-4o-2024-11-20
Commit: b405314

Full results are in the Actions summary.

…quired)

- Replace bing_grounding tool with web_search in agent config and deploy script
- WebSearchTool requires no Bing resource or connection setup
- Update Bicep API version to 2025-06-01 and default region to swedencentral
- Add --skip-foundry flag to bootstrap for using existing Foundry projects
- Fix RBAC role assignment to use role definition ID for Azure AI User
- Add SPN and resource metadata to .env output
@github-actions
Copy link
Copy Markdown
Contributor

Agent Evaluation Results

Phase:
Model: gpt-4o-2024-11-20
Commit: d7f48a3

Full results are in the Actions summary.

@github-actions
Copy link
Copy Markdown
Contributor

Agent Evaluation Results

Phase:
Model: gpt-4o-2024-11-20
Commit: 146c8ec

Full results are in the Actions summary.

@github-actions
Copy link
Copy Markdown
Contributor

Agent Evaluation Results

Phase:
Model: gpt-4o-2024-11-20
Commit: d7f48a3

Full results are in the Actions summary.

@github-actions
Copy link
Copy Markdown
Contributor

Agent Evaluation Results

Phase:
Model: gpt-4o-2024-11-20
Commit: edba7ec

Full results are in the Actions summary.

@github-actions
Copy link
Copy Markdown
Contributor

Agent Evaluation Results

Phase:
Model: gpt-4o-2024-11-20
Commit: d7f48a3

Full results are in the Actions summary.

@github-actions
Copy link
Copy Markdown
Contributor

Agent Evaluation Results

Phase:
Model: gpt-4o-2024-11-20
Commit: edba7ec

Full results are in the Actions summary.

@github-actions
Copy link
Copy Markdown
Contributor

Agent Evaluation Results

Phase:
Model: gpt-4o-2024-11-20
Commit: fd8bcc7

Full results are in the Actions summary.

@github-actions
Copy link
Copy Markdown
Contributor

Agent Evaluation Results

Phase: 1
Model: gpt-4o-2024-11-20
Commit: edba7ec

Full results are in the Actions summary.

@github-actions
Copy link
Copy Markdown
Contributor

Agent Evaluation Results

Phase: 1
Model: gpt-4o-2024-11-20
Commit: e250673

Full results are in the Actions summary.

@github-actions
Copy link
Copy Markdown
Contributor

Agent Evaluation Results

Phase: 1
Model: gpt-4o-2024-11-20
Commit: 386ac67

Full results are in the Actions summary.

…d format

The action expects a JSON object with name, evaluators, and data fields —
not a bare array. Also align evaluator names to builtin.* convention.
@github-actions
Copy link
Copy Markdown
Contributor

Agent Evaluation Results

Phase: 1
Model: gpt-4o-2024-11-20
Commit: 00ed1f8

Full results are in the Actions summary.

@san360 san360 merged commit 378444e into main May 15, 2026
1 check passed
@san360 san360 deleted the feature/phase1-web-search branch May 18, 2026 14:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant