Skip to content

Autogen LLMStreamProxy Updates#1671

Open
TimPansino wants to merge 15 commits intomainfrom
feat-autogen-updates
Open

Autogen LLMStreamProxy Updates#1671
TimPansino wants to merge 15 commits intomainfrom
feat-autogen-updates

Conversation

@TimPansino
Copy link
Contributor

@TimPansino TimPansino commented Feb 26, 2026

Overview

  • Rename GeneratorProxy and AsyncGeneratorProxy to LLMStreamProxy for clarity and to differentiate from the existing transaction wrappers with the same name.
  • Add test suite for LLMStreamProxy.
  • Optimize implementation of LLMStreamProxy by removing unnecessary transaction lookups.
  • Add streaming tests for Autogen.
  • Add streaming reporting for Autogen even if the stream wasn't fully exhausted after the Response object.

@TimPansino TimPansino requested a review from a team as a code owner February 26, 2026 01:13
@github-actions
Copy link

github-actions bot commented Feb 26, 2026

MegaLinter analysis: Success

Descriptor Linter Files Fixed Errors Warnings Elapsed time
✅ ACTION actionlint 7 0 0 1.02s
✅ MARKDOWN markdownlint 7 0 0 0 1.34s
✅ PYTHON ruff 1037 0 0 0 1.18s
✅ PYTHON ruff-format 1037 0 0 0 0.43s
✅ YAML prettier 15 0 0 0 1.62s
✅ YAML v8r 15 0 0 6.11s
✅ YAML yamllint 15 0 0 0.67s

See detailed reports in MegaLinter artifacts

MegaLinter is graciously provided by OX Security

@mergify mergify bot added the tests-failing Tests failing in CI. label Feb 26, 2026
@codecov-commenter
Copy link

codecov-commenter commented Feb 26, 2026

Codecov Report

❌ Patch coverage is 77.92208% with 34 lines in your changes missing coverage. Please review.
✅ Project coverage is 81.84%. Comparing base (983474f) to head (1f30027).

Files with missing lines Patch % Lines
newrelic/hooks/mlmodel_autogen.py 76.82% 11 Missing and 8 partials ⚠️
newrelic/common/llm_utils.py 71.15% 4 Missing and 11 partials ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1671      +/-   ##
==========================================
- Coverage   81.88%   81.84%   -0.05%     
==========================================
  Files         215      215              
  Lines       25861    25959      +98     
  Branches     4108     4127      +19     
==========================================
+ Hits        21177    21246      +69     
- Misses       3303     3315      +12     
- Partials     1381     1398      +17     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@TimPansino TimPansino changed the title LLMStreamProxy Updates Autogen LLMStreamProxy Updates Mar 3, 2026
@mergify mergify bot removed the tests-failing Tests failing in CI. label Mar 4, 2026
@mergify mergify bot added the merge-conflicts Merge conflicts detected. label Mar 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

merge-conflicts Merge conflicts detected.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants