Skip to content

refactor(llm): enhance RAG and LLM debug logging for observability#3073

Merged
marevol merged 1 commit intomasterfrom
refactor/enhance-rag-llm-logging
Mar 15, 2026
Merged

refactor(llm): enhance RAG and LLM debug logging for observability#3073
marevol merged 1 commit intomasterfrom
refactor/enhance-rag-llm-logging

Conversation

@marevol
Copy link
Contributor

@marevol marevol commented Mar 15, 2026

Summary

Enhance RAG and LLM logging to improve observability and debugging capabilities.

Changes Made

  • ChatClient: Add info-level log for search phase completion with query, result count, and elapsed time; include userId in enhanced chat completion log
  • AbstractLlmClient: Add debug-level logs for concurrency permit acquisition (available permits, max concurrent), LLM response token usage (prompt/completion/total tokens, finish reason) for intent and evaluation phases, and history inclusion details (count, start index, character budget)
  • LlmClientManager: Simplify redundant debug log messages that duplicate information already logged at lower levels

Testing

  • Logging changes only; no behavioral impact
  • Verified compilation

Additional Notes

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@marevol marevol added this to the 15.6.0 milestone Mar 15, 2026
@marevol marevol self-assigned this Mar 15, 2026
@marevol marevol merged commit 9f509fc into master Mar 15, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant