FIX: CLI display underlying model#2215
Open
rlundeen2 wants to merge 1 commit into
Open
Conversation
Scenario pretty-printer showed the Azure deployment name (model_name) instead of the underlying model. Prefer underlying_model_name with fallback to model_name, matching the CLI target-list behavior in _output.py. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0647a5d9-1395-4980-8eac-2aa176160ed1
jbolor21
approved these changes
Jul 16, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
The scenario pretty-printer (
pyrit/output/scenario_result/pretty.py) displayed the target'smodel_namefor theTarget Modelline, which for Azure OpenAI targets is the deployment name (e.g.pyrit-github-gpt4) rather than the actual model.This makes it prefer
underlying_model_nameand fall back tomodel_name, matching the CLI target-list behavior inpyrit/cli/_output.py(underlying_model_name or model_name). Now a scenario report shows e.g.Target Model: gpt-4o.Changes
pretty.py: preferunderlying_model_namewith fallback tomodel_namefor the displayed target model.test_pretty.py: added coverage for the underlying-model preference and the deployment-name fallback.Testing
pytest tests/unit/output/scenario_result/test_pretty.py(15 passed)