Skip to content

Extend nvbench_compare.py with --plot, axis/benchmark filtering, and dark mode#315

Draft
bernhardmgruber wants to merge 5 commits intoNVIDIA:mainfrom
bernhardmgruber:plot_diff_script
Draft

Extend nvbench_compare.py with --plot, axis/benchmark filtering, and dark mode#315
bernhardmgruber wants to merge 5 commits intoNVIDIA:mainfrom
bernhardmgruber:plot_diff_script

Conversation

@bernhardmgruber
Copy link
Collaborator

Builds on top of #314. Entirely vibe-coded as well.

Example comparing with axis filter:

python python/scripts/nvbench_compare.py -a T{ct}=[F32,F16] -a Elements{io}[pow2]=28 --plot ./pytorch_ublkcpy_B200.json ./pytorch_unroll_2_bif_100.json --dark
image

With threshold diff and no dark mode:

python python/scripts/nvbench_compare.py -a T{ct}=[F32,F16] -a Elements{io}[pow2]=28 --plot --threshold-diff 0.1 ./pytorch_ublkcpy_B200.json ./pytorch_unroll_2_bif_100.json 
image

No filters:

python python/scripts/nvbench_compare.py --plot ./pytorch_ublkcpy_B200.json ./pytorch_unroll_2_bif_100.json 
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant