Skip to content

GEMM+GEMM tuning #2175

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
dorde-antic wants to merge 11 commits into
base: develop
Choose a base branch
from
+13 −5
Open

GEMM+GEMM tuning #2175

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
fad4316
Initial commit
dorde-antic Dec 17, 2025
85418ea
Use tune-gemmgemm MITuna branch
dorde-antic Dec 17, 2025
db6e9ad
Update Jenkinsfile
dorde-antic Dec 17, 2025
722b5d7
Add support for gemm_gemm tablekind in clear_tables function in tuna-…
dorde-antic Dec 22, 2025
807598a
Merge branch 'develop' into tune-gemmgemm
dorde-antic Dec 22, 2025
1bcd8ca
Merge branch 'develop' into tune-gemmgemm
dorde-antic Dec 23, 2025
3e3acb2
Merge branch 'develop' into tune-gemmgemm
dorde-antic Jan 28, 2026
a9151b2
Update Jenkinsfile
dorde-antic Jan 28, 2026
0a61a80
Merge branch 'develop' into tune-gemmgemm
dorde-antic Feb 23, 2026
0eeb769
Merge branch 'develop' into tune-gemmgemm
dorde-antic Mar 1, 2026
2778712
Undo accidentally deleted part of code
dorde-antic Mar 1, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 7 additions & 3 deletions mlir/utils/jenkins/Jenkinsfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -878,7 +878,7 @@ pipeline {
buildProject('ci-performance-scripts', '')
// How to check out into specific directory, according to stackoverflow.
dir('MITuna') {
git branch: "pf-tuna-rocmlir-3", poll: false, url: 'https://github.com/ROCm/MITuna.git'
git branch: "ggtuning", poll: false, url: 'https://github.com/ROCm/MITuna.git'
Copy link
Contributor

@mirza-halilcevic mirza-halilcevic Dec 23, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just remember to change this once ROCm/MITuna#1020 is merged.

}
dir('build') {
timeout(time: 60, activity: true, unit: 'MINUTES') {
Expand Down Expand Up @@ -1094,14 +1094,14 @@ pipeline {
stage("Tune rocMLIR") {
buildProject('check-rocmlir-build-only ci-performance-scripts', '')
dir('MITuna') {
git branch: "pf-tuna-rocmlir-3", poll: false, url: 'https://github.com/ROCm/MITuna.git'
git branch: "ggtuning", poll: false, url: 'https://github.com/ROCm/MITuna.git'
}
dir('build') {
def tuningLog = "tune_rocmlir_${CHIP}.log"
sh """echo "=== Tuning rocMLIR for ${CHIP} ===" | tee ${tuningLog}"""
// Tune gemms with default datatypes, fail if the DB is not created
// (Includes int8xint8->int8 for performance comparisons against CK.)
sh """../mlir/utils/tuna/tuna-script.sh -o gemm \
sh """../mlir/utils/tuna/tuna-script.sh -o gemm \
-c ../mlir/utils/performance/configs/tier1-gemm-configs \
-t ${WORKSPACE}/MITuna -f mlir_tuning_${CHIP}.tsv 2>&1 | tee -a ${tuningLog}
[ -f mlir_tuning_${CHIP}.tsv ]"""
Expand Down Expand Up @@ -1150,6 +1150,10 @@ PY
sh """../mlir/utils/tuna/tuna-script.sh -o attention \
-c ${attnConfigToUse} \
-t ${WORKSPACE}/MITuna -f mlir_tuning_${CHIP}.tsv 2>&1 | tee -a ${tuningLog}"""
// Tune gemm_gemm configs
sh """../mlir/utils/tuna/tuna-script.sh -o gemm_gemm \
-c ../mlir/utils/performance/configs/tier1-gemmgemm-configs \
-t ${WORKSPACE}/MITuna -f mlir_tuning_${CHIP}.tsv 2>&1 | tee -a ${tuningLog}"""
// Tune gemms with default datatypes, fail if the DB is not created (quick tuning)
// (Includes int8xint8->int8 for performance comparisons against CK.)
sh """../mlir/utils/tuna/tuna-script.sh -o gemm \
Expand Down
8 changes: 6 additions & 2 deletions mlir/utils/tuna/tuna-script.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,10 @@ function clear_tables
tablekind="conv"
fi

if [ "$tablekind" = "gemm_gemm" ]; then
tablekind="gemmgemm"
fi

# config table has foreign keys from job and results tables. however,
# config table doesn't have a session column so we must delete them all.
mysql --user root --database tuna -e "delete from rocmlir_${tablekind}_results;"
Expand Down Expand Up @@ -110,8 +114,8 @@ while getopts ":hc:t:r:f:o:s:l:" arg; do
case $arg in
o) # Operation (convolution or gemm [default convolution])
OP=${OPTARG}
[ "$OP" = "convolution" ] || [ "$OP" = "gemm" ] || [ "$OP" = "attention" ] \
|| echo "Operation needs to be 'convolution', 'gemm', or 'attention'."
[ "$OP" = "convolution" ] || [ "$OP" = "gemm" ] || [ "$OP" = "attention" ] || [ "$OP" = "gemm_gemm" ] \
|| echo "Operation needs to be 'convolution', 'gemm', 'attention', or 'gemm_gemm'."
;;
c) # Configs file
CONFIGS_FILE="${OPTARG}"
Expand Down