Skip to content

sycl: Battlemage AOT build via spir64_gen + MMQ subgroup annotations#22147

Open
aicss-genai wants to merge 2 commits intoggml-org:masterfrom
aicss-genai:aicss-genai/sycl-bmg-upstream-pr-1
Open

sycl: Battlemage AOT build via spir64_gen + MMQ subgroup annotations#22147
aicss-genai wants to merge 2 commits intoggml-org:masterfrom
aicss-genai:aicss-genai/sycl-bmg-upstream-pr-1

Conversation

@aicss-genai
Copy link
Copy Markdown

@aicss-genai aicss-genai commented Apr 20, 2026

Overview

Authors

Enables AOT builds for Intel GPUs (validated on Intel® Arc™ Pro B70, BMG-G31, Xe2-HPG):

  • When GGML_SYCL_DEVICE_ARCH is set, switch to -fsycl-targets=spir64_gen with -Xsycl-target-backend="-device <arch>" and skip -ze-intel-greater-than-4GB-buffer-required (not accepted by the AOT path). Behavior is unchanged when GGML_SYCL_DEVICE_ARCH is unset.
  • Adds [[intel::reqd_sub_group_size(WARP_SIZE)]] to MMQ Q4_0/Q4_1/Q5_0/Q5_1 kernel launches. WARP_SIZE=16 on Intel targets; pinning the required subgroup size is required for spir64_gen AOT correctness and documents intent on JIT.

Also adds a documentation-only update to ggml_sycl_supports_mmq (still returns false) and a note in ggml_sycl_op_mul_mat_sycl recording that fused dequant+GEMM and MMQ/DPAS were both slower than dequant+oneDNN in our experiments.

Additional information

Split from #22066 per reviewer request for independent review.

Requirements

  • I have read and agree with the contributing guidelines
  • AI usage disclosure: Yes. This work was partially produced with an agentic engineering approach: agents surface issues and explore experiments while engineers identify and reject candidates using domain knowledge. Human feedback involved.

@aicss-genai aicss-genai requested a review from a team as a code owner April 20, 2026 06:53
@ggml-gh-bot
Copy link
Copy Markdown

ggml-gh-bot bot commented Apr 20, 2026

Hi @aicss-genai, thanks for your contribution!

Per our contribution guidelines, the automated PR checker found the following issue(s) that need your attention:

  • Multiple open PRs from a new contributor: We limit new contributors (those without a previously merged PR) to 1 open PR at a time. You currently have 3 open PRs.

Please note that maintainers reserve the right to make final decisions on PRs. If you believe there is a mistake, please comment below.

@github-actions github-actions bot added ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language labels Apr 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants