Skip to content

[FORK][FEATURE][x64]Extend InnerProduct source dynamic quantization to BF16#310

Merged
maxnick merged 1 commit into
v3.10_for_ie_masterfrom
liubo/InnerProduct_dynamic_quant_bf16
May 28, 2026
Merged

[FORK][FEATURE][x64]Extend InnerProduct source dynamic quantization to BF16#310
maxnick merged 1 commit into
v3.10_for_ie_masterfrom
liubo/InnerProduct_dynamic_quant_bf16

Conversation

@liubo-intel
Copy link
Copy Markdown
Collaborator

Description

Enables the BRGEMM InnerProduct dynamic-quantization path (previously F32-only) to accept BF16 sources, which is required by the OpenVINO CPU plugin's BF16 compressed-FC flow.

@maxnick
Copy link
Copy Markdown
Collaborator

maxnick commented May 21, 2026

  1. Please squash these commits into one
  2. If these changes are original in our for (not something that we cherry-picked from oneDNN main), please use the agreed naming convention (e.g. "[FORK][FEATURE][x64] Extend inner product src dynamic quant to bf16").

@liubo-intel liubo-intel force-pushed the liubo/InnerProduct_dynamic_quant_bf16 branch from fc147eb to f5c854d Compare May 23, 2026 13:59
@liubo-intel liubo-intel changed the title [FORK][x64]Extend InnerProduct source dynamic quantization to BF16 [FORK][FEATURE][x64]Extend InnerProduct source dynamic quantization to BF16 May 23, 2026
@liubo-intel liubo-intel force-pushed the liubo/InnerProduct_dynamic_quant_bf16 branch from f5c854d to 6b31ed2 Compare May 23, 2026 14:17
@liubo-intel
Copy link
Copy Markdown
Collaborator Author

  • Please squash these commits into one
  • If these changes are original in our for (not something that we cherry-picked from oneDNN main), please use the agreed naming convention (e.g. "[FORK][FEATURE][x64] Extend inner product src dynamic quant to bf16").

Hi, @maxnick : I have squashed the two commits into one.
For the second point, my understanding is that you meant updating the PR title? If the [FORK][FEATURE][x64] prefix is also applied to the commit subject, it triggers the PR CI commit-format check failure. Please correct me if I misunderstood.

@maxnick
Copy link
Copy Markdown
Collaborator

maxnick commented May 27, 2026

  • Please squash these commits into one
  • If these changes are original in our for (not something that we cherry-picked from oneDNN main), please use the agreed naming convention (e.g. "[FORK][FEATURE][x64] Extend inner product src dynamic quant to bf16").

Hi, @maxnick : I have squashed the two commits into one. For the second point, my understanding is that you meant updating the PR title? If the [FORK][FEATURE][x64] prefix is also applied to the commit subject, it triggers the PR CI commit-format check failure. Please correct me if I misunderstood.

Hi. Got it. This naming convection doesn't suite the CI check. So what about cpu: fork: x64: extend inner product src dynamic quant to bf16? This should pass checks and still it's better to clearly mark modifications that are made only in the fork.

Also includes clang-format cleanup of inner product and src
quantization kernel.
@liubo-intel liubo-intel force-pushed the liubo/InnerProduct_dynamic_quant_bf16 branch from 6b31ed2 to f82d833 Compare May 27, 2026 10:16
pull Bot pushed a commit to Pet3cy/openvino that referenced this pull request May 27, 2026
…cted (openvinotoolkit#35726)

### Details:
- *Extends the CPU plugin's weight-decompression FC path so that BF16
activations can go through the oneDNN dynamic-quantization kernel, in
addition to F32.*

oneDNN fork PR:openvinotoolkit/oneDNN#310

### Tickets:
 - *CVS-182410*
@maxnick maxnick merged commit f82d833 into v3.10_for_ie_master May 28, 2026
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants