feat(codecs): support encoding native Vector metrics in OTLP serializer by petere-datadog · Pull Request #25738 · vectordotdev/vector

petere-datadog · 2026-07-01T21:49:11Z

Summary

Support encoding native Vector metrics in OTLP
This means you can now use otel destination with metrics inputs i.e. any metrics pipeline can sink to otel

Vector configuration

How did you test this PR?

Tested using this config:

sources:
  dd_agent:
    type: datadog_agent
    address: 0.0.0.0:8283
    multiple_outputs: true
    disable_logs: true
    disable_traces: true

transforms:
  filter_transform:
    type: filter
    inputs:
      - dd_agent.metrics
    condition:
      type: "vrl"
      source: '.type != "agent dd sketch"'

sinks:
  file_metrics:
    type: file
    inputs:
      - filter_transform
    path: /Users/peter.ehikhuemen/go/src/github.com/DataDog/vectordotdev/vector/tmp/dd-agent-metrics.log
    encoding:
      codec: json

  otlp_metrics:
    type: opentelemetry
    inputs:
      - filter_transform
    protocol:
      type: http
      uri: http://localhost:9090/api/v1/otlp/v1/metrics
      method: post
      encoding:
        codec: otlp
      request:
        headers:
          content-type: application/x-protobuf

Change Type

Is this a breaking change?

Yes
No

Does this PR include user facing changes?

Yes. Please add a changelog fragment based on our guidelines.
No. A maintainer will apply the no-changelog label to this PR.

References

Notes

Please read our Vector contributor resources.
Do not hesitate to use @vectordotdev/vector to reach out to us regarding this PR.
Some CI checks run only after we manually approve them.
- We recommend adding a pre-push hook, please see this template.
- Alternatively, we recommend running the following locally before pushing to the remote branch:
  - make fmt
  - make check-clippy (if there are failures it's possible some of them can be fixed with make clippy-fix)
  - make test
After a review is requested, please avoid force pushes to help us review incrementally.
- Feel free to push as many commits as you want. They will be squashed into one before merging.
- For example, you can run git merge origin master and git push.
If this PR introduces changes Vector dependencies (modifies Cargo.lock), please
run make build-licenses to regenerate the license inventory and commit the changes (if any). More details on the dd-rust-license-tool.

Adds metric -> OTLP conversion to the OTLP codec's serializer, covering Counter, Gauge, AggregatedHistogram, and AggregatedSummary values via direct prost encoding. Unsupported metric types (Set, Distribution, Sketch) return an error naming the variant. The metric -> OTLP -> metric round trip is deterministic; the reverse direction remains lossy by design (e.g. ExponentialHistogram flattens to AggregatedHistogram).

datadog-vectordotdev · 2026-07-01T21:52:16Z

Tests

🎉 All green!

🧪 All tests passed
❄️ No new flaky tests detected

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 2dd3804 | Docs | Give us feedback!}

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 1e9b90ea1a

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

…ik/OPA-5715/implement-otlp-metric-encoder

…P metric encoder Fold the metric namespace into the OTLP metric name (joined with `.`) so namespaced series such as `vector.requests` and `app.requests` keep distinct OTLP identities instead of collapsing to `requests`. Reject pre-epoch metric timestamps instead of casting a negative `i64` nanosecond count into a far-future `u64`; the encoder now returns a descriptive error so the event is dropped rather than emitted with a corrupt timestamp.

…ik/OPA-5715/implement-otlp-metric-encoder

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: fa8df168a1

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

… and fixed other codex issues

…ik/OPA-5715/implement-otlp-metric-encoder

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: d548decc43

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 5ccc161e79

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: f7ee8b3dc9

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 2af64d1066

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

bruceg

This looks broadly appropriate but I am concerned about some of the inefficiencies caused by intermediate owned values (Vec, clones and structs).

…ik/OPA-5715/implement-otlp-metric-encoder

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: dc23a5351d

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

…ik/OPA-5715/implement-otlp-metric-encoder

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: aec7ac7995

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

bruceg

The behavior and calculations look correct so I'm approving as such. There seems to be a lot of room for optimization that we should return to, though, in the form of excess temporaries and copies and repeat operations on the same data.

…ik/OPA-5715/implement-otlp-metric-encoder

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 7c8be33058

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

…ik/OPA-5715/implement-otlp-metric-encoder

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: c9bbbd8169

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

…ik/OPA-5715/implement-otlp-metric-encoder

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: d36187fc75

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 7533cd5632

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

pront

This looks great overall.

I examined the lifecycle of an event from OTEL to Vector to OTEL. Original:

resource.attributes: service.name = "python-hist-summary"
scope:               name="py-hist-summary" version="1.0"
metric:              name="python.test.histogram"  unit="ms"
histogram:
  aggregationTemporality: 2
  dataPoint:
    attributes:      route = "/api"
    timeUnixNano:    1784658526721324800
    count:           10
    sum:             42.5
    explicitBounds:  [1, 5, 10]
    bucketCounts:    [2, 3, 4, 1]

Final:

{
  "resource":  { "service.name": "python-hist-summary" },
  "scope":     { "name": "py-hist-summary", "version": "1.0" },
  "metric":    { "name": "python.test.histogram", "unit": null },
  "histogram": {
    "aggregationTemporality": 2,
    "dataPoints": [{
      "attributes":     [ { "route": "/api" } ],
      "timeUnixNano":   "1784658526721324800",
      "count":          "10",
      "sum":            42.5,
      "explicitBounds": [1, 5, 10],
      "bucketCounts":   ["2", "3", "4", "1"]
    }]
  }
}

Note that unit (from name="python.test.histogram" unit="ms") is missing. I suspect if the original OTEL event had description that would also be missing. But preserving those isn't trivial and not a blocker for this PR.

Throw error if event timestamp is somehow out of u64 range. Co-authored-by: Pavlos Rontidis <pavlos.rontidis@gmail.com>

add metric type to input types accepted by OtlpSerializer Co-authored-by: Pavlos Rontidis <pavlos.rontidis@gmail.com>

petere-datadog · 2026-07-21T20:34:07Z

This looks great overall.

I examined the lifecycle of an event from OTEL to Vector to OTEL. Original:

resource.attributes: service.name = "python-hist-summary"
scope:               name="py-hist-summary" version="1.0"
metric:              name="python.test.histogram"  unit="ms"
histogram:
  aggregationTemporality: 2
  dataPoint:
    attributes:      route = "/api"
    timeUnixNano:    1784658526721324800
    count:           10
    sum:             42.5
    explicitBounds:  [1, 5, 10]
    bucketCounts:    [2, 3, 4, 1]

Final:

{
  "resource":  { "service.name": "python-hist-summary" },
  "scope":     { "name": "py-hist-summary", "version": "1.0" },
  "metric":    { "name": "python.test.histogram", "unit": null },
  "histogram": {
    "aggregationTemporality": 2,
    "dataPoints": [{
      "attributes":     [ { "route": "/api" } ],
      "timeUnixNano":   "1784658526721324800",
      "count":          "10",
      "sum":            42.5,
      "explicitBounds": [1, 5, 10],
      "bucketCounts":   ["2", "3", "4", "1"]
    }]
  }
}

Note that unit (from name="python.test.histogram" unit="ms") is missing. I suspect if the original OTEL event had description that would also be missing. But preserving those isn't trivial and not a blocker for this PR.

@pront main reason we can't preserve those is they're not currently captured in a MetricEvent, we would have to update that struct or do something interesting with tags

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 15c22f6c36

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

petere-datadog added 2 commits July 1, 2026 17:45

update changelog

1e9b90e

petere-datadog requested a review from a team as a code owner July 1, 2026 21:49

chatgpt-codex-connector Bot reviewed Jul 1, 2026

View reviewed changes

petere-datadog added 5 commits July 7, 2026 14:48

Merge branch 'master' of github.com:vectordotdev/vector into peter.eh…

b54d48c

…ik/OPA-5715/implement-otlp-metric-encoder

handle encoding tagvalueset as OTLP arrayvalue

d3ede6e

fix fmt

d2c4684

Merge branch 'master' of github.com:vectordotdev/vector into peter.eh…

fa8df16

…ik/OPA-5715/implement-otlp-metric-encoder

chatgpt-codex-connector Bot reviewed Jul 7, 2026

View reviewed changes

Comment thread lib/opentelemetry-proto/src/metrics.rs Outdated

Comment thread lib/opentelemetry-proto/src/metrics.rs Outdated

Comment thread lib/opentelemetry-proto/src/common.rs Outdated

Comment thread lib/opentelemetry-proto/src/metrics.rs Outdated

petere-datadog added 2 commits July 8, 2026 13:18

fixed the conversion of icnremental gauges, also did some refactoring…

81da2e0

… and fixed other codex issues

Merge branch 'master' of github.com:vectordotdev/vector into peter.eh…

d548dec

…ik/OPA-5715/implement-otlp-metric-encoder

chatgpt-codex-connector Bot reviewed Jul 8, 2026

View reviewed changes

fix test

5ccc161

chatgpt-codex-connector Bot reviewed Jul 8, 2026

View reviewed changes

fix more validation issues

f7ee8b3

chatgpt-codex-connector Bot reviewed Jul 8, 2026

View reviewed changes

Comment thread lib/opentelemetry-proto/src/metrics.rs Outdated

Comment thread lib/opentelemetry-proto/src/metrics.rs

Comment thread lib/opentelemetry-proto/src/metrics.rs Outdated

add duplicatees validation as well as update is_monotonic check

2af64d1

chatgpt-codex-connector Bot reviewed Jul 8, 2026

View reviewed changes

Comment thread lib/opentelemetry-proto/src/metrics.rs Outdated

update test

4fd4726

bruceg reviewed Jul 8, 2026

View reviewed changes

petere-datadog added 2 commits July 9, 2026 11:40

Merge branch 'master' of github.com:vectordotdev/vector into peter.eh…

01431d0

…ik/OPA-5715/implement-otlp-metric-encoder

do some cleanup, remove unneeded functions, avoid unnecessary cloning

80c6805

github-actions Bot removed the domain: codecs Anything related to Vector's codecs (encoding/decoding) label Jul 9, 2026

reject invalid sum in summary metric. Avoid cloning attrs

dc23a53

chatgpt-codex-connector Bot reviewed Jul 9, 2026

View reviewed changes

Comment thread lib/opentelemetry-proto/src/metrics.rs

Comment thread lib/opentelemetry-proto/src/metrics.rs

Merge branch 'master' of github.com:vectordotdev/vector into peter.eh…

aec7ac7

…ik/OPA-5715/implement-otlp-metric-encoder

chatgpt-codex-connector Bot reviewed Jul 10, 2026

View reviewed changes

Comment thread lib/opentelemetry-proto/src/metrics.rs

Comment thread lib/opentelemetry-proto/src/metrics.rs

bruceg approved these changes Jul 10, 2026

View reviewed changes

Comment thread lib/opentelemetry-proto/src/common.rs

Comment thread lib/codecs/src/encoding/format/otlp.rs

Comment thread lib/codecs/src/encoding/format/otlp.rs

Comment thread lib/opentelemetry-proto/src/metrics.rs

Merge branch 'master' of github.com:vectordotdev/vector into peter.eh…

7c8be33

…ik/OPA-5715/implement-otlp-metric-encoder

chatgpt-codex-connector Bot reviewed Jul 13, 2026

View reviewed changes

Comment thread lib/opentelemetry-proto/src/metrics.rs

Comment thread lib/opentelemetry-proto/src/metrics.rs Outdated

petere-datadog added 2 commits July 14, 2026 08:58

Merge branch 'master' of github.com:vectordotdev/vector into peter.eh…

97f95f9

…ik/OPA-5715/implement-otlp-metric-encoder

Merge branch 'master' of github.com:vectordotdev/vector into peter.eh…

c9bbbd8

…ik/OPA-5715/implement-otlp-metric-encoder

chatgpt-codex-connector Bot reviewed Jul 15, 2026

View reviewed changes

Comment thread lib/opentelemetry-proto/src/metrics.rs Outdated

petere-datadog added 2 commits July 20, 2026 15:57

Merge branch 'master' of github.com:vectordotdev/vector into peter.eh…

d22c3bd

…ik/OPA-5715/implement-otlp-metric-encoder

add NaN checks. Fix issue with shifting time interval for delta metrics

d36187f

chatgpt-codex-connector Bot reviewed Jul 20, 2026

View reviewed changes

Comment thread lib/opentelemetry-proto/src/metrics.rs

thomasqueirozb mentioned this pull request Jul 20, 2026

feat(opentelemetry sink): support legacy nested config fallback and fix gRPC gzip/zstd #25757

Open

4 tasks

reject negative summary sum

7533cd5

chatgpt-codex-connector Bot reviewed Jul 20, 2026

View reviewed changes

Comment thread lib/opentelemetry-proto/src/metrics.rs Outdated

Comment thread lib/opentelemetry-proto/src/metrics.rs

Comment thread lib/opentelemetry-proto/src/metrics.rs Outdated

petere-datadog added 2 commits July 21, 2026 11:44

do not create empty key attributes

77df65f

reject negative counter absolute values

74c3981

pront approved these changes Jul 21, 2026

View reviewed changes

Comment thread lib/codecs/src/encoding/format/otlp.rs Outdated

Comment thread lib/opentelemetry-proto/src/metrics.rs

Comment thread lib/opentelemetry-proto/src/metrics.rs Outdated

petere-datadog and others added 2 commits July 21, 2026 16:30

Update lib/opentelemetry-proto/src/metrics.rs

1e00bbd

Throw error if event timestamp is somehow out of u64 range. Co-authored-by: Pavlos Rontidis <pavlos.rontidis@gmail.com>

Update lib/codecs/src/encoding/format/otlp.rs

15c22f6

add metric type to input types accepted by OtlpSerializer Co-authored-by: Pavlos Rontidis <pavlos.rontidis@gmail.com>

fix fmt issues from applying last commit

2dd3804

chatgpt-codex-connector Bot reviewed Jul 21, 2026

View reviewed changes

Comment thread lib/opentelemetry-proto/src/metrics.rs Outdated

petere-datadog enabled auto-merge July 21, 2026 20:43

petere-datadog added this pull request to the merge queue Jul 21, 2026

Merged via the queue into master with commit b2bf6fc Jul 21, 2026
61 checks passed

petere-datadog deleted the peter.ehik/OPA-5715/implement-otlp-metric-encoder branch July 21, 2026 21:32

github-actions Bot locked and limited conversation to collaborators Jul 21, 2026

Uh oh!

Conversation

petere-datadog commented Jul 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Vector configuration

How did you test this PR?

Change Type

Is this a breaking change?

Does this PR include user facing changes?

References

Notes

Uh oh!

datadog-vectordotdev Bot commented Jul 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

bruceg left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

Uh oh!

petere-datadog commented Jul 1, 2026 •

edited

Loading

datadog-vectordotdev Bot commented Jul 1, 2026 •

edited

Loading

pront left a comment •

edited

Loading