Skip to content

Feat/opentelemetry monitoring #50

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
rahulghangas wants to merge 12 commits into
base: main
Choose a base branch
from
Open

Feat/opentelemetry monitoring #50

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
ba73bf8
feat: add OpenTelemetry dependencies
BornPsych Mar 25, 2026
71b72fe
feat: add OTel config, TOML template, and CLI flags
BornPsych Mar 25, 2026
c876752
feat: add OTel initialization and server startup wiring
BornPsych Mar 25, 2026
f49eddd
feat: instrument erc20 and feemarket modules with OTel
BornPsych Mar 25, 2026
f422ec7
feat: instrument ibc, precisebank, and vm modules with OTel
BornPsych Mar 25, 2026
a33636c
feat: add monitoring stack and OTel flags to startup scripts
BornPsych Mar 25, 2026
ccbfa5f
feat: add instance-id config and simplify OTel initialization
BornPsych Apr 1, 2026
778e3ca
fix: optimize metric instrumentation and fix naming conventions
BornPsych Apr 1, 2026
25e2569
refactor: replace loki/promtail with node-exporter and update configs
BornPsych Apr 1, 2026
f601b5e
feat: add prometheus recording rules and scrape targets
BornPsych Apr 1, 2026
b2f736b
feat: add grafana dashboards and alerting rules
BornPsych Apr 1, 2026
3480cb0
feat: enable metrics in wrapper script and update docs
BornPsych Apr 1, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 13 additions & 0 deletions contrib/images/evmd-env/wrapper.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,19 @@ fi

export EVMDHOME="/data/node${ID}/evmd"

# Enable Prometheus metrics in CometBFT config
CONFIG_TOML="${EVMDHOME}/config/config.toml"
if [ -f "${CONFIG_TOML}" ]; then
sed -i 's/prometheus = false/prometheus = true/' "${CONFIG_TOML}"
fi

# Enable SDK telemetry and set OTel instance ID
APP_TOML="${EVMDHOME}/config/app.toml"
if [ -f "${APP_TOML}" ]; then
sed -i '/^\[telemetry\]/,/^\[/ s/enabled = false/enabled = true/' "${APP_TOML}"
sed -i "s/instance-id = \"\"/instance-id = \"validator-${ID}\"/" "${APP_TOML}"
fi

if [ -d "$(dirname "${EVMDHOME}"/"${LOG}")" ]; then
"${BINARY}" --home "${EVMDHOME}" "$@" | tee "${EVMDHOME}/${LOG}"
else
Expand Down
16 changes: 12 additions & 4 deletions docker-compose.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ services:
container_name: evmdnode0
image: "cosmos/evmd"
entrypoint: ["/usr/bin/wrapper.sh"]
command: ["start", "--chain-id", "local-4221", "--json-rpc.api", "eth,txpool,personal,net,debug,web3"]
command: ["start", "--chain-id", "local-4221", "--json-rpc.api", "eth,txpool,personal,net,debug,web3", "--metrics", "--otel.enable", "--otel.endpoint", "host.docker.internal:4317", "--otel.insecure"]
environment:
- DEBUG=0
- ID=0
Expand All @@ -16,10 +16,12 @@ services:
- seccomp:unconfined
ports:
- "26656-26657:26656-26657"
- "26660:26660"
- "1317:1317"
- "9090:9090"
- "2345:2345"
- "6065:6065"
- "8100:8100"
- "8545-8546:8545-8546"
volumes:
- ./.testnets:/data:Z
Expand All @@ -31,7 +33,7 @@ services:
container_name: evmdnode1
image: "cosmos/evmd"
entrypoint: ["/usr/bin/wrapper.sh"]
command: ["start", "--chain-id", "local-4221", "--json-rpc.api", "eth,txpool,personal,net,debug,web3"]
command: ["start", "--chain-id", "local-4221", "--json-rpc.api", "eth,txpool,personal,net,debug,web3", "--metrics", "--otel.enable", "--otel.endpoint", "host.docker.internal:4317", "--otel.insecure"]
environment:
- DEBUG=0
- ID=1
Expand All @@ -42,10 +44,12 @@ services:
- seccomp:unconfined
ports:
- "26666-26667:26656-26657"
- "26661:26660"
- "1318:1317"
- "9091:9090"
- "2346:2345"
- "6075:6065"
- "8101:8100"
- "8555-8556:8545-8546"
volumes:
- ./.testnets:/data:Z
Expand All @@ -57,7 +61,7 @@ services:
container_name: evmdnode2
image: "cosmos/evmd"
entrypoint: ["/usr/bin/wrapper.sh"]
command: ["start", "--chain-id", "local-4221", "--json-rpc.api", "eth,txpool,personal,net,debug,web3"]
command: ["start", "--chain-id", "local-4221", "--json-rpc.api", "eth,txpool,personal,net,debug,web3", "--metrics", "--otel.enable", "--otel.endpoint", "host.docker.internal:4317", "--otel.insecure"]
environment:
- DEBUG=0
- ID=2
Expand All @@ -68,10 +72,12 @@ services:
- seccomp:unconfined
ports:
- "26676-26677:26656-26657"
- "26662:26660"
- "1319:1317"
- "9092:9090"
- "2347:2345"
- "6085:6065"
- "8102:8100"
- "8565-8566:8545-8546"
volumes:
- ./.testnets:/data:Z
Expand All @@ -83,7 +89,7 @@ services:
container_name: evmdnode3
image: "cosmos/evmd"
entrypoint: ["/usr/bin/wrapper.sh"]
command: ["start", "--chain-id", "local-4221", "--json-rpc.api", "eth,txpool,personal,net,debug,web3"]
command: ["start", "--chain-id", "local-4221", "--json-rpc.api", "eth,txpool,personal,net,debug,web3", "--metrics", "--otel.enable", "--otel.endpoint", "host.docker.internal:4317", "--otel.insecure"]
environment:
- DEBUG=0
- ID=3
Expand All @@ -94,10 +100,12 @@ services:
- seccomp:unconfined
ports:
- "26686-26687:26656-26657"
- "26663:26660"
- "1320:1317"
- "9093:9090"
- "2348:2345"
- "6095:6065"
- "8103:8100"
- "8575-8576:8545-8546"
volumes:
- ./.testnets:/data:Z
Expand Down
2 changes: 2 additions & 0 deletions evmd/config/config.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,7 @@ func InitAppConfig(denom string, evmChainID uint64) (string, interface{}) {
EVM: *evmCfg,
JSONRPC: *cosmosevmserverconfig.DefaultJSONRPCConfig(),
TLS: *cosmosevmserverconfig.DefaultTLSConfig(),
OTel: *cosmosevmserverconfig.DefaultOTelConfig(),
}

return EVMAppTemplate, customAppConfig
Expand All @@ -53,6 +54,7 @@ type EVMAppConfig struct {
EVM cosmosevmserverconfig.EVMConfig
JSONRPC cosmosevmserverconfig.JSONRPCConfig
TLS cosmosevmserverconfig.TLSConfig
OTel cosmosevmserverconfig.OTelConfig
}

const EVMAppTemplate = serverconfig.DefaultConfigTemplate + cosmosevmserverconfig.DefaultEVMConfigTemplate
46 changes: 23 additions & 23 deletions evmd/go.mod
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,11 +30,11 @@ require (
github.com/stretchr/testify v1.11.1
github.com/xrplevm/node/v10 v10.0.3
golang.org/x/sync v0.19.0
google.golang.org/grpc v1.78.0
google.golang.org/grpc v1.79.2
)

require (
cel.dev/expr v0.24.0 // indirect
cel.dev/expr v0.25.1 // indirect
cloud.google.com/go v0.123.0 // indirect
cloud.google.com/go/auth v0.17.0 // indirect
cloud.google.com/go/auth/oauth2adapt v0.2.8 // indirect
Expand Down Expand Up @@ -91,7 +91,7 @@ require (
github.com/cespare/xxhash/v2 v2.3.0 // indirect
github.com/chzyer/readline v1.5.1 // indirect
github.com/cloudwego/base64x v0.1.6 // indirect
github.com/cncf/xds/go v0.0.0-20251022180443-0feb69152e9f // indirect
github.com/cncf/xds/go v0.0.0-20251210132809-ee656c7534f5 // indirect
github.com/cockroachdb/apd/v2 v2.0.2 // indirect
github.com/cockroachdb/errors v1.12.0 // indirect
github.com/cockroachdb/fifo v0.0.0-20240816210425-c5d0cb0b6fc0 // indirect
Expand Down Expand Up @@ -125,8 +125,8 @@ require (
github.com/dvsekhvalnov/jose2go v1.7.0 // indirect
github.com/ebitengine/purego v0.9.1 // indirect
github.com/emicklei/dot v1.8.0 // indirect
github.com/envoyproxy/go-control-plane/envoy v1.35.0 // indirect
github.com/envoyproxy/protoc-gen-validate v1.2.1 // indirect
github.com/envoyproxy/go-control-plane/envoy v1.36.0 // indirect
github.com/envoyproxy/protoc-gen-validate v1.3.0 // indirect
github.com/ethereum/c-kzg-4844/v2 v2.1.0 // indirect
github.com/ethereum/go-verkle v0.2.2 // indirect
github.com/fatih/color v1.18.0 // indirect
Expand Down Expand Up @@ -165,7 +165,7 @@ require (
github.com/gorilla/websocket v1.5.3 // indirect
github.com/grpc-ecosystem/go-grpc-middleware v1.4.0 // indirect
github.com/grpc-ecosystem/grpc-gateway v1.16.0 // indirect
github.com/grpc-ecosystem/grpc-gateway/v2 v2.27.3 // indirect
github.com/grpc-ecosystem/grpc-gateway/v2 v2.28.0 // indirect
github.com/gsterjov/go-libsecret v0.0.0-20161001094733-a6f4afe4910c // indirect
github.com/hashicorp/aws-sdk-go-base/v2 v2.0.0-beta.70 // indirect
github.com/hashicorp/go-cleanhttp v0.5.2 // indirect
Expand Down Expand Up @@ -259,32 +259,32 @@ require (
github.com/zondax/ledger-go v1.0.1 // indirect
go.etcd.io/bbolt v1.4.0 // indirect
go.opentelemetry.io/auto/sdk v1.2.1 // indirect
go.opentelemetry.io/contrib/detectors/gcp v1.38.0 // indirect
go.opentelemetry.io/contrib/detectors/gcp v1.39.0 // indirect
go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc v0.64.0 // indirect
go.opentelemetry.io/contrib/instrumentation/host v0.64.0 // indirect
go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp v0.62.0 // indirect
go.opentelemetry.io/contrib/instrumentation/runtime v0.64.0 // indirect
go.opentelemetry.io/contrib/otelconf v0.19.0 // indirect
go.opentelemetry.io/contrib/propagators/b3 v1.39.0 // indirect
go.opentelemetry.io/contrib/propagators/jaeger v1.39.0 // indirect
go.opentelemetry.io/otel v1.39.0 // indirect
go.opentelemetry.io/otel v1.42.0 // indirect
go.opentelemetry.io/otel/exporters/otlp/otlplog/otlploggrpc v0.15.0 // indirect
go.opentelemetry.io/otel/exporters/otlp/otlplog/otlploghttp v0.15.0 // indirect
go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetricgrpc v1.39.0 // indirect
go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp v1.39.0 // indirect
go.opentelemetry.io/otel/exporters/otlp/otlptrace v1.39.0 // indirect
go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc v1.39.0 // indirect
go.opentelemetry.io/otel/exporters/otlp/otlptrace v1.42.0 // indirect
go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc v1.42.0 // indirect
go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp v1.39.0 // indirect
go.opentelemetry.io/otel/exporters/prometheus v0.61.0 // indirect
go.opentelemetry.io/otel/exporters/stdout/stdoutlog v0.15.0 // indirect
go.opentelemetry.io/otel/exporters/stdout/stdoutmetric v1.39.0 // indirect
go.opentelemetry.io/otel/exporters/stdout/stdouttrace v1.39.0 // indirect
go.opentelemetry.io/otel/log v0.15.0 // indirect
go.opentelemetry.io/otel/metric v1.39.0 // indirect
go.opentelemetry.io/otel/sdk v1.39.0 // indirect
go.opentelemetry.io/otel/metric v1.42.0 // indirect
go.opentelemetry.io/otel/sdk v1.42.0 // indirect
go.opentelemetry.io/otel/sdk/log v0.15.0 // indirect
go.opentelemetry.io/otel/sdk/metric v1.39.0 // indirect
go.opentelemetry.io/otel/trace v1.39.0 // indirect
go.opentelemetry.io/otel/sdk/metric v1.42.0 // indirect
go.opentelemetry.io/otel/trace v1.42.0 // indirect
go.opentelemetry.io/proto/otlp v1.9.0 // indirect
go.uber.org/automaxprocs v1.6.0 // indirect
go.uber.org/mock v0.6.0 // indirect
Expand All @@ -293,19 +293,19 @@ require (
go.yaml.in/yaml/v2 v2.4.3 // indirect
go.yaml.in/yaml/v3 v3.0.4 // indirect
golang.org/x/arch v0.21.0 // indirect
golang.org/x/crypto v0.47.0 // indirect
golang.org/x/crypto v0.48.0 // indirect
golang.org/x/exp v0.0.0-20250506013437-ce4c2cf36ca6 // indirect
golang.org/x/net v0.48.0 // indirect
golang.org/x/oauth2 v0.34.0 // indirect
golang.org/x/sys v0.40.0 // indirect
golang.org/x/term v0.39.0 // indirect
golang.org/x/text v0.33.0 // indirect
golang.org/x/net v0.51.0 // indirect
golang.org/x/oauth2 v0.35.0 // indirect
golang.org/x/sys v0.41.0 // indirect
golang.org/x/term v0.40.0 // indirect
golang.org/x/text v0.34.0 // indirect
golang.org/x/time v0.14.0 // indirect
golang.org/x/tools v0.40.0 // indirect
golang.org/x/tools v0.41.0 // indirect
google.golang.org/api v0.256.0 // indirect
google.golang.org/genproto v0.0.0-20250922171735-9219d122eba9 // indirect
google.golang.org/genproto/googleapis/api v0.0.0-20251202230838-ff82c1b0f217 // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20251202230838-ff82c1b0f217 // indirect
google.golang.org/genproto/googleapis/api v0.0.0-20260209200024-4cfbd4190f57 // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20260209200024-4cfbd4190f57 // indirect
google.golang.org/protobuf v1.36.11 // indirect
gopkg.in/yaml.v2 v2.4.0 // indirect
gopkg.in/yaml.v3 v3.0.1 // indirect
Expand Down
Loading
Loading