-
Notifications
You must be signed in to change notification settings - Fork 897
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Otel take 2 #4075
Otel take 2 #4075
Conversation
04c7921
to
3c2f9b2
Compare
metrics/core/src/main/java/org/hyperledger/besu/metrics/opentelemetry/DebugMetricReader.java
Show resolved
Hide resolved
metrics/core/src/main/java/org/hyperledger/besu/metrics/opentelemetry/DebugMetricReader.java
Show resolved
Hide resolved
Ah, I'm still seeing errors in the logs. I need to take another look at it. |
@atoulme since this still needs work - I changed to draft for visibility from the main page |
2d4748e
to
8cfd882
Compare
Tested locally, no more errors logged |
I spun this up on an AWS box (with default config) and still seeing this "Failed to export metrics" error periodically - @atoulme is this expected?
|
config looks like this
|
No it is not. Your config is different than what I used, I'll try it out now. |
I'm not reproducing locally :( Are you using Docker by chance? |
besu is not running in docker. I will try the same procedure with this PR updated with changes from main |
besu --version |
Still seeing that error periodically
|
I've just rerun this test on a goerli canary - still seeing this ERROR log every minute
ERROR log:
|
I have some good news - the sdk folks are working on making it possible to disable the sdk from auto-starting here: https://github.com/open-telemetry/opentelemetry-java/blob/main/sdk-extensions/autoconfigure/README.md#disabling-opentelemetrysdk |
@atoulme are we still waiting on sdk development for this one? |
It looks like that finally landed. |
daf95c5
to
178c8a9
Compare
ran up a node on AWS with this and logging appears normal
|
…istake Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com>
Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com>
Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com>
Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com>
Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com>
* Revert "Revert "Upgrade OpenTelemetry (hyperledger#3675)" (hyperledger#4031)" This reverts commit 17de636. Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * Make sure we don't initialize the OpenTelemetry global singleton by mistake Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * disable global otel singleton explicitly Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * make sure to set GlobalOpenTelemetry at most once to avoid test failures Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * reset for tests Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * fix changelog Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> Signed-off-by: wcgcyx <wcgcyx@gmail.com>
commit
|
@holiman please open an issue and assign to me thanks! |
Way ahead of you :) Don't have rights to assign on this repo though. |
* Revert "Revert "Upgrade OpenTelemetry (hyperledger#3675)" (hyperledger#4031)" This reverts commit 17de636. Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * Make sure we don't initialize the OpenTelemetry global singleton by mistake Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * disable global otel singleton explicitly Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * make sure to set GlobalOpenTelemetry at most once to avoid test failures Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * reset for tests Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * fix changelog Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> Signed-off-by: Sally MacFarlane <macfarla.github@gmail.com>
* Revert "Revert "Upgrade OpenTelemetry (hyperledger#3675)" (hyperledger#4031)" This reverts commit 17de636. Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * Make sure we don't initialize the OpenTelemetry global singleton by mistake Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * disable global otel singleton explicitly Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * make sure to set GlobalOpenTelemetry at most once to avoid test failures Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * reset for tests Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> * fix changelog Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com> Signed-off-by: Antoine Toulme <antoine@lunar-ocean.com>
PR description
Fixes the OpenTelemetry configuration so it doesn't initialize the global opentelemetry singleton when getting the tracer.
Documentation
doc-change-required
label to this PR ifupdates are required.
Changelog