-
Notifications
You must be signed in to change notification settings - Fork 4.4k
[BEAM-11032] Use metric for Java BigQuery streaming insert API latenc⦠#13491
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking βSign up for GitHubβ, you agree to our terms of service and privacy statement. Weβll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
R: @ajamato Uses Metrics for logging latencies instead of parameters. Reverted BigQueryService API signature changes for histogram and counter. |
@ajamato PTAL |
@ajamato Friendly ping |
sdks/java/core/src/main/java/org/apache/beam/sdk/metrics/DelegatingCounter.java
Outdated
Show resolved
Hide resolved
...ain/java/org/apache/beam/sdk/extensions/gcp/util/LatencyRecordingHttpRequestInitializer.java
Outdated
Show resolved
Hide resolved
sdks/java/core/src/main/java/org/apache/beam/sdk/metrics/Metrics.java
Outdated
Show resolved
Hide resolved
sdks/java/core/src/main/java/org/apache/beam/sdk/metrics/MetricsLogger.java
Show resolved
Hide resolved
@pabloem Would you take a look as well, as a committer. Or lmk if you have someone else in mind on the java side. |
Run Java PreCommit |
@@ -383,4 +409,70 @@ public boolean equals(@Nullable Object object) { | |||
public int hashCode() { | |||
return Objects.hash(stepName, counters, distributions, gauges); | |||
} | |||
|
|||
private boolean equalsMetricName(MetricName metricName, String namespace, String name) { | |||
return (namespace == null || namespace.equals(metricName.getNamespace())) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This equality looks werid, why would it be considered equal if the param is null?
Can you add a clairifying comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah, equals
prefix is misleading. It's more like matching and when the field will be ignored when the parameter is null. I renamed the method.
β¦y logging
Please add a meaningful description for your change here
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
R: @username
).[BEAM-XXX] Fixes bug in ApproximateQuantiles
, where you replaceBEAM-XXX
with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.CHANGES.md
with noteworthy changes.See the Contributor Guide for more tips on how to make review process smoother.
Post-Commit Tests Status (on master branch)
Pre-Commit Tests Status (on master branch)
See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.
GitHub Actions Tests Status (on master branch)
See CI.md for more information about GitHub Actions CI.