Support for tracing. Telemetry data traces, metrics, and logs are often known as the three pillars of observability. Currently, Doris lacks traces telemetry data collection, which makes it difficult to locate slow queries and troubleshoot system bottlenecks. With OpenTelemetry, traces data can be collected to effectively monitor the process of request execution and greatly improve system observability.
Export profile information as traces. The current query profile output text format, query each stage of the time consuming display is not intuitive, and not persistent. Tagging the profile to the trace allows the trace to override the profile and facilitates analysis of slow queries.
Associate traces, metrics and logs. The telemetry data currently collected by Doris is not correlated with each other, and it is impossible to quickly locate one kind of telemetry data to another. By introducing OpenTelemetry, traces, metrics, logs can be correlated. For example, we can inject trace_id and span_id into metrics through exemplars to correlate traces and metrics, and inject trace_id and span_id into logs to correlate traces and logs, so as to quickly locate all telemetry data of the problem.
export profile. the current query profile output text format, query each stage of the time consuming display is not intuitive, and not persistent. Tagging the profile to the trace allows the trace to override the profile and facilitates analysis of slow queries.

Related Research

1. Telemetry

...

Support trace and basic span collection and export：https://github.com/apache/doris/pull/10533
Support span to record query profile related counter information：Support to export span to otel collector, support to filter and process span through otel collector, and support to export span to multiple back-end：https://github.com/apache/doris/pull/10864
Support span to record query profile related counter information：https://github.com/apache/doris/pull/11458
Support exporting span to doris：

...