...
- Application: General applications, such as doris' fe and be.
- OTel Libraty: Also known as SDK, it is responsible for collecting and exporting telemetry data in the program.
- OTel Collector: The OpenTelemetry Collector offers a vendor-agnostic implementation of how to receive, process and export telemetry data. It removes the need to run, operate, and maintain multiple agents/collectors. This works with improved scalability and supports open-source observability data formats (e.g. Jaeger, Prometheus, Fluent Bit, etc.) sending to one or more open-source or commercial back-ends.
- Backends: Responsible for persisting and presenting telemetry data, and providing the ability to analyze telemetry data. such as zipkin, prometheus, etc.
Detailed Design
Query trace collection and export:
1-creating trace
2-collecting span of fe
3-collecting span of be
4-propagating trace between fe and be
5-exporting span
Scheduling
specific implementation steps and approximate scheduling.