Quick Local Testing with the OpenTelemetry Collector
Colin J. Ihrig
The OTel Collector is an agent that runs alongside your application. The alternative to using the Collector is to ship telemetry data directly from your application to the location(s) where it will be stored. However, this adds overhead and complexity to your application. As your application scales, it it useful to get the telemetry data out of your application as quickly as possible and let the Collector handle the processing and shipping.
Getting up and running
The OTel Collector is highly configurable. However, sometimes you just want to get up and running locally as quickly as possible. Once you see telemetry data is flowing to the Collector as expected, you can refine your configuration as needed. Follow these steps to get up and running quickly.
Install the OTel Collector. The Getting Started page has all of the necessary instructions for doing this. For local development, you can likely get away with simply downloading from the GitHub Releases page. This post was written using v0.84.0.
Create a configuration file that receives data on the default ports and logs that data to the console. An example configuration file is shown below. This is not a production ready configuration. It was adapted from one of the SigNoz examples.
receivers: otlp: protocols: grpc: endpoint: 127.0.0.1:4317 http: endpoint: 127.0.0.1:4318 processors: batch: send_batch_size: 1000 timeout: 10s exporters: logging: # verbosity of the logging export: detailed, normal, basic verbosity: detailed service: pipelines: metrics: receivers: [otlp] processors: [batch] exporters: [logging] traces: receivers: [otlp] processors: [batch] exporters: [logging] logs: receivers: [otlp] processors: [batch] exporters: [logging]
- Start the OTel Collector with a command similar to the following one.
otelcolis the OTel Collector binary, and
config.yamlis the configuration file created in the previous step.
- Generate telemetry data somehow. Ideally, you should be creating the data in your application, but you can download a telemetry generator like
otelgenand provide artificial data:
./otelgen --otel-exporter-otlp-endpoint 127.0.0.1:4317 --insecure --duration 10 --rate 1 traces multi
If the data is sent to the Collector properly, it should be logged to the console where
otelcol is running.
- Refine the configuration as needed for your use case. See the Configuration page for more details.