Skip to Content

Observability & Monitoring

Send Databrain data to Kloudfuse

Send traces, metrics and logs from a self-hosted Databrain backend to Kloudfuse.

Before you start

Steps

  1. Run an OpenTelemetry Collector (otel/opentelemetry-collector-contrib) with this config. Set KLOUDFUSE_HOST on the Collector.

    receivers:
      otlp:
        protocols:
          http:
            endpoint: 0.0.0.0:4318
    
    processors:
      batch: {}
      resource:
        attributes:
          - key: kf_platform
            value: docker
            action: upsert
    
    exporters:
      otlphttp/kloudfuse:
        traces_endpoint: https://${env:KLOUDFUSE_HOST}/ingester/otlp/traces
        metrics_endpoint: https://${env:KLOUDFUSE_HOST}/ingester/otlp/metrics
        logs_endpoint: https://${env:KLOUDFUSE_HOST}/ingester/otlp/v1/logs
    
    service:
      pipelines:
        traces:
          receivers: [otlp]
          processors: [resource, batch]
          exporters: [otlphttp/kloudfuse]
        metrics:
          receivers: [otlp]
          processors: [resource, batch]
          exporters: [otlphttp/kloudfuse]
        logs:
          receivers: [otlp]
          processors: [resource, batch]
          exporters: [otlphttp/kloudfuse]

    Set kf_platform to kubernetes or host if you do not run on Docker. The paths depend on your Kloudfuse version, so check them in the Kloudfuse docs.

  2. Set these on the Databrain backend and restart it:

    OTEL_ENABLED=true
    OTEL_EXPORTER_OTLP_ENDPOINT=http://otel-collector:4318

Check it

In Kloudfuse, look for the service databrain-api in APM, and for its logs and metrics.

If nothing arrives, check the Collector log first, then see Observability setup. Kloudfuse reference: OpenTelemetry Collector on Docker.