Is it Observable

Episode : Collecting logs with the OpenTelemetry Logs

This repository contains the files utilized during the tutorial presented in the dedicated IsItObservable episode related to the episode explaining how to collect logs with the OpenTelemtry collector. this tutorial will also utilize the OpenTelemetry Transformation Language.

This repository showcase the usage of the openTelemetry collector with :

• The OpenTelemetry demo
• Dynatrace

We will send all Telemetry data produced by otel-demo to Dynatrace.

Prerequisite

The following tools need to be install on your machine :

• jq
• kubectl
• git
• gcloud ( if you are using GKE)
• Helm

1.Create a Google Cloud Platform Project

PROJECT_ID="<your-project-id>"
gcloud services enable container.googleapis.com --project ${PROJECT_ID}
gcloud services enable monitoring.googleapis.com \
cloudtrace.googleapis.com \
clouddebugger.googleapis.com \
cloudprofiler.googleapis.com \
--project ${PROJECT_ID}

2.Create a GKE cluster

ZONE=europe-west3-a
NAME=isitobservable-otel-logs
gcloud container clusters create ${NAME} --zone=${ZONE} --machine-type=e2-standard-4 --num-nodes=2

Getting started

Dynatrace Tenant

1. Dynatrace Tenant - start a trial

If you don't have any Dynatrace tenant , then i suggest to create a trial using the following link : Dynatrace Trial Once you have your Tenant save the Dynatrace tenant url in the variable DT_TENANT_URL (for example : https://dedededfrf.live.dynatrace.com)

DT_TENANT_URL=<YOUR TENANT Host>

2. Create the Dynatrace API Tokens

Create a Dynatrace token with the following scope ( left menu Acces Token):

• ingest metrics
• ingest OpenTelemetry traces
• ingest logs

Save the value of the token . We will use it later to store in a k8S secret

DATA_INGEST_TOKEN=<YOUR TOKEN VALUE>

Kuma

1. Download kumactl

curl -L https://kuma.io/installer.sh | VERSION=2.5.0 sh -

This command download the latest version of kuma ( in our case kuma 2.4.3) compatible with our operating system. 2. Add kumactl to your PATH

cd kuma-2.5.0/bin

this directory contains samples with addons . We will refer to it later.

export PATH=$PWD:$PATH

Clone the Github Repository

https://github.com/isItObservable/openTelemetry-logs
cd openTelemetry-logs

Deploy most of the components

The application will deploy the entire environment:

chmod 777 deployment.sh
./deployment.sh   --dthost "${DT_TENANT_URL}" --dttoken "${DATA_INGEST_TOKEN}"