Fluent Bit

Seamlessly configure Fluent Bit to forward collected logs to Dynatrace for AI alerting, in-context analysis in the Dynatrace platform, and automation. While Fluent Bit has configurable HTTP output, Dynatrace can be configured as your data's target log management and analytics environment.

Fluent Bit is an open source, lightweight, and multi-platform log processor and forwarder that allows you to collect data/logs from different sources, unify and send them to multiple destinations, and is fully compatible with Docker and Kubernetes environments.

This is intended for users who want to:

Integrate logs collected via Fluent Bit running as a log collector or edge agent. This will enable App Owners, DevOps, and SRE teams to centrally analyze all log data in the context of infrastructure, traces, and applications, build automation, and complement ingested observability signals for AI alerting.

Kubernetes troubleshooting

If you already have Fluent Bit in your tech stack and have made an effort to configure pipelines to contextualize and enrich your log data, but your legacy log tooling is not capable of bringing answers based on logs, Dynatrace Platform will provide automation and problem detection for you.

Let’s take Kubernetes observability as an example.

To ensure Kubernetes platform and workload health with detailed cluster views that show all health-relevant signals of contained resources, including nodes, namespaces, and workloads Dynatrace comes with Kuberentes monitoring & observability

In order to complement observability signals like metrics and basic performance indicators, integrate Kubernetes logs with full Kubernetes context preservation by configuring stream of Kubernetes logs with Fluent Bit

For guided experience with minimal configuration navigate to Dynatrace Kubernetes Application and choose “+ Add cluster”. Refer to Kubernetes app documentation for more details.

Platforms and technologies support

Fluent Bit can be deployed as an edge agent for localized telemetry data handling or utilized as a central aggregator/collector for managing telemetry data across multiple sources and environments.

Just to name few:

• Kafka
• Systemd allows to collect log messages from the Journald deamon
• ElasticSearch

Review the full list of Fluent Bit inputs in Fluent Bit Official Manual

Ingest AWS Fargate logs with Fluent Bit

Fluent Bit can be used as log collector for server-less cloud services to ship logs to external services. Please refer to Ingest AWS Fargate logs with Fluent Bit, for detailed integration instructions.

The Fluent Bit http output plugin allows to forward your logs into a Dynatrace Logs ingestion API endpoint.

• Get a Dynatrace API token with the Ingest Logs scope

Fluent Bit configuraitons

• For Kubernetes' logs integration, please follow the instructions available in Dynatrace documentation, which also covers full Kubernetes context preservation: Stream Kubernetes logs with Fluent Bit

• If you already manage Fluent Bit instance, configure HTTP output plugin by appending the Output section with the configurations described in Dynatrace documentation: Stream logs to Dynatrace with Fluent Bit

Note: You can place your-API-token in the header or as GET variable in URI.

• A Dynatrace API token with the logs.ingest (Ingest Logs) scope
• For Dynatrace SaaS Generic logs ingest endpoint is available in you environement. For Dynatrace managed or if Environment ActiveGate is your choice for an endpoint in local environment, install AG instance (From the main menu in the product go to Manage > Deploy Dynatarce > Install ActiveGate). Generic log ingest API v2 is automatically enabled on ActiveGate.