Extend the platform,
empower your team.
Stream AWS services logs collected in CloudWatch or directly via Firehose
TechnologyAmazon CloudWatch is the most common method of collecting logs across your AWS footprint. As a native tool, it supports a wide range of AWS resources, applications, and services and is chosen by many enterprises. Amazon Data Firehose is a common solution to stream CloudWatch logs from AWS to an observability platform like Dynatrace. This fully managed native service is indispensable for streaming high-frequency logs collected by CloudWatch.
Developers, SREs, and DevOps engineers need cloud logs in an integrated observability platform to monitor the whole software development lifecycle. Dynatrace comes with the automation for root cause analysis of the SLO violations, ensures visibility on the application landscape to fix problems efficiently, and minimizes production costs by cutting down on errors.
In some deployment scenarios, you might skip CloudWatch altogether. Take the example of Amazon Virtual Private Cloud (VPC) flow logs, which provide insights into the IP traffic of your network interfaces. VPC flow logs are the source that enable troubleshooting connectivity issues, security incident investigations, detecting intrusions, or managing access control issues. VPC flow logs can be massive in volume as your cloud deployment footprint grows, and direct streaming these with Amazon Data Firehose can be the most cost-effective method.
After a successful Amazon Data Firehose configuration, you can analyse your cloud logs in Dynatrace to fulfill troubleshooting, analytical, and security use cases.
Setting up a direct ingest of AWS logs forwarded via Amazon Data Firehose takes just a few simple steps to start log analysis in Dynatrace with topology context.
Get API key to ingest logs.
Configure forwarding of data streams defined in CloudWatch log groups.
Choose the source and set up the destination to configure the Firehose in AWS console UI.
* Data Firehose stream requires a trust relationship with CloudWatch through an IAM role. Follow instructions available in [Dynatrace documentation](https://docs.dynatrace.com/docs/observe-and-explore/logs/lma-log-ingestion-via-api/lma-stream-logs-with-firehose#create-amazon-data-firehose-delivery-stream) to create proper access and Firehose configurations.
Follow instructions on Stream logs via Amazon Data Firehose documentation page to set up integration.
See Figures 1 and 2 for Amazon Firehose streaming configuration.
Monitoring service for AWS cloud resources and the applications you run on AWS.
Fully managed service for delivering real-time streaming data.
Reliable, scalable, and inexpensive cloud computing services.
Monitor, store, and access your log files from instances, AWS CloudTrail, Route 53, and other sources.
Route traffic, monitor clouds and remote technologies & run Synthetic monitors