Extend the platform,
empower your team.
Stream log data from Amazon S3 to Dynatrace for analysis and automation.
TechnologyAmazon S3 is a popular storage location for AWS services and third party solutions, which can be easily integrated with Dynatrace Grail™ data lakehouse. This allows you to answer any question at any time using log data while avoiding the complexity of storage management.
The Amazon S3 log forwarder can ingest any text- or JSON-formatted logs, which unlocks not only log data from AWS services but also from common third-party logs. Service providers such as Akamai, Fastly, Netlify, open source tools like Apache Airflow, and many others have built-in log delivery integration with S3. The Dynatrace AWS S3 log forwarder is designed to be extensible, so you can customize ingestion settings to fit your specific use cases as well as add custom attributes to your logs.
We designed the Dynatrace Amazon S3 log forwarder to scale up to meet the demands of our largest customers, some of whom operate thousands of AWS accounts. Dynatrace Amazon S3 log forwarder has built-in support for log ingestion from multiple AWS Accounts and AWS regions with a single log forwarder deployment.
The S3 log forwarder also keeps the metadata of log messages, so the originating AWS account and region as well as service-specific attributes like resource ID, are preserved. This makes it possible to tie log messages back to the apps, infrastructure, and cloud services where they originated and enables the unified observability of the Dynatrace platform.
To learn about deployment instructions, forwarder’s architecture, and supported AWS services, discover Dynatrace Amazon S3 Log forwarder in Github.
Refer to Log ingestion from Amazon S3 documentation page to learn about available features.
S3 log forwarder integration is based on log ingestion API. Refer to the documentation for overview and configuration details: Generic log ingestion.
Get a Dynatrace API token with the logs.ingest (Ingest Logs) scope to integrate with Dynatrace generic log ingest API.