OpenPipeline

OpenPipeline is one of the built-in apps shipped with Dynatrace and focuses on configuring all aspects of ingesting, processing, and persisting streaming data into Dynatrace. It addresses the need to support the highest throughput and processing demands, ensures compliant and secure ingest, allows for easy data pipe management, and helps improve the quality of your data.

OpenPipeline enables you to:

• mask and filter records to remove sensitive data and comply with security and privacy requirements
• parse, add, remove, and rename fields to reshape or normalize the data format
• aggregate metrics from records for easier and faster query and dashboard display
• convert a record to a different data type for domain-specific usage (eg create a business event out of a log record)
• set security-specific meta-data for defining record-based permissions
• assign data to Grail buckets to comply with proper retention time

At launch, OpenPipelines supports logs, events, and business data with more data types to come soon.

OpenPipeline comes preinstalled with all Dynatrace SaaS environments. Launch the app, send a basic event to Grail, and add parsing or metric extraction from a simple log line.