Skip to technology filters Skip to main content
Dynatrace Hub

Extend the platform,
empower your team.

Popular searches:
Home hero bg
Google DataprocGoogle Dataproc
Google Dataproc

Google Dataproc

Get insights into Google Dataproc service metrics collected from the Google Operations API to ensure health of your cloud infrastructure.

Extension
Free trial
  • Product information
  • Release notes

Overview

This Dynatrace extension leverages data collected from the Google Operations API to constantly monitor health and performance of Google Dataproc services. This extension combines all relevant data into pre-configured dashboards and provides alerting and event tracking.

This is intended for users, who want to:

  • enrich their monitoring data with metrics and logs from Google Operations API

This enables you to:

  • View and analyze 21 metrics that are specific to Google Dataproc, like HDFS DataNodes, HDFS capacity, HDFS storage utilization, and more.

  • Build custom dashboards for your cloud infrastructure.

  • Analyze Google Dataproc logs.

  • Set custom alerts that trigger remediation workflows.

Google Dataproc metric and log ingestion requires advanced GCP integration.

Compatibility requirements

  • Dynatrace GCP integration version 1.0.0+. To enable metric and log ingestion, see Dynatrace Documentation.
  • Dynatrace version 1.230+

Details

This extension package contains:

  • Configuration for Google Dataproc metric ingest based on your selected feature set (see full list of feature sets and metrics)

To provide correlation and causation analysis all ingested metrics and logs are analyzed by the Dynatrace Davis AI engine, which consumes DDUs.

Get started

To add this extension to your environment:

  • Follow the instructions detailed in Dynatrace Documentation. (Ignore the “Add to environment” button below.)
  • Ensure that you have GCP integration running in your environment and that Google Dataproc service is configured.

Following GCP integration and Google Dataproc configuration:

  • The first data points will be ingested by Dynatrace Davis within ~5 minutes.
  • Explore Google Dataproc metrics in Data Explorer and create custom charts.
  • Set custom events for alerting
Dynatrace
By Dynatrace
Dynatrace support center
Subscribe to new releases
Copy to clipboard

Extension content

Content typeNumber of items included
metric metadata
26
screen injections
1
generic relationship
1
screen actions
1
screen layout
1
generic type
2
screen entities lists
1

Feature sets

Below is a complete list of the feature sets provided in this version. To ensure a good fit for your needs, individual feature sets can be activated and deactivated by your administrator during configuration.

Feature setsNumber of metrics included
Metric nameMetric keyDescriptionUnit
Cluster capacity deviationcloud.gcp.dataproc_googleapis_com.cluster.capacity_deviation-Count
HDFS DataNodescloud.gcp.dataproc_googleapis_com.cluster.hdfs.datanodes-Count
HDFS capacitycloud.gcp.dataproc_googleapis_com.cluster.hdfs.storage_capacity-GibiByte
HDFS storage utilizationcloud.gcp.dataproc_googleapis_com.cluster.hdfs.storage_utilization-Count
Unhealthy HDFS blocks by statuscloud.gcp.dataproc_googleapis_com.cluster.hdfs.unhealthy_blocks-Count
Job durationcloud.gcp.dataproc_googleapis_com.cluster.job.completion_time-Second
Job state durationcloud.gcp.dataproc_googleapis_com.cluster.job.duration-Second
Failed jobscloud.gcp.dataproc_googleapis_com.cluster.job.failed_count-Count
Running jobscloud.gcp.dataproc_googleapis_com.cluster.job.running_count.gauge-Count
Submitted jobscloud.gcp.dataproc_googleapis_com.cluster.job.submitted_count-Count
Expected Nodescloud.gcp.dataproc_googleapis_com.cluster.nodes.expected-Count
Failed Nodescloud.gcp.dataproc_googleapis_com.cluster.nodes.failed_count-Count
Recovered Nodescloud.gcp.dataproc_googleapis_com.cluster.nodes.recovered_count-Count
Running Nodescloud.gcp.dataproc_googleapis_com.cluster.nodes.running-Count
Operation durationcloud.gcp.dataproc_googleapis_com.cluster.operation.completion_time-Second
Operation state durationcloud.gcp.dataproc_googleapis_com.cluster.operation.duration-Second
Failed operationscloud.gcp.dataproc_googleapis_com.cluster.operation.failed_count-Count
Running operationscloud.gcp.dataproc_googleapis_com.cluster.operation.running_count.gauge-Count
Submitted operationscloud.gcp.dataproc_googleapis_com.cluster.operation.submitted_count-Count
YARN allocated memory percentagecloud.gcp.dataproc_googleapis_com.cluster.yarn.allocated_memory_percentage-Count
YARN active applicationscloud.gcp.dataproc_googleapis_com.cluster.yarn.apps-Count
YARN containerscloud.gcp.dataproc_googleapis_com.cluster.yarn.containers-Count
YARN memory sizecloud.gcp.dataproc_googleapis_com.cluster.yarn.memory_size-GibiByte
YARN NodeManagerscloud.gcp.dataproc_googleapis_com.cluster.yarn.nodemanagers-Count
YARN pending memory sizecloud.gcp.dataproc_googleapis_com.cluster.yarn.pending_memory_size-GibiByte
YARN virtual corescloud.gcp.dataproc_googleapis_com.cluster.yarn.virtual_cores-Count

Full version history

To have more information on how to install the downloaded package, please follow the instructions on this page.
ReleaseDate

Full version history

Version 1.1.0

Updated

  • Service entity for Dataproc cluster
  • Updated set of supported metrics
  • Relationships between service entity and project
  • Log linking for service entity
  • Basic UI (list on GCP project details page)

Full version history

Version 1.0.4

Updated

  • Feature sets & metrics section in HUB Product Information page

Full version history

Version 1.0.3

Fixed

  • Empty feature sets in extension description

Full version history

Version 1.0.2

Added

  • Release notes to published extension
  • Auto publishing extensions to Hub

Full version history

No release notes

Full version history

No release notes

Dynatrace Hub
Hub HomeGet data into DynatraceBuild your own app
Log Management and AnalyticsKubernetesAI/ML ObservabilityInfrastructure ObservabilitySoftware DeliveryApplication ObservabilityApplication SecurityDigital ExperienceBusiness Analytics
Filter
Type
Built and maintained by
Deployment model
SaaS
  • SaaS
  • Managed
Partner FinderBecome a partnerDynatrace Developer

All

1 Results filtered by:

Tricentis NeoLoad logo

Tricentis NeoLoad

Automated Load Testing tool enabling you to run Continuous Performance Testing.

Reach out to certified Dynatrace partners to solve your unique use-case

Spica Solutions logo

Spica Solutions

Certified individuals: 30Endorsements: Services Endorsed Partner
Authorized Sales Partner
Alanata logo

Alanata

Certified individuals: 30Endorsements: Services Endorsed Partner
Premier Sales Partner
avodaq AG logo

avodaq AG

Certified individuals: 31Endorsements: Services Endorsed Partner
Advanced Sales Partner
Moviri logo

Moviri

Certified individuals: 14
Advanced Sales Partner
AskMe Solutions & Consultants Co Ltd logo

AskMe Solutions & Consultants Co Ltd

Certified individuals: 30Endorsements: Services Endorsed Partner
Authorized Sales Partner
Eviden logo

Eviden

Certified individuals: 79Endorsements: Services Endorsed Partner
Premier Sales Partner
Omnilogy logo

Omnilogy

Certified individuals: 38Endorsements: Services Endorsed Partner
Premier Sales Partner
Matrix logo

Matrix

Certified individuals: 14
Premier Sales Partner
Phenisys logo

Phenisys

Certified individuals: 32Endorsements: Services Endorsed Partner
Premier Sales Partner
Spindox logo

Spindox

Certified individuals: 11
Authorized Sales Partner