Google Cloud Dataproc Metastore

Dataproc Metastore is a fully managed, highly available, autohealing, serverless, and Apache Hive metastore (HMS) that runs on Google Cloud. For more details, refer to the GCP documentation

Log types

• Platform Logs
• Audit Logs

Setup

You can collect the logs for Sumo Logic's Google Cloud Dataproc Metastore integration by following the below steps.

Configure logs collection

• Collect Audit Logs using the Google Cloud Platform source. These Audit Logs can be accessed based on the permissions and roles. To enable logging for Google Dataproc Metastore, refer to Google documentation. For more detail on Dataproc Metastore operations being audited, refer to audited operations. While creating the sync in GCP, as part of the Choose logs to include in sink section, you can use the following query:

  (resource.type=audited_resource AND resource.labels.service=metastore.googleapis.com)
• Collect Platform Logs using the Google Cloud Platform source. Platform logs include service logs and Metadata federation. While creating the sync in GCP, as part of the Choose logs to include in sink section, you can use the following query:

  resource.type=metastore.googleapis.com/Service OR metastore.googleapis.com/Federation