New Relic's integrations with the Google Cloud Platform (GCP) include an integration to report Google Cloud Pub/Sub data to New Relic. This document explains how to activate the GCP Pub/Sub integration and describes the data that will be reported.
Features
As part of the Google Cloud stream analytics solution, the Cloud Pub/Sub service ingests and delivers event streams for quick data processing and analysis.
Activate integration
To enable the integration follow standard procedures to connect your GCP service to New Relic.
Polling frequency
New Relic integrations query your GCP services according to a polling interval, which varies depending on the integration. The polling frequency for Google Cloud Pub/Sub is five minutes. The resolution is 1 data point every minute.
Find and use data
After activating the integration and waiting a few minutes (based on the polling frequency), data will appear in the New Relic UI. To find and use your data, including links to your and alert settings, go to one.newrelic.com > All capabilities > Infrastructure > GCP > (select an integration).
Metric data
Pub/Sub topics are named entities that represent feeds of messages, and subscriptions are named entities that represent message destinations on a particular topic.
To view metric data for your GCP Pub/Sub integration in New Relic, create NRQL queries for GcpPubSubTopicSample and GcpPubSubSubscriptionSample events and their related attributes.
GcpPubSubTopicSample
Query GcpPubSubTopicSample events in New Relic to view data for the following attributes:
Attribute | Description |
|---|---|
| Cost of operations, measured in bytes. This is used to measure utilization for quotas. |
| Cumulative count of configuration changes, grouped by operation type and result. |
| Distribution of publish message sizes (in bytes). |
| Number of acknowledged messages retained in a topic, broken down by Cloud region. |
| Number of unacknowledged messages in a topic, broken down by Cloud region. |
| Age (in seconds) of the oldest acknowledged message retained in a topic, broken down by Cloud region. |
| Age (in seconds) of the oldest unacknowledged message in a topic, broken down by Cloud region. |
| Total byte size of the acknowledged messages retained in a topic, broken down by Cloud region. |
| Cumulative count of publish message operations. |
| Cumulative count of publish requests. |
| Total byte size of the unacknowledged messages in a topic, broken down by Cloud region. |
GcpPubSubSubscriptionSample
Query GcpPubSubSubscriptionSample events in New Relic to view data for the following attributes:
Attribute | Description |
|---|---|
| Total byte size of the unacknowledged messages (a.k.a. backlog messages) in a subscription. |
| Cumulative cost of operations, measured in bytes. This is used to measure quota utilization. |
| Cumulative count of configuration changes for each subscription, grouped by operation type and result. |
| Cumulative count of ModifyAckDeadline message operations, grouped by result. |
| Cumulative count of ModifyAckDeadline requests, grouped by result. |
| Number of messages delivered to a subscription's push endpoint, but not yet acknowledged. |
| Number of acknowledged messages retained in a subscription. |
| Number of acknowledged messages retained in a subscription, broken down by Cloud region. |
| Number of unacknowledged messages in a subscription, broken down by Cloud region. |
| Number of unacknowledged messages (a.k.a. backlog messages) in a subscription. |
| Age (in seconds) of the oldest acknowledged message retained in a subscription. |
| Age (in seconds) of the oldest acknowledged message retained in a subscription, broken down by Cloud region. |
| Age (in seconds) of the oldest unacknowledged message (a.k.a. backlog message) in a subscription. |
| Age (in seconds) of the oldest unacknowledged message in a subscription, broken down by Cloud region. |
| Cumulative count of acknowledge message operations, grouped by result. |
| Cumulative count of acknowledge requests, grouped by result. |
| Cumulative count of pull message operations, grouped by result. |
| Cumulative count of pull requests, grouped by result. |
| Cumulative count of push attempts, grouped by result. Unlike pulls, the push server implementation does not batch user messages, so each request only contains one user message. The push server retries on errors, so a given user message can appear multiple times. |
| Distribution of push request latencies (in microseconds), grouped by result. |
| Total byte size of the acknowledged messages retained in a subscription. |
| Total byte size of the acknowledged messages retained in a subscription, broken down by Cloud region. |
| Cumulative count of StreamingPull acknowledge message operations, grouped by result. |
| Cumulative count of streaming pull requests with non-empty acknowledge ids, grouped by result. |
| Cumulative count of streaming pull message operations, grouped by result. |
| Cumulative count of StreamingPull ModifyAckDeadline operations, grouped by result. |
| Cumulative count of streaming pull requests with non-empty ModifyAckDeadline fields, grouped by result. |
| Cumulative count of streaming pull responses, grouped by result. |
| Total byte size of the unacknowledged messages in a subscription, broken down by Cloud region. |