You are viewing docs on Elastic's new documentation system, currently in technical preview. For all other Elastic docs, visit elastic.co/guide.

Custom Google Pub/Sub Logs

Collect Logs from Google Pub/Sub topics

What is an Elastic integration?
Version
1.12.1 (View all)
Compatible Kibana version(s)
7.16.0 or higher
8.0.0 or higher
Supported Serverless project types

What's this?
Security
Observability
Subscription level
What's this?
Basic
Level of support
What's this?
Elastic

The custom Google Pub/Sub input integration is used to ingest data from a Google Pub/Sub topic subscription that is not covered by our GCP Integration.

This integration could for example be used to receive Stackdriver logs that have been exported to a Google Pub/Sub topic.

Multiple Elastic Agent instances can be configured to read from the same subscription to achieve high-availability or increased throughput.

Configuring

  1. Create a user-managed service account (you can skip this if Elastic Agent is running in a VM with a service account attached). See: Service Accounts

  2. Create a Pub/Sub topic and subscription. See:Topics and Subscriptions

  3. Configure this integration to read from the Pub/Sub subscription using the service account credentials.

  4. Write logs into the Pub/Sub topic yourself or configure a log sink to export GCP logs to the topic. See: Managing Sinks

Changelog

VersionDetailsKibana version(s)

1.12.1

Enhancement View pull request
Changed owners

7.16.0 or higher
8.0.0 or higher

1.12.0

Enhancement View pull request
ECS version updated to 8.11.0.

7.16.0 or higher
8.0.0 or higher

1.11.0

Enhancement View pull request
ECS version updated to 8.10.0.

7.16.0 or higher
8.0.0 or higher

1.10.0

Enhancement View pull request
The format_version in the package manifest changed from 2.11.0 to 3.0.0. Removed dotted YAML keys from package manifest. Added 'owner.type: elastic' to package manifest.

7.16.0 or higher
8.0.0 or higher

1.9.0

Enhancement View pull request
Add tags.yml file so that integration's dashboards and saved searches are tagged with "Security Solution" and displayed in the Security Solution UI.

7.16.0 or higher
8.0.0 or higher

1.8.0

Enhancement View pull request
Update package to ECS 8.9.0.

7.16.0 or higher
8.0.0 or higher

1.7.0

Enhancement View pull request
Update package to ECS 8.8.0.

7.16.0 or higher
8.0.0 or higher

1.6.0

Enhancement View pull request
Update package-spec version to 2.7.0.

7.16.0 or higher
8.0.0 or higher

1.5.0

Enhancement View pull request
Update package to ECS 8.7.0.

7.16.0 or higher
8.0.0 or higher

1.4.1

Enhancement View pull request
Added categories and/or subcategories.

7.16.0 or higher
8.0.0 or higher

1.4.0

Enhancement View pull request
Update package to ECS 8.6.0.

7.16.0 or higher
8.0.0 or higher

1.3.0

Enhancement View pull request
Update package to ECS 8.5.0.

7.16.0 or higher
8.0.0 or higher

1.2.0

Enhancement View pull request
Update package to ECS 8.4.0

7.16.0 or higher
8.0.0 or higher

1.1.0

Enhancement View pull request
Update package to ECS 8.3.0.

7.16.0 or higher
8.0.0 or higher

1.0.1

Enhancement View pull request
update readme

7.16.0 or higher
8.0.0 or higher

1.0.0

Enhancement View pull request
Initial Release

7.16.0 or higher
8.0.0 or higher

On this page