Prometheus Alertmanager integration

This integration ingests notifications from Prometheus Alertmanager and maps them to APEX AIOps Incident Management events automatically.

This integration was validated with Prometheus v2.31.1.

When to use the Prometheus Alertmanager integration

Incident Management offers three convenient mechanisms for integration with Prometheus.

Incident Management offers two Prometheus integrations, Prometheus Alertmanager and Prometheus Remote Write:
- Use the Prometheus Alertmanager integration to ingest notifications from Prometheus and send them to Incident Management with automatic mapping.
- Use the Prometheus Remote Write integration to ingest metrics from any external system that supports the Prometheus remote write protocol.
- Use either integration when you can configure your Prometheus instance to authenticate against an Incident Management endpoint to send data to Incident Management. These integrations do not require an Incident Management Collector and you can use authentication.
Use the Incident Management Prometheus Scrape plugin with an Incident Management Collector, when you:
- Can install a collector on a host in your environment and it will act as a proxy.
- Don’t want to make direct outbound calls from your environment.
- Want to gather and send Prometheus Scrape data to the Incident Management Events API for intelligent monitoring.

Create a new integration in Incident Management

Log in to your Incident Management instance.
Choose Integrations > Ingestion Services > Prometheus Alertmanager.
Click Add New Integration.

The new integration includes a custom endpoint, a set of default mappings to convert Prometheus data to Incident Management events, and a deduplication key to group similar events into alerts. You can customize how the integration maps and deduplicates your Prometheus data, but this is an advanced feature.

Note

The default configuration provided by Incident Management for the Prometheus Alertmanager integration is set for customer environments that use Kubernetes. Environments using different labels may require a different mapping. Be sure to customize the configuration to match your environment.

Configure your Prometheus instance

Set up Alertmanager to generate the alert notifications you want to send to Incident Management.
Set up your Alertmanager configuration file to send alerts to the Incident Management endpoint.
1. Define a generic webhook in your Alertmanager alertmanager.yml config file like this. Replace <incidentmanagement-api-key> with your Incident Management API key:
```
receivers:
- name: "IncidentManagement"
  webhook_configs:
  - url: <incidentmanagement-endpoint-url>
    http_config:
      basic_auth:
        username: alertmanager
        password: <incidentmanagement-api-key>
```
  To create a new API key to use with your integration, follow the instructions in Manage API keys.
2. In the routes section of the alertmanager.yml file, add Incident Management as a receiver:
```
receiver: 'IncidentManagement'
```

For more information, go to the Prometheus docs and search for Alertmanager and webhook_configs.

In this section:

Prometheus Alertmanager integration

When to use the Prometheus Alertmanager integration

Create a new integration in Incident Management

Note

Configure your Prometheus instance

Search results