﻿---
title: Monitoring in a production environment
description: In production, you should send monitoring data to a separate monitoring cluster so that historical data is available even when the nodes you are monitoring...
url: https://www.elastic.co/elastic/docs-builder/docs/2651/deploy-manage/monitor/stack-monitoring/es-self-monitoring-prod
products:
  - Elasticsearch
applies_to:
  - Self-managed Elastic deployments: Generally available
---

# Monitoring in a production environment
In production, you should send monitoring data to a separate *monitoring cluster* so that historical data is available even when the nodes you are monitoring are not.
If you have at least a Gold subscription, using a dedicated monitoring cluster also enables you to monitor multiple clusters from a central location.

## Set up your monitoring cluster and Kibana instance

To store monitoring data in a separate cluster:
1. Set up the Elasticsearch cluster you want to use as the monitoring cluster. For example, you might set up a two host cluster with the nodes `es-mon-1` and `es-mon-2`.
   <important>
   - Ideally the monitoring cluster and the production cluster run on the same Elastic Stack version. However, a monitoring cluster on the latest release of 9.x also works with production clusters that use the same major version. Monitoring clusters that use 9.x also work with production clusters that use the latest release of 8.x.
   - There must be at least one [ingest node](https://www.elastic.co/elastic/docs-builder/docs/2651/manage-data/ingest/transform-enrich/ingest-pipelines) in the monitoring cluster; it does not need to be a dedicated ingest node.
   </important>
   1. (Optional) Verify that the collection of monitoring data is disabled on the monitoring cluster. By default, the `xpack.monitoring.collection.enabled` setting is `false`.
   For example, you can use the following APIs to review and change this setting:
   ```json



   {
     "persistent": {
       "xpack.monitoring.collection.enabled": false
     }
   }
   ```
2. If the Elasticsearch security features are enabled on the monitoring cluster, create users that can send and retrieve monitoring data:
   <note>
   If you plan to use Kibana to view monitoring data, username and password credentials must be valid on both the Kibana server and the monitoring cluster.
   </note>
   - If you plan to use Elastic Agent, create a user that has the `remote_monitoring_collector` [built-in role](https://docs-v3-preview.elastic.dev/elastic/docs-builder/docs/2651/reference/elasticsearch/roles#built-in-roles-remote-monitoring-collector) and that the monitoring related [integration assets have been installed](/elastic/docs-builder/docs/2651/reference/fleet/install-uninstall-integration-assets#install-integration-assets) on the remote monitoring cluster.
- If you plan to use Metricbeat, create a user that has the `remote_monitoring_collector` built-in role and a user that has the `remote_monitoring_agent` [built-in role](https://docs-v3-preview.elastic.dev/elastic/docs-builder/docs/2651/reference/elasticsearch/roles#built-in-roles-remote-monitoring-agent). Alternatively, use the `remote_monitoring_user` [built-in user](https://www.elastic.co/elastic/docs-builder/docs/2651/deploy-manage/users-roles/cluster-or-deployment-auth/built-in-users).
- If you plan to use HTTP exporters to route data through your production cluster, create a user that has the `remote_monitoring_agent` [built-in role](https://docs-v3-preview.elastic.dev/elastic/docs-builder/docs/2651/reference/elasticsearch/roles#built-in-roles-remote-monitoring-agent).
  For example, the following request creates a `remote_monitor` user that has the `remote_monitoring_agent` role:
  ```json

  {
    "password" : "changeme",
    "roles" : [ "remote_monitoring_agent"],
    "full_name" : "Internal Agent For Remote Monitoring"
  }
  ```
  Alternatively, use the `remote_monitoring_user` [built-in user](https://www.elastic.co/elastic/docs-builder/docs/2651/deploy-manage/users-roles/cluster-or-deployment-auth/built-in-users).
2. (Optional) Create a dedicated Kibana instance for monitoring, rather than using a single Kibana instance to access both your production cluster and monitoring cluster.
   <note>
   If you log in to Kibana using SAML, Kerberos, PKI, OpenID Connect, or token authentication providers, a dedicated Kibana instance is **required**. The security tokens that are used in these contexts are cluster-specific; therefore you cannot use a single Kibana instance to connect to both production and monitoring clusters.
   </note>
   1. (Optional) Disable the collection of monitoring data in this Kibana instance. Set the `xpack.monitoring.kibana.collection.enabled` setting to `false` in the [`kibana.yml`](https://www.elastic.co/elastic/docs-builder/docs/2651/deploy-manage/stack-settings) file. For more information about this setting, see [Monitoring settings in Kibana](https://docs-v3-preview.elastic.dev/elastic/docs-builder/docs/2651/reference/kibana/configuration-reference/monitoring-settings).


## Send data to your cluster

After your monitoring cluster is set up, configure your Elastic Stack components to send data to the cluster. Refer to [Stack monitoring](https://www.elastic.co/elastic/docs-builder/docs/2651/deploy-manage/monitor/stack-monitoring) to learn about the available methods for each component.

## Configure Kibana to retrieve and display the monitoring data

After data is being shipped to your monitoring cluster, you can [configure Kibana to retrieve and display the monitoring data](https://www.elastic.co/elastic/docs-builder/docs/2651/deploy-manage/monitor/stack-monitoring/kibana-monitoring-data).