Monitoring
ECE ECK Elastic Cloud Hosted Self Managed
Keeping on top of the health of your cluster or deployment, as well as your orchestrator, is an important part of maintenance. It also helps you to identify and troubleshoot issues. When you move to production, detecting and resolving issues when they arise is a key component of keeping your deployment highly available.
Depending on your deployment type, you can use a variety of solutions for monitoring your Elastic components.
Depending on your deployment type and context, you have several options for monitoring your cluster or deployment.
Elastic Cloud Hosted
If you’re using Elastic Cloud Hosted, then you can use AutoOps to monitor your cluster. AutoOps significantly simplifies cluster management with performance recommendations, resource utilization visibility, real-time issue detection and resolution paths. AutoOps is rolling out in phases across Elastic Cloud Hosted regions and cloud service providers. It will be automatically activated for your deployment, with no installation required. For more information, refer to Monitor with AutoOps.
ECE ECK Elastic Cloud Hosted Self Managed
Stack monitoring allows you to collect logs and metrics from various Elastic products, including Elasticsearch nodes, Logstash nodes, Kibana instances, APM Server, and Beats in your cluster. You can also collect logs.
All of the monitoring metrics are stored in Elasticsearch, which enables you to easily visualize the data in Kibana.
In Elastic Cloud Enterprise and Elastic Cloud Hosted, Elastic manages the installation and configuration of the monitoring agent for you, simplifying the stack monitoring setup process.
By default, the monitoring metrics are stored in local indices. In production, we strongly recommend using a separate monitoring cluster. Using a separate monitoring cluster prevents production cluster outages from impacting your ability to access your monitoring data. It also prevents monitoring activities from impacting the performance of your production cluster. For the same reason, we also recommend using a separate Kibana instance for viewing the monitoring data.
ECE Elastic Cloud Hosted
Elastic Cloud Enterprise and Elastic Cloud Hosted provide out of the box tools for monitoring the health of your deployment and resolving health issues when they arise:
Elastic Cloud Hosted only:
Elastic Cloud Enterprise only:
- Platform monitoring, including logs, metrics, and proxy logs
Out of the box logs and metrics tools, including ECH preconfigured logs and metrics and ECE platform monitoring logs and metrics, are useful for providing information in a non-production environment. In a production environment, it’s important set up either AutoOps or stack monitoring to retain the logs and metrics that can be used to troubleshoot any health issues in your deployments. In the event of that you need to contact our support team, they can use the retained data to help diagnose any problems that you may encounter.
To learn more about the health and performance tools in Elastic Cloud, refer to Cloud deployment health and performance metrics.
Elastic Stack Technical Preview
The Kibana task manager has an internal monitoring mechanism to keep track of a variety of metrics, which can be consumed with either the health monitoring API or the Kibana server log. Learn how to configure thresholds and consume related to Kibana task manager.
ECE ECK
In addition to monitoring your cluster or deployment health and performance, you need to monitor your orchestrator. Monitoring is especially important for orchestrators hosted on infrastructure that you control.
Learn how to enable monitoring of your orchestrator:
- ECK operator metrics: Open and secure a metrics endpoint that can be used to monitor the operator’s performance and health. This endpoint can be scraped by third-party Kubernetes monitoring tools.
- ECE platform monitoring: Learn about how ECE collects monitoring data for your installation in the
logging-and-metricsdeployment, and how to access monitoring data.
Elastic monitors Elastic Cloud service metrics and performance as part of our shared responsibility. We provide service availability information on our service status page.
You can configure several types of logs in Elastic Stack that can help you to gain insight into Elastic Stack operations, diagnose issues, and track certain types of events. Learn about the types of logs available, where to find them, and how to configure them.