Monitoring and collecting data from Elasticsearch

Search & Analyze Data in Real Time. Distributed, scalable, and highly available. Real-time search and analytics capabilities. Sophisticated RESTful API.

More information on: https://www.elastic.co/products/elasticsearch

How it works

The plugin connects to the ElasticSearch server and uses the node stats call to fetch statistics about the server.

These statistics include information about the processes, threads, network and JVM. These statistics are gathered by default and no additional configuration is required. Just provide the connection details and the plugin is ready to go.

The minimal supported version of ElasticSearch is 0.90.

Installation

The plugin needs to be installed together with a CoScale agent, instructions on how to install the CoScale agent can be found here. If you want to monitor Elasticsearch inside Docker containers using CoScale, check out the instructions here.

Configuration

Active checks

This plugin can be configured to execute a URI query on your ElasticSearch. This active monitoring allows us to calculate the uptime of the service and the response time of the query.

A valid URI query (eg. http://localhost:9200/twitter/tweet/_search?q=user:kimchy) should be provided.

Metrics

ElasticSearch

Name Unit Dimensions
ElasticSearch active check latency s  
ElasticSearch active check uptime %  

ElasticSearch / Breaker

Name Unit Dimensions
ElasticSearch estimated size b EsBreaker
ElasticSearch limit size b EsBreaker
ElasticSearch overhead   EsBreaker
ElasticSearch tripped   EsBreaker

ElasticSearch / CPU

Name Unit Dimensions
ElasticSearch CPU idle    
ElasticSearch CPU percent %  
ElasticSearch CPU stolen    
ElasticSearch CPU sys    
ElasticSearch CPU sys time s  
ElasticSearch CPU usage    
ElasticSearch CPU user    
ElasticSearch process CPU user s  
ElasticSearch total CPU time s  

ElasticSearch / Disk

Name Unit Dimensions
ElasticSearch disk IO op    
ElasticSearch disk IO size b  
ElasticSearch disk read size b  
ElasticSearch disk reads    
ElasticSearch disk write size b  
ElasticSearch disk writes    
ElasticSearch free disk b  
ElasticSearch total b  
ElasticSearch total file system space b  

ElasticSearch / Docs

Name Unit Dimensions
ElasticSearch deleted documents    
ElasticSearch indices merges current docs    

ElasticSearch / Http

Name Unit Dimensions
ElasticSearch current open    
ElasticSearch total opened    

ElasticSearch / Indices

Name Unit Dimensions
ElasticSearch completion size b  
ElasticSearch current size b  
ElasticSearch delete current    
ElasticSearch delete time s  
ElasticSearch exists time s  
ElasticSearch fetch time s  
ElasticSearch fetch total    
ElasticSearch fielddata evictions    
ElasticSearch filtercache evictions    
ElasticSearch flush total    
ElasticSearch flush total time s  
ElasticSearch index current    
ElasticSearch index time s  
ElasticSearch index writer max memory b  
ElasticSearch indexing throttle time s  
ElasticSearch merges total    
ElasticSearch merges total time s  
ElasticSearch missing number    
ElasticSearch missing time s  
ElasticSearch noop update total    
ElasticSearch number of delete requests req/s  
ElasticSearch number of index requests req/s  
ElasticSearch open contexts    
ElasticSearch operations    
ElasticSearch percolate total    
ElasticSearch queries    
ElasticSearch query cache evictions    
ElasticSearch query time s  
ElasticSearch recovery throttle time s  
ElasticSearch refresh total    
ElasticSearch refresh total time s  
ElasticSearch store size b  
ElasticSearch store throttle time s  
ElasticSearch suggest total    
ElasticSearch translog size b  
ElasticSearch warmer total    
ElasticSearch warmer total time s  
Total ElasticSearch docs    
Total ElasticSearch exists    
Total ElasticSearch indices merges size b  

ElasticSearch / JVM

Name Unit Dimensions
ElasticSearch buffered count b JVMBufferPool
ElasticSearch collection count   JVMMemPool
ElasticSearch collection time s JVMMemPool
ElasticSearch heap committed b  
ElasticSearch heap used b  
ElasticSearch heap used percent %  
ElasticSearch JVM heap max memory b  
ElasticSearch JVM mem non heap committed b  
ElasticSearch JVM threads count    
ElasticSearch non heap memory used b  
ElasticSearch peak count    
ElasticSearch pools used b JVMMemPool
ElasticSearch total capacity buffered memory b JVMBufferPool
ElasticSearch uptime s  
ElasticSearch used buffered memory b JVMBufferPool

ElasticSearch / Memory

Name Unit Dimensions
ElasticSearch actual free memory b  
ElasticSearch fielddata memory size b  
ElasticSearch filter cache memory size b  
ElasticSearch fixed bit set memory b  
ElasticSearch free mem percent %  
ElasticSearch id cache memory size b  
ElasticSearch index writer memory b  
ElasticSearch memory b  
ElasticSearch memory free b  
ElasticSearch memory share b  
ElasticSearch memory used b  
ElasticSearch OS used memory b  
ElasticSearch percolate memory size b  
ElasticSearch query_cache memory size b  
ElasticSearch resident b  
ElasticSearch swap free b  
ElasticSearch swap used b  
ElasticSearch total virtual memory b  
ElasticSearch used memory percent %  
ElasticSearch version map memory b  

ElasticSearch / Network

Name Unit Dimensions
ElasticSearch active opens    
ElasticSearch curr estab    
ElasticSearch estabresets    
ElasticSearch in segs    
ElasticSearch network attempt fails    
ElasticSearch out rsts    
ElasticSearch out segs    
ElasticSearch passive opens    
In ElasticSearch errs    
Retransmitted ElasticSearch segments    

ElasticSearch / Process

Name Unit Dimensions
ElasticSearch open file descriptors    
Name Unit Dimensions
ElasticSearch current query    
ElasticSearch Fetch current    
Total ElasticSearch query number queries/s  

ElasticSearch / Shards

Name Unit Dimensions
ElasticSearch active primary shards    
ElasticSearch active shards    
ElasticSearch initializing shards    
ElasticSearch relocating shards    
ElasticSearch unassigned shards    

ElasticSearch / Total

Name Unit Dimensions
ElasticSearch docs count    
ElasticSearch get current    
ElasticSearch get time s  
ElasticSearch merges current    
ElasticSearch number of data nodes    
ElasticSearch number of get requests req/s  
ElasticSearch number of nodes    
ElasticSearch percolate current    
ElasticSearch percolate time s  
ElasticSearch query cache hit count    
ElasticSearch query cache miss count    
ElasticSearch requests req/s  
ElasticSearch segments count    
ElasticSearch suggest current    
ElasticSearch suggest time s  
ElasticSearch warmer current    

ElasticSearch / Transport

Name Unit Dimensions
ElasticSearch rx count    
ElasticSearch rx size b  
ElasticSearch server open    
ElasticSearch tx count    
ElasticSearch tx size b  

Events

Name Description Attributes
ELASTICSEARCH service state watcher State watcher status