Elasticsearch Cluster version 7.7 is not stable

Hello guys,

Can anyone help me on this problem?

My Cluster:
I have a ES cluster with 3 nodes version 7.7. Every node have 2 vCPU and 16GB Ram. I have 2 index:
Index 1: 121 MB (1.9M Doc, 2 Primary Shards, 1 Replica Shard)
Index 2: 23.5GB (263M Doc , 2 Primary Shards, 1 Replica Shard)
I configured JVM heap size with 8GB Ram:
-Xms8g
-Xmx8g
Here is my ES config file


#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: ${HOSTNAME}
#
# Add custom attributes to the node:
#
#node.attr.rack: r1

# Make this node eligible to be elected as master node which controls the cluster (enabled by default)
node.master: true

# Enable data node which holds data and performs data related operations such as CRUD, search, aggregations (enabled by default)
node.data: true

# Enable ingest node which preprocesses document before indexing happens (enabled by default)
node.ingest: true

# Disable cross-cluster search (enabled by default)
search.remote.connect: false


#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: /var/lib/elasticsearch,/home/elasticsearch

#
# Path to log files:
#
path.logs: /var/log/elasticsearch


#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# Set the bind address to a specific IP (IPv4 or IPv6):
#
network.host: ${HOSTNAME}

#
# Set a custom port for HTTP:
#
# Port to bind for incoming HTTP requests (defaults to 9200-9300)
http.port: 9200

# Port to bind for communication between nodes (defaults to 9300-9400)
transport.tcp.port: 9300

#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
#
discovery.seed_hosts: ["Node001", "Node002", "Node003"]
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
#
cluster.initial_master_nodes: ["Node001", "Node002", "Node003"]

Recently, my Elasticsearch Cluster is not stable.
I check on the log show as below:


I have a tool to check the status of index

The shard 1 (Primary) is N/A. But when I restart the elasticsearch service, it comes back to normal.
Question:
Does my system need more memory in JVM Heap?

Welcome to our community! :smiley:
Please don't post pictures of text, they are difficult to read, impossible to search and replicate (if it's code), and some people may not be even able to see them :slight_smile:

Is there a reason you have done this?

Thanks Warkolm for your feedback. I'm a newbie in ES Community

Here is the my cluster log in text format.

    [2020-12-24T12:18:49,815][WARN ][o.e.a.b.TransportShardBulkAction] [Node003] [[IndexA][1]] failed to perform indices:data/write/bulk[s] on replica [IndexA][1], node[A4_hLiUbT4WklL9X3uIcRA], [R], s[STARTED], a[id=arjfwV-dTv6M1kj8XjIMqQ]
    org.elasticsearch.transport.RemoteTransportException: [Node002][172.16.211.52:9300][indices:data/write/bulk[s][r]]
    Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [parent] Data too large, data for [<transport_request>] would be [8209687404/7.6gb], which is larger than the limit of [8160437862/7.5gb], real usage: [8209686656/7.6gb], new bytes reserved: [748/748b], usages [request=0/0b, fielddata=1332624003/1.2gb, in_flight_requests=748/748b, accounting=443698/433.2kb]
    	at org.elasticsearch.indices.breaker.HierarchyCircuitBreakerService.checkParentLimit(HierarchyCircuitBreakerService.java:347) ~[elasticsearch-7.7.0.jar:7.7.0]
    	at org.elasticsearch.common.breaker.ChildMemoryCircuitBreaker.addEstimateBytesAndMaybeBreak(ChildMemoryCircuitBreaker.java:128) ~[elasticsearch-7.7.0.jar:7.7.0]
    	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:171) [elasticsearch-7.7.0.jar:7.7.0]
    	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:119) [elasticsearch-7.7.0.jar:7.7.0]
    	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:103) [elasticsearch-7.7.0.jar:7.7.0]
    	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:676) [elasticsearch-7.7.0.jar:7.7.0]
    	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:62) [transport-netty4-client-7.7.0.jar:7.7.0]
    	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) [netty-codec-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) [netty-codec-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:227) [netty-handler-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.45.Final.jar:4.1.45.Final]
    	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.45.Final.jar:4.1.45.Final]
    	at java.lang.Thread.run(Thread.java:832) [?:?]

What is the output from _cluster/stats?pretty&human?

The cluster auto recover to green status after 20 mins when the memory of a node exceed limit (Circuit_breaking event ). Will try to catch _cluster/stats?pretty&human when the issue happen again. I have normal result as below for now


{
  "_nodes" : {
    "total" : 3,
    "successful" : 3,
    "failed" : 0
  },
  "cluster_name" : "elasticsearch_cluster01",
  "cluster_uuid" : "pVVYKFTCT6OOkB9G29kJyg",
  "timestamp" : 1610355994201,
  "status" : "green",
  "indices" : {
    "count" : 7,
    "shards" : {
      "total" : 18,
      "primaries" : 9,
      "replication" : 1.0,
      "index" : {
        "shards" : {
          "min" : 2,
          "max" : 4,
          "avg" : 2.5714285714285716
        },
        "primaries" : {
          "min" : 1,
          "max" : 2,
          "avg" : 1.2857142857142858
        },
        "replication" : {
          "min" : 1.0,
          "max" : 1.0,
          "avg" : 1.0
        }
      }
    },
    "docs" : {
      "count" : 269016398,
      "deleted" : 46708983
    },
    "store" : {
      "size" : "45.5gb",
      "size_in_bytes" : 48937362690
    },
    "fielddata" : {
      "memory_size" : "6.7gb",
      "memory_size_in_bytes" : 7225031668,
      "evictions" : 0
    },
    "query_cache" : {
      "memory_size" : "2.3gb",
      "memory_size_in_bytes" : 2558739905,
      "total_count" : 61583098,
      "hit_count" : 23264491,
      "miss_count" : 38318607,
      "cache_size" : 8626,
      "cache_count" : 22495,
      "evictions" : 13869
    },
    "completion" : {
      "size" : "0b",
      "size_in_bytes" : 0
    },
    "segments" : {
      "count" : 152,
      "memory" : "1.9mb",
      "memory_in_bytes" : 2079372,
      "terms_memory" : "1010kb",
      "terms_memory_in_bytes" : 1034288,
      "stored_fields_memory" : "507.7kb",
      "stored_fields_memory_in_bytes" : 519888,
      "term_vectors_memory" : "0b",
      "term_vectors_memory_in_bytes" : 0,
      "norms_memory" : "233.8kb",
      "norms_memory_in_bytes" : 239488,
      "points_memory" : "0b",
      "points_memory_in_bytes" : 0,
      "doc_values_memory" : "279kb",
      "doc_values_memory_in_bytes" : 285708,
      "index_writer_memory" : "0b",
      "index_writer_memory_in_bytes" : 0,
      "version_map_memory" : "0b",
      "version_map_memory_in_bytes" : 0,
      "fixed_bit_set" : "148.5mb",
      "fixed_bit_set_memory_in_bytes" : 155804496,
      "max_unsafe_auto_id_timestamp" : -1,
      "file_sizes" : { }
    },
    "mappings" : {
      "field_types" : [
        {
          "name" : "binary",
          "count" : 3,
          "index_count" : 1
        },
        {
          "name" : "boolean",
          "count" : 28,
          "index_count" : 4
        },
        {
          "name" : "date",
          "count" : 50,
          "index_count" : 5
        },
        {
          "name" : "flattened",
          "count" : 1,
          "index_count" : 1
        },
        {
          "name" : "float",
          "count" : 4,
          "index_count" : 1
        },
        {
          "name" : "geo_shape",
          "count" : 1,
          "index_count" : 1
        },
        {
          "name" : "integer",
          "count" : 32,
          "index_count" : 3
        },
        {
          "name" : "keyword",
          "count" : 281,
          "index_count" : 6
        },
        {
          "name" : "long",
          "count" : 83,
          "index_count" : 3
        },
        {
          "name" : "nested",
          "count" : 13,
          "index_count" : 3
        },
        {
          "name" : "object",
          "count" : 222,
          "index_count" : 4
        },
        {
          "name" : "short",
          "count" : 1,
          "index_count" : 1
        },
        {
          "name" : "text",
          "count" : 150,
          "index_count" : 6
        }
      ]
    },
    "analysis" : {
      "char_filter_types" : [ ],
      "tokenizer_types" : [ ],
      "filter_types" : [ ],
      "analyzer_types" : [
        {
          "name" : "custom",
          "count" : 3,
          "index_count" : 2
        }
      ],
      "built_in_char_filters" : [ ],
      "built_in_tokenizers" : [
        {
          "name" : "keyword",
          "count" : 2,
          "index_count" : 2
        },
        {
          "name" : "whitespace",
          "count" : 1,
          "index_count" : 1
        }
      ],
      "built_in_filters" : [
        {
          "name" : "lowercase",
          "count" : 3,
          "index_count" : 2
        },
        {
          "name" : "trim",
          "count" : 1,
          "index_count" : 1
        }
      ],
      "built_in_analyzers" : [
        {
          "name" : "keyword",
          "count" : 12,
          "index_count" : 1
        },
        {
          "name" : "standard",
          "count" : 9,
          "index_count" : 1
        }
      ]
    }
  },
  "nodes" : {
    "count" : {
      "total" : 3,
      "coordinating_only" : 0,
      "data" : 3,
      "ingest" : 3,
      "master" : 3,
      "ml" : 3,
      "remote_cluster_client" : 0,
      "transform" : 3,
      "voting_only" : 0
    },
    "versions" : [
      "7.7.0"
    ],
    "os" : {
      "available_processors" : 6,
      "allocated_processors" : 6,
      "names" : [
        {
          "name" : "Linux",
          "count" : 3
        }
      ],
      "pretty_names" : [
        {
          "pretty_name" : "CentOS Linux 7 (Core)",
          "count" : 3
        }
      ],
      "mem" : {
        "total" : "46.4gb",
        "total_in_bytes" : 49912631296,
        "free" : "502mb",
        "free_in_bytes" : 526483456,
        "used" : "45.9gb",
        "used_in_bytes" : 49386147840,
        "free_percent" : 1,
        "used_percent" : 99
      }
    },
    "process" : {
      "cpu" : {
        "percent" : 15
      },
      "open_file_descriptors" : {
        "min" : 353,
        "max" : 398,
        "avg" : 371
      }
    },
    "jvm" : {
      "max_uptime" : "147.3d",
      "max_uptime_in_millis" : 12729903164,
      "versions" : [
        {
          "version" : "14",
          "vm_name" : "OpenJDK 64-Bit Server VM",
          "vm_version" : "14+36",
          "vm_vendor" : "AdoptOpenJDK",
          "bundled_jdk" : true,
          "using_bundled_jdk" : true,
          "count" : 3
        }
      ],
      "mem" : {
        "heap_used" : "12.7gb",
        "heap_used_in_bytes" : 13700086696,
        "heap_max" : "24gb",
        "heap_max_in_bytes" : 25769803776
      },
      "threads" : 150
    },
    "fs" : {
      "total" : "273.2gb",
      "total_in_bytes" : 293365690368,
      "free" : "207.3gb",
      "free_in_bytes" : 222595383296,
      "available" : "207.3gb",
      "available_in_bytes" : 222595383296
    },
    "plugins" : [ ],
    "network_types" : {
      "transport_types" : {
        "security4" : 3
      },
      "http_types" : {
        "security4" : 3
      }
    },
    "discovery_types" : {
      "zen" : 3
    },
    "packaging_types" : [
      {
        "flavor" : "default",
        "type" : "rpm",
        "count" : 3
      }
    ],
    "ingest" : {
      "number_of_pipelines" : 2,
      "processor_stats" : {
        "gsub" : {
          "count" : 0,
          "failed" : 0,
          "current" : 0,
          "time" : "0s",
          "time_in_millis" : 0
        },
        "script" : {
          "count" : 0,
          "failed" : 0,
          "current" : 0,
          "time" : "0s",
          "time_in_millis" : 0
        }
      }
    }
  }
}

What sort of data do you have?
What sort of queries do you run?

Developers sync data from Microsoft SQL server to Elasticsearch. They run queries like

GET index/_search
{
  "track_total_hits": true,
  "sort": [
    {
      "createdDate": {
        "order": "desc"
      }
    }
  ]
}

What is the output from the _cluster/stats?pretty&human API?

Here is the output

{
  "_nodes" : {
    "total" : 3,
    "successful" : 3,
    "failed" : 0
  },
  "cluster_name" : "elasticsearch_cluster01",
  "cluster_uuid" : "pVVYKFTCT6OOkB9G29kJyg",
  "timestamp" : 1610434376569,
  "status" : "green",
  "indices" : {
    "count" : 7,
    "shards" : {
      "total" : 18,
      "primaries" : 9,
      "replication" : 1.0,
      "index" : {
        "shards" : {
          "min" : 2,
          "max" : 4,
          "avg" : 2.5714285714285716
        },
        "primaries" : {
          "min" : 1,
          "max" : 2,
          "avg" : 1.2857142857142858
        },
        "replication" : {
          "min" : 1.0,
          "max" : 1.0,
          "avg" : 1.0
        }
      }
    },
    "docs" : {
      "count" : 269164592,
      "deleted" : 46684069
    },
    "store" : {
      "size" : "44.9gb",
      "size_in_bytes" : 48225167188
    },
    "fielddata" : {
      "memory_size" : "6.7gb",
      "memory_size_in_bytes" : 7260808084,
      "evictions" : 0
    },
    "query_cache" : {
      "memory_size" : "2.3gb",
      "memory_size_in_bytes" : 2557258368,
      "total_count" : 68874465,
      "hit_count" : 25504073,
      "miss_count" : 43370392,
      "cache_size" : 7666,
      "cache_count" : 25330,
      "evictions" : 17664
    },
    "completion" : {
      "size" : "0b",
      "size_in_bytes" : 0
    },
    "segments" : {
      "count" : 142,
      "memory" : "1.9mb",
      "memory_in_bytes" : 2031342,
      "terms_memory" : "990.2kb",
      "terms_memory_in_bytes" : 1013968,
      "stored_fields_memory" : "503.8kb",
      "stored_fields_memory_in_bytes" : 515904,
      "term_vectors_memory" : "0b",
      "term_vectors_memory_in_bytes" : 0,
      "norms_memory" : "229.5kb",
      "norms_memory_in_bytes" : 235072,
      "points_memory" : "0b",
      "points_memory_in_bytes" : 0,
      "doc_values_memory" : "260.1kb",
      "doc_values_memory_in_bytes" : 266398,
      "index_writer_memory" : "4.1mb",
      "index_writer_memory_in_bytes" : 4373464,
      "version_map_memory" : "600b",
      "version_map_memory_in_bytes" : 600,
      "fixed_bit_set" : "148.7mb",
      "fixed_bit_set_memory_in_bytes" : 155973792,
      "max_unsafe_auto_id_timestamp" : -1,
      "file_sizes" : { }
    },
    "mappings" : {
      "field_types" : [
        {
          "name" : "binary",
          "count" : 3,
          "index_count" : 1
        },
        {
          "name" : "boolean",
          "count" : 28,
          "index_count" : 4
        },
        {
          "name" : "date",
          "count" : 50,
          "index_count" : 5
        },
        {
          "name" : "flattened",
          "count" : 1,
          "index_count" : 1
        },
        {
          "name" : "float",
          "count" : 4,
          "index_count" : 1
        },
        {
          "name" : "geo_shape",
          "count" : 1,
          "index_count" : 1
        },
        {
          "name" : "integer",
          "count" : 32,
          "index_count" : 3
        },
        {
          "name" : "keyword",
          "count" : 281,
          "index_count" : 6
        },
        {
          "name" : "long",
          "count" : 83,
          "index_count" : 3
        },
        {
          "name" : "nested",
          "count" : 13,
          "index_count" : 3
        },
        {
          "name" : "object",
          "count" : 222,
          "index_count" : 4
        },
        {
          "name" : "short",
          "count" : 1,
          "index_count" : 1
        },
        {
          "name" : "text",
          "count" : 150,
          "index_count" : 6
        }
      ]
    },
    "analysis" : {
      "char_filter_types" : [ ],
      "tokenizer_types" : [ ],
      "filter_types" : [ ],
      "analyzer_types" : [
        {
          "name" : "custom",
          "count" : 3,
          "index_count" : 2
        }
      ],
      "built_in_char_filters" : [ ],
      "built_in_tokenizers" : [
        {
          "name" : "keyword",
          "count" : 2,
          "index_count" : 2
        },
        {
          "name" : "whitespace",
          "count" : 1,
          "index_count" : 1
        }
      ],
      "built_in_filters" : [
        {
          "name" : "lowercase",
          "count" : 3,
          "index_count" : 2
        },
        {
          "name" : "trim",
          "count" : 1,
          "index_count" : 1
        }
      ],
      "built_in_analyzers" : [
        {
          "name" : "keyword",
          "count" : 12,
          "index_count" : 1
        },
        {
          "name" : "standard",
          "count" : 9,
          "index_count" : 1
        }
      ]
    }
  },
  "nodes" : {
    "count" : {
      "total" : 3,
      "coordinating_only" : 0,
      "data" : 3,
      "ingest" : 3,
      "master" : 3,
      "ml" : 3,
      "remote_cluster_client" : 0,
      "transform" : 3,
      "voting_only" : 0
    },
    "versions" : [
      "7.7.0"
    ],
    "os" : {
      "available_processors" : 6,
      "allocated_processors" : 6,
      "names" : [
        {
          "name" : "Linux",
          "count" : 3
        }
      ],
      "pretty_names" : [
        {
          "pretty_name" : "CentOS Linux 7 (Core)",
          "count" : 3
        }
      ],
      "mem" : {
        "total" : "46.4gb",
        "total_in_bytes" : 49912631296,
        "free" : "515.9mb",
        "free_in_bytes" : 541044736,
        "used" : "45.9gb",
        "used_in_bytes" : 49371586560,
        "free_percent" : 1,
        "used_percent" : 99
      }
    },
    "process" : {
      "cpu" : {
        "percent" : 27
      },
      "open_file_descriptors" : {
        "min" : 355,
        "max" : 391,
        "avg" : 368
      }
    },
    "jvm" : {
      "max_uptime" : "148.2d",
      "max_uptime_in_millis" : 12808286674,
      "versions" : [
        {
          "version" : "14",
          "vm_name" : "OpenJDK 64-Bit Server VM",
          "vm_version" : "14+36",
          "vm_vendor" : "AdoptOpenJDK",
          "bundled_jdk" : true,
          "using_bundled_jdk" : true,
          "count" : 3
        }
      ],
      "mem" : {
        "heap_used" : "12.5gb",
        "heap_used_in_bytes" : 13430301600,
        "heap_max" : "24gb",
        "heap_max_in_bytes" : 25769803776
      },
      "threads" : 149
    },
    "fs" : {
      "total" : "273.2gb",
      "total_in_bytes" : 293365690368,
      "free" : "208gb",
      "free_in_bytes" : 223421825024,
      "available" : "208gb",
      "available_in_bytes" : 223421825024
    },
    "plugins" : [ ],
    "network_types" : {
      "transport_types" : {
        "security4" : 3
      },
      "http_types" : {
        "security4" : 3
      }
    },
    "discovery_types" : {
      "zen" : 3
    },
    "packaging_types" : [
      {
        "flavor" : "default",
        "type" : "rpm",
        "count" : 3
      }
    ],
    "ingest" : {
      "number_of_pipelines" : 2,
      "processor_stats" : {
        "gsub" : {
          "count" : 0,
          "failed" : 0,
          "current" : 0,
          "time" : "0s",
          "time_in_millis" : 0
        },
        "script" : {
          "count" : 0,
          "failed" : 0,
          "current" : 0,
          "time" : "0s",
          "time_in_millis" : 0
        }
      }
    }
  }
}