# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1010 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1011 --- ## [Do i need to re-index?](https://discuss.elastic.co/t/do-i-need-to-re-index/219704)
**Author:** [@Phie\_Albert](https://discuss.elastic.co/u/Phie_Albert)\ **Replies:** 1\ **Last updated:** [February 20, 2020, 8:43pm UTC](https://discuss.elastic.co/t/do-i-need-to-re-index/219704 "2020-02-20T20:43:51Z")
Hi, currently i have 10 nodes with 5 shards, 1 replica and i don't use dedicated master node. if i want to use 3 dedicated master node and increase the number of my nodes so the number of shards on every node is still… --- ## [How to print all the hits from a bucket array of results](https://discuss.elastic.co/t/how-to-print-all-the-hits-from-a-bucket-array-of-results/220044)
**Author:** [@Chop](https://discuss.elastic.co/u/Chop)\ **Replies:** 4\ **Last updated:** [February 20, 2020, 8:32pm UTC](https://discuss.elastic.co/t/how-to-print-all-the-hits-from-a-bucket-array-of-results/220044 "2020-02-20T20:32:55Z")
I am using Watcher/Alerts to send some emails but it dont seem to find out how to get all keys from an array with out all the array: {{ctx.payload.aggregations.host.buckets.\*.key}} \<-- this is what my logic said it s… --- ## [Highlighting on ngram search](https://discuss.elastic.co/t/highlighting-on-ngram-search/220257)
**Author:** [@roman731](https://discuss.elastic.co/u/roman731)\ **Replies:** 0\ **Last updated:** [February 20, 2020, 7:27pm UTC](https://discuss.elastic.co/t/highlighting-on-ngram-search/220257 "2020-02-20T19:27:31Z")
Hello, I'm using ES7.5 and am trying to get highlighting to work on my ngram search (search results are working as expected). Currently I have a bunch of documents with a name field, and when i do a partial search with … --- ## [Adding another instance as a means to expand writable space](https://discuss.elastic.co/t/adding-another-instance-as-a-means-to-expand-writable-space/220080)
**Author:** [@fallenreaper](https://discuss.elastic.co/u/fallenreaper)\ **Replies:** 6\ **Last updated:** [February 20, 2020, 6:54pm UTC](https://discuss.elastic.co/t/adding-another-instance-as-a-means-to-expand-writable-space/220080 "2020-02-20T18:54:14Z")
we all run into the issue of running out of space on your initial ES instance. I launched a second and it spooled up but when i look at the summary for my instance it says: 1 primary and 1 replica. If i recall, my fir… --- ## [Stop-start an elasticsearch instance having all the primary shards](https://discuss.elastic.co/t/stop-start-an-elasticsearch-instance-having-all-the-primary-shards/220028)
**Author:** [@Chimu](https://discuss.elastic.co/u/Chimu)\ **Replies:** 13\ **Last updated:** [February 20, 2020, 5:26pm UTC](https://discuss.elastic.co/t/stop-start-an-elasticsearch-instance-having-all-the-primary-shards/220028 "2020-02-20T17:26:56Z")
I have an Elasticsearch (v5.6.10) cluster with 3 nodes. Node A : Master Node B : Master + Data Node C : Master + Data There are 6 shards per data node with replication set as 1. All 6 primary nodes are in Node B and a… --- ## [Elastic logging](https://discuss.elastic.co/t/elastic-logging/219076)
**Author:** [@aniaks](https://discuss.elastic.co/u/aniaks)\ **Replies:** 4\ **Last updated:** [February 20, 2020, 5:20pm UTC](https://discuss.elastic.co/t/elastic-logging/219076 "2020-02-20T17:20:16Z")
whenever there is an exception from the cluster like EsRejectedException we are not logging it on the elastic side. We have to rely on the client to provide this information. is there a way we could enable the exhaustive… --- ## [Merge daily indexes into monthly](https://discuss.elastic.co/t/merge-daily-indexes-into-monthly/220230)
**Author:** [@Norman\_Khine](https://discuss.elastic.co/u/Norman_Khine)\ **Replies:** 0\ **Last updated:** [February 20, 2020, 4:48pm UTC](https://discuss.elastic.co/t/merge-daily-indexes-into-monthly/220230 "2020-02-20T16:48:29Z")
Hello, Currently we have daily indexes, so I am looking to run a monthly job task to merge these, for example: POST \_reindex?requests\_per\_second=115&wait\_for\_completion=true { "source": { "index": "analytics-stag… --- ## [Lifecycle Management question about multiple index patterns in one template?](https://discuss.elastic.co/t/lifecycle-management-question-about-multiple-index-patterns-in-one-template/220226)
**Author:** [@Matt\_McGovern](https://discuss.elastic.co/u/Matt_McGovern)\ **Replies:** 0\ **Last updated:** [February 20, 2020, 4:25pm UTC](https://discuss.elastic.co/t/lifecycle-management-question-about-multiple-index-patterns-in-one-template/220226 "2020-02-20T16:25:01Z")
After upgrading our ElasticSearch in the recent months we now have Lifecycle Management to use - we have always used Curator to manage our rollover/delete indices, etc. Now we are looking to do away with Curator and use … --- ## [Manage ILM with ingestion pipeline](https://discuss.elastic.co/t/manage-ilm-with-ingestion-pipeline/220223)
**Author:** [@Federico\_Bevione](https://discuss.elastic.co/u/Federico_Bevione)\ **Replies:** 0\ **Last updated:** [February 20, 2020, 4:05pm UTC](https://discuss.elastic.co/t/manage-ilm-with-ingestion-pipeline/220223 "2020-02-20T16:05:08Z")
Hi there, Is there a way to manage ILM when the index name is built in the ingestion pipeline? In my scenario, metricbeats send data, specifing the target pipeline output.elasticsearch: hosts: \["${ELASTICSEARCH\_HOST… --- ## [Get cheapest trip departure based on inner hits](https://discuss.elastic.co/t/get-cheapest-trip-departure-based-on-inner-hits/220125)
**Author:** [@AndyFurniss](https://discuss.elastic.co/u/AndyFurniss)\ **Replies:** 4\ **Last updated:** [February 20, 2020, 3:58pm UTC](https://discuss.elastic.co/t/get-cheapest-trip-departure-based-on-inner-hits/220125 "2020-02-20T15:58:19Z")
I have a index containing trips. Each trip will have multiple departures, each departure will have it's own departure date and a collection of prices (each with a different currency). I want to be able to query and find… --- ## [Elasticsearch Cluster on Docker Stack Fails](https://discuss.elastic.co/t/elasticsearch-cluster-on-docker-stack-fails/220043)
**Author:** [@areller](https://discuss.elastic.co/u/areller)\ **Replies:** 3\ **Last updated:** [February 20, 2020, 3:21pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-on-docker-stack-fails/220043 "2020-02-20T15:21:01Z")
I try to create a 3-node Elasticsearch cluster on docker stack. I started with the docker-stack.yml file from this repository https://github.com/deviantony/docker-elk#how-to-scale-out-the-elasticsearch-cluster And exte… --- ## [How to structure this index/query problem](https://discuss.elastic.co/t/how-to-structure-this-index-query-problem/220189)
**Author:** [@martinjuhasz](https://discuss.elastic.co/u/martinjuhasz)\ **Replies:** 5\ **Last updated:** [February 20, 2020, 3:27pm UTC](https://discuss.elastic.co/t/how-to-structure-this-index-query-problem/220189 "2020-02-20T15:27:51Z")
Hey, i'm pretty new to using ES and wonder how one would solve my current problem, regarding how to index this best and how to query it. As an example lets say i have two entities in my application. Users and Challenge… --- ## [ELK cloud- kafka ec2 connection to visualize kafka-topic data on kibana](https://discuss.elastic.co/t/elk-cloud-kafka-ec2-connection-to-visualize-kafka-topic-data-on-kibana/219116)
**Author:** [@rahulanand](https://discuss.elastic.co/u/rahulanand)\ **Replies:** 1\ **Last updated:** [February 20, 2020, 3:04pm UTC](https://discuss.elastic.co/t/elk-cloud-kafka-ec2-connection-to-visualize-kafka-topic-data-on-kibana/219116 "2020-02-20T15:04:55Z")
Hi, I want to link kafka to elasticsearch, kibana to visualize data from kafka-topic. I was able to do it on local via following this link: https://logz.io/blog/deploying-kafka-with-elk/ But i am not able to replicate … --- ## [Webhook output inside ctx?](https://discuss.elastic.co/t/webhook-output-inside-ctx/219866)
**Author:** [@Chop](https://discuss.elastic.co/u/Chop)\ **Replies:** 4\ **Last updated:** [February 20, 2020, 2:49pm UTC](https://discuss.elastic.co/t/webhook-output-inside-ctx/219866 "2020-02-20T14:49:26Z")
I am running a webhook but i am not able to get the rest api call output into the context so i can send it through an email action is that possible? --- ## [Configuring Elasticsearch output in filebeat](https://discuss.elastic.co/t/configuring-elasticsearch-output-in-filebeat/220143)
**Author:** [@Ilayda\_Akinalan](https://discuss.elastic.co/u/Ilayda_Akinalan)\ **Replies:** 3\ **Last updated:** [February 20, 2020, 2:29pm UTC](https://discuss.elastic.co/t/configuring-elasticsearch-output-in-filebeat/220143 "2020-02-20T14:29:12Z")
Currently we are using Elasticsearch 6.7.1 and have: 3 master nodes and 4 data nodes. In filebeat configuration, should the output to elasticsearch point to master or the data nodes? We also have a load balancer for t… --- ## [How to use \_source to create a scripted filter](https://discuss.elastic.co/t/how-to-use-source-to-create-a-scripted-filter/219646)
**Author:** [@wiouser](https://discuss.elastic.co/u/wiouser)\ **Replies:** 11\ **Last updated:** [February 20, 2020, 1:56pm UTC](https://discuss.elastic.co/t/how-to-use-source-to-create-a-scripted-filter/219646 "2020-02-20T13:56:28Z")
Hi I am trying to write a query to return documents which has the length of the log field more than 900. It is a text field. Running the below search I get variable \_source is not defined GET logdata/\_search { "query… --- ## [How can we create an Elasticsearch cluster with AWS ECS and Docker](https://discuss.elastic.co/t/how-can-we-create-an-elasticsearch-cluster-with-aws-ecs-and-docker/220166)
**Author:** [@chamiduz](https://discuss.elastic.co/u/chamiduz)\ **Replies:** 1\ **Last updated:** [February 20, 2020, 12:47pm UTC](https://discuss.elastic.co/t/how-can-we-create-an-elasticsearch-cluster-with-aws-ecs-and-docker/220166 "2020-02-20T12:47:55Z")
Hi, I'm trying to create an ES cluster with AWS ECS and Docker. here is what i have already done. created aws infrastructure ECS cluster Network load balancer target groups for 9200,9300 ports and attached t… --- ## [Simulate tail -f](https://discuss.elastic.co/t/simulate-tail-f/219735)
**Author:** [@robertofabrizi](https://discuss.elastic.co/u/robertofabrizi)\ **Replies:** 6\ **Last updated:** [February 20, 2020, 12:19pm UTC](https://discuss.elastic.co/t/simulate-tail-f/219735 "2020-02-20T12:19:15Z")
Dear friends, I'm new to ElasticSearch, only been enjoying it as the backend of the Kibana instance running in production. I have a new requirement, I have to parse application logs in real time, until now via buffered… --- ## [S3 Snapshot on S3 compatible servers](https://discuss.elastic.co/t/s3-snapshot-on-s3-compatible-servers/217750)
**Author:** [@SimonJ](https://discuss.elastic.co/u/SimonJ)\ **Replies:** 11\ **Last updated:** [February 20, 2020, 10:34am UTC](https://discuss.elastic.co/t/s3-snapshot-on-s3-compatible-servers/217750 "2020-02-20T10:34:18Z")
Hi, I've been trying to setup the snapshot plugin in order to be able to backup my cluster, but I'm running into some issues with setting up the repository in ElasticSearch 7.5. I'm using OVH OpenStack Swift with S3 co… --- ## [How to add a new node to existing cluster](https://discuss.elastic.co/t/how-to-add-a-new-node-to-existing-cluster/220090)
**Author:** [@zeghitsama](https://discuss.elastic.co/u/zeghitsama)\ **Replies:** 3\ **Last updated:** [February 20, 2020, 10:03am UTC](https://discuss.elastic.co/t/how-to-add-a-new-node-to-existing-cluster/220090 "2020-02-20T10:03:05Z")
Hi, i want to add a new to the existing cluster. I already setup a new elasticsearch on another vm and named it as node-2. My first elasticsearch named it as node-1. Already configured both of it and restart the elastics… --- ## [ES 1.7 completion suggester throws zero results](https://discuss.elastic.co/t/es-1-7-completion-suggester-throws-zero-results/220092)
**Author:** [@deltafarce](https://discuss.elastic.co/u/deltafarce)\ **Replies:** 2\ **Last updated:** [February 20, 2020, 9:51am UTC](https://discuss.elastic.co/t/es-1-7-completion-suggester-throws-zero-results/220092 "2020-02-20T09:51:32Z")
I'm aware of 1.7 reaching EOL but I have to make this work on it. What I defined in the mapping: "mappings": { "questions": { "\_id": {"store": "yes", "path": "id"}, "\_source": {"enabled"… --- ## [Failed to load elasticsearch nodes](https://discuss.elastic.co/t/failed-to-load-elasticsearch-nodes/220107)
**Author:** [@shivsandeep](https://discuss.elastic.co/u/shivsandeep)\ **Replies:** 3\ **Last updated:** [February 20, 2020, 9:42am UTC](https://discuss.elastic.co/t/failed-to-load-elasticsearch-nodes/220107 "2020-02-20T09:42:45Z")
hi, i have setup elasticsearch 5.6.3 using docker but when i am trying to access that using my local spring application i am getting below error: " failed to load elasticsearch nodes : org.elasticsearch.client.transpo… --- ## [Unable to install ingest attachment plugin in windows using elasticsearch-plugin install ingest-attachment](https://discuss.elastic.co/t/unable-to-install-ingest-attachment-plugin-in-windows-using-elasticsearch-plugin-install-ingest-attachment/220104)
**Author:** [@samanvi\_sweety](https://discuss.elastic.co/u/samanvi_sweety)\ **Replies:** 6\ **Last updated:** [February 20, 2020, 9:24am UTC](https://discuss.elastic.co/t/unable-to-install-ingest-attachment-plugin-in-windows-using-elasticsearch-plugin-install-ingest-attachment/220104 "2020-02-20T09:24:51Z")
Exception in thread "main" java.net.ConnectException: Connection timed out: connect at java.base/java.net.PlainSocketImpl.connect0(Native Method) at java.base/java.net.PlainSocketImpl.socketConnect(PlainS… --- ## [Index lifecycle error illegal\_state\_exception: no rollover info found for \[metricbeat-6.8.4-2020.02.18\] with alias \[metricbeat\] the index has not yet rolled over with that alias](https://discuss.elastic.co/t/index-lifecycle-error-illegal-state-exception-no-rollover-info-found-for-metricbeat-6-8-4-2020-02-18-with-alias-metricbeat-the-index-has-not-yet-rolled-over-with-that-alias/220140)
**Author:** [@Yoga\_Konsultan](https://discuss.elastic.co/u/Yoga_Konsultan)\ **Replies:** 0\ **Last updated:** [February 20, 2020, 9:22am UTC](https://discuss.elastic.co/t/index-lifecycle-error-illegal-state-exception-no-rollover-info-found-for-metricbeat-6-8-4-2020-02-18-with-alias-metricbeat-the-index-has-not-yet-rolled-over-with-that-alias/220140 "2020-02-20T09:22:33Z")
i've found this error while index on rollver action : Index lifecycle error illegal\_state\_exception: no rollover info found for \[metricbeat-6.8.4-2020.02.18\] with alias \[metricbeat\] the index has not yet rolled over wit… --- ## [Efficient way to query Elasticsearch](https://discuss.elastic.co/t/efficient-way-to-query-elasticsearch/220094)
**Author:** [@sidshirke](https://discuss.elastic.co/u/sidshirke)\ **Replies:** 1\ **Last updated:** [February 20, 2020, 9:18am UTC](https://discuss.elastic.co/t/efficient-way-to-query-elasticsearch/220094 "2020-02-20T09:18:55Z")
Below is the short version of the dataset I am working on. ID TYPE DATA SERIES\_ID VALIDITY MOVIE\_1 MOVIE MOVIE\_DATA\_1 NULL 2000-2050 MOVIE\_2 MOVIE MOVIE\_DATA\_2 NULL 2000-2050 SERIES\_1 TV\_SERI… --- ## [Error from \_cat APIs: Values less than -1 bytes are not supported](https://discuss.elastic.co/t/error-from-cat-apis-values-less-than-1-bytes-are-not-supported/220071)
**Author:** [@anon17386273](https://discuss.elastic.co/u/anon17386273)\ **Replies:** 3\ **Last updated:** [February 20, 2020, 9:11am UTC](https://discuss.elastic.co/t/error-from-cat-apis-values-less-than-1-bytes-are-not-supported/220071 "2020-02-20T09:11:10Z")
Elasticsearch cluster running 7.1.1. I was adding/removing some nodes to the cluster, but no other config changes took place. The \_cat/nodes and \_cat/indices API started returning an error as below $ curl localhost:9200… --- ## [Td-agent logs stopped working](https://discuss.elastic.co/t/td-agent-logs-stopped-working/219907)
**Author:** [@krushnakantB](https://discuss.elastic.co/u/krushnakantB)\ **Replies:** 2\ **Last updated:** [February 20, 2020, 9:06am UTC](https://discuss.elastic.co/t/td-agent-logs-stopped-working/219907 "2020-02-20T09:06:36Z")
Hi All, Need a guideline for below mentioned issue. In our environment, we are using Elasticsearch to store web logs and we also use td-agent to pass data to elasticsearch. Elasticsearch version is 7.2.0, Kibana versio… --- ## [Querying geolocated events with a duration in time](https://discuss.elastic.co/t/querying-geolocated-events-with-a-duration-in-time/220127)
**Author:** [@JulGor](https://discuss.elastic.co/u/JulGor)\ **Replies:** 1\ **Last updated:** [February 20, 2020, 8:48am UTC](https://discuss.elastic.co/t/querying-geolocated-events-with-a-duration-in-time/220127 "2020-02-20T08:48:27Z")
Hello, I'm starting a new project and I thought that Elasticsearch could work for my use case but I have a problem I couldn't find the way to solve it and I hope anyone can shed some light on it. I want to store physic… --- ## [Testing Watcher without gold licence](https://discuss.elastic.co/t/testing-watcher-without-gold-licence/220128)
**Author:** [@Jakob](https://discuss.elastic.co/u/Jakob)\ **Replies:** 1\ **Last updated:** [February 20, 2020, 8:45am UTC](https://discuss.elastic.co/t/testing-watcher-without-gold-licence/220128 "2020-02-20T08:45:20Z")
Hello, I'm trying to implement watchers for our cluster however I am waiting for confirmation from support about getting gold licence. While I'm waiting for it I would like to start testing the watcher configurations I… --- ## [Elasticsearch store time series data when there are many properties fields (about 60000 fields)](https://discuss.elastic.co/t/elasticsearch-store-time-series-data-when-there-are-many-properties-fields-about-60000-fields/220114)
**Author:** [@qinlin](https://discuss.elastic.co/u/qinlin)\ **Replies:** 4\ **Last updated:** [February 20, 2020, 8:38am UTC](https://discuss.elastic.co/t/elasticsearch-store-time-series-data-when-there-are-many-properties-fields-about-60000-fields/220114 "2020-02-20T08:38:21Z")
store 60000 points value every 500 milliseconds with elasticsearch,there are two ways to design elasticsearch mapping: 1.one pointName/one timestamp in one doc,like this: \_id timestamp pointName value uuid1 … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1009) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1011)