# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1770

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1771

---

## ["Search analyzer without index analyzer" migration tool error](https://discuss.elastic.co/t/search-analyzer-without-index-analyzer-migration-tool-error/121912)

<div class="topic-metadata">

**Author:** [@kohner86](https://discuss.elastic.co/u/kohner86)\
**Replies:** 1\
**Last updated:** [March 1, 2018, 1:30pm UTC](https://discuss.elastic.co/t/search-analyzer-without-index-analyzer-migration-tool-error/121912 "2018-03-01T13:30:22Z")

</div>

Hi, We're getting ready to perform an upgrade of an ES cluster from 1.7.5 to 2.4.6 (the index started off life on the 0.9.x series) and from running the migration checker I'm seeing a an error around "Search analyzer wi…

---

## [Reindexing: unsupported parameters: \[payloads : false\]](https://discuss.elastic.co/t/reindexing-unsupported-parameters-payloads-false/122057)

<div class="topic-metadata">

**Author:** [@atom](https://discuss.elastic.co/u/atom)\
**Replies:** 0\
**Last updated:** [March 1, 2018, 12:47pm UTC](https://discuss.elastic.co/t/reindexing-unsupported-parameters-payloads-false/122057 "2018-03-01T12:47:25Z")

</div>

Hi :slight\_smile: im currently upgrading our second ES instance from v2 to v5. After upgrading i want to reindex my indexes in order to upgrade to v6. Reindexing was successful in 30 of 41 indexes. Unfortunately, the …

---

## [What can explain ElasticSearch 2.4 not accepting to create watchers via curl?](https://discuss.elastic.co/t/what-can-explain-elasticsearch-2-4-not-accepting-to-create-watchers-via-curl/122070)

<div class="topic-metadata">

**Author:** [@ujjain](https://discuss.elastic.co/u/ujjain)\
**Replies:** 0\
**Last updated:** [March 1, 2018, 1:23pm UTC](https://discuss.elastic.co/t/what-can-explain-elasticsearch-2-4-not-accepting-to-create-watchers-via-curl/122070 "2018-03-01T13:23:21Z")

</div>

\[root@elk01 ~\]# curl -XPUT 'http://127.0.0.1:9200/\_watcher/watch/log\_error\_watch' -d '{ "trigger" : { "schedule" : { "interval" : "10s" } }, "input" : { "search" : { "request" : { "indices" : …

---

## [Indices Settings](https://discuss.elastic.co/t/indices-settings/122068)

<div class="topic-metadata">

**Author:** [@moni15moni](https://discuss.elastic.co/u/moni15moni)\
**Replies:** 0\
**Last updated:** [March 1, 2018, 1:21pm UTC](https://discuss.elastic.co/t/indices-settings/122068 "2018-03-01T13:21:04Z")

</div>

Hi Team, We have used spinning disks of 2 TB on every node with 16GB and 4 CPU's . I have changed the template setting to the following , IS there any thing be tuned. index" : { "refresh\_interval" : "-1", "number\_of\_…

---

## [Can’t create a new index in elasticsearch](https://discuss.elastic.co/t/can-t-create-a-new-index-in-elasticsearch/122064)

<div class="topic-metadata">

**Author:** [@geppo](https://discuss.elastic.co/u/geppo)\
**Replies:** 0\
**Last updated:** [March 1, 2018, 1:18pm UTC](https://discuss.elastic.co/t/can-t-create-a-new-index-in-elasticsearch/122064 "2018-03-01T13:18:14Z")

</div>

hi, i'm new in logstash and I would try to index my apache logs in elasticsearch 5.4.3. I have followed this guide on official es blog: https://www.elastic.co/blog/logstash\_lesson\_elasticsearch\_mapping When I try to cre…

---

## [Recommended # of Shards for 1.5 TB = 2.752.250.197 Docs](https://discuss.elastic.co/t/recommended-of-shards-for-1-5-tb-2-752-250-197-docs/121208)

<div class="topic-metadata">

**Author:** [@cmadera\_rp](https://discuss.elastic.co/u/cmadera_rp)\
**Replies:** 5\
**Last updated:** [March 1, 2018, 12:01pm UTC](https://discuss.elastic.co/t/recommended-of-shards-for-1-5-tb-2-752-250-197-docs/121208 "2018-03-01T12:01:16Z")

</div>

Hello I'm working with a cluster with 6 nodes with 64 Gb of Ram and 1.7Tb of storage SSD NVMe on each node actually all our data is actively used and we have one index per year (total 24 index), 4 of them are the most …

---

## [Getting multiple exception on restart of node - org.elasticsearch.action.FailedNodeException](https://discuss.elastic.co/t/getting-multiple-exception-on-restart-of-node-org-elasticsearch-action-failednodeexception/120173)

<div class="topic-metadata">

**Author:** [@nrmohta](https://discuss.elastic.co/u/nrmohta)\
**Replies:** 1\
**Last updated:** [March 1, 2018, 11:19am UTC](https://discuss.elastic.co/t/getting-multiple-exception-on-restart-of-node-org-elasticsearch-action-failednodeexception/120173 "2018-03-01T11:19:28Z")

</div>

Hi Team, We got below exceptions multiple times in our cluster (2 nodes) setup. After some times it gets auto recovered and ES is running fine. We want to understand what is the exact cause and is there any data loss sc…

---

## [Querying embedded arrays vs named objects](https://discuss.elastic.co/t/querying-embedded-arrays-vs-named-objects/121996)

<div class="topic-metadata">

**Author:** [@Richard\_Spence](https://discuss.elastic.co/u/Richard_Spence)\
**Replies:** 0\
**Last updated:** [March 1, 2018, 8:33am UTC](https://discuss.elastic.co/t/querying-embedded-arrays-vs-named-objects/121996 "2018-03-01T08:33:42Z")

</div>

I'm trying to decide how best to model data between these 2 options: Explicitly named objects.... "categories" : { "food" : { "categoryName" : "Food", "score" : 1 }, "shopping" : { "categoryName" : "Shop…

---

## [Can I send Cloudwatch logs to Elasticsearch without Logstash?](https://discuss.elastic.co/t/can-i-send-cloudwatch-logs-to-elasticsearch-without-logstash/122028)

<div class="topic-metadata">

**Author:** [@ujjain](https://discuss.elastic.co/u/ujjain)\
**Replies:** 0\
**Last updated:** [March 1, 2018, 10:09am UTC](https://discuss.elastic.co/t/can-i-send-cloudwatch-logs-to-elasticsearch-without-logstash/122028 "2018-03-01T10:09:18Z")

</div>

We'd like to have the AWS Cloudwatch logs in ElasticSearch. Would it be possible to implement this, without using Logstash and the Cloudwatch input plugin?

---

## [ElasticSearch for monitoring and alerting as an alternative for Nagios](https://discuss.elastic.co/t/elasticsearch-for-monitoring-and-alerting-as-an-alternative-for-nagios/122027)

<div class="topic-metadata">

**Author:** [@ujjain](https://discuss.elastic.co/u/ujjain)\
**Replies:** 0\
**Last updated:** [March 1, 2018, 10:07am UTC](https://discuss.elastic.co/t/elasticsearch-for-monitoring-and-alerting-as-an-alternative-for-nagios/122027 "2018-03-01T10:07:51Z")

</div>

Since we already have filebeat, metricbeat and heartbeat configured and running. I wonder if people have successfully implemented the ELK stack for actual monitoring with alerting/notifications instead of using traditio…

---

## [How to fix repository\_missing\_exception?](https://discuss.elastic.co/t/how-to-fix-repository-missing-exception/122013)

<div class="topic-metadata">

**Author:** [@asp](https://discuss.elastic.co/u/asp)\
**Replies:** 0\
**Last updated:** [March 1, 2018, 9:38am UTC](https://discuss.elastic.co/t/how-to-fix-repository-missing-exception/122013 "2018-03-01T09:38:24Z")

</div>

Hi, I made a snapshot on production tared the complete repository folder and moved it to another system for deeper analysis. Path configuration for repository and snapshot is identical. But on my target system I had t…

---

## [Elasticsearch multi match](https://discuss.elastic.co/t/elasticsearch-multi-match/121380)

<div class="topic-metadata">

**Author:** [@svarup](https://discuss.elastic.co/u/svarup)\
**Replies:** 2\
**Last updated:** [March 1, 2018, 8:56am UTC](https://discuss.elastic.co/t/elasticsearch-multi-match/121380 "2018-03-01T08:56:29Z")

</div>

I have index with dynamic mapping 'mappings' =\> \[ 'index\_type' =\> \[ 'dynamic\_templates' =\> \[ \[ 'property\_name' =\> \[ 'match\_mapping\_type' =\> '\*', 'match' =\> 'name\_property\_\*', 'mapping' =\> …

---

## [Using results of one query in another over multiple indices](https://discuss.elastic.co/t/using-results-of-one-query-in-another-over-multiple-indices/122002)

<div class="topic-metadata">

**Author:** [@kartik\_jain](https://discuss.elastic.co/u/kartik_jain)\
**Replies:** 0\
**Last updated:** [March 1, 2018, 8:51am UTC](https://discuss.elastic.co/t/using-results-of-one-query-in-another-over-multiple-indices/122002 "2018-03-01T08:51:36Z")

</div>

I want to send a query to my 1st index and then use the results of this query over the the 2nd index. I looked into pipeline aggregations but it works only on a single index. So is there any way i could achieve this?

---

## [Disable embedded elastic search](https://discuss.elastic.co/t/disable-embedded-elastic-search/121691)

<div class="topic-metadata">

**Author:** [@sana](https://discuss.elastic.co/u/sana)\
**Replies:** 2\
**Last updated:** [March 1, 2018, 8:14am UTC](https://discuss.elastic.co/t/disable-embedded-elastic-search/121691 "2018-03-01T08:14:50Z")

</div>

i have all my log data in an external elasticsearch but everytime i configure spring data elasticsearch it create an embadded elastic search and ignore the external one, please how to configure it so connects to my insta…

---

## [Neo4j Cypher query to Elasticsearch conversion](https://discuss.elastic.co/t/neo4j-cypher-query-to-elasticsearch-conversion/121852)

<div class="topic-metadata">

**Author:** [@Shreeraksha](https://discuss.elastic.co/u/Shreeraksha)\
**Replies:** 4\
**Last updated:** [March 1, 2018, 7:50am UTC](https://discuss.elastic.co/t/neo4j-cypher-query-to-elasticsearch-conversion/121852 "2018-03-01T07:50:20Z")

</div>

MATCH (:Person {id: 19791209310731})-\[:KNOWS\*3..5\]-(person:Person) WITH DISTINCT person MATCH (person)-\[:IS\_LOCATED\_IN\]-\>(:City)-\[:IS\_PART\_OF\]-\>(:Country {name: 'Pakistan'}), (person)\<-\[:HAS\_CREATOR\]-(message:Messag…

---

## [ElasticsearchIndexer needs some new property 6.1](https://discuss.elastic.co/t/elasticsearchindexer-needs-some-new-property-6-1/121277)

<div class="topic-metadata">

**Author:** [@satyarajp](https://discuss.elastic.co/u/satyarajp)\
**Replies:** 4\
**Last updated:** [March 1, 2018, 7:30am UTC](https://discuss.elastic.co/t/elasticsearchindexer-needs-some-new-property-6-1/121277 "2018-03-01T07:30:42Z")

</div>

Hi Team, I'm trying to create a class to initialize my elastic indexing. What is the transport type that I can use to run this locally on fresh setup. (Local is no longer supported in 6.1.1) What are the mandatory…

---

## [Elastic Search 6.2.2 Not starting on Windows](https://discuss.elastic.co/t/elastic-search-6-2-2-not-starting-on-windows/121987)

<div class="topic-metadata">

**Author:** [@paul1243](https://discuss.elastic.co/u/paul1243)\
**Replies:** 0\
**Last updated:** [March 1, 2018, 6:19am UTC](https://discuss.elastic.co/t/elastic-search-6-2-2-not-starting-on-windows/121987 "2018-03-01T06:19:54Z")

</div>

Hi, I have tried upgrading the Elastic Search to 6.2.2, I found the below error message: C:\\ELK\\elasticsearch-6.2.2\\bin\>elasticsearch \\Java\\jdk1.8.0\_151\\bin\\java.exe" -cp "C:\\ELK\\elasticsearch-6.2.2\\lib\*" "org.elasti…

---

## [Can't change analyzer for \_all field](https://discuss.elastic.co/t/cant-change-analyzer-for-all-field/121982)

<div class="topic-metadata">

**Author:** [@jaisharma](https://discuss.elastic.co/u/jaisharma)\
**Replies:** 1\
**Last updated:** [March 1, 2018, 5:58am UTC](https://discuss.elastic.co/t/cant-change-analyzer-for-all-field/121982 "2018-03-01T05:58:47Z")

</div>

ES=2.4.0 My configuration in elasticsearch.yml has default analyzer : keyword index.analysis.analyzer.default.type: keyword Now i've a field which stores notes and thus i want to analyze only this particular field. Th…

---

## [Retention Policy for a single growing index](https://discuss.elastic.co/t/retention-policy-for-a-single-growing-index/121191)

<div class="topic-metadata">

**Author:** [@shrikantgulia](https://discuss.elastic.co/u/shrikantgulia)\
**Replies:** 7\
**Last updated:** [March 1, 2018, 5:24am UTC](https://discuss.elastic.co/t/retention-policy-for-a-single-growing-index/121191 "2018-03-01T05:24:59Z")

</div>

I have a Single index and its growing daily and as i cant use Curator for data retention as it cant delete data from index How should i proceed A help would be really appreciated Regards Shrikant

---

## [Security Audit logs not printing to console with docker](https://discuss.elastic.co/t/security-audit-logs-not-printing-to-console-with-docker/119307)

<div class="topic-metadata">

**Author:** [@aaronloesattv](https://discuss.elastic.co/u/aaronloesattv)\
**Replies:** 4\
**Last updated:** [March 1, 2018, 5:02am UTC](https://discuss.elastic.co/t/security-audit-logs-not-printing-to-console-with-docker/119307 "2018-03-01T05:02:58Z")

</div>

Our ES docker container ran out of disk because of the security audit logs being written to file. I found this issue on github (https://github.com/elastic/elasticsearch-docker/issues/78) and went to verify that our docke…

---

## ["Doubling down on open" question](https://discuss.elastic.co/t/doubling-down-on-open-question/121916)

<div class="topic-metadata">

**Author:** [@arisbanach](https://discuss.elastic.co/u/arisbanach)\
**Replies:** 5\
**Last updated:** [March 1, 2018, 3:54am UTC](https://discuss.elastic.co/t/doubling-down-on-open-question/121916 "2018-03-01T03:54:20Z")

</div>

I am just hoping for some clarification: will X-Pack security be free now? Or just open source and we still need to pay for a license?

---

## [Very high CPU usage of elastic nodes](https://discuss.elastic.co/t/very-high-cpu-usage-of-elastic-nodes/121877)

<div class="topic-metadata">

**Author:** [@dboss101](https://discuss.elastic.co/u/dboss101)\
**Replies:** 5\
**Last updated:** [March 1, 2018, 1:20am UTC](https://discuss.elastic.co/t/very-high-cpu-usage-of-elastic-nodes/121877 "2018-03-01T01:20:49Z")

</div>

Hi, we are running a cluster of elasticsearch with the following specs: we run on AWS EC2's (self managed, not their Saas). 3 nodes (all do everything... data, master) each node is r4.large type (2 CPU, 15GB RAM), 8GB…

---

## [Is the nested document bitset filter cache eviction added in any version?](https://discuss.elastic.co/t/is-the-nested-document-bitset-filter-cache-eviction-added-in-any-version/121794)

<div class="topic-metadata">

**Author:** [@antonpious](https://discuss.elastic.co/u/antonpious)\
**Replies:** 0\
**Last updated:** [February 28, 2018, 7:07am UTC](https://discuss.elastic.co/t/is-the-nested-document-bitset-filter-cache-eviction-added-in-any-version/121794 "2018-02-28T07:07:51Z")

</div>

I have gone through this discussion Can I print out bitset cache sizes by filter (or what’s eating my heap)? Specifically the reply by mvg Martijn Van Groningen No, the bitset filter cache caches bitsets per nested f…

---

## [Searching content doesn't show exact output](https://discuss.elastic.co/t/searching-content-doesnt-show-exact-output/121883)

<div class="topic-metadata">

**Author:** [@kunam](https://discuss.elastic.co/u/kunam)\
**Replies:** 7\
**Last updated:** [February 28, 2018, 10:41pm UTC](https://discuss.elastic.co/t/searching-content-doesnt-show-exact-output/121883 "2018-02-28T22:41:09Z")

</div>

Hi elastic, I'm indexing some text files to elastic search, i've installed ingest attachment plugin and successfully created mapping and indexed few text files in to ES and the file which i've indexed is Base 64 encoded…

---

## [Frequency aggregation](https://discuss.elastic.co/t/frequency-aggregation/121946)

<div class="topic-metadata">

**Author:** [@queenstownswords](https://discuss.elastic.co/u/queenstownswords)\
**Replies:** 0\
**Last updated:** [February 28, 2018, 10:05pm UTC](https://discuss.elastic.co/t/frequency-aggregation/121946 "2018-02-28T22:05:34Z")

</div>

Howdy, Given: each event with timestamp is already in an index. Problem: I am looking for a way to aggregate (percentile) the frequency of events. For example, between the hours of 8am and 5pm, what is the load in t…

---

## [Hot to get a duration value extracted from field message into an new field](https://discuss.elastic.co/t/hot-to-get-a-duration-value-extracted-from-field-message-into-an-new-field/121888)

<div class="topic-metadata">

**Author:** [@sklein](https://discuss.elastic.co/u/sklein)\
**Replies:** 1\
**Last updated:** [February 28, 2018, 9:50pm UTC](https://discuss.elastic.co/t/hot-to-get-a-duration-value-extracted-from-field-message-into-an-new-field/121888 "2018-02-28T21:50:59Z")

</div>

I am hardly trying to extract the Duration value (in the example below: 10.400) using grok and to create a field Conference\_duration. The reason for the extraction is that I would like to summarize it or to receive an a…

---

## [ES-Hadoop configuration parameter es.read.source.filter doesn't accept a list](https://discuss.elastic.co/t/es-hadoop-configuration-parameter-es-read-source-filter-doesnt-accept-a-list/121576)

<div class="topic-metadata">

**Author:** [@kahndor](https://discuss.elastic.co/u/kahndor)\
**Replies:** 3\
**Last updated:** [February 28, 2018, 9:39pm UTC](https://discuss.elastic.co/t/es-hadoop-configuration-parameter-es-read-source-filter-doesnt-accept-a-list/121576 "2018-02-28T21:39:25Z")

</div>

When I try to limit my ES results using Spark and the Python API I am able to retrieve only the desired fields with: es\_conf = {"es.nodes": "localhost", "es.port" : "9200", "es.read.source.filter": "some\_field"} But i…

---

## [Finding all occurrences of a phrase or sentence](https://discuss.elastic.co/t/finding-all-occurrences-of-a-phrase-or-sentence/121925)

<div class="topic-metadata">

**Author:** [@cpkthompson](https://discuss.elastic.co/u/cpkthompson)\
**Replies:** 1\
**Last updated:** [February 28, 2018, 9:35pm UTC](https://discuss.elastic.co/t/finding-all-occurrences-of-a-phrase-or-sentence/121925 "2018-02-28T21:35:24Z")

</div>

Hello all, I need help from a high level perspective (or a link to documentation) how I can find occurrences of a block of sentences in all documents indexed. For example: Say a specific version of the entire Bible in i…

---

## [Mean calculating within elasticsearch](https://discuss.elastic.co/t/mean-calculating-within-elasticsearch/121938)

<div class="topic-metadata">

**Author:** [@soukaina](https://discuss.elastic.co/u/soukaina)\
**Replies:** 0\
**Last updated:** [February 28, 2018, 8:43pm UTC](https://discuss.elastic.co/t/mean-calculating-within-elasticsearch/121938 "2018-02-28T20:43:15Z")

</div>

Hi, i have an index in elasticsearch that contains 3 fields(time,tweet, sentiment compound) and want to add new field that contains sentiment compound's mean for each 5 min . Does any one have an idea about how to do t…

---

## [Trying to decide to use indices or types](https://discuss.elastic.co/t/trying-to-decide-to-use-indices-or-types/121771)

<div class="topic-metadata">

**Author:** [@dr\_dob](https://discuss.elastic.co/u/dr_dob)\
**Replies:** 3\
**Last updated:** [February 28, 2018, 8:20pm UTC](https://discuss.elastic.co/t/trying-to-decide-to-use-indices-or-types/121771 "2018-02-28T20:20:40Z")

</div>

Hi Use case: I'm trying to separate my documents for each client. As in, one client may only be interested in documents that only have \_\_\_ value for \_\_\_ field. Currently, I have a main index with all documents, and then…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1769)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1771)
