# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1759

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1760

---

## [Reindex Error](https://discuss.elastic.co/t/reindex-error/123102)

<div class="topic-metadata">

**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\
**Replies:** 3\
**Last updated:** [March 9, 2018, 3:40pm UTC](https://discuss.elastic.co/t/reindex-error/123102 "2018-03-09T15:40:15Z")

</div>

Hi, I'm trying to reindex a 1.7.0 kibana index to 2.4.6 via the elasticsearch-migration plugin and am seeing the following error: PUT /.kibana-2.4.6 failed with \[400\] Mapping definition for \[\_size\] has unsupported para…

---

## [Turn a tokenized string into a list of tokens?](https://discuss.elastic.co/t/turn-a-tokenized-string-into-a-list-of-tokens/123295)

<div class="topic-metadata">

**Author:** [@stefan3](https://discuss.elastic.co/u/stefan3)\
**Replies:** 0\
**Last updated:** [March 9, 2018, 3:26pm UTC](https://discuss.elastic.co/t/turn-a-tokenized-string-into-a-list-of-tokens/123295 "2018-03-09T15:26:27Z")

</div>

I am analysing texts with Elastic Search + Kibana 6.2: I have a text field (say "mycontent") that I'd need to turn into a list of the tokens (not just the tokenized string) such that in Kibana I can get a count of the v…

---

## [Elasticsearch says the disk is out of space, but \[df -h\] shows not](https://discuss.elastic.co/t/elasticsearch-says-the-disk-is-out-of-space-but-df-h-shows-not/123223)

<div class="topic-metadata">

**Author:** [@helloEson](https://discuss.elastic.co/u/helloEson)\
**Replies:** 6\
**Last updated:** [March 9, 2018, 3:23pm UTC](https://discuss.elastic.co/t/elasticsearch-says-the-disk-is-out-of-space-but-df-h-shows-not/123223 "2018-03-09T15:23:35Z")

</div>

Today hours ago, when we found the Kibana shows an error like below: Error: Request to Elasticsearch failed: {"error":{"root\_cause":\[\],"type":"search\_phase\_execution\_exception","reason":"all shards failed","phase":"quer…

---

## [One instance of log4net not appearing in elasticsearch](https://discuss.elastic.co/t/one-instance-of-log4net-not-appearing-in-elasticsearch/123294)

<div class="topic-metadata">

**Author:** [@peter1992](https://discuss.elastic.co/u/peter1992)\
**Replies:** 0\
**Last updated:** [March 9, 2018, 3:18pm UTC](https://discuss.elastic.co/t/one-instance-of-log4net-not-appearing-in-elasticsearch/123294 "2018-03-09T15:18:00Z")

</div>

We have an instance of Log4net that does not appear to be appearing in elastic search. If we log log4net into the event logs it logs fine. The log4net config has the same setup as other applications on the same server wh…

---

## [A few general questions about Elasticsearch](https://discuss.elastic.co/t/a-few-general-questions-about-elasticsearch/120390)

<div class="topic-metadata">

**Author:** [@arisbanach](https://discuss.elastic.co/u/arisbanach)\
**Replies:** 13\
**Last updated:** [March 9, 2018, 3:07pm UTC](https://discuss.elastic.co/t/a-few-general-questions-about-elasticsearch/120390 "2018-03-09T15:07:58Z")

</div>

I've been curious about a few aspects of Elasticsearch I was hoping I could get some answers to: What is the best way to deal with queries that bring down the entire cluster by causing Elasticsearch to run out of memo…

---

## [Non-heap memory usage growing out of control (leak?)](https://discuss.elastic.co/t/non-heap-memory-usage-growing-out-of-control-leak/123278)

<div class="topic-metadata">

**Author:** [@Jong\_Kim](https://discuss.elastic.co/u/Jong_Kim)\
**Replies:** 0\
**Last updated:** [March 9, 2018, 2:09pm UTC](https://discuss.elastic.co/t/non-heap-memory-usage-growing-out-of-control-leak/123278 "2018-03-09T14:09:52Z")

</div>

Elasticsearch version: 5.5.1 Search Guard version: 5.5.1 (including netty tcnative 2.0.1) OS: SUSE Linux Enterprise Server 12 (x86\_64) Kernel version: 4.4.114-94.11-default java version: "1.8.0\_152" Java(TM) SE Run…

---

## [Porting to High Level Rest Client](https://discuss.elastic.co/t/porting-to-high-level-rest-client/123166)

<div class="topic-metadata">

**Author:** [@questar](https://discuss.elastic.co/u/questar)\
**Replies:** 1\
**Last updated:** [March 9, 2018, 1:53pm UTC](https://discuss.elastic.co/t/porting-to-high-level-rest-client/123166 "2018-03-09T13:53:39Z")

</div>

The transport client supports the following Elastic example: AggregationBuilder aggregation = AggregationBuilders .significantTerms("significant\_countries") .field("address.country"); SearchResponse sr = client.pr…

---

## [Unable to GET endpoint](https://discuss.elastic.co/t/unable-to-get-endpoint/123143)

<div class="topic-metadata">

**Author:** [@Darnell\_Martin](https://discuss.elastic.co/u/Darnell_Martin)\
**Replies:** 4\
**Last updated:** [March 9, 2018, 1:36pm UTC](https://discuss.elastic.co/t/unable-to-get-endpoint/123143 "2018-03-09T13:36:58Z")

</div>

I am having an issue running the command curl -XGET -k -u username:password https://localhost:9200/\_cat/health on Elasticsearch 6.2.2 with X-Pack installed. It is returning a 500 error whenever the xpack.security.audit.e…

---

## [How to view all the surrounding log lines around a selected log line in a specific order using elastic search or even in kibanna?](https://discuss.elastic.co/t/how-to-view-all-the-surrounding-log-lines-around-a-selected-log-line-in-a-specific-order-using-elastic-search-or-even-in-kibanna/123265)

<div class="topic-metadata">

**Author:** [@zakkhan](https://discuss.elastic.co/u/zakkhan)\
**Replies:** 0\
**Last updated:** [March 9, 2018, 1:11pm UTC](https://discuss.elastic.co/t/how-to-view-all-the-surrounding-log-lines-around-a-selected-log-line-in-a-specific-order-using-elastic-search-or-even-in-kibanna/123265 "2018-03-09T13:11:37Z")

</div>

We are currently using kibanna, which gives you option to view surrounding logs but it doesn't provide you those log lines in the exact order. Is there a way i can view all log lines in a order like they were in a raw lo…

---

## [Discover: Request Timeout after 1200000ms](https://discuss.elastic.co/t/discover-request-timeout-after-1200000ms/123263)

<div class="topic-metadata">

**Author:** [@rmarin](https://discuss.elastic.co/u/rmarin)\
**Replies:** 1\
**Last updated:** [March 9, 2018, 1:02pm UTC](https://discuss.elastic.co/t/discover-request-timeout-after-1200000ms/123263 "2018-03-09T13:02:04Z")

</div>

Hi, When I try to search with a period upper than 3 or 4 hours, I have the timeout request message in Kibana ("Discover: Request Timeout after 30000ms"). I have already try to up the timeout to 60 then 120 secs but the…

---

## [Understanding json typing](https://discuss.elastic.co/t/understanding-json-typing/122932)

<div class="topic-metadata">

**Author:** [@Tim\_Coote1](https://discuss.elastic.co/u/Tim_Coote1)\
**Replies:** 4\
**Last updated:** [March 9, 2018, 12:59pm UTC](https://discuss.elastic.co/t/understanding-json-typing/122932 "2018-03-09T12:59:16Z")

</div>

I'm getting errors of this form: "error"=\>{"type"=\>"mapper\_parsing\_exception", "reason"=\>"failed to parse \[valueId.value\]", "caused\_by"=\>{"type"=\>"json\_parse\_exception", "reason"=\>"Current token (VALUE\_TRUE) not numeric…

---

## [Unable to use es.index.read.missing.as.empty with spark sql](https://discuss.elastic.co/t/unable-to-use-es-index-read-missing-as-empty-with-spark-sql/120326)

<div class="topic-metadata">

**Author:** [@bjet007](https://discuss.elastic.co/u/bjet007)\
**Replies:** 4\
**Last updated:** [March 9, 2018, 10:51am UTC](https://discuss.elastic.co/t/unable-to-use-es-index-read-missing-as-empty-with-spark-sql/120326 "2018-03-09T10:51:21Z")

</div>

I'm trying to read data with spark in elasticsearch on indexe that could not exist, since my index has a date pattern. Since it's expected in my situation I only want an empty dataset. Is there a way to do it? I'm using…

---

## [Different load on nodes](https://discuss.elastic.co/t/different-load-on-nodes/123228)

<div class="topic-metadata">

**Author:** [@mats990](https://discuss.elastic.co/u/mats990)\
**Replies:** 4\
**Last updated:** [March 9, 2018, 10:35am UTC](https://discuss.elastic.co/t/different-load-on-nodes/123228 "2018-03-09T10:35:25Z")

</div>

Hi, We had more load on our cluster than usual and at that time we noticed some strange behavior. A node that hold primaries had much higher GC count. All nodes have the same configuration, JVM: 1.8.0\_162 ES: 5.6.4. Th…

---

## [Scripted Similarity performance](https://discuss.elastic.co/t/scripted-similarity-performance/123098)

<div class="topic-metadata">

**Author:** [@Barry\_Woods](https://discuss.elastic.co/u/Barry_Woods)\
**Replies:** 2\
**Last updated:** [March 9, 2018, 10:14am UTC](https://discuss.elastic.co/t/scripted-similarity-performance/123098 "2018-03-09T10:14:28Z")

</div>

We have previously been using a custom similarity plugin to meet the scoring needs of our application. It was pretty simple as all I wanted out of it was to ignore TF/IDF so I could compare scores across indices. In the…

---

## [Understanding ES performance metrics](https://discuss.elastic.co/t/understanding-es-performance-metrics/123229)

<div class="topic-metadata">

**Author:** [@Juris\_Rats](https://discuss.elastic.co/u/Juris_Rats)\
**Replies:** 0\
**Last updated:** [March 9, 2018, 9:04am UTC](https://discuss.elastic.co/t/understanding-es-performance-metrics/123229 "2018-03-09T09:04:04Z")

</div>

Hi, I am asking for help again. I have created ES cluster to evaluate it's performance for our use cases. The cluster lives in MS Azure cloud and has 6 nodes - 1 dedicated master (only) node, 2 hot data nodes and 3 war…

---

## [GET latest value for each unique value?](https://discuss.elastic.co/t/get-latest-value-for-each-unique-value/123196)

<div class="topic-metadata">

**Author:** [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\
**Replies:** 5\
**Last updated:** [March 9, 2018, 8:42am UTC](https://discuss.elastic.co/t/get-latest-value-for-each-unique-value/123196 "2018-03-09T08:42:59Z")

</div>

Hi, I have the query below which will provide me with the latest error for a certain location. However I have multiple locations and I would like to pull the latest error for each location (without having to put in a wh…

---

## [Merge doc\_count aggregation and sum](https://discuss.elastic.co/t/merge-doc-count-aggregation-and-sum/123218)

<div class="topic-metadata">

**Author:** [@cekeriya](https://discuss.elastic.co/u/cekeriya)\
**Replies:** 0\
**Last updated:** [March 9, 2018, 8:29am UTC](https://discuss.elastic.co/t/merge-doc-count-aggregation-and-sum/123218 "2018-03-09T08:29:05Z")

</div>

For this question I want you to focus on "entities" field I have lots of this kind of data in ES { "sighting\_of\_ref": "indicator--6fcfde95-97b8-49b4-a9c2-0be60d7de3bf", "observed\_data\_refs": \[ "observed-data--6…

---

## [Merge count aggregation for nested objects](https://discuss.elastic.co/t/merge-count-aggregation-for-nested-objects/123082)

<div class="topic-metadata">

**Author:** [@cekeriya](https://discuss.elastic.co/u/cekeriya)\
**Replies:** 0\
**Last updated:** [March 8, 2018, 1:52pm UTC](https://discuss.elastic.co/t/merge-count-aggregation-for-nested-objects/123082 "2018-03-08T13:52:43Z")

</div>

For this question I want you to focus on "entities" field I have lots of this kind of data in ES { "sighting\_of\_ref": "indicator--6fcfde95-97b8-49b4-a9c2-0be60d7de3bf", "observed\_data\_refs": \[ "observed-data--6…

---

## [Deleting snapshots on S3 sometimes fails with NoSuchFileException](https://discuss.elastic.co/t/deleting-snapshots-on-s3-sometimes-fails-with-nosuchfileexception/123214)

<div class="topic-metadata">

**Author:** [@Dominik\_Stadler](https://discuss.elastic.co/u/Dominik_Stadler)\
**Replies:** 0\
**Last updated:** [March 9, 2018, 7:53am UTC](https://discuss.elastic.co/t/deleting-snapshots-on-s3-sometimes-fails-with-nosuchfileexception/123214 "2018-03-09T07:53:28Z")

</div>

Hi, we run a number of Elasticsearch clusters on Amazon EC2 clusters and perform regular hourly snapshot to S3 using the AWS plugins. Afterwards, the snapshots are "thinned out" by removing some of the snapshots earlier…

---

## [Why plugins can't be added dynamically into ES](https://discuss.elastic.co/t/why-plugins-cant-be-added-dynamically-into-es/122610)

<div class="topic-metadata">

**Author:** [@fhalde](https://discuss.elastic.co/u/fhalde)\
**Replies:** 1\
**Last updated:** [March 9, 2018, 6:36am UTC](https://discuss.elastic.co/t/why-plugins-cant-be-added-dynamically-into-es/122610 "2018-03-09T06:36:38Z")

</div>

Just wondering what is the ES internal design like that makes it difficult to install a plugin dynamically? Why is it that we always have to restart the nodes?

---

## [Why elasticsearch used different languages like painless and groovy in different cases?](https://discuss.elastic.co/t/why-elasticsearch-used-different-languages-like-painless-and-groovy-in-different-cases/123150)

<div class="topic-metadata">

**Author:** [@saikrishnagaddipati](https://discuss.elastic.co/u/saikrishnagaddipati)\
**Replies:** 2\
**Last updated:** [March 9, 2018, 5:54am UTC](https://discuss.elastic.co/t/why-elasticsearch-used-different-languages-like-painless-and-groovy-in-different-cases/123150 "2018-03-09T05:54:45Z")

</div>

As we know Scripting is supported in many APIs. Can someone explain me at which scenario we should use groovy and which scenario we should use painless or other scripting languages? I was going through the elastic docum…

---

## [Example watches repo update](https://discuss.elastic.co/t/example-watches-repo-update/123111)

<div class="topic-metadata">

**Author:** [@annk](https://discuss.elastic.co/u/annk)\
**Replies:** 1\
**Last updated:** [March 9, 2018, 5:20am UTC](https://discuss.elastic.co/t/example-watches-repo-update/123111 "2018-03-09T05:20:20Z")

</div>

Hi, any plans to update sample watches for 6.2 version ? Thanks

---

## [Unordered results from Elastic search](https://discuss.elastic.co/t/unordered-results-from-elastic-search/122233)

<div class="topic-metadata">

**Author:** [@iamsameer](https://discuss.elastic.co/u/iamsameer)\
**Replies:** 3\
**Last updated:** [March 9, 2018, 3:54am UTC](https://discuss.elastic.co/t/unordered-results-from-elastic-search/122233 "2018-03-09T03:54:54Z")

</div>

Hi, Good Day! I am currently using Elastic search 5.2 upgraded from 0.9 followed by 2.3. Right now working on project which displays the opportunities based on Talent segment, location and career level. I am expecting …

---

## [High CPU usage after GC?](https://discuss.elastic.co/t/high-cpu-usage-after-gc/122429)

<div class="topic-metadata">

**Author:** [@uLan](https://discuss.elastic.co/u/uLan)\
**Replies:** 8\
**Last updated:** [March 9, 2018, 3:39am UTC](https://discuss.elastic.co/t/high-cpu-usage-after-gc/122429 "2018-03-09T03:39:14Z")

</div>

I got alerted that our CPU usage is high and according to some metrics elasticsearch is consuming cpu. This was the last log of elasticsearch, but it's still working fine though \[INFO \]\[o.e.m.j.JvmGcMonitorService\] \[iJX…

---

## [Need help in importing location data to ES](https://discuss.elastic.co/t/need-help-in-importing-location-data-to-es/121342)

<div class="topic-metadata">

**Author:** [@Prakash\_Punj](https://discuss.elastic.co/u/Prakash_Punj)\
**Replies:** 3\
**Last updated:** [March 9, 2018, 2:42am UTC](https://discuss.elastic.co/t/need-help-in-importing-location-data-to-es/121342 "2018-03-09T02:42:50Z")

</div>

Folks, I am quite new to this and trying to understand fundamentals of importing location data to ES using logstash. Below are the specification: a.) I have a CSV file with bunch of columns, one of which is location whi…

---

## [Transfer data from postgresql to elasticsearch](https://discuss.elastic.co/t/transfer-data-from-postgresql-to-elasticsearch/123031)

<div class="topic-metadata">

**Author:** [@Augustus1995](https://discuss.elastic.co/u/Augustus1995)\
**Replies:** 2\
**Last updated:** [March 9, 2018, 2:07am UTC](https://discuss.elastic.co/t/transfer-data-from-postgresql-to-elasticsearch/123031 "2018-03-09T02:07:02Z")

</div>

Hey guys: I want to transfer data from postgresql to elasticsearch Such as I want input a Table to elasticsearch, what could i do. In fact i use Kettle as the tool to transfer data, So coulde elasticsearch or logstas…

---

## [Nginx on ES/Kibana machine](https://discuss.elastic.co/t/nginx-on-es-kibana-machine/123168)

<div class="topic-metadata">

**Author:** [@seanziee](https://discuss.elastic.co/u/seanziee)\
**Replies:** 0\
**Last updated:** [March 9, 2018, 12:30am UTC](https://discuss.elastic.co/t/nginx-on-es-kibana-machine/123168 "2018-03-09T00:30:26Z")

</div>

Hi guys, I've been trying every combination to make this work and after many hours, I've come here to post my config for anyone in the future because it was hard to find any documentation about it. I'm setting up nginx…

---

## [Hard to understand Elasticsearch optimization article](https://discuss.elastic.co/t/hard-to-understand-elasticsearch-optimization-article/121153)

<div class="topic-metadata">

**Author:** [@elasticdude](https://discuss.elastic.co/u/elasticdude)\
**Replies:** 1\
**Last updated:** [March 8, 2018, 11:28pm UTC](https://discuss.elastic.co/t/hard-to-understand-elasticsearch-optimization-article/121153 "2018-03-08T23:28:02Z")

</div>

I read the article about optimizing Elasticsearch table but I'm not able to understand what does author mean by following line. These fields however aren’t actually “stored” in Elasticsearch, rather, they are only stor…

---

## [Failed to parse date error](https://discuss.elastic.co/t/failed-to-parse-date-error/123157)

<div class="topic-metadata">

**Author:** [@geoff\_yalo](https://discuss.elastic.co/u/geoff_yalo)\
**Replies:** 0\
**Last updated:** [March 8, 2018, 11:01pm UTC](https://discuss.elastic.co/t/failed-to-parse-date-error/123157 "2018-03-08T23:01:30Z")

</div>

Hi, I am running a python script using the Elasticsearch client to insert a document into an existing index. My documents have a datefield called "@timestamp" with the following format: '@timestamp': '2018-03-07T00:0…

---

## [What should be structure of document for Clickstream data based on IP addresses](https://discuss.elastic.co/t/what-should-be-structure-of-document-for-clickstream-data-based-on-ip-addresses/121856)

<div class="topic-metadata">

**Author:** [@ikarthikb](https://discuss.elastic.co/u/ikarthikb)\
**Replies:** 6\
**Last updated:** [March 8, 2018, 10:54pm UTC](https://discuss.elastic.co/t/what-should-be-structure-of-document-for-clickstream-data-based-on-ip-addresses/121856 "2018-03-08T22:54:07Z")

</div>

I have clickstream data about my website. The events come in as the user clicks/interacts with the website. For example a sampling of the data looks like this. I have millions of data points like this coming from million…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1758)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1760)
