# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1967 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1968 --- ## [Serial Differencing where operand records are returned](https://discuss.elastic.co/t/serial-differencing-where-operand-records-are-returned/98458)
**Author:** [@patrickian](https://discuss.elastic.co/u/patrickian)\ **Replies:** 0\ **Last updated:** [August 26, 2017, 3:59pm UTC](https://discuss.elastic.co/t/serial-differencing-where-operand-records-are-returned/98458 "2017-08-26T15:59:02Z")
Is there a way for elasticsearch to look at the documents, perform subtraction on a single field (similar to serial difference) and get two specific records that produced a difference that exceeds a defined threshold? Le… --- ## [\[Resolved\] 400 Error ResponseException when using example request code for Java REST Client](https://discuss.elastic.co/t/resolved-400-error-responseexception-when-using-example-request-code-for-java-rest-client/98445)
**Author:** [@Jaspreet\_Singh](https://discuss.elastic.co/u/Jaspreet_Singh)\ **Replies:** 1\ **Last updated:** [August 26, 2017, 3:10pm UTC](https://discuss.elastic.co/t/resolved-400-error-responseexception-when-using-example-request-code-for-java-rest-client/98445 "2017-08-26T15:10:02Z")
Hi, Im trying to invoke search queries via GET body request. While trying to execute the example request code here - https://www.elastic.co/guide/en/elasticsearch/client/java-rest/current/\_example\_requests.html Im see… --- ## [Ingest pipeline execute external command or call rest?](https://discuss.elastic.co/t/ingest-pipeline-execute-external-command-or-call-rest/98264)
**Author:** [@Zachary\_Buckholz](https://discuss.elastic.co/u/Zachary_Buckholz)\ **Replies:** 2\ **Last updated:** [August 26, 2017, 1:27pm UTC](https://discuss.elastic.co/t/ingest-pipeline-execute-external-command-or-call-rest/98264 "2017-08-26T13:27:09Z")
I’d like to know if it’s possible to execute an external command from an ingest pipeline? My usecase is to do a unix dig command on an IP and see who owns it. We have Akamai fronting a lot of our web traffic and I’d lik… --- ## [Index.queries.cache.term\_queries](https://discuss.elastic.co/t/index-queries-cache-term-queries/98451)
**Author:** [@Sundar\_V](https://discuss.elastic.co/u/Sundar_V)\ **Replies:** 2\ **Last updated:** [August 26, 2017, 12:13pm UTC](https://discuss.elastic.co/t/index-queries-cache-term-queries/98451 "2017-08-26T12:13:37Z")
After our initial migration from ES 2 to 5, one major issue that we faced was that the term queries were very slow in comparison to ES 2. I had raised a GtitHub issue https://github.com/elastic/elasticsearch/issues/2334… --- ## [Should I store strings directly or their numeric tokens in elasticsearch](https://discuss.elastic.co/t/should-i-store-strings-directly-or-their-numeric-tokens-in-elasticsearch/98438)
**Author:** [@Fong\_Ng](https://discuss.elastic.co/u/Fong_Ng)\ **Replies:** 4\ **Last updated:** [August 26, 2017, 10:23am UTC](https://discuss.elastic.co/t/should-i-store-strings-directly-or-their-numeric-tokens-in-elasticsearch/98438 "2017-08-26T10:23:50Z")
I can't decide which way to save an increasing number of event information to elasticsearch. Each filterable fields have a limited number of options, but multiple options are allowed. Should I store the information dir… --- ## [Clear cache not working properly](https://discuss.elastic.co/t/clear-cache-not-working-properly/98444)
**Author:** [@hack3rcon](https://discuss.elastic.co/u/hack3rcon)\ **Replies:** 4\ **Last updated:** [August 26, 2017, 9:58am UTC](https://discuss.elastic.co/t/clear-cache-not-working-properly/98444 "2017-08-26T09:58:37Z")
Hello. I did below command my ELK box for clear cache: # curl -XDELETE 'http://localhost:9200/\_all' {"acknowledged":true} but when I restart my server then cache back: # curl -XGET 'http://localhost:9200/\_cat/indices?… --- ## [How many indexes is too many indexes](https://discuss.elastic.co/t/how-many-indexes-is-too-many-indexes/98401)
**Author:** [@lauraerinmann](https://discuss.elastic.co/u/lauraerinmann)\ **Replies:** 1\ **Last updated:** [August 26, 2017, 9:57am UTC](https://discuss.elastic.co/t/how-many-indexes-is-too-many-indexes/98401 "2017-08-26T09:57:04Z")
I recently decided that it might be a good idea to change the structure of our elasticsearch indexes for performance. Right now we have a single index and two types and our corresponding graph has a database for each “p… --- ## [Change default data path in Elastic 5.5](https://discuss.elastic.co/t/change-default-data-path-in-elastic-5-5/98054)
**Author:** [@Kumar\_Narottam](https://discuss.elastic.co/u/Kumar_Narottam)\ **Replies:** 2\ **Last updated:** [August 26, 2017, 9:18am UTC](https://discuss.elastic.co/t/change-default-data-path-in-elastic-5-5/98054 "2017-08-26T09:18:39Z")
I have installed elastic search 5.5 via debian package. I wanted to change the default data and log path to some other customized folders. I have edited the yml file and restarted. The elastic service fails to start. Ca… --- ## [Data distribute in large cluster with many indices](https://discuss.elastic.co/t/data-distribute-in-large-cluster-with-many-indices/98428)
**Author:** [@sunchnaras](https://discuss.elastic.co/u/sunchnaras)\ **Replies:** 3\ **Last updated:** [August 26, 2017, 6:23am UTC](https://discuss.elastic.co/t/data-distribute-in-large-cluster-with-many-indices/98428 "2017-08-26T06:23:28Z")
Hi, I have a cluster with 30 nodes and a lot of indices with small number of primary shards . Let’s say 800 indices . most indices only have 1 or 2 primary shards. I want to know how elasticsearch cluster distribute … --- ## [How get not sorted value of array field](https://discuss.elastic.co/t/how-get-not-sorted-value-of-array-field/98434)
**Author:** [@clark010](https://discuss.elastic.co/u/clark010)\ **Replies:** 0\ **Last updated:** [August 26, 2017, 5:08am UTC](https://discuss.elastic.co/t/how-get-not-sorted-value-of-array-field/98434 "2017-08-26T05:08:23Z")
Hi, i write a score script, and used doc().getOrDefault() api to get the value of array field, but i found the result is sorted, so i just can get the original value of this field from source().get() api, but i know thi… --- ## [Rolling restart possible when root certificate changed?](https://discuss.elastic.co/t/rolling-restart-possible-when-root-certificate-changed/97530)
**Author:** [@nkoothrappahli](https://discuss.elastic.co/u/nkoothrappahli)\ **Replies:** 3\ **Last updated:** [August 26, 2017, 4:01am UTC](https://discuss.elastic.co/t/rolling-restart-possible-when-root-certificate-changed/97530 "2017-08-26T04:01:17Z")
We are currently evaluating x-pack security and there is an open question where i cannot find any answer: For transport TLS we need to change the root certificate from time to time but we have to avoid a full cluster re… --- ## [Could not get unknown property 'jar' for project ':core' of type org.gradle.ap i.Project](https://discuss.elastic.co/t/could-not-get-unknown-property-jar-for-project-core-of-type-org-gradle-ap-i-project/98426)
**Author:** [@saliormoon](https://discuss.elastic.co/u/saliormoon)\ **Replies:** 1\ **Last updated:** [August 26, 2017, 3:19am UTC](https://discuss.elastic.co/t/could-not-get-unknown-property-jar-for-project-core-of-type-org-gradle-ap-i-project/98426 "2017-08-26T03:19:37Z")
Elasticsearch version: 5.5.2 OS: Windlws When I use gradle to build elasticsearch source code, I encounter a problem like this: What went wrong: A problem occurred evaluating project ':distribution'. Could not get… --- ## [Heap usage causing node failure - 5.5.2](https://discuss.elastic.co/t/heap-usage-causing-node-failure-5-5-2/98272)
**Author:** [@erikanderson753](https://discuss.elastic.co/u/erikanderson753)\ **Replies:** 3\ **Last updated:** [August 25, 2017, 9:41pm UTC](https://discuss.elastic.co/t/heap-usage-causing-node-failure-5-5-2/98272 "2017-08-25T21:41:06Z")
Running cluster of 6 nodes on Ubuntu 14.04 with 128G RAM each on 5.5.2 Heap is currently set to 28G and confirmed ES is using zero based compressed Oops as recommended in https://www.elastic.co/blog/a-heap-of-trouble B… --- ## [Elastic API Extension Steps](https://discuss.elastic.co/t/elastic-api-extension-steps/97818)
**Author:** [@nijov](https://discuss.elastic.co/u/nijov)\ **Replies:** 7\ **Last updated:** [August 25, 2017, 9:13pm UTC](https://discuss.elastic.co/t/elastic-api-extension-steps/97818 "2017-08-25T21:13:42Z")
Hello, I am trying to learn how to extend the existing APIs like search to add something very specific before the call and after the call. I understand the plugins are the way to go, can I anyone point me to documentati… --- ## [Index sharing in 3 nodes cluster](https://discuss.elastic.co/t/index-sharing-in-3-nodes-cluster/96353)
**Author:** [@extramental](https://discuss.elastic.co/u/extramental)\ **Replies:** 9\ **Last updated:** [August 25, 2017, 6:52pm UTC](https://discuss.elastic.co/t/index-sharing-in-3-nodes-cluster/96353 "2017-08-25T18:52:03Z")
Hi, I am trying to set up a three node cluster on Elasticsearch 2.3 with PeopleSoft 9.2/8.55 Tools. Three nodes on three Linux VM. Each node is master and data eligible. I need to setup the failover functionaity so tha… --- ## [\[Discussion\] I have two options for designing my indexes, which one do you thinks will be better?](https://discuss.elastic.co/t/discussion-i-have-two-options-for-designing-my-indexes-which-one-do-you-thinks-will-be-better/98177)
**Author:** [@fanooos](https://discuss.elastic.co/u/fanooos)\ **Replies:** 5\ **Last updated:** [August 25, 2017, 7:00pm UTC](https://discuss.elastic.co/t/discussion-i-have-two-options-for-designing-my-indexes-which-one-do-you-thinks-will-be-better/98177 "2017-08-25T19:00:55Z")
Hi guys, Suppose I am willing to use elasticsearch for building a system for analyzing tweets. The tweets will be fetched and tagged before being indexed into ES. I have two options for designing the indexes for tweets… --- ## [Question About Dynamically Generated Keyword Fields](https://discuss.elastic.co/t/question-about-dynamically-generated-keyword-fields/97815)
**Author:** [@krmathieu](https://discuss.elastic.co/u/krmathieu)\ **Replies:** 2\ **Last updated:** [August 25, 2017, 5:58pm UTC](https://discuss.elastic.co/t/question-about-dynamically-generated-keyword-fields/97815 "2017-08-25T17:58:22Z")
I am getting ready to make the jump from 2.4 to 5.X and see that string fields are now dynamically mapped as both a text and keyword field by default. My question is, does it hurt anything to leave the keyword field in p… --- ## [Cannot start/run ElasticSearch on OS X](https://discuss.elastic.co/t/cannot-start-run-elasticsearch-on-os-x/98287)
**Author:** [@stevepetcu](https://discuss.elastic.co/u/stevepetcu)\ **Replies:** 2\ **Last updated:** [August 25, 2017, 5:18pm UTC](https://discuss.elastic.co/t/cannot-start-run-elasticsearch-on-os-x/98287 "2017-08-25T17:18:21Z")
Hi, I’ve been programming for a few years and now I’d like to learn some Java. I thought a good way to do it would be by contributing to ElasticSearch. Keep in mind that I’m a complete noob with everything Java right no… --- ## [Elastic Search 5.5.1 does not start](https://discuss.elastic.co/t/elastic-search-5-5-1-does-not-start/96651)
**Author:** [@Jospaul](https://discuss.elastic.co/u/Jospaul)\ **Replies:** 14\ **Last updated:** [August 25, 2017, 5:18pm UTC](https://discuss.elastic.co/t/elastic-search-5-5-1-does-not-start/96651 "2017-08-25T17:18:16Z")
The elastic search do not start in Windows with the below exception - An exception occurred while trying to start elasticsearch.: System.ArgumentException: Illegal characters in path. at System.IO.Path.CheckInvalidPath… --- ## [Failed to execute pipeline for a bulk request after a successfull ingest plugin](https://discuss.elastic.co/t/failed-to-execute-pipeline-for-a-bulk-request-after-a-successfull-ingest-plugin/98354)
**Author:** [@martin.d](https://discuss.elastic.co/u/martin.d)\ **Replies:** 1\ **Last updated:** [August 25, 2017, 4:36pm UTC](https://discuss.elastic.co/t/failed-to-execute-pipeline-for-a-bulk-request-after-a-successfull-ingest-plugin/98354 "2017-08-25T16:36:35Z")
Hi, I made an ingest plugin for Eleasticsearch 5.4.0, the ingest plugin works well in simulate mode . but in standard mode I have a "failed to execute pipeline for a bulk request" message in the logs after the executi… --- ## [Exception in Date Format while inserting document in Elasticsearch through Java code](https://discuss.elastic.co/t/exception-in-date-format-while-inserting-document-in-elasticsearch-through-java-code/98233)
**Author:** [@PinkiMondal](https://discuss.elastic.co/u/PinkiMondal)\ **Replies:** 3\ **Last updated:** [August 25, 2017, 4:08pm UTC](https://discuss.elastic.co/t/exception-in-date-format-while-inserting-document-in-elasticsearch-through-java-code/98233 "2017-08-25T16:08:23Z")
I am getting below error MapperParsingException\[failed to parse \[paymentValueDate\]\]; nested: IllegalArgumentException\[Invalid format: “May 23, 2016”\]; And I have used following formats: “dd-MM-yy HH:mm:ss.SSSSSSSSS a … --- ## [Slow search query issue \[5.5\]](https://discuss.elastic.co/t/slow-search-query-issue-5-5/97420)
**Author:** [@akubasa](https://discuss.elastic.co/u/akubasa)\ **Replies:** 5\ **Last updated:** [August 25, 2017, 2:50pm UTC](https://discuss.elastic.co/t/slow-search-query-issue-5-5/97420 "2017-08-25T14:50:02Z")
Dear Elastic community We are struggling with very slow search querys. We have ~ 10 Mio documents and 140 Shards on one node. Elasticsearch is running on 7GB Ram and 2cores. Each first request takes up to 15 seconds. H… --- ## [Existing data nodes unable to connect to new master](https://discuss.elastic.co/t/existing-data-nodes-unable-to-connect-to-new-master/98291)
**Author:** [@bmwmaestoso](https://discuss.elastic.co/u/bmwmaestoso)\ **Replies:** 1\ **Last updated:** [August 25, 2017, 2:38pm UTC](https://discuss.elastic.co/t/existing-data-nodes-unable-to-connect-to-new-master/98291 "2017-08-25T14:38:35Z")
Elasticsearch/X-Pack 5.5.2 I created a prototype cluster with 4 data nodes and 1 master. X-pack was installed on every node and everything was working correctly. The cluster had been running for several weeks and about… --- ## [X-Pack Monitoring. Data Missing](https://discuss.elastic.co/t/x-pack-monitoring-data-missing/98192)
**Author:** [@Sudarsun\_Peru](https://discuss.elastic.co/u/Sudarsun_Peru)\ **Replies:** 1\ **Last updated:** [August 25, 2017, 2:29pm UTC](https://discuss.elastic.co/t/x-pack-monitoring-data-missing/98192 "2017-08-25T14:29:57Z")
Hi, I have 2 Logstash nodes and an Elasticsearch Cluster of 3 Nodes. All are configured for X-Pack Monitoring along with Kibana. I wanted to validate the fail over mechanism for the Elasticsearch cluster configuration,… --- ## [Making string field aggregatable in kibana](https://discuss.elastic.co/t/making-string-field-aggregatable-in-kibana/98373)
**Author:** [@Singa\_Forever](https://discuss.elastic.co/u/Singa_Forever)\ **Replies:** 1\ **Last updated:** [August 25, 2017, 2:11pm UTC](https://discuss.elastic.co/t/making-string-field-aggregatable-in-kibana/98373 "2017-08-25T14:11:00Z")
Hello, This is my first time using elk 5.5 for gathering tweets from twitter, everything is ok and works fine. In order to handle my application, I need to make the filed text (tweets ) as an aggregatable field, i tri… --- ## [Create more certs with same CA file using certgen utility](https://discuss.elastic.co/t/create-more-certs-with-same-ca-file-using-certgen-utility/97868)
**Author:** [@gaurav\_mutreja](https://discuss.elastic.co/u/gaurav_mutreja)\ **Replies:** 1\ **Last updated:** [August 25, 2017, 2:05pm UTC](https://discuss.elastic.co/t/create-more-certs-with-same-ca-file-using-certgen-utility/97868 "2017-08-25T14:05:13Z")
I have created a set of certs, without DNS and IP. In the config of elastic search and config , I have set the ssl.verification.mode = certificate in the elastic and Kibana configs. Things work fine. But when I connect… --- ## [The type initializer for 'Elasticsearch.Net.HttpConnection' threw an exception](https://discuss.elastic.co/t/the-type-initializer-for-elasticsearch-net-httpconnection-threw-an-exception/98207)
**Author:** [@Heckfy](https://discuss.elastic.co/u/Heckfy)\ **Replies:** 0\ **Last updated:** [August 24, 2017, 10:21am UTC](https://discuss.elastic.co/t/the-type-initializer-for-elasticsearch-net-httpconnection-threw-an-exception/98207 "2017-08-24T10:21:44Z")
Hi everyone! Sometimes, when I use Elasticsearch there is the following error (I can’t reproduce it manually at all): The type initializer for ‘Elasticsearch.Net.HttpConnection’ threw an exception. The application / ass… --- ## [SaaS monitoring application design](https://discuss.elastic.co/t/saas-monitoring-application-design/98369)
**Author:** [@ignasbernotas](https://discuss.elastic.co/u/ignasbernotas)\ **Replies:** 0\ **Last updated:** [August 25, 2017, 1:10pm UTC](https://discuss.elastic.co/t/saas-monitoring-application-design/98369 "2017-08-25T13:10:44Z")
Hi there, Our initial application version was written on MySQL, but we decided to try out ElasticSearch and so far I’m amazed with the results. My tests were quite simple, basic aggregations for charts/counts but the pe… --- ## [Obtain the elasticsearch client using RestClient for DELETE and SCROLLAPI](https://discuss.elastic.co/t/obtain-the-elasticsearch-client-using-restclient-for-delete-and-scrollapi/97261)
**Author:** [@Lbr1](https://discuss.elastic.co/u/Lbr1)\ **Replies:** 5\ **Last updated:** [August 25, 2017, 11:46am UTC](https://discuss.elastic.co/t/obtain-the-elasticsearch-client-using-restclient-for-delete-and-scrollapi/97261 "2017-08-25T11:46:55Z")
I’m using elasticsearch to save data coming from twitter. At this point I’m having difficulty deleting data from index and using the Scroll API because after reading about ways to do that, everyone uses the Client and I… --- ## [Comparing data from a RDBMS to Elasticsearch](https://discuss.elastic.co/t/comparing-data-from-a-rdbms-to-elasticsearch/97723)
**Author:** [@newbie\_here](https://discuss.elastic.co/u/newbie_here)\ **Replies:** 1\ **Last updated:** [August 25, 2017, 11:41am UTC](https://discuss.elastic.co/t/comparing-data-from-a-rdbms-to-elasticsearch/97723 "2017-08-25T11:41:52Z")
Hi All, We have a RDBMS source, from where we are indexing the data into indices in elasticsearch. For reconcillation, we have run few sum and count aggregations on both the source and destination data, but found few d… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1966) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1968)