# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1742 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1743 --- ## [Elasticsearch bucket\_script to subtract two timestamps](https://discuss.elastic.co/t/elasticsearch-bucket-script-to-subtract-two-timestamps/125309)
**Author:** [@Siddaram\_Jamagav](https://discuss.elastic.co/u/Siddaram_Jamagav)\ **Replies:** 4\ **Last updated:** [March 23, 2018, 10:38am UTC](https://discuss.elastic.co/t/elasticsearch-bucket-script-to-subtract-two-timestamps/125309 "2018-03-23T10:38:14Z")
Unable to subtract two time stamps using bucket\_script aggregation: Below is my query: POST xxxxxxxxxxxxxxxxxxxxxxxxxx/\_search?size=0 { "query": { "bool": { "must": \[ { "match\_phrase": { "projectId.keyword": "… --- ## [Elastichsearch range query does not work with icu\_collation for Turkish words](https://discuss.elastic.co/t/elastichsearch-range-query-does-not-work-with-icu-collation-for-turkish-words/125353)
**Author:** [@gulcabuk](https://discuss.elastic.co/u/gulcabuk)\ **Replies:** 0\ **Last updated:** [March 23, 2018, 10:50am UTC](https://discuss.elastic.co/t/elastichsearch-range-query-does-not-work-with-icu-collation-for-turkish-words/125353 "2018-03-23T10:50:47Z")
Hi, I've document which has Turkish words like "şa, za, sb, şc, sd, şe" etc. as customer\_address property. I've indexed my documents as documented below because I want to order documents according to the customer\_addre… --- ## [org.elasticsearch.xpack.notification.email.Account$1.run(Account.java:55) should cast to CommandMap not javax.activation.MailcapCommandMap](https://discuss.elastic.co/t/org-elasticsearch-xpack-notification-email-account-1-run-account-java-55-should-cast-to-commandmap-not-javax-activation-mailcapcommandmap/124877)
**Author:** [@sits](https://discuss.elastic.co/u/sits)\ **Replies:** 6\ **Last updated:** [March 23, 2018, 10:48am UTC](https://discuss.elastic.co/t/org-elasticsearch-xpack-notification-email-account-1-run-account-java-55-should-cast-to-commandmap-not-javax-activation-mailcapcommandmap/124877 "2018-03-23T10:48:19Z")
Hoping this is the right place to report this. I'm basically requesting on the offending line below to cast to CommandMap (the interface) rather than the concrete class MailcapCommandMap as our app uses a custom ComandM… --- ## [Could not start datafeed](https://discuss.elastic.co/t/could-not-start-datafeed/124098)
**Author:** [@Arturo](https://discuss.elastic.co/u/Arturo)\ **Replies:** 10\ **Last updated:** [March 23, 2018, 10:23am UTC](https://discuss.elastic.co/t/could-not-start-datafeed/124098 "2018-03-23T10:23:18Z")
Hello, I am getting below errors while trying to create a single metric Job in machine learning tab of Kibana. Errors: Could not start datafeed for Jobname \[status\_exception\] cannot start datafeed \[datafeed-Jobname\] b… --- ## [Csv datafram to elasticsearch](https://discuss.elastic.co/t/csv-datafram-to-elasticsearch/125342)
**Author:** [@retxedue](https://discuss.elastic.co/u/retxedue)\ **Replies:** 0\ **Last updated:** [March 23, 2018, 10:09am UTC](https://discuss.elastic.co/t/csv-datafram-to-elasticsearch/125342 "2018-03-23T10:09:30Z")
may i know how to properly create elasticsearch index from python csv dataframe? --- ## [Get total items in bucket in Elasticsearch](https://discuss.elastic.co/t/get-total-items-in-bucket-in-elasticsearch/124637)
**Author:** [@Hayder\_Abbass](https://discuss.elastic.co/u/Hayder_Abbass)\ **Replies:** 1\ **Last updated:** [March 23, 2018, 9:35am UTC](https://discuss.elastic.co/t/get-total-items-in-bucket-in-elasticsearch/124637 "2018-03-23T09:35:19Z")
Using the sample data below, I would like to get the total number of users who own at least 2 phones on a histogram. Let me explain with a simple example: Create mappings PUT sales { "settings": { "number\_of\_sha… --- ## [How to set listener timeout by high level rest client?](https://discuss.elastic.co/t/how-to-set-listener-timeout-by-high-level-rest-client/125051)
**Author:** [@majid\_zarrin](https://discuss.elastic.co/u/majid_zarrin)\ **Replies:** 1\ **Last updated:** [March 23, 2018, 9:31am UTC](https://discuss.elastic.co/t/how-to-set-listener-timeout-by-high-level-rest-client/125051 "2018-03-23T09:31:38Z")
Hello guys based on the our previous problem I need read all documents in an Index with sorting. as it's data is somewhat big I confront with the search timeout. here is the simplified code: RestHighLevelClient hi… --- ## [Terms aggregation - from and to](https://discuss.elastic.co/t/terms-aggregation-from-and-to/125330)
**Author:** [@Nili](https://discuss.elastic.co/u/Nili)\ **Replies:** 1\ **Last updated:** [March 23, 2018, 9:28am UTC](https://discuss.elastic.co/t/terms-aggregation-from-and-to/125330 "2018-03-23T09:28:11Z")
Hello, We need to extract partial number of the result of "Terms" aggregation from a starting point and till an endpoint, lets say - only the 10th till the 20th values. We have the "size" parameter, but it there a way … --- ## [Unable to create template with Analyzer](https://discuss.elastic.co/t/unable-to-create-template-with-analyzer/124708)
**Author:** [@madeti](https://discuss.elastic.co/u/madeti)\ **Replies:** 7\ **Last updated:** [March 23, 2018, 8:52am UTC](https://discuss.elastic.co/t/unable-to-create-template-with-analyzer/124708 "2018-03-23T08:52:28Z")
Hello, I was able to create an analyzer and use it on a single Index. Now, I would like to apply this to an Index template, so that whenever a new index (with Date attached to it) is created, this analyzer can be applie… --- ## [Create a plugin that needs a client](https://discuss.elastic.co/t/create-a-plugin-that-needs-a-client/125142)
**Author:** [@jettro](https://discuss.elastic.co/u/jettro)\ **Replies:** 3\ **Last updated:** [March 23, 2018, 8:39am UTC](https://discuss.elastic.co/t/create-a-plugin-that-needs-a-client/125142 "2018-03-23T08:39:59Z")
Hi, I am working on a plugin that needs access to Elasticsearch to potentially run a query against another index. I have found a way, but it feels hacky. Does someone know a better way? Thanks! public class UseQueryPl… --- ## [How to remove specific response body content in Elasticsearch](https://discuss.elastic.co/t/how-to-remove-specific-response-body-content-in-elasticsearch/125319)
**Author:** [@muthu\_kutty](https://discuss.elastic.co/u/muthu_kutty)\ **Replies:** 2\ **Last updated:** [March 23, 2018, 8:33am UTC](https://discuss.elastic.co/t/how-to-remove-specific-response-body-content-in-elasticsearch/125319 "2018-03-23T08:33:13Z")
My response body from Elasticsearch is { "took": 67, "timed\_out": false, "\_shards": { "total": 331, "successful": 331, "skipped": 321, "failed": 0 }, "hits": { "total": 5344, "max\_score… --- ## [Applying ingest node processors with a specific order](https://discuss.elastic.co/t/applying-ingest-node-processors-with-a-specific-order/125201)
**Author:** [@madou23](https://discuss.elastic.co/u/madou23)\ **Replies:** 3\ **Last updated:** [March 23, 2018, 8:28am UTC](https://discuss.elastic.co/t/applying-ingest-node-processors-with-a-specific-order/125201 "2018-03-23T08:28:32Z")
Hi all, I'm sending data from a csv file to elasticsearch via logstash and everything is ok but I have a problem on an ip address field that contains some different values that doesn't conform to ipv4 format so I'am usi… --- ## [Ordering in bool filter case](https://discuss.elastic.co/t/ordering-in-bool-filter-case/125271)
**Author:** [@pierluca](https://discuss.elastic.co/u/pierluca)\ **Replies:** 2\ **Last updated:** [March 23, 2018, 8:19am UTC](https://discuss.elastic.co/t/ordering-in-bool-filter-case/125271 "2018-03-23T08:19:07Z")
Hi everyone, I was wondering if when I use a bool/filter there is a default sorting. For example, I wrote this query: POST myindex/\_search { "query": { "bool": { "filter": \[{ "match\_phrase\_prefix":… --- ## [Calculate on nested field, got wrong result , any advice will be appreciated](https://discuss.elastic.co/t/calculate-on-nested-field-got-wrong-result-any-advice-will-be-appreciated/124985)
**Author:** [@small-tomorrow](https://discuss.elastic.co/u/small-tomorrow)\ **Replies:** 3\ **Last updated:** [March 23, 2018, 8:05am UTC](https://discuss.elastic.co/t/calculate-on-nested-field-got-wrong-result-any-advice-will-be-appreciated/124985 "2018-03-23T08:05:31Z")
with query conditions, I filtered out only one doc, part of the doc \_source is : "\_source": { "event": \[ { "time": 1520252057459, "duration": 1… --- ## [Reverse Nested Aggregations With Filters](https://discuss.elastic.co/t/reverse-nested-aggregations-with-filters/125128)
**Author:** [@bevans88](https://discuss.elastic.co/u/bevans88)\ **Replies:** 1\ **Last updated:** [March 23, 2018, 7:34am UTC](https://discuss.elastic.co/t/reverse-nested-aggregations-with-filters/125128 "2018-03-23T07:34:45Z")
Hi, I'm currently looking at using reverse nested aggregations with filters and have a question regarding the filter 'scope' within the aggregations. It's probably best explained through examples: Create an index with … --- ## [X-Pack 6.2.1 and Ingest Nodes](https://discuss.elastic.co/t/x-pack-6-2-1-and-ingest-nodes/122864)
**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\ **Replies:** 4\ **Last updated:** [March 23, 2018, 7:15am UTC](https://discuss.elastic.co/t/x-pack-6-2-1-and-ingest-nodes/122864 "2018-03-23T07:15:21Z")
Whether it is mandatory to have the Ingest Nodes for X-Pack to work? I have seen the issue while using the X-Pack without the ingest nodes and have to mark the data nodes as ingest as well. --- ## [RoR/es-hadoop connector/Hive problem](https://discuss.elastic.co/t/ror-es-hadoop-connector-hive-problem/116777)
**Author:** [@dzyubanv](https://discuss.elastic.co/u/dzyubanv)\ **Replies:** 11\ **Last updated:** [March 18, 2018, 4:24pm UTC](https://discuss.elastic.co/t/ror-es-hadoop-connector-hive-problem/116777 "2018-03-18T16:24:52Z")
I'm experiencing the issue when querying ES with RoR (readonlyrest) from external Hive table with property 'es.net.http.header.Authorization'='Basic (base64 encoded user:pwd)' in hive table definition. Running select st… --- ## [Numerous small shards or Few big shards?](https://discuss.elastic.co/t/numerous-small-shards-or-few-big-shards/125292)
**Author:** [@Ong](https://discuss.elastic.co/u/Ong)\ **Replies:** 3\ **Last updated:** [March 23, 2018, 6:31am UTC](https://discuss.elastic.co/t/numerous-small-shards-or-few-big-shards/125292 "2018-03-23T06:31:44Z")
I am planning on the number of shards for 2 clusters. One cluster has 3 nodes while the other cluster has 5 nodes. The projected index size for both clusters have been estimated. With regards to search performance and i… --- ## [Elasticsearch 1.1.1 going down with addition of new indices](https://discuss.elastic.co/t/elasticsearch-1-1-1-going-down-with-addition-of-new-indices/125222)
**Author:** [@Ehteshaam](https://discuss.elastic.co/u/Ehteshaam)\ **Replies:** 3\ **Last updated:** [March 23, 2018, 6:16am UTC](https://discuss.elastic.co/t/elasticsearch-1-1-1-going-down-with-addition-of-new-indices/125222 "2018-03-23T06:16:19Z")
We have 4 nodes with 16gigs. With addition of new indices we see OOM errors and nodes going down 1 by 1. I believe this is Gazillion shards problem. In search of evidence that supports it with details like how much ove… --- ## [Basic Authentication for X-Pack not working](https://discuss.elastic.co/t/basic-authentication-for-x-pack-not-working/125300)
**Author:** [@zhuzhenfirst](https://discuss.elastic.co/u/zhuzhenfirst)\ **Replies:** 1\ **Last updated:** [March 23, 2018, 5:29am UTC](https://discuss.elastic.co/t/basic-authentication-for-x-pack-not-working/125300 "2018-03-23T05:29:30Z")
thanks i resolved it by myself --- ## [Elasticsearch Hadoop id mapping can't handle big number?](https://discuss.elastic.co/t/elasticsearch-hadoop-id-mapping-cant-handle-big-number/125296)
**Author:** [@unruledboy](https://discuss.elastic.co/u/unruledboy)\ **Replies:** 2\ **Last updated:** [March 23, 2018, 3:27am UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-id-mapping-cant-handle-big-number/125296 "2018-03-23T03:27:25Z")
Hi, I save RDD to Elasticsearch via Scala like this: EsSpark.saveJsonToEs(rdd, index, Map( "es.mapping.id" -\> "IncrementalId")) When the IncrementalId is small number (like less than 1 billion), the id mapping is fin… --- ## [Background\_filter on parent field in a nested significant\_terms aggregation](https://discuss.elastic.co/t/background-filter-on-parent-field-in-a-nested-significant-terms-aggregation/125295)
**Author:** [@jjhh](https://discuss.elastic.co/u/jjhh)\ **Replies:** 0\ **Last updated:** [March 23, 2018, 2:13am UTC](https://discuss.elastic.co/t/background-filter-on-parent-field-in-a-nested-significant-terms-aggregation/125295 "2018-03-23T02:13:11Z")
My mapping looks like: "properties": { "user\_id": { "type": "keyword" }, "need\_to\_check": { "type": "boolean" }, "tags": { "type": "nested", "properties": { "name": { "type": "key… --- ## [ElasticSearch Freeboard](https://discuss.elastic.co/t/elasticsearch-freeboard/125290)
**Author:** [@Dipali](https://discuss.elastic.co/u/Dipali)\ **Replies:** 0\ **Last updated:** [March 23, 2018, 1:40am UTC](https://discuss.elastic.co/t/elasticsearch-freeboard/125290 "2018-03-23T01:40:28Z")
I have this requirement, i was just trying to break it down. I have API from elastic search, http://localhost:9200/dummytest/\_search?pretty which gives the response like { "took" : 0, "timed\_out" : false, "\_shards" … --- ## [Elastic to provide active primary shards percent metric](https://discuss.elastic.co/t/elastic-to-provide-active-primary-shards-percent-metric/125285)
**Author:** [@fhalde](https://discuss.elastic.co/u/fhalde)\ **Replies:** 3\ **Last updated:** [March 23, 2018, 1:01am UTC](https://discuss.elastic.co/t/elastic-to-provide-active-primary-shards-percent-metric/125285 "2018-03-23T01:01:21Z")
We are trying to show metrics such as yield & harvest. Yield is basically how much of data is available for searching. The problem with active\_shards\_percent\_as\_num is that it considers both primary and replica. But le… --- ## [Using NEST how can I build up a search query](https://discuss.elastic.co/t/using-nest-how-can-i-build-up-a-search-query/125161)
**Author:** [@jchannon](https://discuss.elastic.co/u/jchannon)\ **Replies:** 2\ **Last updated:** [March 23, 2018, 12:38am UTC](https://discuss.elastic.co/t/using-nest-how-can-i-build-up-a-search-query/125161 "2018-03-23T00:38:34Z")
I am trying to use the NEST APIs to execute a search. In my logic of building this up with the fluent api I need to do a conditional check and so far I have this however I believe my assignment will be getting overwritt… --- ## [Receiving the report despite error 504](https://discuss.elastic.co/t/receiving-the-report-despite-error-504/124248)
**Author:** [@emil.mirzayev](https://discuss.elastic.co/u/emil.mirzayev)\ **Replies:** 5\ **Last updated:** [March 22, 2018, 11:38pm UTC](https://discuss.elastic.co/t/receiving-the-report-despite-error-504/124248 "2018-03-22T23:38:42Z")
Hi. I scheduled a daily report to my email from my Local Kibana (localhost) instance using X-pack. When I force run this watch, I receive an 504 Error. Despite that, seconds later, I do receive the report I wanted. Repor… --- ## [Parse the logs](https://discuss.elastic.co/t/parse-the-logs/125276)
**Author:** [@kanthimathi](https://discuss.elastic.co/u/kanthimathi)\ **Replies:** 5\ **Last updated:** [March 22, 2018, 10:50pm UTC](https://discuss.elastic.co/t/parse-the-logs/125276 "2018-03-22T22:50:38Z")
Hi all, Currently, we are using filebeat to get the logs from kubernetes. But we would like to parse the logs for better usage. Is there any possibility to do that? Note: The message is too log and using filter did not… --- ## [Failed to parse value \[fals\]](https://discuss.elastic.co/t/failed-to-parse-value-fals/125260)
**Author:** [@bolivia](https://discuss.elastic.co/u/bolivia)\ **Replies:** 1\ **Last updated:** [March 22, 2018, 9:43pm UTC](https://discuss.elastic.co/t/failed-to-parse-value-fals/125260 "2018-03-22T21:43:53Z")
Hi, my Docker Conainer with elasticsearch 6.2.1 does not start anymore. Elasticsearch Version 6.2.1 Java 8 Updated 161 OS Windows 10 1709 16299.309 Description: elasticsearch\_1 | \[2018-03-19T20:06:30,779\]\[INFO \]\[o.… --- ## [Performance degradation of queries for AWS managed Elastic](https://discuss.elastic.co/t/performance-degradation-of-queries-for-aws-managed-elastic/125266)
**Author:** [@mukrrambajwa](https://discuss.elastic.co/u/mukrrambajwa)\ **Replies:** 3\ **Last updated:** [March 22, 2018, 8:58pm UTC](https://discuss.elastic.co/t/performance-degradation-of-queries-for-aws-managed-elastic/125266 "2018-03-22T20:58:06Z")
We are using Elastic 5.5.2 and ingestion jobs are scheduled to run every day and each job lasts for around one hour. Once indexed, data is not mutated and the only action is to query data for our customers. Our data also… --- ## [ES 6.2.1 Unassigned shards due to DANGLING\_INDEX\_IMPORTED](https://discuss.elastic.co/t/es-6-2-1-unassigned-shards-due-to-dangling-index-imported/121896)
**Author:** [@ld\_pvl](https://discuss.elastic.co/u/ld_pvl)\ **Replies:** 3\ **Last updated:** [March 22, 2018, 7:26pm UTC](https://discuss.elastic.co/t/es-6-2-1-unassigned-shards-due-to-dangling-index-imported/121896 "2018-03-22T19:26:53Z")
Hi Team, I am getting unassigned shards after I added a new data node to the cluster. This is the sequence of actions that I did prior that lead to unassigned shards: Cluster is green Then on host A, where there is a … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1741) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1743)