# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1027 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1028 --- ## [Elasticsearch cannot be started after an upgrade: Temporary file directory \[${ES\_TMPDIR}\] does not exist or is not accessible](https://discuss.elastic.co/t/elasticsearch-cannot-be-started-after-an-upgrade-temporary-file-directory-es-tmpdir-does-not-exist-or-is-not-accessible/217780)
**Author:** [@nelyanne-v](https://discuss.elastic.co/u/nelyanne-v)\ **Replies:** 0\ **Last updated:** [February 4, 2020, 11:13am UTC](https://discuss.elastic.co/t/elasticsearch-cannot-be-started-after-an-upgrade-temporary-file-directory-es-tmpdir-does-not-exist-or-is-not-accessible/217780 "2020-02-04T11:13:06Z")
Hi all, I am trying to upgrade my Elasticsearch cluster from 7.4.0 to 7.5.2. It is running on CentOS 7 with Java 1.8.0. I used the rpm files from https://www.elastic.co/downloads/elasticsearch. I successfully upgraded … --- ## [ES 7.5.0 not starting when remote cluster is down](https://discuss.elastic.co/t/es-7-5-0-not-starting-when-remote-cluster-is-down/217691)
**Author:** [@JPedroM](https://discuss.elastic.co/u/JPedroM)\ **Replies:** 9\ **Last updated:** [February 4, 2020, 10:56am UTC](https://discuss.elastic.co/t/es-7-5-0-not-starting-when-remote-cluster-is-down/217691 "2020-02-04T10:56:02Z")
Hey, Was able to setup a remote cluster in one of my ES instances. After this instance was up and the connection to remote established I shut down the remote instance. The connection has been lost but after the start of… --- ## [Failed to parse field \[event\_data\_param2\] of type \[date\] in document](https://discuss.elastic.co/t/failed-to-parse-field-event-data-param2-of-type-date-in-document/217770)
**Author:** [@morpheus](https://discuss.elastic.co/u/morpheus)\ **Replies:** 0\ **Last updated:** [February 4, 2020, 10:49am UTC](https://discuss.elastic.co/t/failed-to-parse-field-event-data-param2-of-type-date-in-document/217770 "2020-02-04T10:49:41Z")
Hi I am getting this error \[DEBUG\]\[o.e.a.b.TransportShardBulkAction\] \[node-1\] \[index-2020.02.04\]\[4\] failed to execute bulk item (index) index {\[index-2020.02.04\]\[doc\]\[QNd0D3ABiS2QGKK1NMuw\], source\[n/a, actual length: \[… --- ## [Advice on Heap usage](https://discuss.elastic.co/t/advice-on-heap-usage/217752)
**Author:** [@royal\_man](https://discuss.elastic.co/u/royal_man)\ **Replies:** 4\ **Last updated:** [February 4, 2020, 10:34am UTC](https://discuss.elastic.co/t/advice-on-heap-usage/217752 "2020-02-04T10:34:31Z")
Node: 12cpu + 45GB RAM I have 1 shard on 1 node. size of 1 shard: 12GB Heap assigned: 20GB Based on the graph below. I think I should reduce the heap size but it is recommended to keep heap 50% of the RAM. Can someon… --- ## [Use of Ranking API with pre-defined templates](https://discuss.elastic.co/t/use-of-ranking-api-with-pre-defined-templates/217767)
**Author:** [@styks90](https://discuss.elastic.co/u/styks90)\ **Replies:** 0\ **Last updated:** [February 4, 2020, 10:27am UTC](https://discuss.elastic.co/t/use-of-ranking-api-with-pre-defined-templates/217767 "2020-02-04T10:27:11Z")
While we're developing and updating search templates, we regularly test them against a set of queries using the ranking API. However, we did not yet find any docs on how to use the templates stored within a cluster this … --- ## [Query on nested array fields](https://discuss.elastic.co/t/query-on-nested-array-fields/217727)
**Author:** [@Neil\_Alex](https://discuss.elastic.co/u/Neil_Alex)\ **Replies:** 1\ **Last updated:** [February 4, 2020, 10:22am UTC](https://discuss.elastic.co/t/query-on-nested-array-fields/217727 "2020-02-04T10:22:27Z")
Hi , I am trying to query an index in elasticsearch which typically consists of documents of the following structure. Doc 1 : { "group":"pl", "club":\[ { "name":"Arsenal", "wins":\[ { "2018":22 }, { "2019":17 … --- ## [ES upgrade from 6.8.1 to 7.4.2](https://discuss.elastic.co/t/es-upgrade-from-6-8-1-to-7-4-2/217703)
**Author:** [@satya06](https://discuss.elastic.co/u/satya06)\ **Replies:** 2\ **Last updated:** [February 4, 2020, 10:18am UTC](https://discuss.elastic.co/t/es-upgrade-from-6-8-1-to-7-4-2/217703 "2020-02-04T10:18:49Z")
Hello, I am trying to upgrade my TST environment from Elasticsearch 6.8.1 to 7.4.2, I am getting the below error during the upgrade in logs. Error: master not discovered yet, this node has not previously joined a boot… --- ## [Add Completion Suggester and reindex, no data](https://discuss.elastic.co/t/add-completion-suggester-and-reindex-no-data/217763)
**Author:** [@Lina7906](https://discuss.elastic.co/u/Lina7906)\ **Replies:** 0\ **Last updated:** [February 4, 2020, 10:07am UTC](https://discuss.elastic.co/t/add-completion-suggester-and-reindex-no-data/217763 "2020-02-04T10:07:46Z")
I have a mapping like this, and i have already added data and indexed. {"mappints":{ "properties": { "type": "object", "properties": { "occupation": { "type": "text" }, "skill": { "type": "text", } }} And rig… --- ## [Elastic API](https://discuss.elastic.co/t/elastic-api/217751)
**Author:** [@vinu89](https://discuss.elastic.co/u/vinu89)\ **Replies:** 3\ **Last updated:** [February 4, 2020, 10:04am UTC](https://discuss.elastic.co/t/elastic-api/217751 "2020-02-04T10:04:41Z")
Hi, I am creating my own java page with customized charts using elastic API. how to give the time interval dynamically for eg as in kibana last 15 mins last 30mins and etc...... --- ## [Time field in filters](https://discuss.elastic.co/t/time-field-in-filters/217757)
**Author:** [@Anne\_Kim](https://discuss.elastic.co/u/Anne_Kim)\ **Replies:** 0\ **Last updated:** [February 4, 2020, 9:56am UTC](https://discuss.elastic.co/t/time-field-in-filters/217757 "2020-02-04T09:56:19Z")
Hi there, I'm in a timezone UTC +2. When I'm sending data from my database to Elastic, I'm converting all dates into UTC +0 format. Then Elastic formats a date into UTC +2 (as it's indicated in Advanced Settings). The … --- ## [ILM waiting shards to be allocated](https://discuss.elastic.co/t/ilm-waiting-shards-to-be-allocated/217662)
**Author:** [@Jeremy\_S](https://discuss.elastic.co/u/Jeremy_S)\ **Replies:** 0\ **Last updated:** [February 3, 2020, 4:33pm UTC](https://discuss.elastic.co/t/ilm-waiting-shards-to-be-allocated/217662 "2020-02-03T16:33:13Z")
Hi, I have a cluster on elastic cloud with Hot-Warm Architecture template (v 7.5.1). I've set an ILM policy for moving indexes to warm nodes after 1h (testing purpose) Here is the policy defined with Kibana { - "… --- ## [SQL Query with CASE When condition and SUM](https://discuss.elastic.co/t/sql-query-with-case-when-condition-and-sum/217397)
**Author:** [@Zou\_Justin](https://discuss.elastic.co/u/Zou_Justin)\ **Replies:** 1\ **Last updated:** [February 4, 2020, 8:58am UTC](https://discuss.elastic.co/t/sql-query-with-case-when-condition-and-sum/217397 "2020-02-04T08:58:37Z")
Hi Experts, Can we use the case when with SUM in one SQL in Elastic Search7.5.1? Does ES support this in SQL or other way? I tried to do this , while there have following issue: sql\> select sum(case when model\_qi\_categ… --- ## [How to config watcher to output event to index?](https://discuss.elastic.co/t/how-to-config-watcher-to-output-event-to-index/217552)
**Author:** [@lusynda](https://discuss.elastic.co/u/lusynda)\ **Replies:** 3\ **Last updated:** [February 4, 2020, 8:55am UTC](https://discuss.elastic.co/t/how-to-config-watcher-to-output-event-to-index/217552 "2020-02-04T08:55:50Z")
Hi all, I currently use elastic to store log file. Can some one tell me how to write the watcher to have the output to an index, I want whenever there is a something that matche my query then watcher will output the w… --- ## [Elasticsearch 7.x consumes more space for indexes](https://discuss.elastic.co/t/elasticsearch-7-x-consumes-more-space-for-indexes/217406)
**Author:** [@mainameiz](https://discuss.elastic.co/u/mainameiz)\ **Replies:** 4\ **Last updated:** [February 4, 2020, 8:50am UTC](https://discuss.elastic.co/t/elasticsearch-7-x-consumes-more-space-for-indexes/217406 "2020-02-04T08:50:53Z")
Hello everyone! I have a question about index size of 7.5.2 version compared to 6.8.6. I have two identical set of data indexed in ES6 and in ES7. Both indexes are force merged. ES6 (index size - 91.2mb) green open d… --- ## [Delete file from index with \_delete\_by\_query empties the index](https://discuss.elastic.co/t/delete-file-from-index-with-delete-by-query-empties-the-index/217382)
**Author:** [@Tommie](https://discuss.elastic.co/u/Tommie)\ **Replies:** 6\ **Last updated:** [February 4, 2020, 8:06am UTC](https://discuss.elastic.co/t/delete-file-from-index-with-delete-by-query-empties-the-index/217382 "2020-02-04T08:06:23Z")
I've tried to delete one of the imported files (csv logstash import) from my index by using: POST /myindex/\_delete\_by\_query { "query": { "match": { "path": "filename.ext" } } } My intention was to delete only th… --- ## [Heap memory leak in Elasticsearch 6.2.4](https://discuss.elastic.co/t/heap-memory-leak-in-elasticsearch-6-2-4/214419)
**Author:** [@bsarkar](https://discuss.elastic.co/u/bsarkar)\ **Replies:** 4\ **Last updated:** [February 4, 2020, 7:57am UTC](https://discuss.elastic.co/t/heap-memory-leak-in-elasticsearch-6-2-4/214419 "2020-02-04T07:57:48Z")
We have a cluster with 60 data nodes (8 CPU cores, 28 GB memory, 14 GB reserved for JVM heap) in addition to 3 master and 3 client nodes. There are around 35K shards (including replicas) in the cluster. In the past few … --- ## [Migrating DATA from Solarwinds to Elasticsearch](https://discuss.elastic.co/t/migrating-data-from-solarwinds-to-elasticsearch/217734)
**Author:** [@fekade](https://discuss.elastic.co/u/fekade)\ **Replies:** 0\ **Last updated:** [February 4, 2020, 7:17am UTC](https://discuss.elastic.co/t/migrating-data-from-solarwinds-to-elasticsearch/217734 "2020-02-04T07:17:51Z")
Currently, we are using Solarwinds for monitoring and log analyzing, what is the possibility of migrating all the data from SolarWinds to Elasticsearch. Please I need your advice ..? --- ## [ElasticSearch SSL HTTP](https://discuss.elastic.co/t/elasticsearch-ssl-http/217733)
**Author:** [@Sriharsha](https://discuss.elastic.co/u/Sriharsha)\ **Replies:** 0\ **Last updated:** [February 4, 2020, 7:05am UTC](https://discuss.elastic.co/t/elasticsearch-ssl-http/217733 "2020-02-04T07:05:56Z")
I am trying to configure security to Elastic Search on a windows machine running on http://localhost:9200/. We have logstash jdbc plugin (with Oracle sql developer) set up to index data and kibana configured which also… --- ## [Cpu and memory elastic watcher email alert](https://discuss.elastic.co/t/cpu-and-memory-elastic-watcher-email-alert/217715)
**Author:** [@tmodi](https://discuss.elastic.co/u/tmodi)\ **Replies:** 0\ **Last updated:** [February 4, 2020, 3:54am UTC](https://discuss.elastic.co/t/cpu-and-memory-elastic-watcher-email-alert/217715 "2020-02-04T03:54:01Z")
Anyone know, how to create a watcher using metricbeat in kibana? like to create a alert when cpu and memory reach 75% threadhold --- ## [Parent - Child relationship not working for some documents](https://discuss.elastic.co/t/parent-child-relationship-not-working-for-some-documents/217714)
**Author:** [@user977505](https://discuss.elastic.co/u/user977505)\ **Replies:** 0\ **Last updated:** [February 4, 2020, 3:18am UTC](https://discuss.elastic.co/t/parent-child-relationship-not-working-for-some-documents/217714 "2020-02-04T03:18:53Z")
I'm running into an issue where the Parent - Child relationship is working for some documents ONLY (using the has\_parent and has\_child queries). Say there is a 'Brand' and 'Product' documents and brand is a parent docum… --- ## [Python to ingest data in to ES, reading from kafka](https://discuss.elastic.co/t/python-to-ingest-data-in-to-es-reading-from-kafka/216493)
**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\ **Replies:** 13\ **Last updated:** [February 3, 2020, 7:35pm UTC](https://discuss.elastic.co/t/python-to-ingest-data-in-to-es-reading-from-kafka/216493 "2020-02-03T19:35:23Z")
I want to read kafka topic and insert that data in to elasticsearch anyone has basic python script for it. I am newbee to python connection to es is alredy established with this code from elasticsearch import Elastic… --- ## [ElasticSearch and CentOS 7: Failed to start elasticsearch-.service: Unit not found](https://discuss.elastic.co/t/elasticsearch-and-centos-7-failed-to-start-elasticsearch-service-unit-not-found/217676)
**Author:** [@psohn](https://discuss.elastic.co/u/psohn)\ **Replies:** 0\ **Last updated:** [February 3, 2020, 6:57pm UTC](https://discuss.elastic.co/t/elasticsearch-and-centos-7-failed-to-start-elasticsearch-service-unit-not-found/217676 "2020-02-03T18:57:02Z")
Hello, First time trying to install and configure ElkStack on CentOS7 and ran into some issues. Was able to install the Elasticsearch package, however, I have not been able to start ElasticSearch after using systemctl s… --- ## [Date range search from the 25th of the month to now](https://discuss.elastic.co/t/date-range-search-from-the-25th-of-the-month-to-now/217668)
**Author:** [@npahucki](https://discuss.elastic.co/u/npahucki)\ **Replies:** 0\ **Last updated:** [February 3, 2020, 6:09pm UTC](https://discuss.elastic.co/t/date-range-search-from-the-25th-of-the-month-to-now/217668 "2020-02-03T18:09:01Z")
Using a range query, it's easy to search from the 1st of the month until now. However, I need to create an alert that aggregates date from the 25th of the month to now. For example, if today is the Jan 24, then I want da… --- ## [Populate field with dynamic value](https://discuss.elastic.co/t/populate-field-with-dynamic-value/217431)
**Author:** [@tmathwe](https://discuss.elastic.co/u/tmathwe)\ **Replies:** 2\ **Last updated:** [February 3, 2020, 5:47pm UTC](https://discuss.elastic.co/t/populate-field-with-dynamic-value/217431 "2020-02-03T17:47:54Z")
i have a requirement to show the remaining days for an expiration days, like if record expire in 100 days we should be able to give a field back saying expire in 99 days 98 days.. my questions is how do i generate the a… --- ## [Strange issue with Elasticsearch while bulk indexing](https://discuss.elastic.co/t/strange-issue-with-elasticsearch-while-bulk-indexing/217653)
**Author:** [@giorgio](https://discuss.elastic.co/u/giorgio)\ **Replies:** 2\ **Last updated:** [February 3, 2020, 4:55pm UTC](https://discuss.elastic.co/t/strange-issue-with-elasticsearch-while-bulk-indexing/217653 "2020-02-03T16:55:22Z")
Hi I have bit of strange issue with elasticsearch, I have 30 shards 0 replicas and currently 14 million documents. I Bulk index using NEST like this: public static bool MultiIndex(List objects) where T : someclass { b… --- ## [Elastic snapshot for GCS seem to be ignoring my client credentials](https://discuss.elastic.co/t/elastic-snapshot-for-gcs-seem-to-be-ignoring-my-client-credentials/217526)
**Author:** [@Guillaume\_Roderick](https://discuss.elastic.co/u/Guillaume_Roderick)\ **Replies:** 17\ **Last updated:** [February 3, 2020, 4:47pm UTC](https://discuss.elastic.co/t/elastic-snapshot-for-gcs-seem-to-be-ignoring-my-client-credentials/217526 "2020-02-03T16:47:44Z")
Hi, I've exhausted my google-fu and have trawled the documentation and similar issues discussed in these support and am completely stuck. I'm attempting to snapshot my cluster to GCS, and the system seems to be ignorin… --- ## [Elastic Search watcher is not working](https://discuss.elastic.co/t/elastic-search-watcher-is-not-working/217661)
**Author:** [@Abdulhadi](https://discuss.elastic.co/u/Abdulhadi)\ **Replies:** 0\ **Last updated:** [February 3, 2020, 4:27pm UTC](https://discuss.elastic.co/t/elastic-search-watcher-is-not-working/217661 "2020-02-03T16:27:41Z")
Hi All I am trying to build a JSON file for Watcher that will send an email whenever an account for Error logs exceed 80. But it continues giving an Error message This is the Built JSON file: PUT \_watcher/watch/feb6b0… --- ## [Log source with different field type - mapper\_parsing\_exception](https://discuss.elastic.co/t/log-source-with-different-field-type-mapper-parsing-exception/217655)
**Author:** [@nitzang](https://discuss.elastic.co/u/nitzang)\ **Replies:** 0\ **Last updated:** [February 3, 2020, 3:44pm UTC](https://discuss.elastic.co/t/log-source-with-different-field-type-mapper-parsing-exception/217655 "2020-02-03T15:44:45Z")
Hello, I recently started getting AWS cloud logs to ES and received many exceptions for indexing issues, such as: \[2020-02-03T15:35:56,728\]\[WARN \]\[logstash.outputs.elasticsearch\] Could not index event to Elasticsearch… --- ## [Unable to parse BaseAggregationBuilder](https://discuss.elastic.co/t/unable-to-parse-baseaggregationbuilder/217457)
**Author:** [@WLH](https://discuss.elastic.co/u/WLH)\ **Replies:** 1\ **Last updated:** [February 3, 2020, 3:23pm UTC](https://discuss.elastic.co/t/unable-to-parse-baseaggregationbuilder/217457 "2020-02-03T15:23:58Z")
Good afternoon, I am trying to build an elastic watcher query using nested aggs, that feed the variables into a bucket script that will subtract one field from another, then put that value into a watcher on a threashold.… --- ## [Sorting a Text Based Field](https://discuss.elastic.co/t/sorting-a-text-based-field/217496)
**Author:** [@rickyooi](https://discuss.elastic.co/u/rickyooi)\ **Replies:** 1\ **Last updated:** [February 3, 2020, 3:22pm UTC](https://discuss.elastic.co/t/sorting-a-text-based-field/217496 "2020-02-03T15:22:28Z")
How to sort a text based field in alphabetically. [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1026) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1028)