# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1382

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1383

---

## [Reindexing many indices](https://discuss.elastic.co/t/reindexing-many-indices/169952)

<div class="topic-metadata">

**Author:** [@Praneet\_Khandelwal](https://discuss.elastic.co/u/Praneet_Khandelwal)\
**Replies:** 2\
**Last updated:** [February 26, 2019, 2:44pm UTC](https://discuss.elastic.co/t/reindexing-many-indices/169952 "2019-02-26T14:44:53Z")

</div>

Currently I am working to reindex daily indices for 4 months to new indices. I want to know if there is some way to carry this out so that if any error occurs while reindexing a document, I can continue from that point a…

---

## [Elastic search crashes after start](https://discuss.elastic.co/t/elastic-search-crashes-after-start/169957)

<div class="topic-metadata">

**Author:** [@Anmari](https://discuss.elastic.co/u/Anmari)\
**Replies:** 4\
**Last updated:** [February 26, 2019, 2:15pm UTC](https://discuss.elastic.co/t/elastic-search-crashes-after-start/169957 "2019-02-26T14:15:46Z")

</div>

It seems that our server operator installes updates on 22.02 and since 23.02 no new logfils are written. Wehn trying to start ES it imidiatly crashes again. The elasticsearch.log gives the following hint.: \[2019-02-26T…

---

## ["missing checksum for name" error on S3 incremental snapshot](https://discuss.elastic.co/t/missing-checksum-for-name-error-on-s3-incremental-snapshot/169867)

<div class="topic-metadata">

**Author:** [@ndtreviv](https://discuss.elastic.co/u/ndtreviv)\
**Replies:** 2\
**Last updated:** [February 26, 2019, 2:13pm UTC](https://discuss.elastic.co/t/missing-checksum-for-name-error-on-s3-incremental-snapshot/169867 "2019-02-26T14:13:57Z")

</div>

When trying to attempt an S3 incremental snapshot I get a number of failures, all with the same sort of error, being: "reason": "IndexShardSnapshotFailedException\[ElasticsearchParseException\[missing checksum for…

---

## [Elasticsearch Cluster | Total Shards number of Cluster not matching addition of individual shards number of nodes](https://discuss.elastic.co/t/elasticsearch-cluster-total-shards-number-of-cluster-not-matching-addition-of-individual-shards-number-of-nodes/169943)

<div class="topic-metadata">

**Author:** [@Nikesh](https://discuss.elastic.co/u/Nikesh)\
**Replies:** 3\
**Last updated:** [February 26, 2019, 2:06pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-total-shards-number-of-cluster-not-matching-addition-of-individual-shards-number-of-nodes/169943 "2019-02-26T14:06:34Z")

</div>

Hi, I am using kibana to monitor and visualize my Elastic Cluster. As I see, the total number of shards in Cluster is 1242 where as the addition of shards of individual nodes is different. Each of my three data nodes …

---

## [Connection refused to connect elastic through ip with same machine](https://discuss.elastic.co/t/connection-refused-to-connect-elastic-through-ip-with-same-machine/169996)

<div class="topic-metadata">

**Author:** [@mani6264](https://discuss.elastic.co/u/mani6264)\
**Replies:** 3\
**Last updated:** [February 26, 2019, 1:50pm UTC](https://discuss.elastic.co/t/connection-refused-to-connect-elastic-through-ip-with-same-machine/169996 "2019-02-26T13:50:31Z")

</div>

Hi am new to elastic search, i hitting loclhost:9200 it's working fine but when i hit IP:9200 that's not connected with same machine elastic installed? what should i do?

---

## [How to use specific filter score in score function script](https://discuss.elastic.co/t/how-to-use-specific-filter-score-in-score-function-script/170008)

<div class="topic-metadata">

**Author:** [@fabiomrch](https://discuss.elastic.co/u/fabiomrch)\
**Replies:** 0\
**Last updated:** [February 26, 2019, 12:47pm UTC](https://discuss.elastic.co/t/how-to-use-specific-filter-score-in-score-function-script/170008 "2019-02-26T12:47:10Z")

</div>

Hi everyone, I want to execute the following query in order to get a score that combines many conditions. Each result must respect a precondition (query) and each filter in functions must have a role in calculating outp…

---

## [Is it possible to Sort all the docs nested field together, If yes, then how](https://discuss.elastic.co/t/is-it-possible-to-sort-all-the-docs-nested-field-together-if-yes-then-how/169992)

<div class="topic-metadata">

**Author:** [@PUSHKAR\_SINGH](https://discuss.elastic.co/u/PUSHKAR_SINGH)\
**Replies:** 0\
**Last updated:** [February 26, 2019, 11:41am UTC](https://discuss.elastic.co/t/is-it-possible-to-sort-all-the-docs-nested-field-together-if-yes-then-how/169992 "2019-02-26T11:41:57Z")

</div>

\#Problem: we want to sort completionTimeStamp of all the docs together. Not a single document wise, but whole document wise. DELETE my\_index PUT my\_index { "mappings": { "doc": { "properties": { "courses": { "typ…

---

## [Searching for a term in normal and nested field. Providing position based sorting](https://discuss.elastic.co/t/searching-for-a-term-in-normal-and-nested-field-providing-position-based-sorting/169986)

<div class="topic-metadata">

**Author:** [@PUSHKAR\_SINGH](https://discuss.elastic.co/u/PUSHKAR_SINGH)\
**Replies:** 0\
**Last updated:** [February 26, 2019, 11:21am UTC](https://discuss.elastic.co/t/searching-for-a-term-in-normal-and-nested-field-providing-position-based-sorting/169986 "2019-02-26T11:21:31Z")

</div>

DELETE test PUT test GET test/\_mapping PUT test/test/\_mapping { "properties": { "name": { "type": "text", "fields":{ "keyword":{ "type":"keyword" } } }, "words": { "type": "nested", …

---

## [JVM Heap Advice from documentation](https://discuss.elastic.co/t/jvm-heap-advice-from-documentation/169827)

<div class="topic-metadata">

**Author:** [@truekonrads](https://discuss.elastic.co/u/truekonrads)\
**Replies:** 3\
**Last updated:** [February 26, 2019, 10:54am UTC](https://discuss.elastic.co/t/jvm-heap-advice-from-documentation/169827 "2019-02-26T10:54:09Z")

</div>

Hello, In the Setting the heap size documentation page, the advice for setting the heap is as follows: less than 50% of physical ram because of kernel caches less than 32 or even 26 GB because of Compressed OOPS How…

---

## [java.lang.NoSuchFieldError: LUCENE\_8\_0\_0](https://discuss.elastic.co/t/java-lang-nosuchfielderror-lucene-8-0-0/169959)

<div class="topic-metadata">

**Author:** [@liuxyshcn](https://discuss.elastic.co/u/liuxyshcn)\
**Replies:** 2\
**Last updated:** [February 26, 2019, 10:16am UTC](https://discuss.elastic.co/t/java-lang-nosuchfielderror-lucene-8-0-0/169959 "2019-02-26T10:16:02Z")

</div>

I am just starting to learn to use elasticsearch and trying to get some documents from elasticsearch server using java rest client in the first picture. An error occured when I ran the code as an application.Here is t…

---

## [Access elasticsearch service installed on elastic-server via application servers](https://discuss.elastic.co/t/access-elasticsearch-service-installed-on-elastic-server-via-application-servers/169965)

<div class="topic-metadata">

**Author:** [@Amitittech](https://discuss.elastic.co/u/Amitittech)\
**Replies:** 1\
**Last updated:** [February 26, 2019, 10:25am UTC](https://discuss.elastic.co/t/access-elasticsearch-service-installed-on-elastic-server-via-application-servers/169965 "2019-02-26T10:25:07Z")

</div>

Hi, I am running elasticsearch 6.4.0. on my server. Now i want to use the same service on other application server. how?

---

## [Elasticsearch with logstash tuning](https://discuss.elastic.co/t/elasticsearch-with-logstash-tuning/169788)

<div class="topic-metadata">

**Author:** [@fadihaddad](https://discuss.elastic.co/u/fadihaddad)\
**Replies:** 9\
**Last updated:** [February 26, 2019, 10:14am UTC](https://discuss.elastic.co/t/elasticsearch-with-logstash-tuning/169788 "2019-02-26T10:14:20Z")

</div>

hello, i have been using configuring logstash for tuning and i need help. i set the JVM heap of elasticsearch to 8gb and logstash JVM heap to 6gb my server has 4 cpus, 4 cores each 2.2ghz and 16gb RAM. i set the number…

---

## [How to calculate date diffs using ingest node](https://discuss.elastic.co/t/how-to-calculate-date-diffs-using-ingest-node/169652)

<div class="topic-metadata">

**Author:** [@Christian\_SANCHEZ](https://discuss.elastic.co/u/Christian_SANCHEZ)\
**Replies:** 2\
**Last updated:** [February 26, 2019, 9:49am UTC](https://discuss.elastic.co/t/how-to-calculate-date-diffs-using-ingest-node/169652 "2019-02-26T09:49:27Z")

</div>

Hi I have a basic date diff between 2 dates to do and display it as weeks. If i use the Kibana scripted fields, it works fine using the following syntax : Math.round((doc\['last\_detected'\].value.toInstant().toEpochMill…

---

## [Using elasticsearch-sql to query elasticsearch on elastic cloud](https://discuss.elastic.co/t/using-elasticsearch-sql-to-query-elasticsearch-on-elastic-cloud/169872)

<div class="topic-metadata">

**Author:** [@jerry.browne](https://discuss.elastic.co/u/jerry.browne)\
**Replies:** 2\
**Last updated:** [February 26, 2019, 8:59am UTC](https://discuss.elastic.co/t/using-elasticsearch-sql-to-query-elasticsearch-on-elastic-cloud/169872 "2019-02-26T08:59:04Z")

</div>

I'm trying to query elasticsearch data using elasticsearch-sql. I am using elastic cloud, so the first question is whether or not elasticsearch-sql is available on elastic cloud. If it is (based on what i read it is) .…

---

## [Not able to run elastic search on Server IP](https://discuss.elastic.co/t/not-able-to-run-elastic-search-on-server-ip/167725)

<div class="topic-metadata">

**Author:** [@dheeraj.Kumar](https://discuss.elastic.co/u/dheeraj.Kumar)\
**Replies:** 18\
**Last updated:** [February 26, 2019, 5:22am UTC](https://discuss.elastic.co/t/not-able-to-run-elastic-search-on-server-ip/167725 "2019-02-26T05:22:54Z")

</div>

HI , I am new on ElasticSearch and trying to configure it on Fedora VM, Host machine is Windows 10 Pro. Elastic search ver. 6.6.0 i am able to run elastic search with KIbana on Localhost:9200. but if change "network.…

---

## [Single node HTTPS configuration for Elasticsearch without X-pack](https://discuss.elastic.co/t/single-node-https-configuration-for-elasticsearch-without-x-pack/169940)

<div class="topic-metadata">

**Author:** [@MKU](https://discuss.elastic.co/u/MKU)\
**Replies:** 0\
**Last updated:** [February 26, 2019, 5:01am UTC](https://discuss.elastic.co/t/single-node-https-configuration-for-elasticsearch-without-x-pack/169940 "2019-02-26T05:01:35Z")

</div>

I am looking for a way to configure https for elasticsearch,without x-pack. can anybody provide detailed steps to do the same

---

## [Stats\_bucket the correct query here?](https://discuss.elastic.co/t/stats-bucket-the-correct-query-here/169931)

<div class="topic-metadata">

**Author:** [@jjasonclark](https://discuss.elastic.co/u/jjasonclark)\
**Replies:** 0\
**Last updated:** [February 26, 2019, 2:26am UTC](https://discuss.elastic.co/t/stats-bucket-the-correct-query-here/169931 "2019-02-26T02:26:50Z")

</div>

Question: How do I get the average sales the clerk's are doing in each region and store? How do I not include clerkSums in the responses? I only care about salesStats and costStats? Imagine I have a single index with…

---

## [Append processor overwrites, doesn't append](https://discuss.elastic.co/t/append-processor-overwrites-doesnt-append/169901)

<div class="topic-metadata">

**Author:** [@drs](https://discuss.elastic.co/u/drs)\
**Replies:** 2\
**Last updated:** [February 26, 2019, 2:13am UTC](https://discuss.elastic.co/t/append-processor-overwrites-doesnt-append/169901 "2019-02-26T02:13:02Z")

</div>

I'm playing with the append processor, but it seems to be overwriting the array each time, not appending. PUT /\_ingest/pipeline/append { "description": "Append", "processors": \[ { "append": { "fiel…

---

## [Searching geo data for all documents that contains a particular point](https://discuss.elastic.co/t/searching-geo-data-for-all-documents-that-contains-a-particular-point/169743)

<div class="topic-metadata">

**Author:** [@Mark\_Lloyd](https://discuss.elastic.co/u/Mark_Lloyd)\
**Replies:** 2\
**Last updated:** [February 25, 2019, 9:55pm UTC](https://discuss.elastic.co/t/searching-geo-data-for-all-documents-that-contains-a-particular-point/169743 "2019-02-25T21:55:10Z")

</div>

Hi All Looking for a solution to a geo search I'm trying to perform. This thread is very close to what I need but not quite 100%. Essentially we have a bunch of shapes defined in an index. The shapes could be polygons …

---

## [Kibana says "Error: Request Timeout after 30000ms" when we started to retain longer history in ES](https://discuss.elastic.co/t/kibana-says-error-request-timeout-after-30000ms-when-we-started-to-retain-longer-history-in-es/168050)

<div class="topic-metadata">

**Author:** [@gavenkoa](https://discuss.elastic.co/u/gavenkoa)\
**Replies:** 3\
**Last updated:** [February 25, 2019, 9:45pm UTC](https://discuss.elastic.co/t/kibana-says-error-request-timeout-after-30000ms-when-we-started-to-retain-longer-history-in-es/168050 "2019-02-25T21:45:29Z")

</div>

I provide details below, straight to the point: I suspect that increased index count made impossible to perform some Kibana built-in queries. ls elasticsearch-5.6.14.deb kibana-5.6.14-amd64.deb I suspect that it is im…

---

## [How to sync windows custom log file with ELK](https://discuss.elastic.co/t/how-to-sync-windows-custom-log-file-with-elk/169815)

<div class="topic-metadata">

**Author:** [@PraveenKumar](https://discuss.elastic.co/u/PraveenKumar)\
**Replies:** 1\
**Last updated:** [February 25, 2019, 9:35pm UTC](https://discuss.elastic.co/t/how-to-sync-windows-custom-log-file-with-elk/169815 "2019-02-25T21:35:00Z")

</div>

Hi Team, How to add custom log file in ELK and which module will use for that

---

## [Search and return like substring](https://discuss.elastic.co/t/search-and-return-like-substring/169904)

<div class="topic-metadata">

**Author:** [@gra7mq](https://discuss.elastic.co/u/gra7mq)\
**Replies:** 1\
**Last updated:** [February 25, 2019, 8:55pm UTC](https://discuss.elastic.co/t/search-and-return-like-substring/169904 "2019-02-25T20:55:45Z")

</div>

Want to search elasticsearch for foobar and return and docs with substring foo. Any ideas on how to do this? I can search for foo and return foobar. But I really need to be able to search full string and return any \_doc …

---

## [Index lifecycle management runs into IndexNotFoundException](https://discuss.elastic.co/t/index-lifecycle-management-runs-into-indexnotfoundexception/169625)

<div class="topic-metadata">

**Author:** [@wei1](https://discuss.elastic.co/u/wei1)\
**Replies:** 3\
**Last updated:** [February 25, 2019, 7:59pm UTC](https://discuss.elastic.co/t/index-lifecycle-management-runs-into-indexnotfoundexception/169625 "2019-02-25T19:59:58Z")

</div>

Hi, I'm starting to use index lifecycle management policy to delete index that's been created for xx time. Here's the policy: { "policy": { "phases": { "hot": { "actions": {}}, "delete": …

---

## [\[RESOLVED\] API to list all watchers](https://discuss.elastic.co/t/resolved-api-to-list-all-watchers/169167)

<div class="topic-metadata">

**Author:** [@vicpav](https://discuss.elastic.co/u/vicpav)\
**Replies:** 2\
**Last updated:** [February 25, 2019, 7:20pm UTC](https://discuss.elastic.co/t/resolved-api-to-list-all-watchers/169167 "2019-02-25T19:20:55Z")

</div>

I am a bit puzzled about this one. While checking the documentation for X-Pack Watcher APIs, I cannot see a basic API that would return the list of existing watchers. I can see that Kibana is using the GET https://kiban…

---

## [Correlate with watcher?](https://discuss.elastic.co/t/correlate-with-watcher/169278)

<div class="topic-metadata">

**Author:** [@paniccontrol](https://discuss.elastic.co/u/paniccontrol)\
**Replies:** 1\
**Last updated:** [February 25, 2019, 6:34pm UTC](https://discuss.elastic.co/t/correlate-with-watcher/169278 "2019-02-25T18:34:09Z")

</div>

Hello, I m wondering if with watchers it would be able to interogates external sources of data , like external database to be able to do correlations, do operations, on results aggregates, enrich with external source, f…

---

## ["cannot poll for user changes since security index \[.security\] does not exist" prevents authorization](https://discuss.elastic.co/t/cannot-poll-for-user-changes-since-security-index-security-does-not-exist-prevents-authorization/169078)

<div class="topic-metadata">

**Author:** [@btmurphy](https://discuss.elastic.co/u/btmurphy)\
**Replies:** 24\
**Last updated:** [February 25, 2019, 6:23pm UTC](https://discuss.elastic.co/t/cannot-poll-for-user-changes-since-security-index-security-does-not-exist-prevents-authorization/169078 "2019-02-25T18:23:04Z")

</div>

New to Elasticsearch & Shield. Required to work with version 2.4.6, and cannot currently upgrade to a newer version. Installed Shield, started a SINGLE NODE Elasticsearch 'cluster' with basic authentication, added a us…

---

## [ELK Stack Setup on GCP](https://discuss.elastic.co/t/elk-stack-setup-on-gcp/166662)

<div class="topic-metadata">

**Author:** [@pavan1991](https://discuss.elastic.co/u/pavan1991)\
**Replies:** 2\
**Last updated:** [February 25, 2019, 6:06pm UTC](https://discuss.elastic.co/t/elk-stack-setup-on-gcp/166662 "2019-02-25T18:06:57Z")

</div>

Hi Everyone, We are looking to setup ELK stack on Google Cloud Platform and would need some suggestions to build a high availability cluster. We have disabled Stackdriver Alerts for Dev/QA Environments and are looking …

---

## [What is difference between indices snapshot and cluster snapshot?](https://discuss.elastic.co/t/what-is-difference-between-indices-snapshot-and-cluster-snapshot/169887)

<div class="topic-metadata">

**Author:** [@163satish](https://discuss.elastic.co/u/163satish)\
**Replies:** 0\
**Last updated:** [February 25, 2019, 5:56pm UTC](https://discuss.elastic.co/t/what-is-difference-between-indices-snapshot-and-cluster-snapshot/169887 "2019-02-25T17:56:16Z")

</div>

I am working on the curator snapshot and restore feature. Can you please elaborate on how these 2 are different? I have used following template to take snapshot: action: snapshot description: \>- Snapshot selected ind…

---

## [One node is stuck with gc](https://discuss.elastic.co/t/one-node-is-stuck-with-gc/165068)

<div class="topic-metadata">

**Author:** [@Yogesh\_BG](https://discuss.elastic.co/u/Yogesh_BG)\
**Replies:** 14\
**Last updated:** [February 25, 2019, 5:37pm UTC](https://discuss.elastic.co/t/one-node-is-stuck-with-gc/165068 "2019-02-25T17:37:50Z")

</div>

Hi I am using elasticsearch 2.4 version. Have a setup with 3 nodes each having 36cpu's, 32gc(es) + 32gb(lucen) setup. Setup was running fine for 7days. huge and constant traffic is going on continuously. after 7 days o…

---

## [Cant we use scripted fields in dev console to perform any operations in elastic search](https://discuss.elastic.co/t/cant-we-use-scripted-fields-in-dev-console-to-perform-any-operations-in-elastic-search/169843)

<div class="topic-metadata">

**Author:** [@PRUDHVI\_CHOWDHARY\_NE](https://discuss.elastic.co/u/PRUDHVI_CHOWDHARY_NE)\
**Replies:** 2\
**Last updated:** [February 25, 2019, 4:20pm UTC](https://discuss.elastic.co/t/cant-we-use-scripted-fields-in-dev-console-to-perform-any-operations-in-elastic-search/169843 "2019-02-25T16:20:34Z")

</div>

I have a scripted field(named as exit\_time) created by me. Now i want to use this exit\_time in dev console(kibana) to perform certain operations like delete,etc on documents present in the my index of elastic search. H…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1381)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1383)
