# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1537

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1538

---

## [How to monitor Lucene inner ES](https://discuss.elastic.co/t/how-to-monitor-lucene-inner-es/149967)

<div class="topic-metadata">

**Author:** [@LazyMonster](https://discuss.elastic.co/u/LazyMonster)\
**Replies:** 0\
**Last updated:** [September 26, 2018, 9:14am UTC](https://discuss.elastic.co/t/how-to-monitor-lucene-inner-es/149967 "2018-09-26T09:14:31Z")

</div>

I am working with ES 2.4.1 and ES 6.4.0. When I start ES, I can monitor the process of ES instance using some profiler tools (actually, ES instance is an Java service). I can control the XMX and XMS of ES instance. But,…

---

## [ES high heap memory issue over a couple of nodes](https://discuss.elastic.co/t/es-high-heap-memory-issue-over-a-couple-of-nodes/149931)

<div class="topic-metadata">

**Author:** [@mjunaidmuzammil](https://discuss.elastic.co/u/mjunaidmuzammil)\
**Replies:** 2\
**Last updated:** [September 26, 2018, 8:35am UTC](https://discuss.elastic.co/t/es-high-heap-memory-issue-over-a-couple-of-nodes/149931 "2018-09-26T08:35:19Z")

</div>

Hi, We have one of the clusters over which we see high heap usages around 80% levels over a couple of nodes. The cluster has around 10 nodes in total, but heap is seen high only on couple of nodes. All the nodes have a …

---

## [Xpack license in 6.41](https://discuss.elastic.co/t/xpack-license-in-6-41/149919)

<div class="topic-metadata">

**Author:** [@sandipatmca](https://discuss.elastic.co/u/sandipatmca)\
**Replies:** 7\
**Last updated:** [September 26, 2018, 7:46am UTC](https://discuss.elastic.co/t/xpack-license-in-6-41/149919 "2018-09-26T07:46:08Z")

</div>

x-pack package in ELK version 5.1.2 release is not free.It comes with 30 days trial version. I heard that the x-pack package for the 6.4.1 release is free. Is that correct or we just get 30 days free trial version with …

---

## [Parsing multiple date types from message field with ingest node](https://discuss.elastic.co/t/parsing-multiple-date-types-from-message-field-with-ingest-node/149821)

<div class="topic-metadata">

**Author:** [@dlazarov](https://discuss.elastic.co/u/dlazarov)\
**Replies:** 2\
**Last updated:** [September 26, 2018, 6:55am UTC](https://discuss.elastic.co/t/parsing-multiple-date-types-from-message-field-with-ingest-node/149821 "2018-09-26T06:55:57Z")

</div>

I have the following case. I have setup Filebeat to send the logs straight to Elasticsearch since there is no need for significant log parsing. I am receiving logs from different services and in the message field the dat…

---

## [CPU 100% after upgrading from 5.6.5 to 6.4.0](https://discuss.elastic.co/t/cpu-100-after-upgrading-from-5-6-5-to-6-4-0/148462)

<div class="topic-metadata">

**Author:** [@steno](https://discuss.elastic.co/u/steno)\
**Replies:** 4\
**Last updated:** [September 26, 2018, 6:54am UTC](https://discuss.elastic.co/t/cpu-100-after-upgrading-from-5-6-5-to-6-4-0/148462 "2018-09-26T06:54:21Z")

</div>

Hi there! After upgrading from 5.6.5 to 6.4.0 we are facing random CPU usage to 100% on elasticsearch java process. It happens when executing some queries from Kibana. But it's difficult to understand it from elasticsea…

---

## [Cannot edit node.max\_local\_storage\_nodes in elasticsearch.yml file](https://discuss.elastic.co/t/cannot-edit-node-max-local-storage-nodes-in-elasticsearch-yml-file/149914)

<div class="topic-metadata">

**Author:** [@Edgar](https://discuss.elastic.co/u/Edgar)\
**Replies:** 1\
**Last updated:** [September 26, 2018, 6:49am UTC](https://discuss.elastic.co/t/cannot-edit-node-max-local-storage-nodes-in-elasticsearch-yml-file/149914 "2018-09-26T06:49:42Z")

</div>

Hello, I installed elasticsearch 6.3.1 version on Mac. I used vim config/elasticsearch.yml command in order to set the number\_of\_data\_nodes to 2 with node.max\_local\_storage\_nodes: 2. When I save yml file below. ==…

---

## [Looping through Aggregations to trigger multiple emails](https://discuss.elastic.co/t/looping-through-aggregations-to-trigger-multiple-emails/149777)

<div class="topic-metadata">

**Author:** [@Suman\_Reddy1](https://discuss.elastic.co/u/Suman_Reddy1)\
**Replies:** 2\
**Last updated:** [September 26, 2018, 6:25am UTC](https://discuss.elastic.co/t/looping-through-aggregations-to-trigger-multiple-emails/149777 "2018-09-26T06:25:36Z")

</div>

Hi All, Can someone please advise if I can achieve below in some or other way in Kibana Watcher Notifications/Actions. "actions": { {{#ctx.payload.aggregations.app\_id.buckets}} "send\_email": { "email": { …

---

## [Path.data changing the data path from one place to other](https://discuss.elastic.co/t/path-data-changing-the-data-path-from-one-place-to-other/149884)

<div class="topic-metadata">

**Author:** [@chandra0651](https://discuss.elastic.co/u/chandra0651)\
**Replies:** 1\
**Last updated:** [September 26, 2018, 6:20am UTC](https://discuss.elastic.co/t/path-data-changing-the-data-path-from-one-place-to-other/149884 "2018-09-26T06:20:38Z")

</div>

Hello I have a three node cluster where all the nodes are writing to X folder as of now in there individual servers and now i want to move the path to be written to some other path per say "Y" .What are the steps do i ne…

---

## [Ingest attachement plugin not able index complex pdf](https://discuss.elastic.co/t/ingest-attachement-plugin-not-able-index-complex-pdf/149810)

<div class="topic-metadata">

**Author:** [@lakhansamani](https://discuss.elastic.co/u/lakhansamani)\
**Replies:** 5\
**Last updated:** [September 26, 2018, 6:08am UTC](https://discuss.elastic.co/t/ingest-attachement-plugin-not-able-index-complex-pdf/149810 "2018-09-26T06:08:01Z")

</div>

I am trying to index following file pdf but it fails. https://drive.google.com/open?id=1KS\_ow1mfQKLjv\_9zihpkn-No1vq0Z\_a7 axios.put(\`${ELASTIC\_SEARCH\_DOC\_URL}/\_ingest/pipeline/${id}\`, { "description" : "Extract…

---

## [Request timeout after 30000ms - should I set a higher value?](https://discuss.elastic.co/t/request-timeout-after-30000ms-should-i-set-a-higher-value/149370)

<div class="topic-metadata">

**Author:** [@popa](https://discuss.elastic.co/u/popa)\
**Replies:** 1\
**Last updated:** [September 26, 2018, 1:29am UTC](https://discuss.elastic.co/t/request-timeout-after-30000ms-should-i-set-a-higher-value/149370 "2018-09-26T01:29:35Z")

</div>

I was reading through the following post and had some follow up questions: My issue: When running long time range queries / more complex queries in Kibana, I receive the following error: Fatal Error: Courier fetch: …

---

## [Jar hell?](https://discuss.elastic.co/t/jar-hell/149431)

<div class="topic-metadata">

**Author:** [@ping\_luo](https://discuss.elastic.co/u/ping_luo)\
**Replies:** 2\
**Last updated:** [September 26, 2018, 1:39am UTC](https://discuss.elastic.co/t/jar-hell/149431 "2018-09-26T01:39:50Z")

</div>

when i install a Customized plugin on elasticsearch, i got this error, it's so puzzled Caused by: java.lang.IllegalStateException: jar hell! class: org.joda.time.base.AbstractDateTime jar1: /usr/share/elasticsearch/plug…

---

## [Netty4Utils fatal error on the network layer](https://discuss.elastic.co/t/netty4utils-fatal-error-on-the-network-layer/149574)

<div class="topic-metadata">

**Author:** [@eramitsinha](https://discuss.elastic.co/u/eramitsinha)\
**Replies:** 1\
**Last updated:** [September 26, 2018, 12:52am UTC](https://discuss.elastic.co/t/netty4utils-fatal-error-on-the-network-layer/149574 "2018-09-26T00:52:58Z")

</div>

Hi, I am using Elastic Search 5.6.10 and Jdk 1.8.102, I was doing load testing this got failed and during Load testing(Only Search operation on Index) , below is logs. I read: Its mention to add: -Dio.netty.re…

---

## [Elastic search as a windows service is not starting](https://discuss.elastic.co/t/elastic-search-as-a-windows-service-is-not-starting/146606)

<div class="topic-metadata">

**Author:** [@SudevPK](https://discuss.elastic.co/u/SudevPK)\
**Replies:** 1\
**Last updated:** [September 26, 2018, 12:31am UTC](https://discuss.elastic.co/t/elastic-search-as-a-windows-service-is-not-starting/146606 "2018-09-26T00:31:32Z")

</div>

Hi , I have downloaded Elastic search and started the elastic search using "elasticsearch.bat".it is working fine, then i have created Elastic search as a windows service.But while statring the service i am getting 1053…

---

## [Update call with a script doesn't work](https://discuss.elastic.co/t/update-call-with-a-script-doesnt-work/149756)

<div class="topic-metadata">

**Author:** [@magedmakled](https://discuss.elastic.co/u/magedmakled)\
**Replies:** 0\
**Last updated:** [September 25, 2018, 3:39am UTC](https://discuss.elastic.co/t/update-call-with-a-script-doesnt-work/149756 "2018-09-25T03:39:20Z")

</div>

I have a model message\_lists that looks like threads: nested thread\_id: text read\_all: boolean messages: nested message\_id: text read: boolean body: text When I run /message\_lists/message\_list/xxxxxxx…

---

## [Curator - want to set http\_auth password and username through env from kubernetes secret](https://discuss.elastic.co/t/curator-want-to-set-http-auth-password-and-username-through-env-from-kubernetes-secret/149907)

<div class="topic-metadata">

**Author:** [@DStorck](https://discuss.elastic.co/u/DStorck)\
**Replies:** 1\
**Last updated:** [September 25, 2018, 11:35pm UTC](https://discuss.elastic.co/t/curator-want-to-set-http-auth-password-and-username-through-env-from-kubernetes-secret/149907 "2018-09-25T23:35:29Z")

</div>

I am installing curator with a helm chart that has the client configs in a values.yaml file. I also have a value in there for security.password and security.username that I want to be able to set when I run helm install…

---

## [Null Pointer exception when trying to reindex using script](https://discuss.elastic.co/t/null-pointer-exception-when-trying-to-reindex-using-script/149717)

<div class="topic-metadata">

**Author:** [@mikesparr](https://discuss.elastic.co/u/mikesparr)\
**Replies:** 3\
**Last updated:** [September 25, 2018, 11:25pm UTC](https://discuss.elastic.co/t/null-pointer-exception-when-trying-to-reindex-using-script/149717 "2018-09-25T23:25:53Z")

</div>

Dealing with a user-defined object in about 600k records and want to reindex to standardized field naming. Issue is field has space in name and I'm struggling to figure syntax in script to reference old field with space …

---

## [How to get the equvalent of GET indexName using Nest .NET Library?](https://discuss.elastic.co/t/how-to-get-the-equvalent-of-get-indexname-using-nest-net-library/149571)

<div class="topic-metadata">

**Author:** [@rgelb](https://discuss.elastic.co/u/rgelb)\
**Replies:** 5\
**Last updated:** [September 25, 2018, 11:22pm UTC](https://discuss.elastic.co/t/how-to-get-the-equvalent-of-get-indexname-using-nest-net-library/149571 "2018-09-25T23:22:52Z")

</div>

When I run GET indexName against ES, i get a definition of the index. How does one do that with the Nest library? I've tried client.GetIndex but that doesn't seem to do the trick. And I don't see any metadata specific…

---

## [Help with querying with nested fields and range](https://discuss.elastic.co/t/help-with-querying-with-nested-fields-and-range/149910)

<div class="topic-metadata">

**Author:** [@chandu](https://discuss.elastic.co/u/chandu)\
**Replies:** 0\
**Last updated:** [September 25, 2018, 10:48pm UTC](https://discuss.elastic.co/t/help-with-querying-with-nested-fields-and-range/149910 "2018-09-25T22:48:44Z")

</div>

Hi Could someone help with the query? Here is couple of sample records (simplified) that are stored in elasticsearch record#1 { "some\_field": true, "products": { "a": { "dt": "2018-08-28"}, "b": { "dt": "2018-08-…

---

## [Just launched, search is much slower than our self hosted](https://discuss.elastic.co/t/just-launched-search-is-much-slower-than-our-self-hosted/149882)

<div class="topic-metadata">

**Author:** [@horstuff](https://discuss.elastic.co/u/horstuff)\
**Replies:** 0\
**Last updated:** [September 25, 2018, 5:46pm UTC](https://discuss.elastic.co/t/just-launched-search-is-much-slower-than-our-self-hosted/149882 "2018-09-25T17:46:49Z")

</div>

Since we are on the lower account we get zero support, which for integration issues is stupid. My question is: can I switch deployment types on the fly, trying a different optimization setup other than the default "recom…

---

## [Does daily snapshot of monthly indexes only track deltas?](https://discuss.elastic.co/t/does-daily-snapshot-of-monthly-indexes-only-track-deltas/149858)

<div class="topic-metadata">

**Author:** [@javadevmtl](https://discuss.elastic.co/u/javadevmtl)\
**Replies:** 2\
**Last updated:** [September 25, 2018, 9:45pm UTC](https://discuss.elastic.co/t/does-daily-snapshot-of-monthly-indexes-only-track-deltas/149858 "2018-09-25T21:45:23Z")

</div>

Hi, I I'm currently snapshotting daily indexes, but I would like to switch to Monthly indexes. reading the docs here: https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-snapshots.html It didn't spec…

---

## [Upload report pdf from watcher action](https://discuss.elastic.co/t/upload-report-pdf-from-watcher-action/149251)

<div class="topic-metadata">

**Author:** [@Horaci\_Macias](https://discuss.elastic.co/u/Horaci_Macias)\
**Replies:** 2\
**Last updated:** [September 25, 2018, 8:21pm UTC](https://discuss.elastic.co/t/upload-report-pdf-from-watcher-action/149251 "2018-09-25T20:21:43Z")

</div>

I'm trying to upload a report pdf file through HTTP POST/PUT to a web service, but I'm unable to find any examples. I've successfully emailed report pdfs as attachments but I need HTTP integration as well. Is this supp…

---

## [What's with these crazy CPU spikes?](https://discuss.elastic.co/t/whats-with-these-crazy-cpu-spikes/149894)

<div class="topic-metadata">

**Author:** [@sysadmin](https://discuss.elastic.co/u/sysadmin)\
**Replies:** 1\
**Last updated:** [September 25, 2018, 7:59pm UTC](https://discuss.elastic.co/t/whats-with-these-crazy-cpu-spikes/149894 "2018-09-25T19:59:41Z")

</div>

Hey, I'm relatively new to ES and am building out a cluster for some pretty heavy lifting. Throughout my whole process of building and troubleshooting this thing so far, there's been a pattern of spikes to almost 100% CP…

---

## [Mapper\_parsing\_exception, illegal\_state\_exception, unpredictable data, dynamic mapping](https://discuss.elastic.co/t/mapper-parsing-exception-illegal-state-exception-unpredictable-data-dynamic-mapping/149510)

<div class="topic-metadata">

**Author:** [@cgmelastic](https://discuss.elastic.co/u/cgmelastic)\
**Replies:** 1\
**Last updated:** [September 25, 2018, 7:57pm UTC](https://discuss.elastic.co/t/mapper-parsing-exception-illegal-state-exception-unpredictable-data-dynamic-mapping/149510 "2018-09-25T19:57:40Z")

</div>

I've been working on aggregating log data across many different microservices. I've got all of the developers logging data in JSON format now. It shows up in CloudWatch and is forwarded to a lambda which reformats them a…

---

## ['Snapshot' to new index](https://discuss.elastic.co/t/snapshot-to-new-index/149897)

<div class="topic-metadata">

**Author:** [@dunkymole](https://discuss.elastic.co/u/dunkymole)\
**Replies:** 0\
**Last updated:** [September 25, 2018, 7:11pm UTC](https://discuss.elastic.co/t/snapshot-to-new-index/149897 "2018-09-25T19:11:42Z")

</div>

I want to have a nightly job which basically snapshots an index (the live one) into a new one so that we have an index which is queryable but which will no longer be written to. Our usage includes a lot of reindexing in…

---

## [NEST Library SQL](https://discuss.elastic.co/t/nest-library-sql/149896)

<div class="topic-metadata">

**Author:** [@han1](https://discuss.elastic.co/u/han1)\
**Replies:** 0\
**Last updated:** [September 25, 2018, 7:10pm UTC](https://discuss.elastic.co/t/nest-library-sql/149896 "2018-09-25T19:10:47Z")

</div>

Does NEST now support SQL query. Is the NEST documentation EVER going to be updated with some decent examples. It is SEVERELY lacking!

---

## [Regexp query](https://discuss.elastic.co/t/regexp-query/149879)

<div class="topic-metadata">

**Author:** [@achraf\_eddine](https://discuss.elastic.co/u/achraf_eddine)\
**Replies:** 0\
**Last updated:** [September 25, 2018, 5:26pm UTC](https://discuss.elastic.co/t/regexp-query/149879 "2018-09-25T17:26:53Z")

</div>

Bonjour, j'aurais besoin de votre aide pour une query avec une expression régulière, enfaite j'ai un field dans mon index qui contient des lettres et des chiffre est qui se termine avec "$" exemple "WMTRB1DC01$" voici …

---

## [Elasticsearch Snapshot Error](https://discuss.elastic.co/t/elasticsearch-snapshot-error/149738)

<div class="topic-metadata">

**Author:** [@DravenJohnson](https://discuss.elastic.co/u/DravenJohnson)\
**Replies:** 3\
**Last updated:** [September 25, 2018, 5:02pm UTC](https://discuss.elastic.co/t/elasticsearch-snapshot-error/149738 "2018-09-25T17:02:43Z")

</div>

Questions is similar to Error Missing Snapshot Error We investigated into this, looks like upgrade Elasticsearch from 5 to 6 broke it. Is there any way to fix this now? If not able to fix it, we want to use curator to …

---

## [GCS repository issues](https://discuss.elastic.co/t/gcs-repository-issues/149872)

<div class="topic-metadata">

**Author:** [@joropito](https://discuss.elastic.co/u/joropito)\
**Replies:** 0\
**Last updated:** [September 25, 2018, 4:11pm UTC](https://discuss.elastic.co/t/gcs-repository-issues/149872 "2018-09-25T16:11:44Z")

</div>

Hello everyone. I'm having some problems trying to setup my google repository to make snapshots. I've already added the credentials file to the keystore with add-file and I've done almost everything I found on the web …

---

## [Aggregation based on categories](https://discuss.elastic.co/t/aggregation-based-on-categories/149871)

<div class="topic-metadata">

**Author:** [@esh](https://discuss.elastic.co/u/esh)\
**Replies:** 0\
**Last updated:** [September 25, 2018, 4:03pm UTC](https://discuss.elastic.co/t/aggregation-based-on-categories/149871 "2018-09-25T16:03:37Z")

</div>

I'm trying to set up Elasticsearch for categorized product searching, but I'm having trouble wrapping my mind around the aggregations, although I believe my situation is fairly common. I have a bunch of items which can …

---

## [Bulk index using .net HttpClient get TaskCanceledException](https://discuss.elastic.co/t/bulk-index-using-net-httpclient-get-taskcanceledexception/149868)

<div class="topic-metadata">

**Author:** [@sailorfina](https://discuss.elastic.co/u/sailorfina)\
**Replies:** 0\
**Last updated:** [September 25, 2018, 3:40pm UTC](https://discuss.elastic.co/t/bulk-index-using-net-httpclient-get-taskcanceledexception/149868 "2018-09-25T15:40:05Z")

</div>

Hi, I have a middle tier that keep fetching data from data source and do some processing work then put them into elasticsearch. I found that when the middle tier machine (it is a Azure Service Fabric VM) is hot (CPU goe…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1536)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1538)
