# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1685

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1686

---

## [Index deleting](https://discuss.elastic.co/t/index-deleting/132328)

<div class="topic-metadata">

**Author:** [@asalma](https://discuss.elastic.co/u/asalma)\
**Replies:** 1\
**Last updated:** [May 17, 2018, 12:34pm UTC](https://discuss.elastic.co/t/index-deleting/132328 "2018-05-17T12:34:32Z")

</div>

I want to delete index that I don't use and keep just what I need, how can I do this ? \[image\]

---

## [Most efficient way to bulk update index?](https://discuss.elastic.co/t/most-efficient-way-to-bulk-update-index/131480)

<div class="topic-metadata">

**Author:** [@Jaspreet\_Singh](https://discuss.elastic.co/u/Jaspreet_Singh)\
**Replies:** 3\
**Last updated:** [May 17, 2018, 12:33pm UTC](https://discuss.elastic.co/t/most-efficient-way-to-bulk-update-index/131480 "2018-05-17T12:33:05Z")

</div>

Hi, Here is my requirement. This is what I need to do ... if (indexedField1.value contains pattern1) indexedField1.value = newValue; add a new indexedField2 I do realize there is a programmatic way of doing this in J…

---

## [Logstash AND Elasticsearch - mapper\_parsing\_exception - geo\_point](https://discuss.elastic.co/t/logstash-and-elasticsearch-mapper-parsing-exception-geo-point/131482)

<div class="topic-metadata">

**Author:** [@Alessio\_Frabotta](https://discuss.elastic.co/u/Alessio_Frabotta)\
**Replies:** 1\
**Last updated:** [May 17, 2018, 12:19pm UTC](https://discuss.elastic.co/t/logstash-and-elasticsearch-mapper-parsing-exception-geo-point/131482 "2018-05-17T12:19:32Z")

</div>

Through logstash I sent my log messages to elasticsearch and a message has the following structure: { "message" =\> "{\\"@version\\":1,\\"level\\":\\"INFO\\",\\"logger\_name\\":\\"it.test.elk.ELKTestApplication\\",\\"appName\\":\\…

---

## [Geo\_shape query not working in version 6](https://discuss.elastic.co/t/geo-shape-query-not-working-in-version-6/132204)

<div class="topic-metadata">

**Author:** [@RahulD](https://discuss.elastic.co/u/RahulD)\
**Replies:** 1\
**Last updated:** [May 17, 2018, 12:02pm UTC](https://discuss.elastic.co/t/geo-shape-query-not-working-in-version-6/132204 "2018-05-17T12:02:15Z")

</div>

Hi, I have an index with the following mapping. PUT test { "mappings": { "type1": { "properties": { "geolocation": { "type": "geo\_shape", "precision": "1.0m", "points\_o…

---

## [Help in Data collection and indexing](https://discuss.elastic.co/t/help-in-data-collection-and-indexing/130802)

<div class="topic-metadata">

**Author:** [@thompsonlau](https://discuss.elastic.co/u/thompsonlau)\
**Replies:** 25\
**Last updated:** [May 17, 2018, 11:36am UTC](https://discuss.elastic.co/t/help-in-data-collection-and-indexing/130802 "2018-05-17T11:36:40Z")

</div>

I have already finished installation and configuration of Elastic, Kibana and Logstash. I found some existing indices after browsing to localhost:9200/\_cat/indices?v Now I want to send logs from different devices via J…

---

## [Elasticsearch v6.2 ERROR No log4j2 configuration file found](https://discuss.elastic.co/t/elasticsearch-v6-2-error-no-log4j2-configuration-file-found/132310)

<div class="topic-metadata">

**Author:** [@Devapp](https://discuss.elastic.co/u/Devapp)\
**Replies:** 1\
**Last updated:** [May 17, 2018, 11:16am UTC](https://discuss.elastic.co/t/elasticsearch-v6-2-error-no-log4j2-configuration-file-found/132310 "2018-05-17T11:16:07Z")

</div>

I'm following the instructions in order to install elasticsearch on an amazon ec2 instance. I have installed this elasticsearch version and also two plugins. Also I have updated the java version to this. And when I try …

---

## [Unit testing code that uses the HighLevelRestClient](https://discuss.elastic.co/t/unit-testing-code-that-uses-the-highlevelrestclient/132319)

<div class="topic-metadata">

**Author:** [@johnjingle](https://discuss.elastic.co/u/johnjingle)\
**Replies:** 0\
**Last updated:** [May 17, 2018, 11:14am UTC](https://discuss.elastic.co/t/unit-testing-code-that-uses-the-highlevelrestclient/132319 "2018-05-17T11:14:40Z")

</div>

We use the HighLevelRestClient.index() to index data to Elasticsearch. I am trying to use PowerMockito to mock client.index(IndexRequest). I would welcome any pointers.

---

## [Compare field value of two different index](https://discuss.elastic.co/t/compare-field-value-of-two-different-index/132290)

<div class="topic-metadata">

**Author:** [@addanuj](https://discuss.elastic.co/u/addanuj)\
**Replies:** 1\
**Last updated:** [May 17, 2018, 11:00am UTC](https://discuss.elastic.co/t/compare-field-value-of-two-different-index/132290 "2018-05-17T11:00:01Z")

</div>

Hi @spinscale please guide me.. please guide me to the following problem, I have two different index and i want to compare two fields value and get result which exist in different index for example :- Index 1: threat…

---

## [Why returning many records with no fields (only IDs) is CPU intensive?](https://discuss.elastic.co/t/why-returning-many-records-with-no-fields-only-ids-is-cpu-intensive/132311)

<div class="topic-metadata">

**Author:** [@aliostad](https://discuss.elastic.co/u/aliostad)\
**Replies:** 2\
**Last updated:** [May 17, 2018, 10:54am UTC](https://discuss.elastic.co/t/why-returning-many-records-with-no-fields-only-ids-is-cpu-intensive/132311 "2018-05-17T10:54:29Z")

</div>

Hi, I have been trying to use Elasticsearch for some simple filtering for example for an index with 100K records, return all matching a criteria (using as terms query). When the number of records matching goes above 1K…

---

## [Using Rally to benchmark a large multi node cluster](https://discuss.elastic.co/t/using-rally-to-benchmark-a-large-multi-node-cluster/132217)

<div class="topic-metadata">

**Author:** [@sharathr83](https://discuss.elastic.co/u/sharathr83)\
**Replies:** 1\
**Last updated:** [May 17, 2018, 10:52am UTC](https://discuss.elastic.co/t/using-rally-to-benchmark-a-large-multi-node-cluster/132217 "2018-05-17T10:52:11Z")

</div>

We has tried Rally (0.7.2) for sometime last year ( Sep 2017) and remember facing a few issues. We had to eventually abandon it on our side because of time constraints we had. Were there anything major that changed form…

---

## [File integrity Monitoring with elasticsearch](https://discuss.elastic.co/t/file-integrity-monitoring-with-elasticsearch/132250)

<div class="topic-metadata">

**Author:** [@Krunal\_kalaria](https://discuss.elastic.co/u/Krunal_kalaria)\
**Replies:** 4\
**Last updated:** [May 17, 2018, 9:59am UTC](https://discuss.elastic.co/t/file-integrity-monitoring-with-elasticsearch/132250 "2018-05-17T09:59:18Z")

</div>

Hello Folks, I want to know any file integrity monitoring solution integration is their with elastic stack ? I am using OSSEC Wazuh for FIM but i want other open source or any FIM solution that we can integrate with El…

---

## [Remove an object from an array](https://discuss.elastic.co/t/remove-an-object-from-an-array/131501)

<div class="topic-metadata">

**Author:** [@basia](https://discuss.elastic.co/u/basia)\
**Replies:** 2\
**Last updated:** [May 17, 2018, 9:36am UTC](https://discuss.elastic.co/t/remove-an-object-from-an-array/131501 "2018-05-17T09:36:54Z")

</div>

Hey, I want to remove an object (which's starting "activityId": 344485} in the array "projet-line" here : { "took": 9, "timed\_out": false, "\_shards": { "total": 5, "successful": 5, "skipped": 0, "failed": 0 }, …

---

## [Increasing max\_result\_window via Logstash Output plugin for ES](https://discuss.elastic.co/t/increasing-max-result-window-via-logstash-output-plugin-for-es/132278)

<div class="topic-metadata">

**Author:** [@Amit\_Jaiswal](https://discuss.elastic.co/u/Amit_Jaiswal)\
**Replies:** 1\
**Last updated:** [May 17, 2018, 8:45am UTC](https://discuss.elastic.co/t/increasing-max-result-window-via-logstash-output-plugin-for-es/132278 "2018-05-17T08:45:49Z")

</div>

Hi All, I am populating data in Elastic search via Logtstash and successfully able to build index. But, it gives error to load records more than 10000 and asks for increasing index. max\_result\_window value. How can i …

---

## [Cannot start ElasticSearch](https://discuss.elastic.co/t/cannot-start-elasticsearch/129779)

<div class="topic-metadata">

**Author:** [@No\_Executable](https://discuss.elastic.co/u/No_Executable)\
**Replies:** 9\
**Last updated:** [May 17, 2018, 7:53am UTC](https://discuss.elastic.co/t/cannot-start-elasticsearch/129779 "2018-05-17T07:53:50Z")

</div>

We have previously set up ELKStack and it has worked without error for several weeks but since yesterday we cannot start ElasticSearch. Logstash, Filebeat and Kibana works like they should. But when we try to start ES w…

---

## [Create Watcher for percentile difference of a field between two days](https://discuss.elastic.co/t/create-watcher-for-percentile-difference-of-a-field-between-two-days/131680)

<div class="topic-metadata">

**Author:** [@ishantanu](https://discuss.elastic.co/u/ishantanu)\
**Replies:** 12\
**Last updated:** [May 16, 2018, 9:41am UTC](https://discuss.elastic.co/t/create-watcher-for-percentile-difference-of-a-field-between-two-days/131680 "2018-05-16T09:41:09Z")

</div>

Hi, I would like to get an idea how I can create a watcher which is triggered based on percentile difference of a numeric field across two days. Here's the scenario: Two float type fields, let's say, A and B Time to …

---

## [Nested object inside nested object](https://discuss.elastic.co/t/nested-object-inside-nested-object/132267)

<div class="topic-metadata">

**Author:** [@prasad.ram1431](https://discuss.elastic.co/u/prasad.ram1431)\
**Replies:** 0\
**Last updated:** [May 17, 2018, 7:29am UTC](https://discuss.elastic.co/t/nested-object-inside-nested-object/132267 "2018-05-17T07:29:13Z")

</div>

Hi All, I am facing problem with below data format. PUT personal/user/1 { "userinfo": { "users": \[{ "uname": "ram", "age": 25, "address": \[{ "town": "ct", "city"…

---

## [Elasticsearch snapshot creation with exclude list](https://discuss.elastic.co/t/elasticsearch-snapshot-creation-with-exclude-list/132263)

<div class="topic-metadata">

**Author:** [@raulk89](https://discuss.elastic.co/u/raulk89)\
**Replies:** 1\
**Last updated:** [May 17, 2018, 6:39am UTC](https://discuss.elastic.co/t/elasticsearch-snapshot-creation-with-exclude-list/132263 "2018-05-17T06:39:44Z")

</div>

Hi ElasticSearch 1.7.2 Is there a possibility to specify exclude indices list during snaphot creaton, rather than indices list to backup..? I'd prefer exclude\_list rather than indices list, because, we rename our indi…

---

## [TransportClient causes abnormal system load](https://discuss.elastic.co/t/transportclient-causes-abnormal-system-load/132257)

<div class="topic-metadata">

**Author:** [@Jian\_Lin](https://discuss.elastic.co/u/Jian_Lin)\
**Replies:** 1\
**Last updated:** [May 17, 2018, 6:01am UTC](https://discuss.elastic.co/t/transportclient-causes-abnormal-system-load/132257 "2018-05-17T06:01:05Z")

</div>

es cluster version: 2.3.3 es client version: 2.3.3 machine: centos6 8GB RAM 4 core cpu Sometimes there is no regular pattern of sudden increase in load, but io and cpu used is normal.Look the picture,on the …

---

## [Disable \_source field](https://discuss.elastic.co/t/disable-source-field/132036)

<div class="topic-metadata">

**Author:** [@nsphaniraj](https://discuss.elastic.co/u/nsphaniraj)\
**Replies:** 9\
**Last updated:** [May 17, 2018, 5:53am UTC](https://discuss.elastic.co/t/disable-source-field/132036 "2018-05-17T05:53:28Z")

</div>

Hello, I had harvested 100 csv files. using filebeat -\> logstash (Using csv filter) -\> Elasticsearch. The disk size of 100 CSV flat files is 609 MB and translated to 1 GB in elasticsearch (pri.store.size). I am aware o…

---

## [Reg: Cluster Privileges for Snapshots - Permission issue](https://discuss.elastic.co/t/reg-cluster-privileges-for-snapshots-permission-issue/132228)

<div class="topic-metadata">

**Author:** [@Karthik\_Ramachandran](https://discuss.elastic.co/u/Karthik_Ramachandran)\
**Replies:** 1\
**Last updated:** [May 17, 2018, 2:37am UTC](https://discuss.elastic.co/t/reg-cluster-privileges-for-snapshots-permission-issue/132228 "2018-05-17T02:37:57Z")

</div>

We are using Azure Repository Plugin (ES 6.2.1) for snapshotting, and use curator actions for snapshot action. But, the action is error'ing out as below action \[cluster:admin/repository/get\] is unauthorized for user Er…

---

## [Reg: xpack:defaultAdminEmail](https://discuss.elastic.co/t/reg-xpack-defaultadminemail/131541)

<div class="topic-metadata">

**Author:** [@Karthik\_Ramachandran](https://discuss.elastic.co/u/Karthik_Ramachandran)\
**Replies:** 1\
**Last updated:** [May 16, 2018, 11:18pm UTC](https://discuss.elastic.co/t/reg-xpack-defaultadminemail/131541 "2018-05-16T23:18:33Z")

</div>

When Kibana is monitored using xPACK, it schedules some alerts by default ex. Cluster Status. The watch requires that the setting xpack:defaultAdminEmail be provided using UI/AdvancedSetting. Shall we specificy this as p…

---

## [Insert a new dashboard with curl](https://discuss.elastic.co/t/insert-a-new-dashboard-with-curl/132224)

<div class="topic-metadata">

**Author:** [@casperhxr](https://discuss.elastic.co/u/casperhxr)\
**Replies:** 0\
**Last updated:** [May 16, 2018, 10:02pm UTC](https://discuss.elastic.co/t/insert-a-new-dashboard-with-curl/132224 "2018-05-16T22:02:43Z")

</div>

Hello all, I've found a third party utility called Vuln Whisperer. There is a prebuilt dashboard in json format. My question is: How can i input the json file into my .kibana index without overwriting my current dashboa…

---

## [Java RestClient sending gzip update](https://discuss.elastic.co/t/java-restclient-sending-gzip-update/132220)

<div class="topic-metadata">

**Author:** [@surabaya](https://discuss.elastic.co/u/surabaya)\
**Replies:** 0\
**Last updated:** [May 16, 2018, 9:32pm UTC](https://discuss.elastic.co/t/java-restclient-sending-gzip-update/132220 "2018-05-16T21:32:18Z")

</div>

Is there a way to send gzipped document update to ES using the low-level Java RestClient? I intend to send a \_bulk update using RestClient this way: restClient.performRequest("POST", "endpoint/\_bulk", emptyMap(), n…

---

## [Is it legal to enable free X-Pack monitoring in production environment?](https://discuss.elastic.co/t/is-it-legal-to-enable-free-x-pack-monitoring-in-production-environment/132190)

<div class="topic-metadata">

**Author:** [@elasticheart](https://discuss.elastic.co/u/elasticheart)\
**Replies:** 1\
**Last updated:** [May 16, 2018, 9:09pm UTC](https://discuss.elastic.co/t/is-it-legal-to-enable-free-x-pack-monitoring-in-production-environment/132190 "2018-05-16T21:09:25Z")

</div>

Hi, I am using ELK GA 5.0.0 in a production environment. Here are the details; Elasticsearch Version : 5.0.0 GA Instances : 3 node cluster OS: Oracle Linux Server release Logstash Version : 5.0.0 GA Instances : 13 …

---

## [Query with min\_score - if no results above that score, return minimum number of skills](https://discuss.elastic.co/t/query-with-min-score-if-no-results-above-that-score-return-minimum-number-of-skills/132213)

<div class="topic-metadata">

**Author:** [@Jason\_Woo](https://discuss.elastic.co/u/Jason_Woo)\
**Replies:** 0\
**Last updated:** [May 16, 2018, 8:48pm UTC](https://discuss.elastic.co/t/query-with-min-score-if-no-results-above-that-score-return-minimum-number-of-skills/132213 "2018-05-16T20:48:10Z")

</div>

I want my query to return all results above a certain score, which I can do with "min\_score". But if there are no results above that score, or there are only 1 or 2, I want to return 5 best results. I think the paramete…

---

## [Curator not able to authenticate elasticSearch, with X-Pack](https://discuss.elastic.co/t/curator-not-able-to-authenticate-elasticsearch-with-x-pack/132206)

<div class="topic-metadata">

**Author:** [@sundeepm](https://discuss.elastic.co/u/sundeepm)\
**Replies:** 1\
**Last updated:** [May 16, 2018, 8:40pm UTC](https://discuss.elastic.co/t/curator-not-able-to-authenticate-elasticsearch-with-x-pack/132206 "2018-05-16T20:40:35Z")

</div>

Hello, I have been using curator to cleanup my data, for a while now. It worked all well while I was running elasticsearch 5.5.2, but since the upgrade to 6.2.3, it doesn't work. I have also added x-pack with the v6.2.…

---

## [How to update Nested object in elasticsearch](https://discuss.elastic.co/t/how-to-update-nested-object-in-elasticsearch/131611)

<div class="topic-metadata">

**Author:** [@kartheek91](https://discuss.elastic.co/u/kartheek91)\
**Replies:** 3\
**Last updated:** [May 16, 2018, 8:10pm UTC](https://discuss.elastic.co/t/how-to-update-nested-object-in-elasticsearch/131611 "2018-05-16T20:10:11Z")

</div>

Hi all developing an application and i need to update nested object. I'm not able to update the nested document.Can anyone help me please/ { "\_index": "i9", "\_type": "i9details", "\_id": "OjmfWGMBhKzS2hoOoiJC", "\_sc…

---

## [Exception while creating a template](https://discuss.elastic.co/t/exception-while-creating-a-template/132207)

<div class="topic-metadata">

**Author:** [@satishrao](https://discuss.elastic.co/u/satishrao)\
**Replies:** 0\
**Last updated:** [May 16, 2018, 8:09pm UTC](https://discuss.elastic.co/t/exception-while-creating-a-template/132207 "2018-05-16T20:09:11Z")

</div>

Hello, I am trying to create a template which I deleted. I am using the below curl command : curl -X PUT -H "Content-Type: application/json" -i "http://172.31.38.157:9200/\_template/couchbase" -d '{ "couchbase" : { …

---

## [Search Result order for filtered queries](https://discuss.elastic.co/t/search-result-order-for-filtered-queries/132198)

<div class="topic-metadata">

**Author:** [@gauravbhatt13](https://discuss.elastic.co/u/gauravbhatt13)\
**Replies:** 0\
**Last updated:** [May 16, 2018, 7:00pm UTC](https://discuss.elastic.co/t/search-result-order-for-filtered-queries/132198 "2018-05-16T19:00:57Z")

</div>

One of our customer was using Lucene indexes for type ahead usecase. Now we decided to move to ES where we are using 'Filtered' queries and because of which the search result order has changed from what we were getting e…

---

## [How to write rows of a Streaming DataFrame to multiple ElasticSearch indices?](https://discuss.elastic.co/t/how-to-write-rows-of-a-streaming-dataframe-to-multiple-elasticsearch-indices/131711)

<div class="topic-metadata">

**Author:** [@kant\_kodali](https://discuss.elastic.co/u/kant_kodali)\
**Replies:** 1\
**Last updated:** [May 16, 2018, 6:39pm UTC](https://discuss.elastic.co/t/how-to-write-rows-of-a-streaming-dataframe-to-multiple-elasticsearch-indices/131711 "2018-05-16T18:39:48Z")

</div>

How to write rows of a Streaming DataFrame to multiple ElasticSearch indices? For example I want to write row1 of a dataframe to index1, row2 of a dataframe to index2 , row3 of a dataframe to index3 and so on ...I have …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1684)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1686)
