# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1597

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1598

---

## [Simple User Audit Table](https://discuss.elastic.co/t/simple-user-audit-table/142403)

<div class="topic-metadata">

**Author:** [@Matt\_2012](https://discuss.elastic.co/u/Matt_2012)\
**Replies:** 0\
**Last updated:** [July 31, 2018, 3:25pm UTC](https://discuss.elastic.co/t/simple-user-audit-table/142403 "2018-07-31T15:25:11Z")

</div>

I want to use ElasticSearch / Kibana To store CRUD access by users to our bespoke PHP Platform API. I want a table that shows User (i.e John Smith), Record (e.g. James Jones), Action (e.g. Archive), Date Then when you…

---

## [Incorrect Post syntax for Elasticsearch in postman](https://discuss.elastic.co/t/incorrect-post-syntax-for-elasticsearch-in-postman/142364)

<div class="topic-metadata">

**Author:** [@Michael\_C.H\_Wang](https://discuss.elastic.co/u/Michael_C.H_Wang)\
**Replies:** 2\
**Last updated:** [July 31, 2018, 2:45pm UTC](https://discuss.elastic.co/t/incorrect-post-syntax-for-elasticsearch-in-postman/142364 "2018-07-31T14:45:04Z")

</div>

Hi,I'm a new learner and follow AWS example here: https://docs.aws.amazon.com/elasticsearch-service/latest/developerguide/es-gsg-upload-data.html to build my first elasticsearch application. I'm using Postman for curl co…

---

## [Elasticsearch 6.3.2 X-Pack features](https://discuss.elastic.co/t/elasticsearch-6-3-2-x-pack-features/141785)

<div class="topic-metadata">

**Author:** [@cerbi](https://discuss.elastic.co/u/cerbi)\
**Replies:** 8\
**Last updated:** [July 31, 2018, 1:57pm UTC](https://discuss.elastic.co/t/elasticsearch-6-3-2-x-pack-features/141785 "2018-07-31T13:57:41Z")

</div>

Is Elasticsearch Watcher features available for x-pack in Elasticsearch 6.3.2? Where can I check available x-pack features? Thanks Sarah

---

## [Error in pipeline aggregation](https://discuss.elastic.co/t/error-in-pipeline-aggregation/142373)

<div class="topic-metadata">

**Author:** [@umeshmishra099](https://discuss.elastic.co/u/umeshmishra099)\
**Replies:** 0\
**Last updated:** [July 31, 2018, 1:39pm UTC](https://discuss.elastic.co/t/error-in-pipeline-aggregation/142373 "2018-07-31T13:39:42Z")

</div>

Trying to run below request but getting error: /prof\_dc44f7ef-d590-44bc-8845-3f1cf82bc521/\_search Post { "aggregations": { "Frequency": { "terms": { "field": "gender", "size": 2147483647, "min\_doc\_count": 1, …

---

## [Increase the number of splitting data on machine learning](https://discuss.elastic.co/t/increase-the-number-of-splitting-data-on-machine-learning/142371)

<div class="topic-metadata">

**Author:** [@Angelos](https://discuss.elastic.co/u/Angelos)\
**Replies:** 1\
**Last updated:** [July 31, 2018, 1:37pm UTC](https://discuss.elastic.co/t/increase-the-number-of-splitting-data-on-machine-learning/142371 "2018-07-31T13:37:10Z")

</div>

Hello, Is there any way to increase the result of splitting data in machine learning? Now, when you split the data in multi metric job, the result has a limit of 50 values(5, 10, 25, 50). Can we change that? Thank …

---

## [Which Machine learning Algorithms used by Elastic x-pack ML?](https://discuss.elastic.co/t/which-machine-learning-algorithms-used-by-elastic-x-pack-ml/142350)

<div class="topic-metadata">

**Author:** [@alizadehei](https://discuss.elastic.co/u/alizadehei)\
**Replies:** 1\
**Last updated:** [July 31, 2018, 1:32pm UTC](https://discuss.elastic.co/t/which-machine-learning-algorithms-used-by-elastic-x-pack-ml/142350 "2018-07-31T13:32:37Z")

</div>

Hello, i have 2 questions: 1- which Machine learning Algorithms used by x-pack Machine Learning? 2- What do you suggest if I want to use other Machine Learning Algorithms for elatstic data? should i use MLlib spark on…

---

## [Not able to run elasticsearch on IP other than localhost](https://discuss.elastic.co/t/not-able-to-run-elasticsearch-on-ip-other-than-localhost/142363)

<div class="topic-metadata">

**Author:** [@MiddlewareTeam](https://discuss.elastic.co/u/MiddlewareTeam)\
**Replies:** 1\
**Last updated:** [July 31, 2018, 1:19pm UTC](https://discuss.elastic.co/t/not-able-to-run-elasticsearch-on-ip-other-than-localhost/142363 "2018-07-31T13:19:27Z")

</div>

I want to run the elasticsearch on different IP other than localhost which can be operated outside any other network. Is is possible to do so? I am using Linux 64 bit operating system with elasticsearch version 6.3. Any …

---

## [Curator's shrink api can't continue after allocation](https://discuss.elastic.co/t/curators-shrink-api-cant-continue-after-allocation/142366)

<div class="topic-metadata">

**Author:** [@Kvin](https://discuss.elastic.co/u/Kvin)\
**Replies:** 0\
**Last updated:** [July 31, 2018, 1:13pm UTC](https://discuss.elastic.co/t/curators-shrink-api-cant-continue-after-allocation/142366 "2018-07-31T13:13:05Z")

</div>

I'm trying to use Curator to shrink indices which are older than a certain number of days from 4 shards to 2 shards. However after it finishes moving all the shards to the same node, it simply stops working. In Kibana's …

---

## [Ignore\_above is not working with analyzer and multi fields](https://discuss.elastic.co/t/ignore-above-is-not-working-with-analyzer-and-multi-fields/140984)

<div class="topic-metadata">

**Author:** [@Hitesh\_Baldaniya](https://discuss.elastic.co/u/Hitesh_Baldaniya)\
**Replies:** 2\
**Last updated:** [July 31, 2018, 1:09pm UTC](https://discuss.elastic.co/t/ignore-above-is-not-working-with-analyzer-and-multi-fields/140984 "2018-07-31T13:09:01Z")

</div>

Hi Team, I have following schema in my index, when i am trying to add content in field with large length it is giving me following error. Mapping { "fields": { "type": "nested", "properties": { "uid":…

---

## [Dealing with Arrays and IP address fields in elasticsearch SQL](https://discuss.elastic.co/t/dealing-with-arrays-and-ip-address-fields-in-elasticsearch-sql/142122)

<div class="topic-metadata">

**Author:** [@blueren](https://discuss.elastic.co/u/blueren)\
**Replies:** 2\
**Last updated:** [July 31, 2018, 1:03pm UTC](https://discuss.elastic.co/t/dealing-with-arrays-and-ip-address-fields-in-elasticsearch-sql/142122 "2018-07-31T13:03:13Z")

</div>

I'm using elastiflow by @rcowart \[tagging for FYI\]. Certain flow fields such as TCP flags return array. Other fields such as source / dest IP return IP address types. If I try to query them using the Elasticsearch SQL a…

---

## [Incorrect population of Empty fields](https://discuss.elastic.co/t/incorrect-population-of-empty-fields/142283)

<div class="topic-metadata">

**Author:** [@Nithani25](https://discuss.elastic.co/u/Nithani25)\
**Replies:** 1\
**Last updated:** [July 31, 2018, 1:01pm UTC](https://discuss.elastic.co/t/incorrect-population-of-empty-fields/142283 "2018-07-31T13:01:18Z")

</div>

Hi Team, I have very unique problem here, i have created a new index for a csv file(separated by "|") and was successful in indexing around 17k messages. Now if you look at my message structure(provided below) there are…

---

## [Can't create s3 repository for backup in AWS Beijing region](https://discuss.elastic.co/t/cant-create-s3-repository-for-backup-in-aws-beijing-region/141584)

<div class="topic-metadata">

**Author:** [@k-troska](https://discuss.elastic.co/u/k-troska)\
**Replies:** 5\
**Last updated:** [July 31, 2018, 12:57pm UTC](https://discuss.elastic.co/t/cant-create-s3-repository-for-backup-in-aws-beijing-region/141584 "2018-07-31T12:57:20Z")

</div>

Elasticsearch version (bin/elasticsearch --version): Version: 6.3.2, Build: oss/deb/053779d/2018-07-20T05:20:23.451332Z, JVM: 1.8.0\_171 Plugins installed: ingest-geoip ingest-user-agent repository-s3 JVM version (j…

---

## [Template with dynamic mapping and \_all converted in 6.3](https://discuss.elastic.co/t/template-with-dynamic-mapping-and-all-converted-in-6-3/142174)

<div class="topic-metadata">

**Author:** [@phia](https://discuss.elastic.co/u/phia)\
**Replies:** 3\
**Last updated:** [July 31, 2018, 12:04pm UTC](https://discuss.elastic.co/t/template-with-dynamic-mapping-and-all-converted-in-6-3/142174 "2018-07-31T12:04:50Z")

</div>

Hey guys, I currently have a JSON for creating a template. There are so many changes in Elasticsearch 6.x so that I am not able to convert my JSON. Can you please help me? Current JSON: { "template" : "ws\*", "set…

---

## [Delete indices from AWS Lambda based on creation date](https://discuss.elastic.co/t/delete-indices-from-aws-lambda-based-on-creation-date/142333)

<div class="topic-metadata">

**Author:** [@flybd5](https://discuss.elastic.co/u/flybd5)\
**Replies:** 2\
**Last updated:** [July 31, 2018, 11:21am UTC](https://discuss.elastic.co/t/delete-indices-from-aws-lambda-based-on-creation-date/142333 "2018-07-31T11:21:54Z")

</div>

This week I decided to tackle improving a particularly convoluted piece of Python code to implement an AWS Lambda that performs a relatively simple task: delete indices for log files based on a retention policy of x days…

---

## [Pattern Matching in Elasticsearch](https://discuss.elastic.co/t/pattern-matching-in-elasticsearch/142338)

<div class="topic-metadata">

**Author:** [@eth](https://discuss.elastic.co/u/eth)\
**Replies:** 1\
**Last updated:** [July 31, 2018, 10:41am UTC](https://discuss.elastic.co/t/pattern-matching-in-elasticsearch/142338 "2018-07-31T10:41:46Z")

</div>

Hi I want to create a mapping for an index which has a field named "interval". The "interval" field should allow only certain values, such as 1M,1d or 1H. How do we achieve this ? Is this possible through pattern matc…

---

## [Efficiently get the nearest geopoint in 6.x](https://discuss.elastic.co/t/efficiently-get-the-nearest-geopoint-in-6-x/142334)

<div class="topic-metadata">

**Author:** [@mihai1voicescu](https://discuss.elastic.co/u/mihai1voicescu)\
**Replies:** 0\
**Last updated:** [July 31, 2018, 10:13am UTC](https://discuss.elastic.co/t/efficiently-get-the-nearest-geopoint-in-6-x/142334 "2018-07-31T10:13:14Z")

</div>

Because of the change to BKD trees for geo\_point type, in order to efficiently find the closest point in a stored database to a given point a simple search with limit on size is enough? GET geodatabase/location/\_search …

---

## [ELK license model](https://discuss.elastic.co/t/elk-license-model/142147)

<div class="topic-metadata">

**Author:** [@adavous](https://discuss.elastic.co/u/adavous)\
**Replies:** 7\
**Last updated:** [July 31, 2018, 9:57am UTC](https://discuss.elastic.co/t/elk-license-model/142147 "2018-07-31T09:57:47Z")

</div>

Sorry to ask about very basic information. Well, I have installed and configured ELK on my own server to ingest and analyze IIS logs and Windows events of few servers. Having a standalone ELK server is filling my needs …

---

## [Complete MySQL database to Elasticsearch](https://discuss.elastic.co/t/complete-mysql-database-to-elasticsearch/142266)

<div class="topic-metadata">

**Author:** [@nandan\_bigdata](https://discuss.elastic.co/u/nandan_bigdata)\
**Replies:** 4\
**Last updated:** [July 31, 2018, 9:35am UTC](https://discuss.elastic.co/t/complete-mysql-database-to-elasticsearch/142266 "2018-07-31T09:35:16Z")

</div>

Hi Team, I am working on a data analysis project on MySQL Database which contains around 100 tables. Details are as below:- Database Type :- RDBMS - MySQL Total No. of Tables:- 100 The total Data size of Current My…

---

## [Elasticsearch cluster design](https://discuss.elastic.co/t/elasticsearch-cluster-design/142300)

<div class="topic-metadata">

**Author:** [@peterch](https://discuss.elastic.co/u/peterch)\
**Replies:** 1\
**Last updated:** [July 31, 2018, 9:13am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-design/142300 "2018-07-31T09:13:50Z")

</div>

Hi All, I'm new on elk stack and planning the design of elasticsearch cluster which needs advice. I have around 9 to 10 million log every day. The log retention is 6 months, 1 year would be the best. I have following qu…

---

## [Using elasticsearch with jupyter notebook](https://discuss.elastic.co/t/using-elasticsearch-with-jupyter-notebook/142317)

<div class="topic-metadata">

**Author:** [@caroline](https://discuss.elastic.co/u/caroline)\
**Replies:** 0\
**Last updated:** [July 31, 2018, 9:04am UTC](https://discuss.elastic.co/t/using-elasticsearch-with-jupyter-notebook/142317 "2018-07-31T09:04:52Z")

</div>

' m trying to use elasticsearch with jupyter notebook I have installed elasticsearch python client using pip install elasticsearch and I have included the elasticsearch spark connector jar on the classpath when launching…

---

## [Create a multi metric machine learning job using dev tools](https://discuss.elastic.co/t/create-a-multi-metric-machine-learning-job-using-dev-tools/142169)

<div class="topic-metadata">

**Author:** [@Angelos](https://discuss.elastic.co/u/Angelos)\
**Replies:** 2\
**Last updated:** [July 31, 2018, 8:13am UTC](https://discuss.elastic.co/t/create-a-multi-metric-machine-learning-job-using-dev-tools/142169 "2018-07-31T08:13:44Z")

</div>

Hello, I want to create a multi metric ml job that will be expired in 1d. Can I do it using dev tools? I have created a forecast job like so and now I want to create a ml job. My Forecast job: POST \_xpack/ml/anomaly\_…

---

## [Elasticsearch htop showing 75 % memory usesd](https://discuss.elastic.co/t/elasticsearch-htop-showing-75-memory-usesd/142274)

<div class="topic-metadata">

**Author:** [@Dilip\_Kumar](https://discuss.elastic.co/u/Dilip_Kumar)\
**Replies:** 7\
**Last updated:** [July 31, 2018, 7:36am UTC](https://discuss.elastic.co/t/elasticsearch-htop-showing-75-memory-usesd/142274 "2018-07-31T07:36:26Z")

</div>

Hi i am using es 5.6 with two nodes, first node using 76 % memory (total 16 gb), mlock already true. please suggest to reduce this % memory.

---

## [Cannot install X-Pack offline in docker](https://discuss.elastic.co/t/cannot-install-x-pack-offline-in-docker/142120)

<div class="topic-metadata">

**Author:** [@MrFrost](https://discuss.elastic.co/u/MrFrost)\
**Replies:** 12\
**Last updated:** [July 31, 2018, 7:16am UTC](https://discuss.elastic.co/t/cannot-install-x-pack-offline-in-docker/142120 "2018-07-31T07:16:33Z")

</div>

What gives? I did download the zip file from elastic.co yet it does not work, logs below: ELK 6.3.0 without X-Pack X-Pack: 6.2.4 When trying to install it offline i get this: Step 8/8 : RUN elasticsearch-plugin inst…

---

## [ES java api for multiple aggregations at same level](https://discuss.elastic.co/t/es-java-api-for-multiple-aggregations-at-same-level/142289)

<div class="topic-metadata">

**Author:** [@prasad.ram1431](https://discuss.elastic.co/u/prasad.ram1431)\
**Replies:** 1\
**Last updated:** [July 31, 2018, 7:08am UTC](https://discuss.elastic.co/t/es-java-api-for-multiple-aggregations-at-same-level/142289 "2018-07-31T07:08:06Z")

</div>

Hi All, Could you please help me on how to convert below dsl to java api using aggregationbuilders, { "aggs": { "status\_aggr": { "terms": { "field": "status", "size": 15, "order": { "\_count": "de…

---

## [ElasticSearch query for most relevant documents](https://discuss.elastic.co/t/elasticsearch-query-for-most-relevant-documents/142276)

<div class="topic-metadata">

**Author:** [@Vidya\_Lalitha\_S\_K](https://discuss.elastic.co/u/Vidya_Lalitha_S_K)\
**Replies:** 1\
**Last updated:** [July 31, 2018, 6:51am UTC](https://discuss.elastic.co/t/elasticsearch-query-for-most-relevant-documents/142276 "2018-07-31T06:51:22Z")

</div>

I have these documents { "\_id" : "1", "name" : "Nopales", } { "\_id" : "2", "name" : "ginger ale", } { "\_id" : "3", "name" : "Kale", } { "\_id" : "4", "name" : "Triticale Flour Whole Grain", } and the requ…

---

## [Illegal\_argument\_exception when copying settings to a new index](https://discuss.elastic.co/t/illegal-argument-exception-when-copying-settings-to-a-new-index/142175)

<div class="topic-metadata">

**Author:** [@Joern\_Ott\_Schufa](https://discuss.elastic.co/u/Joern_Ott_Schufa)\
**Replies:** 4\
**Last updated:** [July 31, 2018, 6:46am UTC](https://discuss.elastic.co/t/illegal-argument-exception-when-copying-settings-to-a-new-index/142175 "2018-07-31T06:46:56Z")

</div>

I tried to duplicate an index with curl -XGET https://$USER:$PASS@$(hostname -f):9200/.kibana \>\_index.json sed -e 's|.kibana|.kibana2|g' -i \_index.json curl -XPUT https://$USER:$PASS@$(hostname -f):9200/.kibana2 -H "C…

---

## [RED status in elastic search indices](https://discuss.elastic.co/t/red-status-in-elastic-search-indices/142200)

<div class="topic-metadata">

**Author:** [@rmanju2020](https://discuss.elastic.co/u/rmanju2020)\
**Replies:** 4\
**Last updated:** [July 31, 2018, 6:37am UTC](https://discuss.elastic.co/t/red-status-in-elastic-search-indices/142200 "2018-07-31T06:37:42Z")

</div>

I have observed that 1)whenever a RED status happen on one indices, the next all creating indices will be in RED status. 2)The UNASSIGNED shards of indices doesn't have data.Hence these indices will never become Yellow…

---

## [SQL queries and node js](https://discuss.elastic.co/t/sql-queries-and-node-js/141832)

<div class="topic-metadata">

**Author:** [@blueren](https://discuss.elastic.co/u/blueren)\
**Replies:** 4\
**Last updated:** [July 31, 2018, 5:40am UTC](https://discuss.elastic.co/t/sql-queries-and-node-js/141832 "2018-07-31T05:40:50Z")

</div>

Hello. I just read the blog about support for SQL queries against ES database. I was wondering how I can get it to work with nodejs. Currently, the elasticsearch npm module caters to regular ES queries. Is it possible t…

---

## [How to hide or scrub data logs in Elasticsearch?](https://discuss.elastic.co/t/how-to-hide-or-scrub-data-logs-in-elasticsearch/142268)

<div class="topic-metadata">

**Author:** [@cheleyace](https://discuss.elastic.co/u/cheleyace)\
**Replies:** 5\
**Last updated:** [July 31, 2018, 5:00am UTC](https://discuss.elastic.co/t/how-to-hide-or-scrub-data-logs-in-elasticsearch/142268 "2018-07-31T05:00:14Z")

</div>

Hello, Is there an approach for scrubbing data logs - if a user requested to delete his/her information from security logs? Data should not be deleted it just need to be hide after that the filtered data logs will be sh…

---

## [java.sql.SQLException: Server sent bad type \[illegal\_argument\_exception\]. Original type was \[request \[/\_xpack/sql\] contains unrecognized parameter](https://discuss.elastic.co/t/java-sql-sqlexception-server-sent-bad-type-illegal-argument-exception-original-type-was-request-xpack-sql-contains-unrecognized-parameter/142190)

<div class="topic-metadata">

**Author:** [@agrawal](https://discuss.elastic.co/u/agrawal)\
**Replies:** 3\
**Last updated:** [July 31, 2018, 4:45am UTC](https://discuss.elastic.co/t/java-sql-sqlexception-server-sent-bad-type-illegal-argument-exception-original-type-was-request-xpack-sql-contains-unrecognized-parameter/142190 "2018-07-31T04:45:16Z")

</div>

Hi, I am indexing some data and trying to fetch out using JDBCDataSource connection. ES server version: 6.2.4 ( Docker container) ES elasticsearch.plugin: 6.3.0 ES rest-high-level-client: 6.3.2 Getting an error: ja…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1596)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1598)
