# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1738 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1739 --- ## [Docker swarm cluster optimization and ingest node](https://discuss.elastic.co/t/docker-swarm-cluster-optimization-and-ingest-node/125840)
**Author:** [@Ram\_Ibaset](https://discuss.elastic.co/u/Ram_Ibaset)\ **Replies:** 0\ **Last updated:** [March 28, 2018, 2:28am UTC](https://discuss.elastic.co/t/docker-swarm-cluster-optimization-and-ingest-node/125840 "2018-03-28T02:28:02Z")
I have a docker swarm cluster setup with the following config: 1 Coordinating node 3 Master nodes 3 Data nodes 7 Logstash nodes each extracting data from a DB The performance however is pretty bad at the moment. I … --- ## [Error encountered after modified elasticsearch.yml](https://discuss.elastic.co/t/error-encountered-after-modified-elasticsearch-yml/125526)
**Author:** [@yks](https://discuss.elastic.co/u/yks)\ **Replies:** 18\ **Last updated:** [March 28, 2018, 2:15am UTC](https://discuss.elastic.co/t/error-encountered-after-modified-elasticsearch-yml/125526 "2018-03-28T02:15:45Z")
Hi, I am trying out new version Elasticsearch 6.2.3 on AWS Ubuntu 16.04 After configuring the elasticsearch.yml file I received these error ubuntu@ip-172-31-25-205:/etc$ sudo /etc/init.d/elasticsearch status ● elasti… --- ## [Anonymize some fields in specifc index](https://discuss.elastic.co/t/anonymize-some-fields-in-specifc-index/125824)
**Author:** [@mlobo](https://discuss.elastic.co/u/mlobo)\ **Replies:** 1\ **Last updated:** [March 27, 2018, 10:16pm UTC](https://discuss.elastic.co/t/anonymize-some-fields-in-specifc-index/125824 "2018-03-27T22:16:40Z")
Hi all, I'd like to know if is possible in Elasticsearch to store some fields, in a specific index, anonymized. So, for example, I'd like that for index named "index\_secret", the fields named "gender" and "religion", a… --- ## [Timestamp minutes loss](https://discuss.elastic.co/t/timestamp-minutes-loss/125827)
**Author:** [@Pororo](https://discuss.elastic.co/u/Pororo)\ **Replies:** 0\ **Last updated:** [March 27, 2018, 9:22pm UTC](https://discuss.elastic.co/t/timestamp-minutes-loss/125827 "2018-03-27T21:22:14Z")
Hi, I was trying to ingest the json file into ES by logstash before. And there is one field called "ts" in my json file, ES recognizes it as the timestamp. Everything worked fine when I run it on my local machine. The … --- ## [Increasing index.mapping.total\_fields.limit still produces error with "1000"](https://discuss.elastic.co/t/increasing-index-mapping-total-fields-limit-still-produces-error-with-1000/125817)
**Author:** [@scotttam](https://discuss.elastic.co/u/scotttam)\ **Replies:** 0\ **Last updated:** [March 27, 2018, 8:38pm UTC](https://discuss.elastic.co/t/increasing-index-mapping-total-fields-limit-still-produces-error-with-1000/125817 "2018-03-27T20:38:09Z")
I've increased my index.mapping.total\_fields.limit from 1000 to 2000 and confirmed the changes: "my\_index" : { "settings" : { "index" : { "mapping" : { "total\_fields" : { "limit" … --- ## [Elasticsearch groovy script not working as expected](https://discuss.elastic.co/t/elasticsearch-groovy-script-not-working-as-expected/125816)
**Author:** [@pungent](https://discuss.elastic.co/u/pungent)\ **Replies:** 0\ **Last updated:** [March 27, 2018, 8:37pm UTC](https://discuss.elastic.co/t/elasticsearch-groovy-script-not-working-as-expected/125816 "2018-03-27T20:37:31Z")
My partial mapping of an index listing elasticsearch 2.5 (I know I have to upgrade to newer version and start using painless, let's keep that aside for this question) "name": { "type": "strin… --- ## [/\_cat/indices size not matching actual size on disk?](https://discuss.elastic.co/t/cat-indices-size-not-matching-actual-size-on-disk/125808)
**Author:** [@fassisrosa](https://discuss.elastic.co/u/fassisrosa)\ **Replies:** 0\ **Last updated:** [March 27, 2018, 8:12pm UTC](https://discuss.elastic.co/t/cat-indices-size-not-matching-actual-size-on-disk/125808 "2018-03-27T20:12:04Z")
Hi there, I was trying to use /\_cat/indices to estimate total index disk usage: GET /\_cat/indices?format=json \[ { "health": "yellow", "status": "open", "index": "size218", "uuid": "vHM0hvdWQbmk2ZOhRwp… --- ## [Dynamic Templates Not Applied](https://discuss.elastic.co/t/dynamic-templates-not-applied/125807)
**Author:** [@Marty\_Loewenthal](https://discuss.elastic.co/u/Marty_Loewenthal)\ **Replies:** 0\ **Last updated:** [March 27, 2018, 7:59pm UTC](https://discuss.elastic.co/t/dynamic-templates-not-applied/125807 "2018-03-27T19:59:23Z")
Hello, a couple questions regarding Dynamic Templates. Can my dynamic template mapping map an object or just simple type properties? i.e. I defined this template to map this object each time a property modules is enco… --- ## [Circuit Breaker Tripping During Shard Relocation](https://discuss.elastic.co/t/circuit-breaker-tripping-during-shard-relocation/125804)
**Author:** [@andrewthad](https://discuss.elastic.co/u/andrewthad)\ **Replies:** 0\ **Last updated:** [March 27, 2018, 7:31pm UTC](https://discuss.elastic.co/t/circuit-breaker-tripping-during-shard-relocation/125804 "2018-03-27T19:31:40Z")
I have a twenty-node cluster with the hot-cold pattern. I'm running ElasticSearch 6.2.3. Here is the breakdown: 12 Hot Nodes: 16GB memory each, 9GB for JVM heap 8 Cold Nodes: 12GB memory each, 9GB for JVM heap I'm usi… --- ## [Grok processor in pipeline throws json\_parse\_exception](https://discuss.elastic.co/t/grok-processor-in-pipeline-throws-json-parse-exception/125251)
**Author:** [@Sonia\_Gupta](https://discuss.elastic.co/u/Sonia_Gupta)\ **Replies:** 2\ **Last updated:** [March 27, 2018, 6:30pm UTC](https://discuss.elastic.co/t/grok-processor-in-pipeline-throws-json-parse-exception/125251 "2018-03-27T18:30:03Z")
Unable to use regex for grok pattern: when I give the following: POST \_ingest/pipeline/\_simulate { "pipeline": { "description" : "parse multiple patterns", "processors": \[ { "grok": { "field": "message", "patte… --- ## [Buckets\_path parameter percents throws error](https://discuss.elastic.co/t/buckets-path-parameter-percents-throws-error/125799)
**Author:** [@saii](https://discuss.elastic.co/u/saii)\ **Replies:** 0\ **Last updated:** [March 27, 2018, 6:23pm UTC](https://discuss.elastic.co/t/buckets-path-parameter-percents-throws-error/125799 "2018-03-27T18:23:23Z")
I have written a watch program which uses percentile to calculate the 90th percentile of the aggregated data and when plotted against threshold,it should alert if its crossing the threshold. The percents parameter contai… --- ## [ES\_PATH\_CONF not considered in 6.2](https://discuss.elastic.co/t/es-path-conf-not-considered-in-6-2/125719)
**Author:** [@andreasmn](https://discuss.elastic.co/u/andreasmn)\ **Replies:** 2\ **Last updated:** [March 27, 2018, 5:00pm UTC](https://discuss.elastic.co/t/es-path-conf-not-considered-in-6-2/125719 "2018-03-27T17:00:27Z")
Hi, I'm just trying to upgrade from 5.6 to 6.2. I have a host with two elasticsearch instances running, which was working fine with 5.6. But since upgrading to 6.2 the environment variable for ES\_PATH\_CONF isn't worki… --- ## [Elasticsearch 6.2 Multiples types (parent-child) in the same index](https://discuss.elastic.co/t/elasticsearch-6-2-multiples-types-parent-child-in-the-same-index/124764)
**Author:** [@Rougui](https://discuss.elastic.co/u/Rougui)\ **Replies:** 1\ **Last updated:** [March 27, 2018, 4:44pm UTC](https://discuss.elastic.co/t/elasticsearch-6-2-multiples-types-parent-child-in-the-same-index/124764 "2018-03-27T16:44:15Z")
Hello, I use Elasticsearch 6.2.1. I have to create multiples types in the same index as (parent-child relationship). i read here https://www.elastic.co/guide/en/elasticsearch/reference/current/removal-of-types.html: t… --- ## [Kibana - Courier Fetch X of Y shards failed](https://discuss.elastic.co/t/kibana-courier-fetch-x-of-y-shards-failed/125788)
**Author:** [@jmkgreen](https://discuss.elastic.co/u/jmkgreen)\ **Replies:** 0\ **Last updated:** [March 27, 2018, 4:35pm UTC](https://discuss.elastic.co/t/kibana-courier-fetch-x-of-y-shards-failed/125788 "2018-03-27T16:35:42Z")
Apologies for the topic - I know this is a common fault I'm just trying to get my head around our own circumstance which I suspect is a misunderstanding someplace. About three months ago we switched indexing strategy fr… --- ## [Multiple BulkRequest using concurrency](https://discuss.elastic.co/t/multiple-bulkrequest-using-concurrency/125786)
**Author:** [@Pushpak\_Chavan](https://discuss.elastic.co/u/Pushpak_Chavan)\ **Replies:** 1\ **Last updated:** [March 27, 2018, 4:33pm UTC](https://discuss.elastic.co/t/multiple-bulkrequest-using-concurrency/125786 "2018-03-27T16:33:01Z")
Hi, I have more than 1 million documents in ArrayList. I need to push those documents using some concurrency mechanism. Currently, I am using BulkRequests. But it is not giving that much performance.Can somebody help on… --- ## [Can't visualize GeoIP locations on a coordinate map](https://discuss.elastic.co/t/cant-visualize-geoip-locations-on-a-coordinate-map/121934)
**Author:** [@timkoers](https://discuss.elastic.co/u/timkoers)\ **Replies:** 8\ **Last updated:** [March 27, 2018, 4:18pm UTC](https://discuss.elastic.co/t/cant-visualize-geoip-locations-on-a-coordinate-map/121934 "2018-03-27T16:18:01Z")
A few months ago I wanted to implement Bro-IDS with Kibana. Since I didn't know much about both, I followed this tutorial: https://medium.com/@utham/bro-elk-stack-integration-part-3-4fe02b5ff519 Everything worked, exce… --- ## [Java Update API and Nested field : MapperParsingException: object mapping for \[xxx\] tried to parse field \[xxx\] as object, but found a concrete value](https://discuss.elastic.co/t/java-update-api-and-nested-field-mapperparsingexception-object-mapping-for-xxx-tried-to-parse-field-xxx-as-object-but-found-a-concrete-value/125617)
**Author:** [@MarneusCalgarXP](https://discuss.elastic.co/u/MarneusCalgarXP)\ **Replies:** 1\ **Last updated:** [March 27, 2018, 3:48pm UTC](https://discuss.elastic.co/t/java-update-api-and-nested-field-mapperparsingexception-object-mapping-for-xxx-tried-to-parse-field-xxx-as-object-but-found-a-concrete-value/125617 "2018-03-27T15:48:30Z")
Hello, I'm using elasticsearch 5.2.2. I have a document with a nested field called "policies". Sample data: { "id": 1, "policies": \[ { "name": "A", "dates": \[ … --- ## [Single query to sort documents by geodistance based on another documents id](https://discuss.elastic.co/t/single-query-to-sort-documents-by-geodistance-based-on-another-documents-id/125780)
**Author:** [@ftaran](https://discuss.elastic.co/u/ftaran)\ **Replies:** 0\ **Last updated:** [March 27, 2018, 3:10pm UTC](https://discuss.elastic.co/t/single-query-to-sort-documents-by-geodistance-based-on-another-documents-id/125780 "2018-03-27T15:10:04Z")
I have an index in elasticsearch which contains a Id field and a geopoint. right now in order to get the nearest documents I have to make two queries, one to get the original document by its id and after that use its co… --- ## [How to configure Elasticsearch with single node?](https://discuss.elastic.co/t/how-to-configure-elasticsearch-with-single-node/125394)
**Author:** [@daved](https://discuss.elastic.co/u/daved)\ **Replies:** 9\ **Last updated:** [March 27, 2018, 2:35pm UTC](https://discuss.elastic.co/t/how-to-configure-elasticsearch-with-single-node/125394 "2018-03-27T14:35:06Z")
Hi, So I keep having a problem where once I start doing stuff on Kibana elasticsearch crashes and goes Red. That's my real issue but I am wondering how elasticsearch should be configured using a single node as I haven't… --- ## [Simple index using word delimiter resulting in startOffset error](https://discuss.elastic.co/t/simple-index-using-word-delimiter-resulting-in-startoffset-error/125774)
**Author:** [@devday](https://discuss.elastic.co/u/devday)\ **Replies:** 0\ **Last updated:** [March 27, 2018, 2:16pm UTC](https://discuss.elastic.co/t/simple-index-using-word-delimiter-resulting-in-startoffset-error/125774 "2018-03-27T14:16:22Z")
Hi All, I am trying to upgrade from Elastic 5 to Elastic 6. I have a very simple index which uses shingles, word\_delimiter and edge. My example is noted below, I am trying to index "Bat man is cool". I want to be abl… --- ## [Is this a bug?](https://discuss.elastic.co/t/is-this-a-bug/125658)
**Author:** [@arisbanach](https://discuss.elastic.co/u/arisbanach)\ **Replies:** 4\ **Last updated:** [March 27, 2018, 2:12pm UTC](https://discuss.elastic.co/t/is-this-a-bug/125658 "2018-03-27T14:12:13Z")
Not sure if this is a bug: I visited /\_cat/recovery?v&active\_only=true in my cluster and saw one row was misaligned, and found that the source\_node for one of my indices started with a whitespace character (e.g. \[whitesp… --- ## [Custom Analyzer deployment](https://discuss.elastic.co/t/custom-analyzer-deployment/125772)
**Author:** [@Tobsucht](https://discuss.elastic.co/u/Tobsucht)\ **Replies:** 0\ **Last updated:** [March 27, 2018, 2:05pm UTC](https://discuss.elastic.co/t/custom-analyzer-deployment/125772 "2018-03-27T14:05:34Z")
As my requirements for the analysis process is pretty unique, I have written multiple custom analyzers and registered them as a plugin in elasticsearch. This is working, but I don't really like the process of having to d… --- ## [Elasticsearch document count going down](https://discuss.elastic.co/t/elasticsearch-document-count-going-down/125750)
**Author:** [@hoangvnit](https://discuss.elastic.co/u/hoangvnit)\ **Replies:** 3\ **Last updated:** [March 27, 2018, 1:59pm UTC](https://discuss.elastic.co/t/elasticsearch-document-count-going-down/125750 "2018-03-27T13:59:53Z")
Hi Now i using elasticsearch 5.5 on AWS I have mapping with about 163000 document. and i don't delete any document, but after one day i have lost about 2000 document without reason, i don't know why. I checked Monit… --- ## [Compare Dates in Script Query](https://discuss.elastic.co/t/compare-dates-in-script-query/125761)
**Author:** [@TomTom](https://discuss.elastic.co/u/TomTom)\ **Replies:** 1\ **Last updated:** [March 27, 2018, 1:38pm UTC](https://discuss.elastic.co/t/compare-dates-in-script-query/125761 "2018-03-27T13:38:55Z")
I'm using Painless to create a filter, but when i use two dates this error happens: "script": "doc\['creation\_date'\].value \> doc\['update\_date'\].value", "lang": "painless", "caused\_by": { "type": "class\_cast\_exception… --- ## [Unbelievable performance improvement with new Index Sorting feature](https://discuss.elastic.co/t/unbelievable-performance-improvement-with-new-index-sorting-feature/125098)
**Author:** [@Kaspars\_Sprogis](https://discuss.elastic.co/u/Kaspars_Sprogis)\ **Replies:** 5\ **Last updated:** [March 27, 2018, 1:36pm UTC](https://discuss.elastic.co/t/unbelievable-performance-improvement-with-new-index-sorting-feature/125098 "2018-03-27T13:36:17Z")
Came here to say huge "thank you" for all the devs who helped delivering this great improvement - Index Sorting (6.x): https://www.elastic.co/guide/en/elasticsearch/reference/6.x/index-modules-index-sorting.html When I … --- ## [Close matches in Elastic](https://discuss.elastic.co/t/close-matches-in-elastic/125759)
**Author:** [@bert\_vervaele](https://discuss.elastic.co/u/bert_vervaele)\ **Replies:** 1\ **Last updated:** [March 27, 2018, 1:30pm UTC](https://discuss.elastic.co/t/close-matches-in-elastic/125759 "2018-03-27T13:30:17Z")
Hi all, I'm looking for a way to find close matches to a certain word. The purpose would be to give a suggestion when there is a typo. So like when you switched two letters or forgot one, ... Someone has any idea how… --- ## [Elasticsearch search does not return hits, Kibana does (5.x)](https://discuss.elastic.co/t/elasticsearch-search-does-not-return-hits-kibana-does-5-x/125631)
**Author:** [@mw\_jko](https://discuss.elastic.co/u/mw_jko)\ **Replies:** 1\ **Last updated:** [March 27, 2018, 12:54pm UTC](https://discuss.elastic.co/t/elasticsearch-search-does-not-return-hits-kibana-does-5-x/125631 "2018-03-27T12:54:18Z")
Hi, I've got ~1.5mio entries in elasticsearch I need to delete/remove, because they caused some grokparseerrors. Luckily they all have a tag (\_rubyexception and/or \_grokparsefailure) and I can do a nice kibana search t… --- ## [Filter on Aggregation Results](https://discuss.elastic.co/t/filter-on-aggregation-results/125752)
**Author:** [@abcxyz](https://discuss.elastic.co/u/abcxyz)\ **Replies:** 0\ **Last updated:** [March 27, 2018, 12:39pm UTC](https://discuss.elastic.co/t/filter-on-aggregation-results/125752 "2018-03-27T12:39:55Z")
Hello World, I am currently facing the following challenge: I want to : 1- Group data by center and sum over value1 (resulting in sum\_value1) 2- Given ALL OF the output of step1 and some min and max values, filter su… --- ## [Elasticsearch v5.6.0 working in local not on unix server](https://discuss.elastic.co/t/elasticsearch-v5-6-0-working-in-local-not-on-unix-server/125557)
**Author:** [@satyarajp](https://discuss.elastic.co/u/satyarajp)\ **Replies:** 10\ **Last updated:** [March 27, 2018, 11:34am UTC](https://discuss.elastic.co/t/elasticsearch-v5-6-0-working-in-local-not-on-unix-server/125557 "2018-03-27T11:34:06Z")
In class extending public class NodeIndexer extends ElasticSearchIndexer private Client init() { private Client client; try { client = new PreBuiltTransportClient(Settings.EMPTY) .addTransportAddress(new InetSocke… --- ## [Machine Learning Jobs](https://discuss.elastic.co/t/machine-learning-jobs/125705)
**Author:** [@Adren](https://discuss.elastic.co/u/Adren)\ **Replies:** 4\ **Last updated:** [March 27, 2018, 10:55am UTC](https://discuss.elastic.co/t/machine-learning-jobs/125705 "2018-03-27T10:55:43Z")
Hello, I wanted to test machine learning today, but I can't create jobs, I mean when I click on the button "Create Job" it's not creating job, it is like nothing is happening, are some other things are required that the … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1737) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1739)