# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1750 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1751 --- ## [Ingest Processor Plugin with Analyzer Support](https://discuss.elastic.co/t/ingest-processor-plugin-with-analyzer-support/123365)
**Author:** [@purefield](https://discuss.elastic.co/u/purefield)\ **Replies:** 4\ **Last updated:** [March 16, 2018, 9:16pm UTC](https://discuss.elastic.co/t/ingest-processor-plugin-with-analyzer-support/123365 "2018-03-16T21:16:41Z")
We are working on building an ingest processor plugin to support the use of analyzer for tokenization. This can be used to create word clouds from text. How does one access an Analyzer to perform this task of tokenizing… --- ## [Bulk ingest example for Elasticsearch](https://discuss.elastic.co/t/bulk-ingest-example-for-elasticsearch/123944)
**Author:** [@protzman](https://discuss.elastic.co/u/protzman)\ **Replies:** 2\ **Last updated:** [March 16, 2018, 8:51pm UTC](https://discuss.elastic.co/t/bulk-ingest-example-for-elasticsearch/123944 "2018-03-16T20:51:27Z")
Brand new here. I am working through the example for bulk ingest into elastic search found here and I cannot seem to get the commands to execute. I have the accounts.json file in the directory I am executing the curl com… --- ## [Ingest geoip processor dynamic mappings not as expected](https://discuss.elastic.co/t/ingest-geoip-processor-dynamic-mappings-not-as-expected/123903)
**Author:** [@David9](https://discuss.elastic.co/u/David9)\ **Replies:** 2\ **Last updated:** [March 16, 2018, 7:44pm UTC](https://discuss.elastic.co/t/ingest-geoip-processor-dynamic-mappings-not-as-expected/123903 "2018-03-16T19:44:52Z")
I've configured the ingest geoip processor but when it creates its various fields, e.g. lat and lon, they are floats. there is no field of type 'geoip' created with the dynamic mapping. this is unexpected as i figured… --- ## [How to run Curator on different clusters?](https://discuss.elastic.co/t/how-to-run-curator-on-different-clusters/124154)
**Author:** [@zachy](https://discuss.elastic.co/u/zachy)\ **Replies:** 1\ **Last updated:** [March 16, 2018, 8:45pm UTC](https://discuss.elastic.co/t/how-to-run-curator-on-different-clusters/124154 "2018-03-16T20:45:20Z")
Say I want to delete my indices in cluster A every 2 hours, while I want to delete the indices in cluster B every 4 hours. How would I do this without 'hardcoding' the IP address of the node in the curator config.yaml f… --- ## [Need an example of BulkProcessor with the 5.6 version of high-level client](https://discuss.elastic.co/t/need-an-example-of-bulkprocessor-with-the-5-6-version-of-high-level-client/123763)
**Author:** [@juanaramis](https://discuss.elastic.co/u/juanaramis)\ **Replies:** 2\ **Last updated:** [March 16, 2018, 8:14pm UTC](https://discuss.elastic.co/t/need-an-example-of-bulkprocessor-with-the-5-6-version-of-high-level-client/123763 "2018-03-16T20:14:57Z")
Hi guys, Need an example of BulkProcessor with the 5.6 version of high-level REST client. It looks like it has a BUG when calling: BulkProcessor bulkProcessor = BulkProcessor.builder(rHLClient::bulkAsync, listener,thr… --- ## [Inconsistent index ordering scores between replicas](https://discuss.elastic.co/t/inconsistent-index-ordering-scores-between-replicas/124339)
**Author:** [@mike3](https://discuss.elastic.co/u/mike3)\ **Replies:** 0\ **Last updated:** [March 16, 2018, 5:43pm UTC](https://discuss.elastic.co/t/inconsistent-index-ordering-scores-between-replicas/124339 "2018-03-16T17:43:07Z")
Hello, I am trying to implement efficient paging through all results of a search query using search\_after with \_doc index ordering on a 12-node cluster with 1 shard that has 11 replicas (elasticsearch 5.6). I'm running… --- ## [Watcher index action - how to get all the hits data to index ](https://discuss.elastic.co/t/watcher-index-action-how-to-get-all-the-hits-data-to-index/123174)
**Author:** [@pulgrims](https://discuss.elastic.co/u/pulgrims)\ **Replies:** 4\ **Last updated:** [March 16, 2018, 6:27pm UTC](https://discuss.elastic.co/t/watcher-index-action-how-to-get-all-the-hits-data-to-index/123174 "2018-03-16T18:27:34Z")
Hi, i'm trying to make a watcher which has a condition that input data meet when its count is larger than or equal to 100. and i would like to index result data using Index Action. but i know that count of result data(… --- ## [How can I get response time for each index or shard](https://discuss.elastic.co/t/how-can-i-get-response-time-for-each-index-or-shard/124345)
**Author:** [@yiliang](https://discuss.elastic.co/u/yiliang)\ **Replies:** 0\ **Last updated:** [March 16, 2018, 6:01pm UTC](https://discuss.elastic.co/t/how-can-i-get-response-time-for-each-index-or-shard/124345 "2018-03-16T18:01:31Z")
Dear ES community members: I am now trying to monitor some query performance on ES. After I run the query I can only get the total time took for this response. Is there a way or api, i can use to get the response time f… --- ## [Spark-ES saveToES without type](https://discuss.elastic.co/t/spark-es-savetoes-without-type/123622)
**Author:** [@skylerl](https://discuss.elastic.co/u/skylerl)\ **Replies:** 1\ **Last updated:** [March 16, 2018, 4:35pm UTC](https://discuss.elastic.co/t/spark-es-savetoes-without-type/123622 "2018-03-16T16:35:51Z")
Hi everyone, We're trying to ingest a DataFrame to Elasticsearch using the Elasticsearch Spark library. In Elasticsearch 6.x, types are now gone. So, to make our data ingestion more compliant, we've been trying to inges… --- ## [Confusions around ELK6 types](https://discuss.elastic.co/t/confusions-around-elk6-types/124008)
**Author:** [@Krzysztof\_Szarlej](https://discuss.elastic.co/u/Krzysztof_Szarlej)\ **Replies:** 4\ **Last updated:** [March 16, 2018, 4:13pm UTC](https://discuss.elastic.co/t/confusions-around-elk6-types/124008 "2018-03-16T16:13:24Z")
Hi guys, I am totally confused about document types in new ELK. I am now migrating from v5 to v6. When reading the Elasticsearch guide on getting rid of types (https://www.elastic.co/guide/en/elasticsearch/reference/ma… --- ## [Defining a mapping for Join (ES 6.2.2) - CURL](https://discuss.elastic.co/t/defining-a-mapping-for-join-es-6-2-2-curl/124315)
**Author:** [@TomTom](https://discuss.elastic.co/u/TomTom)\ **Replies:** 4\ **Last updated:** [March 16, 2018, 4:05pm UTC](https://discuss.elastic.co/t/defining-a-mapping-for-join-es-6-2-2-curl/124315 "2018-03-16T16:05:40Z")
What is the best mapping for a join between two documents? Actually, i'm creating a data warehouse to stock my postgres data: table: customer column | type --------------------------- id\_customer | integer name … --- ## [Using Kafka in ES Cluster](https://discuss.elastic.co/t/using-kafka-in-es-cluster/123709)
**Author:** [@Ben96](https://discuss.elastic.co/u/Ben96)\ **Replies:** 1\ **Last updated:** [March 16, 2018, 4:04pm UTC](https://discuss.elastic.co/t/using-kafka-in-es-cluster/123709 "2018-03-16T16:04:51Z")
Hi everyone, Ben again We are currently investigating to implement Kafka ( In cluster mode ) to perform with our existing Elastic Stack cluster. I'm here to know about some configuration, if some of you are currently u… --- ## [X-pack installation dependency](https://discuss.elastic.co/t/x-pack-installation-dependency/124313)
**Author:** [@kawo123](https://discuss.elastic.co/u/kawo123)\ **Replies:** 5\ **Last updated:** [March 16, 2018, 3:58pm UTC](https://discuss.elastic.co/t/x-pack-installation-dependency/124313 "2018-03-16T15:58:11Z")
When installing x-pack to any component of the elastic stack (elasticsearch, logstash, kibana, filebeat), is there any requirement that x-pack must be installed on all other components? For example, if I install x-pack o… --- ## [Windows services up/down alerting using watcher](https://discuss.elastic.co/t/windows-services-up-down-alerting-using-watcher/123492)
**Author:** [@dilip](https://discuss.elastic.co/u/dilip)\ **Replies:** 1\ **Last updated:** [March 16, 2018, 3:56pm UTC](https://discuss.elastic.co/t/windows-services-up-down-alerting-using-watcher/123492 "2018-03-16T15:56:26Z")
Hi, can we create Metricbeat collected windows services up/down Alerting using watcher by per Host wise. ex:-if Host A services abc is down it should alert that this services is down. like for memory utilisation. "in… --- ## [Rejecting mapping update to \[\] as the final mapping would have more than 1 type](https://discuss.elastic.co/t/rejecting-mapping-update-to-as-the-final-mapping-would-have-more-than-1-type/124316)
**Author:** [@tanisdlj](https://discuss.elastic.co/u/tanisdlj)\ **Replies:** 4\ **Last updated:** [March 16, 2018, 3:14pm UTC](https://discuss.elastic.co/t/rejecting-mapping-update-to-as-the-final-mapping-would-have-more-than-1-type/124316 "2018-03-16T15:14:13Z")
Hi! I've just upgraded to ES6 and my ES logs started to throw this error: \[2018-03-16T15:31:05,759\]\[DEBUG\]\[o.e.a.b.TransportShardBulkAction\] \[logstash-2018.03.16\]\[3\] failed to execute bulk item (index) BulkShardRequest … --- ## [ES search template fails to parse date](https://discuss.elastic.co/t/es-search-template-fails-to-parse-date/124266)
**Author:** [@branislav](https://discuss.elastic.co/u/branislav)\ **Replies:** 1\ **Last updated:** [March 16, 2018, 3:00pm UTC](https://discuss.elastic.co/t/es-search-template-fails-to-parse-date/124266 "2018-03-16T15:00:07Z")
Hello, i have encountered this issue with elasticsearch. When i try to search from c# with NEST and add a scripted field which needs to parse the date var indexResponse = client.Search\(s =\> s.Query(q =\> q.Raw(i… --- ## [Defining a mapping for join datatype - Java API](https://discuss.elastic.co/t/defining-a-mapping-for-join-datatype-java-api/124304)
**Author:** [@kchrusciel](https://discuss.elastic.co/u/kchrusciel)\ **Replies:** 5\ **Last updated:** [March 16, 2018, 2:59pm UTC](https://discuss.elastic.co/t/defining-a-mapping-for-join-datatype-java-api/124304 "2018-03-16T14:59:13Z")
Hi, I migration from old ES version to newest 6.2.2. Right now I want to migrate from \_parent to join using Java API: XContentBuilder documentMapping = jsonBuilder() .startObject() … --- ## [Elasticsearch 6.2.2 Docker containers isn't setting correct storage size](https://discuss.elastic.co/t/elasticsearch-6-2-2-docker-containers-isnt-setting-correct-storage-size/123940)
**Author:** [@whiranpat](https://discuss.elastic.co/u/whiranpat)\ **Replies:** 3\ **Last updated:** [March 16, 2018, 2:30pm UTC](https://discuss.elastic.co/t/elasticsearch-6-2-2-docker-containers-isnt-setting-correct-storage-size/123940 "2018-03-16T14:30:53Z")
Method of setting up the volume for elasticsearch for docker containers seems to change between version. We have a 128GB drive dedicated to the docker volume directory. We want to create presistant storage to the contain… --- ## [What is the Machine learning algorithm in Elastic?](https://discuss.elastic.co/t/what-is-the-machine-learning-algorithm-in-elastic/123527)
**Author:** [@NOUR](https://discuss.elastic.co/u/NOUR)\ **Replies:** 6\ **Last updated:** [March 16, 2018, 2:04pm UTC](https://discuss.elastic.co/t/what-is-the-machine-learning-algorithm-in-elastic/123527 "2018-03-16T14:04:16Z")
Hello world, I'm using kibana 6.2.2 and elastic 6.2.2 for my final academic project. I prepared some analyses using ml plugin under x-pack like this \[1\] But i still confused about the algorithm using in background. … --- ## [Unknown host exception while using Java APIs to index documents (RestHighLevelClient)](https://discuss.elastic.co/t/unknown-host-exception-while-using-java-apis-to-index-documents-resthighlevelclient/124261)
**Author:** [@RishuK](https://discuss.elastic.co/u/RishuK)\ **Replies:** 1\ **Last updated:** [March 16, 2018, 1:50pm UTC](https://discuss.elastic.co/t/unknown-host-exception-while-using-java-apis-to-index-documents-resthighlevelclient/124261 "2018-03-16T13:50:11Z")
I am using the vpc endpoint for elastic search to index my documents using RestHighLevelClient. I am using java high level rest client v6.2.2 to connect Elasticsearch version 6.0 I am able to access my cluster endpoint… --- ## [Status: Red on ES Cluster](https://discuss.elastic.co/t/status-red-on-es-cluster/123707)
**Author:** [@minidan](https://discuss.elastic.co/u/minidan)\ **Replies:** 7\ **Last updated:** [March 16, 2018, 1:42pm UTC](https://discuss.elastic.co/t/status-red-on-es-cluster/123707 "2018-03-16T13:42:50Z")
Hi, Maybe simple question but how do I tailor the commands to troubleshoot an linux elasticsearch cluster in RED on the command line? Nothing I type with localhost:9200 seems to work... --- ## [Elasticsearch/Kibana query\_string with special characters](https://discuss.elastic.co/t/elasticsearch-kibana-query-string-with-special-characters/123766)
**Author:** [@Rougui](https://discuss.elastic.co/u/Rougui)\ **Replies:** 13\ **Last updated:** [March 16, 2018, 1:27pm UTC](https://discuss.elastic.co/t/elasticsearch-kibana-query-string-with-special-characters/123766 "2018-03-16T13:27:37Z")
Hello, i configured Elasticsearch cloud VM machine, i created index, simples types and mapping. By using Kibana Dev-Tools console: I am able to build index data by using POST and PUT requests. Now i have to search te… --- ## [Elasticsearch wont start with X-Pack plug-in on Windows](https://discuss.elastic.co/t/elasticsearch-wont-start-with-x-pack-plug-in-on-windows/124256)
**Author:** [@HarryCrosby](https://discuss.elastic.co/u/HarryCrosby)\ **Replies:** 5\ **Last updated:** [March 16, 2018, 1:24pm UTC](https://discuss.elastic.co/t/elasticsearch-wont-start-with-x-pack-plug-in-on-windows/124256 "2018-03-16T13:24:53Z")
Hi, I'm tyring to configure X-Pack in Elasticsearch 6.2.2 on Windows x86 64 bit and I'm following these instructions: https://www.elastic.co/guide/en/elasticsearch/reference/6.2/installing-xpack-es.html At step 6, wh… --- ## [Rank search query results based on master list ranking](https://discuss.elastic.co/t/rank-search-query-results-based-on-master-list-ranking/124300)
**Author:** [@Rougui](https://discuss.elastic.co/u/Rougui)\ **Replies:** 0\ **Last updated:** [March 16, 2018, 1:23pm UTC](https://discuss.elastic.co/t/rank-search-query-results-based-on-master-list-ranking/124300 "2018-03-16T13:23:17Z")
Hi, I am a beginner with ElasticSearch. I am developing mobile application with Elasticsearch as this scheme: FrontEnd BackEnd Mobile application \<---\> Firebase clo… --- ## [SOLVED - Installation for ES : Java Error](https://discuss.elastic.co/t/solved-installation-for-es-java-error/124269)
**Author:** [@StephanePapin](https://discuss.elastic.co/u/StephanePapin)\ **Replies:** 2\ **Last updated:** [March 16, 2018, 1:12pm UTC](https://discuss.elastic.co/t/solved-installation-for-es-java-error/124269 "2018-03-16T13:12:37Z")
Hi, I've got an error when trying installa X-pack 6.1.2 for ES (zip file x-pack donwload in temp dir) : Elasticsearch keystore is required by plugin \[x-pack\], creating... Exception in thread "main" java.lang.RuntimeE… --- ## [Elasticsearch 6.2 start but keep throwing an error message](https://discuss.elastic.co/t/elasticsearch-6-2-start-but-keep-throwing-an-error-message/119033)
**Author:** [@branislav](https://discuss.elastic.co/u/branislav)\ **Replies:** 4\ **Last updated:** [March 16, 2018, 11:02am UTC](https://discuss.elastic.co/t/elasticsearch-6-2-start-but-keep-throwing-an-error-message/119033 "2018-03-16T11:02:37Z")
Hello, maybe someone encounter this error Feb 08 11:23:20 elasticshsearch04 elasticsearch\[1263\]: at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:291) Feb 08 11:23:20 elasticshsearch04 elasticsearch\[1263\]: … --- ## [Unable to perform group on one field and sort on another field in Terms aggregation](https://discuss.elastic.co/t/unable-to-perform-group-on-one-field-and-sort-on-another-field-in-terms-aggregation/123212)
**Author:** [@shobhit121](https://discuss.elastic.co/u/shobhit121)\ **Replies:** 1\ **Last updated:** [March 16, 2018, 10:41am UTC](https://discuss.elastic.co/t/unable-to-perform-group-on-one-field-and-sort-on-another-field-in-terms-aggregation/123212 "2018-03-16T10:41:03Z")
We want to perform group on src\_id and sort on field alias1.Is there any possibility to perform this action. Please find query below. "aggs": { "grp\_by\_src": { "terms": { "field": "src\_id", "o… --- ## [Consequences of a Large Index Size](https://discuss.elastic.co/t/consequences-of-a-large-index-size/124257)
**Author:** [@Ong](https://discuss.elastic.co/u/Ong)\ **Replies:** 0\ **Last updated:** [March 16, 2018, 10:04am UTC](https://discuss.elastic.co/t/consequences-of-a-large-index-size/124257 "2018-03-16T10:04:48Z")
I have an index which is 2.5 times larger than the raw data size. The estimated index size is around 6TB for 40 million text documents. A key reason for this is the use of shingles. I have a few concerns about having a … --- ## [Partial update with excluded fields](https://discuss.elastic.co/t/partial-update-with-excluded-fields/124252)
**Author:** [@walfen](https://discuss.elastic.co/u/walfen)\ **Replies:** 0\ **Last updated:** [March 16, 2018, 9:54am UTC](https://discuss.elastic.co/t/partial-update-with-excluded-fields/124252 "2018-03-16T09:54:03Z")
I'm trying to execute partial updates in an index with a excluded field. Below you can see the mapping of the index: "mappings": { "doc": { "\_source": { "excludes": \[ "content" \] }, … --- ## [Index Storage Size for a Cluster](https://discuss.elastic.co/t/index-storage-size-for-a-cluster/124246)
**Author:** [@Ong](https://discuss.elastic.co/u/Ong)\ **Replies:** 3\ **Last updated:** [March 16, 2018, 9:52am UTC](https://discuss.elastic.co/t/index-storage-size-for-a-cluster/124246 "2018-03-16T09:52:48Z")
I have a cluster of 3 nodes with 3 primary shards and 2 replica sets. If Node 1 goes down, will the cluster attempt to create whatever shards existed on Node 1 on the remaining nodes? I am sizing for the index storage r… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1749) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1751)