# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1886 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1887 --- ## [How to balance shards based on disk space utilization](https://discuss.elastic.co/t/how-to-balance-shards-based-on-disk-space-utilization/108052)
**Author:** [@mario12](https://discuss.elastic.co/u/mario12)\ **Replies:** 1\ **Last updated:** [November 17, 2017, 3:45am UTC](https://discuss.elastic.co/t/how-to-balance-shards-based-on-disk-space-utilization/108052 "2017-11-17T03:45:29Z")
in our current 2.4 es cluster all nodes has equal no. of shards. But, there are nodes which has very less disk space utilization (25% of nodes). Rest of the nodes (75%) has high disk utilization. Is there a settings tha… --- ## [Spark Structured Streaming - sink in append mode](https://discuss.elastic.co/t/spark-structured-streaming-sink-in-append-mode/105664)
**Author:** [@hcloli](https://discuss.elastic.co/u/hcloli)\ **Replies:** 4\ **Last updated:** [November 17, 2017, 3:13am UTC](https://discuss.elastic.co/t/spark-structured-streaming-sink-in-append-mode/105664 "2017-11-17T03:13:17Z")
Hi James, Great job regarding support for Spark 2.2.0 structured streaming!! I tried it and it works well. However, I wonder why you limited the sink to work only in APPEND mode. If user provides es.mapping.id column, … --- ## [Trying to setup elasticsearch cluster with docker-compose](https://discuss.elastic.co/t/trying-to-setup-elasticsearch-cluster-with-docker-compose/106803)
**Author:** [@hanase](https://discuss.elastic.co/u/hanase)\ **Replies:** 9\ **Last updated:** [November 17, 2017, 2:32am UTC](https://discuss.elastic.co/t/trying-to-setup-elasticsearch-cluster-with-docker-compose/106803 "2017-11-17T02:32:05Z")
Hi, My environment is two physical machine, both running in docker-compose. I want to create elasticsearch cluster cross two docker container. here's my configure: ES1: IP: 10.251.34.60 docker-compose.yml: version… --- ## [Elasticsearch/Kibana Windows Server 2012](https://discuss.elastic.co/t/elasticsearch-kibana-windows-server-2012/108003)
**Author:** [@Ali\_Daoudi](https://discuss.elastic.co/u/Ali_Daoudi)\ **Replies:** 1\ **Last updated:** [November 16, 2017, 10:04pm UTC](https://discuss.elastic.co/t/elasticsearch-kibana-windows-server-2012/108003 "2017-11-16T22:04:30Z")
Hi, tomorrow i'll have to install elasticsearch and kibana on a VM with Windows Server 2012. I've looked up a bit but can't seem to find if there are versions of Elasticsearch/Kibana that aren't compatible for ES and Ki… --- ## [Parent child RelationShip with ES 5.X](https://discuss.elastic.co/t/parent-child-relationship-with-es-5-x/107668)
**Author:** [@Narmatha](https://discuss.elastic.co/u/Narmatha)\ **Replies:** 1\ **Last updated:** [November 16, 2017, 9:38pm UTC](https://discuss.elastic.co/t/parent-child-relationship-with-es-5-x/107668 "2017-11-16T21:38:59Z")
I am changing the nested object model to parent child model. Since type is going to get removed from elasticsearch 6.x onwards. Do we have parent-child relationship still ? Then how to achieve this ? --- ## [How to get the full list of analyzed lemmas of a field](https://discuss.elastic.co/t/how-to-get-the-full-list-of-analyzed-lemmas-of-a-field/107971)
**Author:** [@Kelis](https://discuss.elastic.co/u/Kelis)\ **Replies:** 0\ **Last updated:** [November 16, 2017, 3:21pm UTC](https://discuss.elastic.co/t/how-to-get-the-full-list-of-analyzed-lemmas-of-a-field/107971 "2017-11-16T15:21:46Z")
Hi, I would like to retrieve a set of all the stored lemmas in all the indexed documents in a specific analyzed field in order to work on linguistic algorithms. I could retrieve the specific field, document by document… --- ## [Rollover by month](https://discuss.elastic.co/t/rollover-by-month/107977)
**Author:** [@acchaulk](https://discuss.elastic.co/u/acchaulk)\ **Replies:** 10\ **Last updated:** [November 16, 2017, 7:01pm UTC](https://discuss.elastic.co/t/rollover-by-month/107977 "2017-11-16T19:01:01Z")
Hello, I am trying to use the rollover api to help create indexes by month. However, the rollover api does not seem to support months as a max\_age unit: Failed to parse setting \[max\_age\] with value \[1M\] as a time value:… --- ## [Failed to parse value \[no\]](https://discuss.elastic.co/t/failed-to-parse-value-no/107982)
**Author:** [@Badger](https://discuss.elastic.co/u/Badger)\ **Replies:** 4\ **Last updated:** [November 16, 2017, 6:33pm UTC](https://discuss.elastic.co/t/failed-to-parse-value-no/107982 "2017-11-16T18:33:21Z")
I am getting this error after my upgrade to 6.0 GA \[2017-11-16T11:16:50,464\]\[DEBUG\]\[o.e.a.b.TransportShardBulkAction\] \[logs.web-2017.11.01\]\[0\] failed to execute bulk item (index) BulkShardRequest \[\[logs.web-2017.11.01\]\[… --- ## [Missing results from search](https://discuss.elastic.co/t/missing-results-from-search/107521)
**Author:** [@Aurelien\_3](https://discuss.elastic.co/u/Aurelien_3)\ **Replies:** 6\ **Last updated:** [November 16, 2017, 5:12pm UTC](https://discuss.elastic.co/t/missing-results-from-search/107521 "2017-11-16T17:12:16Z")
Hello all, As I've scaled my cluster and the size of my data, I'm very much wondering how ES handles the search ! I'm still stuck on ES 1.7.2 (difficult to handle migration to a more recent version), on 6 servers with … --- ## [Splitting/tokenizing a Query based on content in an Index (for autosuggest/typeahead/query disambiguation)](https://discuss.elastic.co/t/splitting-tokenizing-a-query-based-on-content-in-an-index-for-autosuggest-typeahead-query-disambiguation/107984)
**Author:** [@Ramdev\_Wudali](https://discuss.elastic.co/u/Ramdev_Wudali)\ **Replies:** 0\ **Last updated:** [November 16, 2017, 4:44pm UTC](https://discuss.elastic.co/t/splitting-tokenizing-a-query-based-on-content-in-an-index-for-autosuggest-typeahead-query-disambiguation/107984 "2017-11-16T16:44:40Z")
Hi All: I have this problem I am trying to solve : Split a text query into multiple segments based on matches in an index. I have an index which has content that is used for typeahead autosuggestions. This index cons… --- ## [Search based suggester example](https://discuss.elastic.co/t/search-based-suggester-example/107983)
**Author:** [@Charlie\_Hull](https://discuss.elastic.co/u/Charlie_Hull)\ **Replies:** 0\ **Last updated:** [November 16, 2017, 4:44pm UTC](https://discuss.elastic.co/t/search-based-suggester-example/107983 "2017-11-16T16:44:12Z")
Here's an example of how to implement a search suggester with Elasticsearch, hope you find it useful. http://www.flax.co.uk/blog/2017/11/16/search-based-suggester-elasticsearch-security-filters/ --- ## [Migrating the Kibana index](https://discuss.elastic.co/t/migrating-the-kibana-index/107749)
**Author:** [@Maekee](https://discuss.elastic.co/u/Maekee)\ **Replies:** 4\ **Last updated:** [November 16, 2017, 3:14pm UTC](https://discuss.elastic.co/t/migrating-the-kibana-index/107749 "2017-11-16T15:14:49Z")
Hello, Am upgrading my ELK-stack to 6.0e but get stuck on migrating the .kibana index to the .kibana-6 described here: https://www.elastic.co/guide/en/kibana/6.0/migrating-6.0-index.html My Q is.. how do run create th… --- ## [Search query for document with nested objects](https://discuss.elastic.co/t/search-query-for-document-with-nested-objects/107954)
**Author:** [@glkhv-vldmr](https://discuss.elastic.co/u/glkhv-vldmr)\ **Replies:** 0\ **Last updated:** [November 16, 2017, 2:29pm UTC](https://discuss.elastic.co/t/search-query-for-document-with-nested-objects/107954 "2017-11-16T14:29:49Z")
Hi! Help please form an index structure and / or write a search query i have about such mapping { "doc": { "mappings": { "base": { "properties": { ..., … --- ## [Elasticsearch Curator - deleting indices by priorities (with python api)](https://discuss.elastic.co/t/elasticsearch-curator-deleting-indices-by-priorities-with-python-api/107895)
**Author:** [@anyat](https://discuss.elastic.co/u/anyat)\ **Replies:** 1\ **Last updated:** [November 16, 2017, 2:06pm UTC](https://discuss.elastic.co/t/elasticsearch-curator-deleting-indices-by-priorities-with-python-api/107895 "2017-11-16T14:06:32Z")
Hi! I have the following scenario that I want to handle with curator python api: I want to delete indices when my cluster storage reaches a fixed water mark (for example - 1TB). But, I want to delete indices by a cert… --- ## [Deleting index with curator not freeing the disk space](https://discuss.elastic.co/t/deleting-index-with-curator-not-freeing-the-disk-space/107909)
**Author:** [@carlosR](https://discuss.elastic.co/u/carlosR)\ **Replies:** 1\ **Last updated:** [November 16, 2017, 2:05pm UTC](https://discuss.elastic.co/t/deleting-index-with-curator-not-freeing-the-disk-space/107909 "2017-11-16T14:05:05Z")
Hello I have a job that deletes elastic indices per hour using the curator. It has been working fine, old shards and index are gone but when I check the amount of free space I have... it is less and less. Is there anyth… --- ## [Bad charset encoding in field names](https://discuss.elastic.co/t/bad-charset-encoding-in-field-names/107947)
**Author:** [@Ondrej\_Bilka](https://discuss.elastic.co/u/Ondrej_Bilka)\ **Replies:** 0\ **Last updated:** [November 16, 2017, 1:33pm UTC](https://discuss.elastic.co/t/bad-charset-encoding-in-field-names/107947 "2017-11-16T13:33:38Z")
I have an issue with Elasticsearch after upgrade to 5.6. I am generating documents using logstash and dynamic fields using native Ruby extension in logstash: filter { if \[attributes\] =~ /\[^\\s\\\\\]+/ { kv { source =\> … --- ## [Elasticsearch API vs CURL calls](https://discuss.elastic.co/t/elasticsearch-api-vs-curl-calls/107911)
**Author:** [@Marek\_Steplewksi](https://discuss.elastic.co/u/Marek_Steplewksi)\ **Replies:** 3\ **Last updated:** [November 16, 2017, 1:09pm UTC](https://discuss.elastic.co/t/elasticsearch-api-vs-curl-calls/107911 "2017-11-16T13:09:57Z")
Hi first post so excuse my lack of knowledge, I currently have a php script pushing data to elasticsearch via a curl call, and was thinking about changing this to use the API and have 2 questions :slight\_smile: Is th… --- ## [Closed topic!](https://discuss.elastic.co/t/closed-topic/107933)
**Author:** [@Jackie\_Wong](https://discuss.elastic.co/u/Jackie_Wong)\ **Replies:** 0\ **Last updated:** [November 16, 2017, 12:15pm UTC](https://discuss.elastic.co/t/closed-topic/107933 "2017-11-16T12:15:49Z")
seems like this is not the problem of es so I am closing this topic.. --- ## [Bulk is too slow](https://discuss.elastic.co/t/bulk-is-too-slow/107351)
**Author:** [@f4ct0r](https://discuss.elastic.co/u/f4ct0r)\ **Replies:** 33\ **Last updated:** [November 16, 2017, 11:33am UTC](https://discuss.elastic.co/t/bulk-is-too-slow/107351 "2017-11-16T11:33:35Z")
Hi, all: I wanna use ElasticSearch to store and search web logs in realtime, and I use Python API to bulk insert into ElasticSearch. I'm trying to bulk insert batches of 1000 documents into elastic search using a prede… --- ## [Not able to send email alert from elastic cloud](https://discuss.elastic.co/t/not-able-to-send-email-alert-from-elastic-cloud/107514)
**Author:** [@Rahulkumar](https://discuss.elastic.co/u/Rahulkumar)\ **Replies:** 13\ **Last updated:** [November 16, 2017, 10:36am UTC](https://discuss.elastic.co/t/not-able-to-send-email-alert-from-elastic-cloud/107514 "2017-11-16T10:36:41Z")
I am using below console command to send email to my official mail id. I am using simple command : if any any port is down, it should send e-mail. PUT \_xpack/watcher/watch/heartbeat { "trigger": { "schedule": { … --- ## [Can I do query to retrieve some doc in ingest processor](https://discuss.elastic.co/t/can-i-do-query-to-retrieve-some-doc-in-ingest-processor/107878)
**Author:** [@itplayer](https://discuss.elastic.co/u/itplayer)\ **Replies:** 6\ **Last updated:** [November 16, 2017, 10:18am UTC](https://discuss.elastic.co/t/can-i-do-query-to-retrieve-some-doc-in-ingest-processor/107878 "2017-11-16T10:18:20Z")
Hi Does anyone have experience that writes your own ingest processor? Is this possible to make a ingest processor that can query ES to retrieve a doc and that fill to the ingest doc before actual index? By directly us… --- ## [Node is not joining the cluster (ES-5.6.3)](https://discuss.elastic.co/t/node-is-not-joining-the-cluster-es-5-6-3/107641)
**Author:** [@dzyubanv](https://discuss.elastic.co/u/dzyubanv)\ **Replies:** 6\ **Last updated:** [November 16, 2017, 10:06am UTC](https://discuss.elastic.co/t/node-is-not-joining-the-cluster-es-5-6-3/107641 "2017-11-16T10:06:36Z")
I"m running two nodes cluster on two separate RHEL servers. Here are the configurations. server ip \*\*\*1 elasticsearch.yml cluster. name: es1 node.name: es1-node1 node.master: true node.data: true network.host: \*\*\*… --- ## [Delete everything](https://discuss.elastic.co/t/delete-everything/107861)
**Author:** [@wkpv68](https://discuss.elastic.co/u/wkpv68)\ **Replies:** 7\ **Last updated:** [November 16, 2017, 9:58am UTC](https://discuss.elastic.co/t/delete-everything/107861 "2017-11-16T09:58:38Z")
Hi, I want to upgrade to 6.0 from 5.6.4 and I want to start from clean environment (delete all). How can I delete everything? Does curl -XDELETE localhost:9200/\* command will do it? Thanks --- ## [Xpack prerequisites](https://discuss.elastic.co/t/xpack-prerequisites/107784)
**Author:** [@cedric1](https://discuss.elastic.co/u/cedric1)\ **Replies:** 2\ **Last updated:** [November 16, 2017, 9:45am UTC](https://discuss.elastic.co/t/xpack-prerequisites/107784 "2017-11-16T09:45:50Z")
Hi, I would like to know what are the minimum prerequisites to install Xpack, Number of ES nodes, cpu, RAM, etc.. Is there any table that shows what we should need for a minimum production installation depending on t… --- ## [Duplicate documents with exactly same index/type/id in ES5.4.2](https://discuss.elastic.co/t/duplicate-documents-with-exactly-same-index-type-id-in-es5-4-2/107683)
**Author:** [@zhangke](https://discuss.elastic.co/u/zhangke)\ **Replies:** 2\ **Last updated:** [November 16, 2017, 9:31am UTC](https://discuss.elastic.co/t/duplicate-documents-with-exactly-same-index-type-id-in-es5-4-2/107683 "2017-11-16T09:31:53Z")
My ES cluster has only one node. The "model" index has 5 primary shards and 1 replica shard. After indexing several documents, I run the below query: GET https://9.111.255.174:9200/model/cubes/\_search The response … --- ## [Handling Null Values](https://discuss.elastic.co/t/handling-null-values/107867)
**Author:** [@sidra\_89](https://discuss.elastic.co/u/sidra_89)\ **Replies:** 6\ **Last updated:** [November 16, 2017, 8:58am UTC](https://discuss.elastic.co/t/handling-null-values/107867 "2017-11-16T08:58:15Z")
Hi .. i want to search where the field value is either equal to null or have some value like suppose if the field name is brand\_name then i want to get record where brand\_name is either equal to null (null means no val… --- ## [Alerting Use Cases](https://discuss.elastic.co/t/alerting-use-cases/107868)
**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\ **Replies:** 1\ **Last updated:** [November 16, 2017, 8:49am UTC](https://discuss.elastic.co/t/alerting-use-cases/107868 "2017-11-16T08:49:50Z")
Can you please list down the alerting (X-Pack Watcher) Use cases. --- ## [Sending SMS alert to mobile devices](https://discuss.elastic.co/t/sending-sms-alert-to-mobile-devices/107829)
**Author:** [@krishna\_chaitanya](https://discuss.elastic.co/u/krishna_chaitanya)\ **Replies:** 1\ **Last updated:** [November 16, 2017, 8:48am UTC](https://discuss.elastic.co/t/sending-sms-alert-to-mobile-devices/107829 "2017-11-16T08:48:08Z")
Hi, Using x-pack actions, we have configured email alerts. What we also need, is to send alerts as an SMS. Is it possible to send alerts as an SMS to mobile devices ? If so, which xpack action should be used and how? … --- ## [Elastic sizing](https://discuss.elastic.co/t/elastic-sizing/107339)
**Author:** [@sesaravanan](https://discuss.elastic.co/u/sesaravanan)\ **Replies:** 7\ **Last updated:** [November 16, 2017, 8:27am UTC](https://discuss.elastic.co/t/elastic-sizing/107339 "2017-11-16T08:27:04Z")
Hi, Architecture 1: I had designed an elastic architecture for 1GB daily incoming data with 365 days retention period. 3 - Master nodes with 8 CPU and 32GB RAM with 50 GB disk space per node. 8 - Data nodes with 8 C… --- ## [Define a date variable with an initial value in scripted field](https://discuss.elastic.co/t/define-a-date-variable-with-an-initial-value-in-scripted-field/107771)
**Author:** [@Anabella\_Cristaldi](https://discuss.elastic.co/u/Anabella_Cristaldi)\ **Replies:** 5\ **Last updated:** [November 16, 2017, 7:45am UTC](https://discuss.elastic.co/t/define-a-date-variable-with-an-initial-value-in-scripted-field/107771 "2017-11-16T07:45:27Z")
Hi, I'm working with an scripted field that computes a difference between two dates "total\_duration": { "max": { "script": {"source": "(doc\['ts\_stop'\].value - doc\['ts\_star… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1885) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1887)