# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1214

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1215

---

## [Split per index per application](https://discuss.elastic.co/t/split-per-index-per-application/192192)

<div class="topic-metadata">

**Author:** [@pjanzen](https://discuss.elastic.co/u/pjanzen)\
**Replies:** 0\
**Last updated:** [July 25, 2019, 7:46am UTC](https://discuss.elastic.co/t/split-per-index-per-application/192192 "2019-07-25T07:46:49Z")

</div>

Hi all, Currently we have several applications (dovecot, openXchange, Exim, etc, etc) that push data in one index. We call it now clog-2019.07.23 for example. This index is 3.5TB big and contains 2b documents (full stat…

---

## [Push a huge JSON file(s) into ES](https://discuss.elastic.co/t/push-a-huge-json-file-s-into-es/192179)

<div class="topic-metadata">

**Author:** [@Revanth](https://discuss.elastic.co/u/Revanth)\
**Replies:** 1\
**Last updated:** [July 25, 2019, 7:04am UTC](https://discuss.elastic.co/t/push-a-huge-json-file-s-into-es/192179 "2019-07-25T07:04:13Z")

</div>

I'm very new to elasticsearch, and working on ES-6.7 version. However I have a scenario where in I have to push a JSON file to elasticsearch. This JSON file will have a minimum of 20,000 lines (with arrays, objects, nest…

---

## [LIKE in Sql Server I'm Using Prefix query in elasticsearch but i have an issue?](https://discuss.elastic.co/t/like-in-sql-server-im-using-prefix-query-in-elasticsearch-but-i-have-an-issue/192182)

<div class="topic-metadata">

**Author:** [@kartheek91](https://discuss.elastic.co/u/kartheek91)\
**Replies:** 0\
**Last updated:** [July 25, 2019, 6:55am UTC](https://discuss.elastic.co/t/like-in-sql-server-im-using-prefix-query-in-elasticsearch-but-i-have-an-issue/192182 "2019-07-25T06:55:54Z")

</div>

Let's say if I search ".5t" I need to get the corresponding document that matches the string that I showed...But I'm getting zero results. Here is the query GET indexname/indextype/\_search { "\_source": \["code"\], "qu…

---

## [NotXContentException when creating ingest pipeline in Elasticsearch 5.1.2 (Solaris)](https://discuss.elastic.co/t/notxcontentexception-when-creating-ingest-pipeline-in-elasticsearch-5-1-2-solaris/191951)

<div class="topic-metadata">

**Author:** [@Newbie111985](https://discuss.elastic.co/u/Newbie111985)\
**Replies:** 2\
**Last updated:** [July 25, 2019, 6:39am UTC](https://discuss.elastic.co/t/notxcontentexception-when-creating-ingest-pipeline-in-elasticsearch-5-1-2-solaris/191951 "2019-07-25T06:39:09Z")

</div>

Hi, I am trying to create a ingest pipeline using below PUT request: { "description": "ContentExtractor", "processors": \[ { "extractor": { "field": "contentData", "target\_field": "content" } } \] } But this i…

---

## [Elasticsearch version 7.2 and version 6.8.1-- network.host: 0.0.0.0 is getting failed](https://discuss.elastic.co/t/elasticsearch-version-7-2-and-version-6-8-1-network-host-0-0-0-0-is-getting-failed/192173)

<div class="topic-metadata">

**Author:** [@jaleel27](https://discuss.elastic.co/u/jaleel27)\
**Replies:** 0\
**Last updated:** [July 25, 2019, 6:12am UTC](https://discuss.elastic.co/t/elasticsearch-version-7-2-and-version-6-8-1-network-host-0-0-0-0-is-getting-failed/192173 "2019-07-25T06:12:17Z")

</div>

Hello everyone, I have installed elasticsearch 7.2 on my ubuntu server running on AWS EC2. I have set the heap memory to minimal level and started the ES service, with default elasticsearch.yml settings the ES is workin…

---

## [\[ES7.0.1\] NoSuchFileException "plugin-descriptor.properties" when installing plugin "siren-federate-6.8.0-10.2.4.zip". Please advice how to get rid of this error](https://discuss.elastic.co/t/es7-0-1-nosuchfileexception-plugin-descriptor-properties-when-installing-plugin-siren-federate-6-8-0-10-2-4-zip-please-advice-how-to-get-rid-of-this-error/191929)

<div class="topic-metadata">

**Author:** [@cheriemilk](https://discuss.elastic.co/u/cheriemilk)\
**Replies:** 1\
**Last updated:** [July 25, 2019, 5:49am UTC](https://discuss.elastic.co/t/es7-0-1-nosuchfileexception-plugin-descriptor-properties-when-installing-plugin-siren-federate-6-8-0-10-2-4-zip-please-advice-how-to-get-rid-of-this-error/191929 "2019-07-25T05:49:23Z")

</div>

Hi Team, I am using below command to install plug in "siren": \` elasticsearch-plugin install file:///C:/swinstall/siren-federate-6.8.0-10.2.4.zip \` But I got following exception, how to get rid of this error and m…

---

## [With Elasticsearch v6.6, Do we still need Subscription to use XPACK security features?](https://discuss.elastic.co/t/with-elasticsearch-v6-6-do-we-still-need-subscription-to-use-xpack-security-features/190683)

<div class="topic-metadata">

**Author:** [@prashantsonawane](https://discuss.elastic.co/u/prashantsonawane)\
**Replies:** 3\
**Last updated:** [July 25, 2019, 5:42am UTC](https://discuss.elastic.co/t/with-elasticsearch-v6-6-do-we-still-need-subscription-to-use-xpack-security-features/190683 "2019-07-25T05:42:46Z")

</div>

X-pack is opened with ES v6.3 onwards. What does it really mean? Customers still need to have Subscription (Gold, Platinum) to legally use security related features (encryption on communication, encryption at rest)?

---

## [Match query not return exact match as top result](https://discuss.elastic.co/t/match-query-not-return-exact-match-as-top-result/192156)

<div class="topic-metadata">

**Author:** [@Timotius\_Pamungkas](https://discuss.elastic.co/u/Timotius_Pamungkas)\
**Replies:** 1\
**Last updated:** [July 25, 2019, 5:02am UTC](https://discuss.elastic.co/t/match-query-not-return-exact-match-as-top-result/192156 "2019-07-25T05:02:54Z")

</div>

I have data in elasticsearch, with field fullName : John Doe Doe John Doe Eric John Doe When I do a match query against fullName, with this query { "from": 0, "size": 20, "query": { "bool": { …

---

## [Group by multiple fields and get count in elasticsearch](https://discuss.elastic.co/t/group-by-multiple-fields-and-get-count-in-elasticsearch/191575)

<div class="topic-metadata">

**Author:** [@Gokul\_Raj](https://discuss.elastic.co/u/Gokul_Raj)\
**Replies:** 1\
**Last updated:** [July 25, 2019, 2:48am UTC](https://discuss.elastic.co/t/group-by-multiple-fields-and-get-count-in-elasticsearch/191575 "2019-07-25T02:48:35Z")

</div>

Is there any option in elasticsearch to use aggregation for multiple fields and get total count ?. My query is "SELECT COUNT(\*), currency,type,status,channel FROM temp\_index WHERE country='SG' and received\_time=now/…

---

## [To find which indices are actively writing to Elasticsearch for past 1 month](https://discuss.elastic.co/t/to-find-which-indices-are-actively-writing-to-elasticsearch-for-past-1-month/192151)

<div class="topic-metadata">

**Author:** [@Sumit\_Kumar1](https://discuss.elastic.co/u/Sumit_Kumar1)\
**Replies:** 0\
**Last updated:** [July 25, 2019, 2:08am UTC](https://discuss.elastic.co/t/to-find-which-indices-are-actively-writing-to-elasticsearch-for-past-1-month/192151 "2019-07-25T02:08:25Z")

</div>

To list out indices that are pushing logs to elasticsearch for last 1 month.

---

## [Access ES in AWS when behind proxy](https://discuss.elastic.co/t/access-es-in-aws-when-behind-proxy/192139)

<div class="topic-metadata">

**Author:** [@vreznik](https://discuss.elastic.co/u/vreznik)\
**Replies:** 1\
**Last updated:** [July 25, 2019, 12:18am UTC](https://discuss.elastic.co/t/access-es-in-aws-when-behind-proxy/192139 "2019-07-25T00:18:15Z")

</div>

Hi, I'm behind proxy and cannot figures out how to access ES from Ajax app. I can access ES in AWS via curl and postman. So far I tried: final HttpHost httpHost = new HttpHost(host, -1, "https"); builder = RestClient…

---

## [“Hot-Warm” Architecture in Elasticsearch best practice](https://discuss.elastic.co/t/hot-warm-architecture-in-elasticsearch-best-practice/154551)

<div class="topic-metadata">

**Author:** [@thangld](https://discuss.elastic.co/u/thangld)\
**Replies:** 7\
**Last updated:** [July 24, 2019, 11:27pm UTC](https://discuss.elastic.co/t/hot-warm-architecture-in-elasticsearch-best-practice/154551 "2019-07-24T23:27:28Z")

</div>

Hi, I'm using Hot-Warm Elasticsearch to store and perform search on logs for my company. My ES cluster has 8 hot nodes and 10 warm nodes located on 10 servers. Each server has 64GB RAM. 2 servers that only run warm n…

---

## [Master nodes do not detect the other masters after service restart](https://discuss.elastic.co/t/master-nodes-do-not-detect-the-other-masters-after-service-restart/191913)

<div class="topic-metadata">

**Author:** [@mhoydis\_datto](https://discuss.elastic.co/u/mhoydis_datto)\
**Replies:** 9\
**Last updated:** [July 24, 2019, 9:46pm UTC](https://discuss.elastic.co/t/master-nodes-do-not-detect-the-other-masters-after-service-restart/191913 "2019-07-24T21:46:15Z")

</div>

Hello. I upgraded my existing elasticsearch cluster from 6.8.0 to 7.2.0. My cluster has 3 master instances, and many data instances. After some fighting and googling, I eventually was able to get the masters to behave…

---

## [Index Alias pointing to last time-based Index](https://discuss.elastic.co/t/index-alias-pointing-to-last-time-based-index/192137)

<div class="topic-metadata">

**Author:** [@John\_Guzman](https://discuss.elastic.co/u/John_Guzman)\
**Replies:** 0\
**Last updated:** [July 24, 2019, 9:09pm UTC](https://discuss.elastic.co/t/index-alias-pointing-to-last-time-based-index/192137 "2019-07-24T21:09:47Z")

</div>

Hello! Is there any way to create an alias that points to the last metricbeat index? I'm using names like "metricbeat-rollup-6.5.4-2019.07" and i would like to make the alias pointing to "metricbeat-6.5.4-{current-year}…

---

## [Elasticsearch node specific settings](https://discuss.elastic.co/t/elasticsearch-node-specific-settings/192133)

<div class="topic-metadata">

**Author:** [@eightnoteight](https://discuss.elastic.co/u/eightnoteight)\
**Replies:** 0\
**Last updated:** [July 24, 2019, 8:43pm UTC](https://discuss.elastic.co/t/elasticsearch-node-specific-settings/192133 "2019-07-24T20:43:37Z")

</div>

Hi, We maintain a hot-warm architecture and I have noticed when I'm trying to move the shards from hot nodes to warm nodes, during the initial phase the a few shards would be moving from hot to warm, but this used to tr…

---

## [Issue with Index Sort -- The sort should work just as fast in either direction](https://discuss.elastic.co/t/issue-with-index-sort-the-sort-should-work-just-as-fast-in-either-direction/192131)

<div class="topic-metadata">

**Author:** [@Jason\_Baumgartner](https://discuss.elastic.co/u/Jason_Baumgartner)\
**Replies:** 0\
**Last updated:** [July 24, 2019, 8:25pm UTC](https://discuss.elastic.co/t/issue-with-index-sort-the-sort-should-work-just-as-fast-in-either-direction/192131 "2019-07-24T20:25:06Z")

</div>

This refers to this new feature that began in ES 6.x: https://www.elastic.co/guide/en/elasticsearch/reference/master/index-modules-index-sorting.html I'm not sure if this is a Lucene issue or Elasticsearch issue, but so…

---

## [Unable to search on a specific field](https://discuss.elastic.co/t/unable-to-search-on-a-specific-field/192114)

<div class="topic-metadata">

**Author:** [@probson](https://discuss.elastic.co/u/probson)\
**Replies:** 5\
**Last updated:** [July 24, 2019, 8:20pm UTC](https://discuss.elastic.co/t/unable-to-search-on-a-specific-field/192114 "2019-07-24T20:20:44Z")

</div>

Hi, I have 2 indexes created from 2 seperate templates. I am trying to unify some of the field names/schema. I have 2 sets of data from 2 sources coming into logstash, I have used mutate and rename to change the name o…

---

## [Machine Learning API's](https://discuss.elastic.co/t/machine-learning-apis/192107)

<div class="topic-metadata">

**Author:** [@Ambarish\_Chitnis](https://discuss.elastic.co/u/Ambarish_Chitnis)\
**Replies:** 1\
**Last updated:** [July 24, 2019, 8:16pm UTC](https://discuss.elastic.co/t/machine-learning-apis/192107 "2019-07-24T20:16:44Z")

</div>

I was looking at the ML API's and had a few questions: How do I execute ML jobs on a specific schedule, for example once daily? Is the flow to execute a ML job using the API's as follows: create a job, open the job…

---

## [Bulk Request Handling - Requests being handled by single node](https://discuss.elastic.co/t/bulk-request-handling-requests-being-handled-by-single-node/192115)

<div class="topic-metadata">

**Author:** [@FatalGlitch](https://discuss.elastic.co/u/FatalGlitch)\
**Replies:** 9\
**Last updated:** [July 24, 2019, 7:47pm UTC](https://discuss.elastic.co/t/bulk-request-handling-requests-being-handled-by-single-node/192115 "2019-07-24T19:47:19Z")

</div>

We have a 19 node hot/warm/master cluster. Logstash is pointed at only the hot nodes. Recently we are seeing that no matter which hot node gets the actual bulk request, only a single node is handling the request, usuall…

---

## [How to represent output of complex query in dashboard](https://discuss.elastic.co/t/how-to-represent-output-of-complex-query-in-dashboard/189453)

<div class="topic-metadata">

**Author:** [@A\_google\_user](https://discuss.elastic.co/u/A_google_user)\
**Replies:** 12\
**Last updated:** [July 24, 2019, 6:47pm UTC](https://discuss.elastic.co/t/how-to-represent-output-of-complex-query-in-dashboard/189453 "2019-07-24T18:47:55Z")

</div>

I have complex query in kibana. How to represent that output in dashboard? I am writing the query in kibana console How to represent that in the visulize form see the below question for further explanation.

---

## [More Like This: Select K-Top-Terms per field or total?](https://discuss.elastic.co/t/more-like-this-select-k-top-terms-per-field-or-total/192113)

<div class="topic-metadata">

**Author:** [@thiagoheron](https://discuss.elastic.co/u/thiagoheron)\
**Replies:** 0\
**Last updated:** [July 24, 2019, 6:11pm UTC](https://discuss.elastic.co/t/more-like-this-select-k-top-terms-per-field-or-total/192113 "2019-07-24T18:11:43Z")

</div>

Hello, I'm working on RecSystem using More Like This. So, I read that the query will select the terms with highest tf-idf to representive the input document, and could be used within a disjunctive query to retrieve simi…

---

## [Setting up data.repo?](https://discuss.elastic.co/t/setting-up-data-repo/192097)

<div class="topic-metadata">

**Author:** [@jjedrasik](https://discuss.elastic.co/u/jjedrasik)\
**Replies:** 1\
**Last updated:** [July 24, 2019, 5:56pm UTC](https://discuss.elastic.co/t/setting-up-data-repo/192097 "2019-07-24T17:56:22Z")

</div>

Hey all, I've set up data.repo inside the elasticsearch.yml file as such: path.repo: \["/mount/restore/data"\] Afterwards I restarted elasticsearch and when I try to create a backup repository I'm told: \["mount/rest…

---

## [ILP failed step: Index name does not match patten](https://discuss.elastic.co/t/ilp-failed-step-index-name-does-not-match-patten/191664)

<div class="topic-metadata">

**Author:** [@VeeT](https://discuss.elastic.co/u/VeeT)\
**Replies:** 2\
**Last updated:** [July 24, 2019, 5:00pm UTC](https://discuss.elastic.co/t/ilp-failed-step-index-name-does-not-match-patten/191664 "2019-07-24T17:00:31Z")

</div>

Hi. We've been creating our index daily with the following pattern 'test-logs-date'. For example, today's index would be 'test-logs2019.07.22'. I tried implementing Index Lifecycle Management/Index Lifecycle Policies an…

---

## [How can I show a "no matches found" message for swifttype automcomplete plugin](https://discuss.elastic.co/t/how-can-i-show-a-no-matches-found-message-for-swifttype-automcomplete-plugin/192096)

<div class="topic-metadata">

**Author:** [@angela.saternus](https://discuss.elastic.co/u/angela.saternus)\
**Replies:** 0\
**Last updated:** [July 24, 2019, 4:58pm UTC](https://discuss.elastic.co/t/how-can-i-show-a-no-matches-found-message-for-swifttype-automcomplete-plugin/192096 "2019-07-24T16:58:04Z")

</div>

I am using the autocomplete jquery plugin (with Swifttype) for my site search. It's working great except if you type something it can't find, like "bananas", nothing appears to indicate that it can't find any matches. Th…

---

## [Filebeat failed to collect log apache and mysql](https://discuss.elastic.co/t/filebeat-failed-to-collect-log-apache-and-mysql/192091)

<div class="topic-metadata">

**Author:** [@zmira\_meriem](https://discuss.elastic.co/u/zmira_meriem)\
**Replies:** 0\
**Last updated:** [July 24, 2019, 4:22pm UTC](https://discuss.elastic.co/t/filebeat-failed-to-collect-log-apache-and-mysql/192091 "2019-07-24T16:22:41Z")

</div>

Hi plllz help i'm trying to test all config but i cant success !!!!!!!!!!!!!!!!!! i monitor 2 hosts(host1 and host2) where i install filebeat the problem is in host1 collect just mysql log and host2 collect just apache …

---

## [FSCrawler errors with large PDF files - Hard failure and timeout](https://discuss.elastic.co/t/fscrawler-errors-with-large-pdf-files-hard-failure-and-timeout/192082)

<div class="topic-metadata">

**Author:** [@erick\_andrade](https://discuss.elastic.co/u/erick_andrade)\
**Replies:** 0\
**Last updated:** [July 24, 2019, 3:55pm UTC](https://discuss.elastic.co/t/fscrawler-errors-with-large-pdf-files-hard-failure-and-timeout/192082 "2019-07-24T15:55:15Z")

</div>

Hi, folks! I'm trying to index some large PDF files (~70MB) in Elasticsearch using FSCrawler, but not all of them are being indexed, and some exceptions are thrown, like following: DEBUG \[f.p.e.c.f.FsParserAbstract\] \[/…

---

## [\_version number incremented, but updates not reflected](https://discuss.elastic.co/t/version-number-incremented-but-updates-not-reflected/192081)

<div class="topic-metadata">

**Author:** [@calmel](https://discuss.elastic.co/u/calmel)\
**Replies:** 0\
**Last updated:** [July 24, 2019, 3:53pm UTC](https://discuss.elastic.co/t/version-number-incremented-but-updates-not-reflected/192081 "2019-07-24T15:53:10Z")

</div>

We have came across a weird situation where we see the \_version number incremented, but the actual document is not updated at all. We noticed that for said failed writes, the \_version number is higher than usual (we norm…

---

## [ES 7 - moving indices from one node to another in a cluster does not free up disk space?](https://discuss.elastic.co/t/es-7-moving-indices-from-one-node-to-another-in-a-cluster-does-not-free-up-disk-space/192070)

<div class="topic-metadata">

**Author:** [@Kobiko](https://discuss.elastic.co/u/Kobiko)\
**Replies:** 0\
**Last updated:** [July 24, 2019, 3:12pm UTC](https://discuss.elastic.co/t/es-7-moving-indices-from-one-node-to-another-in-a-cluster-does-not-free-up-disk-space/192070 "2019-07-24T15:12:36Z")

</div>

Hey, I have an ES7 cluster (6 nodes, different types). When moving indices from one node to another - disk space remains the same. I have moved almost 1TB from one node to other nodes up to a point the mentioned node …

---

## [Search on multiple fields using term](https://discuss.elastic.co/t/search-on-multiple-fields-using-term/192065)

<div class="topic-metadata">

**Author:** [@likeElastic](https://discuss.elastic.co/u/likeElastic)\
**Replies:** 0\
**Last updated:** [July 24, 2019, 2:58pm UTC](https://discuss.elastic.co/t/search-on-multiple-fields-using-term/192065 "2019-07-24T14:58:17Z")

</div>

I have built one query structure with term which search on multiple fields: \[body\] =\> Array ( \[query\] =\> Array ( \[bool\] =\> Array ( \[must\] =\> Array ( \[terms\] =\> Array ( \[skill\] =\> Array ( \[0\] =\> php \[1\] =\> p…

---

## [How to query the type of a field of many indexes](https://discuss.elastic.co/t/how-to-query-the-type-of-a-field-of-many-indexes/192063)

<div class="topic-metadata">

**Author:** [@DidierB](https://discuss.elastic.co/u/DidierB)\
**Replies:** 0\
**Last updated:** [July 24, 2019, 2:57pm UTC](https://discuss.elastic.co/t/how-to-query-the-type-of-a-field-of-many-indexes/192063 "2019-07-24T14:57:04Z")

</div>

Hello there ! Kibana reports me that one field is in conflict in an index pattern. That index pattern matches a lot of Elasticsearch indexes. What query can I use to get the type of one field for each index?

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1213)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1215)
