# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1951

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1952

---

## [How to search for parts of a string in the \_id field in an existing index](https://discuss.elastic.co/t/how-to-search-for-parts-of-a-string-in-the-id-field-in-an-existing-index/239622)

<div class="topic-metadata">

**Author:** [@BjornOlavBerg](https://discuss.elastic.co/u/BjornOlavBerg)\
**Replies:** 3\
**Last updated:** [July 6, 2020, 9:24am UTC](https://discuss.elastic.co/t/how-to-search-for-parts-of-a-string-in-the-id-field-in-an-existing-index/239622 "2020-07-06T09:24:02Z")

</div>

Hie, I am working with an existing Elastic Search index, trying to search for a string in the \_id field. The \_id in this index consists of two concatinated strings, and I need to be able to search for the second part o…

---

## [Help with cluster configuration for a deployment moving from 2.4 in AWS to 7.7 in elastic cloud](https://discuss.elastic.co/t/help-with-cluster-configuration-for-a-deployment-moving-from-2-4-in-aws-to-7-7-in-elastic-cloud/239360)

<div class="topic-metadata">

**Author:** [@Michael\_Turbe](https://discuss.elastic.co/u/Michael_Turbe)\
**Replies:** 1\
**Last updated:** [July 6, 2020, 9:18am UTC](https://discuss.elastic.co/t/help-with-cluster-configuration-for-a-deployment-moving-from-2-4-in-aws-to-7-7-in-elastic-cloud/239360 "2020-07-06T09:18:20Z")

</div>

Hi all, we currently have a large elasticsearch 2.4 deployment that's been running successfully, hosted in AWS, for the last 3 years. The cluster is comprised of ~15,000 indexes, 7700 active primary shards, and 15400 ac…

---

## [Customized template](https://discuss.elastic.co/t/customized-template/239978)

<div class="topic-metadata">

**Author:** [@elk2](https://discuss.elastic.co/u/elk2)\
**Replies:** 0\
**Last updated:** [July 6, 2020, 8:58am UTC](https://discuss.elastic.co/t/customized-template/239978 "2020-07-06T08:58:03Z")

</div>

I have elasticsearch 2.4 and I have a lot of index that every day are created like this: test-app-yyyy.MM.dd test-poc-yyyy.MM.dd test-serv-yyyy.MM.dd I have a template customized for all "test-\*" but now I would like…

---

## [Using wildcard in multiple fields](https://discuss.elastic.co/t/using-wildcard-in-multiple-fields/239924)

<div class="topic-metadata">

**Author:** [@pilo](https://discuss.elastic.co/u/pilo)\
**Replies:** 1\
**Last updated:** [July 6, 2020, 8:36am UTC](https://discuss.elastic.co/t/using-wildcard-in-multiple-fields/239924 "2020-07-06T08:36:45Z")

</div>

Hello everyone, i have mapping like this PUT test { "mappings": { "properties": { "elastic\_case\_title": { "properties": { "ace": { "type": "text", "term\_vector": "with\_position…

---

## [Issue with finding length of a text field](https://discuss.elastic.co/t/issue-with-finding-length-of-a-text-field/239786)

<div class="topic-metadata">

**Author:** [@buddhasmiles](https://discuss.elastic.co/u/buddhasmiles)\
**Replies:** 1\
**Last updated:** [July 6, 2020, 8:34am UTC](https://discuss.elastic.co/t/issue-with-finding-length-of-a-text-field/239786 "2020-07-06T08:34:10Z")

</div>

Team , am using version "number": "7.5.1" of ES. below is the 1 row out put of my table.(added only necessary one) { "took" : 1, "timed\_out" : false, "\_shards" : { "total" : 1, "successful" : 1, "skipped" : 0, "failed…

---

## [Short field type taking 4 bytes instead of 2](https://discuss.elastic.co/t/short-field-type-taking-4-bytes-instead-of-2/239809)

<div class="topic-metadata">

**Author:** [@yfful](https://discuss.elastic.co/u/yfful)\
**Replies:** 5\
**Last updated:** [July 6, 2020, 8:04am UTC](https://discuss.elastic.co/t/short-field-type-taking-4-bytes-instead-of-2/239809 "2020-07-06T08:04:04Z")

</div>

Hello, Looking at the short field type, I see that the Fields created are based on the integer implementation: However, this means that a IntPoint is used when a short field is indexed. This leads to the short point …

---

## [Could not see OCR text in "content" field](https://discuss.elastic.co/t/could-not-see-ocr-text-in-content-field/238653)

<div class="topic-metadata">

**Author:** [@saikat189](https://discuss.elastic.co/u/saikat189)\
**Replies:** 18\
**Last updated:** [July 6, 2020, 7:40am UTC](https://discuss.elastic.co/t/could-not-see-ocr-text-in-content-field/238653 "2020-07-06T07:40:23Z")

</div>

I am using fs crawler with below settings --- name: "test2" fs: url: "/home/local/es" update\_rate: "2m" excludes: - "\*/~\*" json\_support: false filename\_as\_id: false add\_filesize: true remove\_deleted: tru…

---

## [How to align the legends and maintain uniform color across the whole dashboard?](https://discuss.elastic.co/t/how-to-align-the-legends-and-maintain-uniform-color-across-the-whole-dashboard/238555)

<div class="topic-metadata">

**Author:** [@Jaishree\_Pal](https://discuss.elastic.co/u/Jaishree_Pal)\
**Replies:** 5\
**Last updated:** [July 6, 2020, 7:38am UTC](https://discuss.elastic.co/t/how-to-align-the-legends-and-maintain-uniform-color-across-the-whole-dashboard/238555 "2020-07-06T07:38:14Z")

</div>

Hi guys, I created a dashboard containing several visualizations. But, the problem I'm facing is that the legends change color every time the page is refreshed. I want some color uniformity like 'green' for 'pass', 'red'…

---

## [How to sends logs from remote machine to Logstash or Elastic Search](https://discuss.elastic.co/t/how-to-sends-logs-from-remote-machine-to-logstash-or-elastic-search/239791)

<div class="topic-metadata">

**Author:** [@pankaj0172](https://discuss.elastic.co/u/pankaj0172)\
**Replies:** 5\
**Last updated:** [July 6, 2020, 7:23am UTC](https://discuss.elastic.co/t/how-to-sends-logs-from-remote-machine-to-logstash-or-elastic-search/239791 "2020-07-06T07:23:13Z")

</div>

Hi There, I have installed Elasticsearch, Logstash, and Kibana (Elastic Stack) on Ubuntu 18.04 as suggested in the below article and everything configured correctly.. But I have installed metric beat on the remote wi…

---

## [Discover tab shows data but table vizualization shows empty](https://discuss.elastic.co/t/discover-tab-shows-data-but-table-vizualization-shows-empty/238788)

<div class="topic-metadata">

**Author:** [@katara](https://discuss.elastic.co/u/katara)\
**Replies:** 5\
**Last updated:** [July 6, 2020, 6:46am UTC](https://discuss.elastic.co/t/discover-tab-shows-data-but-table-vizualization-shows-empty/238788 "2020-07-06T06:46:42Z")

</div>

Hi, Heres the data in Discover tab And when the same is included in the Data table vizualization, the message is blank. I tried using top hit as well, all shows blank. Please help me fix this. Thanks!

---

## [Logstash pipeline to fill sparse data](https://discuss.elastic.co/t/logstash-pipeline-to-fill-sparse-data/239965)

<div class="topic-metadata">

**Author:** [@henriot-gricad](https://discuss.elastic.co/u/henriot-gricad)\
**Replies:** 0\
**Last updated:** [July 6, 2020, 6:45am UTC](https://discuss.elastic.co/t/logstash-pipeline-to-fill-sparse-data/239965 "2020-07-06T06:45:02Z")

</div>

Hi, I have a series of machines whose status, selected from a set of possible values, is inserted into a database upon change with the associated timestamp. There is no new record until the next state change for the mac…

---

## [How to get filename from filebeat json object in logstash filter?](https://discuss.elastic.co/t/how-to-get-filename-from-filebeat-json-object-in-logstash-filter/239844)

<div class="topic-metadata">

**Author:** [@Rashid\_Ali](https://discuss.elastic.co/u/Rashid_Ali)\
**Replies:** 4\
**Last updated:** [July 6, 2020, 6:41am UTC](https://discuss.elastic.co/t/how-to-get-filename-from-filebeat-json-object-in-logstash-filter/239844 "2020-07-06T06:41:48Z")

</div>

I want to parse the file from the JSON object sent by filebeat to logstash file. Can anyone please help me here?

---

## [How to redirect the kibana home page to custom plugin](https://discuss.elastic.co/t/how-to-redirect-the-kibana-home-page-to-custom-plugin/239742)

<div class="topic-metadata">

**Author:** [@Fent](https://discuss.elastic.co/u/Fent)\
**Replies:** 4\
**Last updated:** [July 6, 2020, 6:14am UTC](https://discuss.elastic.co/t/how-to-redirect-the-kibana-home-page-to-custom-plugin/239742 "2020-07-06T06:14:06Z")

</div>

Hi, I want to change the kibana startup page to my plugin UI,It's possible? when visit http://localhost:5601/ the kibana may redirect to http://localhost:5601/utz/app/kibana#/home?\_g=() now i want to redirect to ht…

---

## [MongoDB Input threw an exception, restarting {:exception=\>org.logstash.MissingConverterException: Missing Converter handling for full class name=org.jruby.gen.RubyObject3, simple name=RubyObject3}](https://discuss.elastic.co/t/mongodb-input-threw-an-exception-restarting-exception-org-logstash-missingconverterexception-missing-converter-handling-for-full-class-name-org-jruby-gen-rubyobject3-simple-name-rubyobject3/239881)

<div class="topic-metadata">

**Author:** [@balamelangi](https://discuss.elastic.co/u/balamelangi)\
**Replies:** 1\
**Last updated:** [July 6, 2020, 6:11am UTC](https://discuss.elastic.co/t/mongodb-input-threw-an-exception-restarting-exception-org-logstash-missingconverterexception-missing-converter-handling-for-full-class-name-org-jruby-gen-rubyobject3-simple-name-rubyobject3/239881 "2020-07-06T06:11:38Z")

</div>

Hi @here , I'm getting below error while loading data From mongodb. MongoDB Input threw an exception, restarting {:exception=\>org.logstash.MissingConverterException: Missing Converter handling for full class name=org.j…

---

## [Elastic Search Common Documents Query](https://discuss.elastic.co/t/elastic-search-common-documents-query/239426)

<div class="topic-metadata">

**Author:** [@surajdalvi](https://discuss.elastic.co/u/surajdalvi)\
**Replies:** 21\
**Last updated:** [July 6, 2020, 4:53am UTC](https://discuss.elastic.co/t/elastic-search-common-documents-query/239426 "2020-07-06T04:53:43Z")

</div>

I have the following documents in elastic search: \[{ "\_version": 1, "uid": "blt275162870bd76359", "title": "Entry1", "publish\_details": \[{ "environment": "blt603fe91adbdcff66", "locale": "en-us", "time": "2…

---

## [Deriving the total term frequency for each term](https://discuss.elastic.co/t/deriving-the-total-term-frequency-for-each-term/239952)

<div class="topic-metadata">

**Author:** [@richylyq](https://discuss.elastic.co/u/richylyq)\
**Replies:** 0\
**Last updated:** [July 6, 2020, 4:02am UTC](https://discuss.elastic.co/t/deriving-the-total-term-frequency-for-each-term/239952 "2020-07-06T04:02:54Z")

</div>

I would like to check on how to derive the total term frequency for each term; where and how should i do the summation of term\_freq for each document?

---

## [How to create Machine Learning job using two indices from kibana UI Version 7.8.0](https://discuss.elastic.co/t/how-to-create-machine-learning-job-using-two-indices-from-kibana-ui-version-7-8-0/239049)

<div class="topic-metadata">

**Author:** [@prabhu\_c](https://discuss.elastic.co/u/prabhu_c)\
**Replies:** 8\
**Last updated:** [July 6, 2020, 3:49am UTC](https://discuss.elastic.co/t/how-to-create-machine-learning-job-using-two-indices-from-kibana-ui-version-7-8-0/239049 "2020-07-06T03:49:05Z")

</div>

Hi, I have to create advanced machine learning job using Kibana 7.3 by pulling data from two indices. I am creating job using Kibana UI. I am not able to understand how to pull data from two indices? while creating ML …

---

## [Creating drilldown to another dashboard](https://discuss.elastic.co/t/creating-drilldown-to-another-dashboard/239780)

<div class="topic-metadata">

**Author:** [@darylamdo](https://discuss.elastic.co/u/darylamdo)\
**Replies:** 2\
**Last updated:** [July 6, 2020, 3:36am UTC](https://discuss.elastic.co/t/creating-drilldown-to-another-dashboard/239780 "2020-07-06T03:36:05Z")

</div>

Hi, can i check why the 'Create Drilldown' option does not appear in my panel visualisation in my dashboard? And if there is a way to enable this function so i can create drilldowns from one dashboard into another? Thank…

---

## [Why Elasticsearch-SQL “group by” use composite agg](https://discuss.elastic.co/t/why-elasticsearch-sql-group-by-use-composite-agg/239740)

<div class="topic-metadata">

**Author:** [@ITzhangqiang](https://discuss.elastic.co/u/ITzhangqiang)\
**Replies:** 8\
**Last updated:** [July 6, 2020, 2:45am UTC](https://discuss.elastic.co/t/why-elasticsearch-sql-group-by-use-composite-agg/239740 "2020-07-06T02:45:25Z")

</div>

When I tested the Elasticsearch-SQL feature，I found the “group by” is too slow,why “group by” relies on Elasticsearch’s composite aggregation？ case1:use Elasticsearch-SQL GET /\_sql?format=json { "query": """ selec…

---

## [Transform - Continuous mode for more than 1 index?](https://discuss.elastic.co/t/transform-continuous-mode-for-more-than-1-index/239244)

<div class="topic-metadata">

**Author:** [@Jason\_Neo](https://discuss.elastic.co/u/Jason_Neo)\
**Replies:** 11\
**Last updated:** [July 6, 2020, 1:28am UTC](https://discuss.elastic.co/t/transform-continuous-mode-for-more-than-1-index/239244 "2020-07-06T01:28:54Z")

</div>

Hi all. I have been searching the web and elastic forum looking for solution, but it doesn't seem like people are having problem with the Transform function. I'm using Transform to create summary tables to optimize que…

---

## [Term Vectors Field Statistics Meaning](https://discuss.elastic.co/t/term-vectors-field-statistics-meaning/239917)

<div class="topic-metadata">

**Author:** [@Ubeta](https://discuss.elastic.co/u/Ubeta)\
**Replies:** 0\
**Last updated:** [July 5, 2020, 10:24am UTC](https://discuss.elastic.co/t/term-vectors-field-statistics-meaning/239917 "2020-07-05T10:24:21Z")

</div>

Hi! I am trying to understand the Term Vectors API of Elastic Stack but I am not quite sure what the 'Field Statistics' output means. I tried reading the Elastic document about this but just got confused. Field statis…

---

## [Unable to restore kibana index from snapshot](https://discuss.elastic.co/t/unable-to-restore-kibana-index-from-snapshot/239213)

<div class="topic-metadata">

**Author:** [@dRm42](https://discuss.elastic.co/u/dRm42)\
**Replies:** 1\
**Last updated:** [July 5, 2020, 9:39pm UTC](https://discuss.elastic.co/t/unable-to-restore-kibana-index-from-snapshot/239213 "2020-07-05T21:39:03Z")

</div>

Hi There, I have upgraded our Elastic Stack from 7.6.1 to 7.7 a couple of days after 7.7 came out. I have literally upgraded everything, Elasticsearch, Kibana, Logstash and all Beats. About a week ago I have set up snap…

---

## [Nested Bucket Aggregation](https://discuss.elastic.co/t/nested-bucket-aggregation/239935)

<div class="topic-metadata">

**Author:** [@Camilo\_Salomon](https://discuss.elastic.co/u/Camilo_Salomon)\
**Replies:** 0\
**Last updated:** [July 5, 2020, 9:12pm UTC](https://discuss.elastic.co/t/nested-bucket-aggregation/239935 "2020-07-05T21:12:41Z")

</div>

I'm trying to do an aggregation over nested buckets, something like this But I don't know how to do get the expected Result. Any advice will be appreciated. Here is my current query: POST kibana\_sample\_data\_ecommer…

---

## [Curator delete process for monthly/weekly indices](https://discuss.elastic.co/t/curator-delete-process-for-monthly-weekly-indices/239735)

<div class="topic-metadata">

**Author:** [@Ganesh2303](https://discuss.elastic.co/u/Ganesh2303)\
**Replies:** 1\
**Last updated:** [July 5, 2020, 5:58pm UTC](https://discuss.elastic.co/t/curator-delete-process-for-monthly-weekly-indices/239735 "2020-07-05T17:58:01Z")

</div>

HI Team, Im using curator to purge old data in my indices, Initially it was daily basis index creation. In our current approach of index creation is monthly basis creation. we indexing production and pre-prod data. Pr…

---

## [Query Users who has similar rating](https://discuss.elastic.co/t/query-users-who-has-similar-rating/239929)

<div class="topic-metadata">

**Author:** [@recordable542](https://discuss.elastic.co/u/recordable542)\
**Replies:** 0\
**Last updated:** [July 5, 2020, 3:54pm UTC](https://discuss.elastic.co/t/query-users-who-has-similar-rating/239929 "2020-07-05T15:54:12Z")

</div>

index "users" has several columns id(integer), name(string), rating(float) e.g users 1 steve 3.3 2 jane 9.9 3 bob 2.3 4 taylor 5.5 when a user is given, (let's say {id:1 name:steve rating:3.3} I want to query oth…

---

## [Logstash can't read stored procedure statement as input](https://discuss.elastic.co/t/logstash-cant-read-stored-procedure-statement-as-input/239928)

<div class="topic-metadata">

**Author:** [@Muhammad\_Badawy](https://discuss.elastic.co/u/Muhammad_Badawy)\
**Replies:** 0\
**Last updated:** [July 5, 2020, 3:52pm UTC](https://discuss.elastic.co/t/logstash-cant-read-stored-procedure-statement-as-input/239928 "2020-07-05T15:52:48Z")

</div>

I'm trying to let logstash read from MySQL DB through stored procedure. Here is my config input { jdbc { jdbc\_driver\_library =\> "/home/devops/mysql-connector-java-5.1.49/mysql-connector-java-5.1.49-bin.jar" jdbc\_driver…

---

## [Best way to save queries](https://discuss.elastic.co/t/best-way-to-save-queries/239863)

<div class="topic-metadata">

**Author:** [@NikolaP93](https://discuss.elastic.co/u/NikolaP93)\
**Replies:** 1\
**Last updated:** [July 5, 2020, 2:21pm UTC](https://discuss.elastic.co/t/best-way-to-save-queries/239863 "2020-07-05T14:21:44Z")

</div>

Hi, I am using Reactivebase to query elasticsearch. Since the users of my app will be able to save the queries, is it reliable for me to store the query as it is returned? Example: {"query":{"bool":{"must":\[{"bool":{"mu…

---

## [Elastic Search 6.x Keeps Failing](https://discuss.elastic.co/t/elastic-search-6-x-keeps-failing/239920)

<div class="topic-metadata">

**Author:** [@thedoctordarren](https://discuss.elastic.co/u/thedoctordarren)\
**Replies:** 2\
**Last updated:** [July 5, 2020, 12:14pm UTC](https://discuss.elastic.co/t/elastic-search-6-x-keeps-failing/239920 "2020-07-05T12:14:00Z")

</div>

Hiya (New on forums like this so bare with me lol) Anyways Just wondered if someone can help me, I've installed Elasticsearch 6.8.9 through the DEB package and have installed the Elasticsearch head through GitHub. I've…

---

## [Replace string in array with \_update\_by\_query](https://discuss.elastic.co/t/replace-string-in-array-with-update-by-query/239913)

<div class="topic-metadata">

**Author:** [@ovinz](https://discuss.elastic.co/u/ovinz)\
**Replies:** 0\
**Last updated:** [July 5, 2020, 8:18am UTC](https://discuss.elastic.co/t/replace-string-in-array-with-update-by-query/239913 "2020-07-05T08:18:02Z")

</div>

Hello, I'd like to replace string by another one in all Array elements but I don't know how to do that in Java. My document is like : "pictures" : \[ "https://www.mydomain.com/images/123.png", …

---

## [Not elligible for basic license?](https://discuss.elastic.co/t/not-elligible-for-basic-license/239906)

<div class="topic-metadata">

**Author:** [@akoumjian](https://discuss.elastic.co/u/akoumjian)\
**Replies:** 1\
**Last updated:** [July 5, 2020, 6:37am UTC](https://discuss.elastic.co/t/not-elligible-for-basic-license/239906 "2020-07-05T06:37:09Z")

</div>

I'm running Elasticsearch 7.8 in docker in a manner similar to here: https://www.elastic.co/guide/en/elasticsearch/reference/current/docker.html I'm not sure why I am getting {"eligible\_to\_start\_basic":false} when I che…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1950)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1952)
