# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1900

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1901

---

## [Elastic machine learning code source](https://discuss.elastic.co/t/elastic-machine-learning-code-source/242847)

<div class="topic-metadata">

**Author:** [@Abdelhalim](https://discuss.elastic.co/u/Abdelhalim)\
**Replies:** 14\
**Last updated:** [July 29, 2020, 1:50pm UTC](https://discuss.elastic.co/t/elastic-machine-learning-code-source/242847 "2020-07-29T13:50:00Z")

</div>

Hello everybody, I started using elastic and kibana from code source, could someone please tell me how can I integrate machine learning "https://github.com/elastic/ml-cpp" with elasticsearch "https://github.com/elastic/…

---

## [Is anyone using logstash-output-datadog\_metrics with logstash 7.8.0?](https://discuss.elastic.co/t/is-anyone-using-logstash-output-datadog-metrics-with-logstash-7-8-0/243064)

<div class="topic-metadata">

**Author:** [@windowsrefund\_refund](https://discuss.elastic.co/u/windowsrefund_refund)\
**Replies:** 0\
**Last updated:** [July 29, 2020, 1:43pm UTC](https://discuss.elastic.co/t/is-anyone-using-logstash-output-datadog-metrics-with-logstash-7-8-0/243064 "2020-07-29T13:43:18Z")

</div>

Full description of the issue I'm seeing: https://github.com/logstash-plugins/logstash-output-datadog\_metrics/issues/16

---

## [Adding new node to cluster](https://discuss.elastic.co/t/adding-new-node-to-cluster/242223)

<div class="topic-metadata">

**Author:** [@hariskhalique](https://discuss.elastic.co/u/hariskhalique)\
**Replies:** 11\
**Last updated:** [July 29, 2020, 1:21pm UTC](https://discuss.elastic.co/t/adding-new-node-to-cluster/242223 "2020-07-29T13:21:53Z")

</div>

Hi, I want to add new node to running cluster. I have two servers on which elastic search 7.8 is setup. Server # 1 IP address x.x.x.x port 9200 hostname: es1.example.com Server # 2 IP Address x.x.x.x port 9200 hostna…

---

## [Ingesting Oracle Cloud Infrastructure Logs from It's Object Storage](https://discuss.elastic.co/t/ingesting-oracle-cloud-infrastructure-logs-from-its-object-storage/243046)

<div class="topic-metadata">

**Author:** [@Kevin\_f](https://discuss.elastic.co/u/Kevin_f)\
**Replies:** 0\
**Last updated:** [July 29, 2020, 11:59am UTC](https://discuss.elastic.co/t/ingesting-oracle-cloud-infrastructure-logs-from-its-object-storage/243046 "2020-07-29T11:59:08Z")

</div>

Hello All, I recently raised a Topic: https://discuss.elastic.co/t/oracle-cloud-infrastructure-logstash-plugin/239813. This is regarding if anyone has come across a way of ingesting logs from OCI object storage. Simil…

---

## [Process to upgrade windows auditbeat install?](https://discuss.elastic.co/t/process-to-upgrade-windows-auditbeat-install/243043)

<div class="topic-metadata">

**Author:** [@ethrbunny](https://discuss.elastic.co/u/ethrbunny)\
**Replies:** 1\
**Last updated:** [July 29, 2020, 1:16pm UTC](https://discuss.elastic.co/t/process-to-upgrade-windows-auditbeat-install/243043 "2020-07-29T13:16:16Z")

</div>

Any special steps to take? Does the existing service need to be removed somehow beforehand? 7.7.0 -\> 7.8.1

---

## [Shall we add more than 50 nested fields in single index?](https://discuss.elastic.co/t/shall-we-add-more-than-50-nested-fields-in-single-index/241901)

<div class="topic-metadata">

**Author:** [@gokulnath112](https://discuss.elastic.co/u/gokulnath112)\
**Replies:** 7\
**Last updated:** [July 29, 2020, 12:32pm UTC](https://discuss.elastic.co/t/shall-we-add-more-than-50-nested-fields-in-single-index/241901 "2020-07-29T12:32:41Z")

</div>

Hi Team, Greetings..! Hope you are doing good. My requirement is to add 55 nested fields in a single index. but elastic recommendation is 50, If i add more than 50 nested fields means will it affect my performance? Ki…

---

## [Change Wacther Acknowledge status](https://discuss.elastic.co/t/change-wacther-acknowledge-status/243023)

<div class="topic-metadata">

**Author:** [@Dhanush.S](https://discuss.elastic.co/u/Dhanush.S)\
**Replies:** 1\
**Last updated:** [July 29, 2020, 11:09am UTC](https://discuss.elastic.co/t/change-wacther-acknowledge-status/243023 "2020-07-29T11:09:01Z")

</div>

Hi I am new to Kibana and am working on Advanced Watches, I tried to Acknowledge a Watcher action and Now after working on the issue I want it to be back to ackable state , but I dont see any option for that, It would …

---

## [How to use jdbc to import data into nested objects?](https://discuss.elastic.co/t/how-to-use-jdbc-to-import-data-into-nested-objects/52871)

<div class="topic-metadata">

**Author:** [@DaanCreemers](https://discuss.elastic.co/u/DaanCreemers)\
**Replies:** 7\
**Last updated:** [July 29, 2020, 10:59am UTC](https://discuss.elastic.co/t/how-to-use-jdbc-to-import-data-into-nested-objects/52871 "2020-07-29T10:59:17Z")

</div>

Hi everybody, I have multiple tables in my database which I would like to import into Elasticsearch using a single document type. One of the tables has a one-to-many relation to another table. I will use the example…

---

## [Logstash Pipeline Monitoring Data Is Intermittently Blank In Kibana](https://discuss.elastic.co/t/logstash-pipeline-monitoring-data-is-intermittently-blank-in-kibana/243008)

<div class="topic-metadata">

**Author:** [@scott\_stash](https://discuss.elastic.co/u/scott_stash)\
**Replies:** 2\
**Last updated:** [July 29, 2020, 10:54am UTC](https://discuss.elastic.co/t/logstash-pipeline-monitoring-data-is-intermittently-blank-in-kibana/243008 "2020-07-29T10:54:15Z")

</div>

In my setup I have 3 Logstash(7.5.0) nodes, each node has 20 pipelines. I'm trying to troubleshoot some performance issues with one of my pipelines, but find it difficult because the data is not always viewable in Kiban…

---

## [Unable to read parse log entries in Logstash](https://discuss.elastic.co/t/unable-to-read-parse-log-entries-in-logstash/243007)

<div class="topic-metadata">

**Author:** [@Dark](https://discuss.elastic.co/u/Dark)\
**Replies:** 1\
**Last updated:** [July 29, 2020, 7:57am UTC](https://discuss.elastic.co/t/unable-to-read-parse-log-entries-in-logstash/243007 "2020-07-29T07:57:59Z")

</div>

I have filebeat pushing data to logstash. Logstash is only able to parse the first entry pushed by beats and the rest are not getting filtered. This is the record present in log file: 2020-07-29 08:35:18,042 INFO \[gov…

---

## [Updating documents when using auto-generated IDs](https://discuss.elastic.co/t/updating-documents-when-using-auto-generated-ids/242828)

<div class="topic-metadata">

**Author:** [@jerrymj](https://discuss.elastic.co/u/jerrymj)\
**Replies:** 6\
**Last updated:** [July 29, 2020, 9:52am UTC](https://discuss.elastic.co/t/updating-documents-when-using-auto-generated-ids/242828 "2020-07-29T09:52:07Z")

</div>

Hi, I have an index running on 6.3. It is about 11MM documents, and since the documents are nested, they are much larger in count. These documents represent information stored in multiple databases relating to a specifi…

---

## [Cannot delete index template](https://discuss.elastic.co/t/cannot-delete-index-template/243009)

<div class="topic-metadata">

**Author:** [@Karel\_Cech](https://discuss.elastic.co/u/Karel_Cech)\
**Replies:** 1\
**Last updated:** [July 29, 2020, 9:58am UTC](https://discuss.elastic.co/t/cannot-delete-index-template/243009 "2020-07-29T09:58:18Z")

</div>

Hi, I accidentally created 2 templates with the same name and same pattern. Unfortunately, I don't remember how this happened, because the API does not allow to create templates of same priority and same pattern. But I…

---

## [Filebeat versions from 7.0 - 7.8 fail to create alias field mappings for majority of modules](https://discuss.elastic.co/t/filebeat-versions-from-7-0-7-8-fail-to-create-alias-field-mappings-for-majority-of-modules/242874)

<div class="topic-metadata">

**Author:** [@b0le](https://discuss.elastic.co/u/b0le)\
**Replies:** 4\
**Last updated:** [July 29, 2020, 9:32am UTC](https://discuss.elastic.co/t/filebeat-versions-from-7-0-7-8-fail-to-create-alias-field-mappings-for-majority-of-modules/242874 "2020-07-29T09:32:26Z")

</div>

Summary: When running Filebeat's 7.8.0 setup command the field mappings for the majority of modules which define mappings of type alias never get created. The alias mappings are missing from export template output as wel…

---

## [All Shards failed to assign](https://discuss.elastic.co/t/all-shards-failed-to-assign/242075)

<div class="topic-metadata">

**Author:** [@Pradeep\_K\_S](https://discuss.elastic.co/u/Pradeep_K_S)\
**Replies:** 18\
**Last updated:** [July 29, 2020, 9:01am UTC](https://discuss.elastic.co/t/all-shards-failed-to-assign/242075 "2020-07-29T09:01:55Z")

</div>

Hi, I tried restoring EBS of Elastic search nodes from one cluster to another but after restoring the EBS nodes are running in EC2 but cluster health shows red. GET http://hostname/\_cluster/health?pretty { "cluster\_n…

---

## [How can I group similar message in visualization](https://discuss.elastic.co/t/how-can-i-group-similar-message-in-visualization/240668)

<div class="topic-metadata">

**Author:** [@Fedir\_Yatseta](https://discuss.elastic.co/u/Fedir_Yatseta)\
**Replies:** 2\
**Last updated:** [July 29, 2020, 8:54am UTC](https://discuss.elastic.co/t/how-can-i-group-similar-message-in-visualization/240668 "2020-07-29T08:54:02Z")

</div>

I can not understand how to group similar message in visualisation, i have field "message" in and why in field don't have message . I want to do group message, I get message with time, it time different, me need divi…

---

## [Which beat to use?](https://discuss.elastic.co/t/which-beat-to-use/243003)

<div class="topic-metadata">

**Author:** [@Murango](https://discuss.elastic.co/u/Murango)\
**Replies:** 1\
**Last updated:** [July 29, 2020, 8:51am UTC](https://discuss.elastic.co/t/which-beat-to-use/243003 "2020-07-29T08:51:51Z")

</div>

Hello, Does anyone know which beat to use for monitoring: File attributes on windows - I have already checked auditbeat but there is no such option for Windows File shifts between folders on windows - Here auditbeat o…

---

## [Kibana 7.7.0 cannot delete saved object and create new index](https://discuss.elastic.co/t/kibana-7-7-0-cannot-delete-saved-object-and-create-new-index/242491)

<div class="topic-metadata">

**Author:** [@wind0316](https://discuss.elastic.co/u/wind0316)\
**Replies:** 5\
**Last updated:** [July 29, 2020, 8:32am UTC](https://discuss.elastic.co/t/kibana-7-7-0-cannot-delete-saved-object-and-create-new-index/242491 "2020-07-29T08:32:58Z")

</div>

Hi there my Kibana is not able to create index and delete saved object. Anyone might assist on checking. My Kibana is build on docker with linux system Thank you in advance

---

## [Slow Elasticsearch Ingestion](https://discuss.elastic.co/t/slow-elasticsearch-ingestion/243006)

<div class="topic-metadata">

**Author:** [@evacch](https://discuss.elastic.co/u/evacch)\
**Replies:** 5\
**Last updated:** [July 29, 2020, 8:20am UTC](https://discuss.elastic.co/t/slow-elasticsearch-ingestion/243006 "2020-07-29T08:20:50Z")

</div>

I am new to ELK stack and I am currently testing on the performance of the Elasticsearch with 3 different configurations as follows: One source file: 1GB One source file: 3GB 3 source files: 1GB+1GB+1GB It took me 3 t…

---

## [The title of Kibana](https://discuss.elastic.co/t/the-title-of-kibana/243013)

<div class="topic-metadata">

**Author:** [@chenghan1993](https://discuss.elastic.co/u/chenghan1993)\
**Replies:** 2\
**Last updated:** [July 29, 2020, 8:19am UTC](https://discuss.elastic.co/t/the-title-of-kibana/243013 "2020-07-29T08:19:33Z")

</div>

Hi, everyone I need modify the title of kibana I can't find this file, and i dont know if it is possible. Thank you.

---

## [Logstash filter conditionals](https://discuss.elastic.co/t/logstash-filter-conditionals/243005)

<div class="topic-metadata">

**Author:** [@smm](https://discuss.elastic.co/u/smm)\
**Replies:** 2\
**Last updated:** [July 29, 2020, 8:05am UTC](https://discuss.elastic.co/t/logstash-filter-conditionals/243005 "2020-07-29T08:05:12Z")

</div>

Hi there, I have 2 simple questions reagarding this logstash conditionals example. I have found something like this: ... if \[fields\]\[some\_id\] { mutate { add\_field =\> {"some\_id" =\> "%{\[fields\]\[some\_id\]}"} } } ... …

---

## [How can I sort the fields order of json output](https://discuss.elastic.co/t/how-can-i-sort-the-fields-order-of-json-output/242987)

<div class="topic-metadata">

**Author:** [@CHU\_XU](https://discuss.elastic.co/u/CHU_XU)\
**Replies:** 1\
**Last updated:** [July 29, 2020, 7:58am UTC](https://discuss.elastic.co/t/how-can-i-sort-the-fields-order-of-json-output/242987 "2020-07-29T07:58:32Z")

</div>

Hi there, Found that the fields in json output have a random order even in the same event. For some reason, I need the fields sorted. The 'codec.format' acutally does but it's too complicated. Is there any configs ma…

---

## [Logstash - Multiple outputs with different content](https://discuss.elastic.co/t/logstash-multiple-outputs-with-different-content/242300)

<div class="topic-metadata">

**Author:** [@vasek](https://discuss.elastic.co/u/vasek)\
**Replies:** 3\
**Last updated:** [July 29, 2020, 7:55am UTC](https://discuss.elastic.co/t/logstash-multiple-outputs-with-different-content/242300 "2020-07-29T07:55:28Z")

</div>

Hello, I would like to achieve to have multiple outputs withing one pipeline but with different content of documents. ONE PIPELINE OUTPUT FOR CUSTOMER (REDIS QUEUE or LOGSTASH) only one field: \[@metadata\]\[message\]\[…

---

## [Scripted fields](https://discuss.elastic.co/t/scripted-fields/243015)

<div class="topic-metadata">

**Author:** [@DJindal](https://discuss.elastic.co/u/DJindal)\
**Replies:** 0\
**Last updated:** [July 29, 2020, 7:45am UTC](https://discuss.elastic.co/t/scripted-fields/243015 "2020-07-29T07:45:36Z")

</div>

hi in my location field which is a geo-hash field, holds latitude and longitude values which is sometimes 0,0. i wish to exclude this 0,0 value to be plotted in the coordinate map. i am using kibana 6.5. how can i exc…

---

## [Modern Plugin router, specify timeout](https://discuss.elastic.co/t/modern-plugin-router-specify-timeout/242088)

<div class="topic-metadata">

**Author:** [@McKittrick\_Kaminski](https://discuss.elastic.co/u/McKittrick_Kaminski)\
**Replies:** 5\
**Last updated:** [July 29, 2020, 7:20am UTC](https://discuss.elastic.co/t/modern-plugin-router-specify-timeout/242088 "2020-07-29T07:20:15Z")

</div>

Hey guys, making a Kibana plugin. I'm uploading a large-ish (think 100mb) file with HTTP2 multipart/form-data, and streaming the data into a GCP bucket. I was able to do this cleanly with the old plugin, with the follow…

---

## [Rabbitmq setup in ELK stack](https://discuss.elastic.co/t/rabbitmq-setup-in-elk-stack/242696)

<div class="topic-metadata">

**Author:** [@nityaraj06](https://discuss.elastic.co/u/nityaraj06)\
**Replies:** 1\
**Last updated:** [July 29, 2020, 7:00am UTC](https://discuss.elastic.co/t/rabbitmq-setup-in-elk-stack/242696 "2020-07-29T07:00:13Z")

</div>

Hi, I need to install a messaging queue in the ELK stack. I am planning to use RabbitMQ for this purpose since my Elastic installation is on Windows servers. I have around 30 app servers on which logstash is installed …

---

## [Elasticsearch cross cluster replication, authorization and authentication](https://discuss.elastic.co/t/elasticsearch-cross-cluster-replication-authorization-and-authentication/242816)

<div class="topic-metadata">

**Author:** [@lnitin12](https://discuss.elastic.co/u/lnitin12)\
**Replies:** 1\
**Last updated:** [July 29, 2020, 5:49am UTC](https://discuss.elastic.co/t/elasticsearch-cross-cluster-replication-authorization-and-authentication/242816 "2020-07-29T05:49:52Z")

</div>

To setup cross cluster replication in elasticsearch, what is the authorization and authentication mechanism in between Local and Remote cluster ..? How does local cluster recognize remote cluster.? @elasticsearch

---

## [An error occurred while enabling session management: Error: Failed when trying to obtain the endpoints from your IdP](https://discuss.elastic.co/t/an-error-occurred-while-enabling-session-management-error-failed-when-trying-to-obtain-the-endpoints-from-your-idp/242993)

<div class="topic-metadata">

**Author:** [@Kundan\_Singh](https://discuss.elastic.co/u/Kundan_Singh)\
**Replies:** 4\
**Last updated:** [July 29, 2020, 5:01am UTC](https://discuss.elastic.co/t/an-error-occurred-while-enabling-session-management-error-failed-when-trying-to-obtain-the-endpoints-from-your-idp/242993 "2020-07-29T05:01:34Z")

</div>

I am configuring kibana 7.2 with Single Sign-On with OpenID and Keycloak for https and its throwing error unable to obtain IDP endpoint. Kibana.yml # Kibana is served by a back end server. This setting specifies the po…

---

## [Match terms with characters in a sequence](https://discuss.elastic.co/t/match-terms-with-characters-in-a-sequence/238768)

<div class="topic-metadata">

**Author:** [@emarthinsen](https://discuss.elastic.co/u/emarthinsen)\
**Replies:** 5\
**Last updated:** [July 29, 2020, 4:33am UTC](https://discuss.elastic.co/t/match-terms-with-characters-in-a-sequence/238768 "2020-07-29T04:33:31Z")

</div>

I'm interested in building an autocomplete-style interface where someone can enter characters and the results will be the terms that have those characters in that order, but not necessarily contiguous. This is functiona…

---

## [Elasticsearch index disk usage change (size of primary and replica shards on disk )](https://discuss.elastic.co/t/elasticsearch-index-disk-usage-change-size-of-primary-and-replica-shards-on-disk/242829)

<div class="topic-metadata">

**Author:** [@jinner](https://discuss.elastic.co/u/jinner)\
**Replies:** 2\
**Last updated:** [July 29, 2020, 4:30am UTC](https://discuss.elastic.co/t/elasticsearch-index-disk-usage-change-size-of-primary-and-replica-shards-on-disk/242829 "2020-07-29T04:30:07Z")

</div>

As you can see above, disk usage of index is changed (poped up a bit around 10:21 and came down again) although document count is still increasing. Additionally, ILM(index lifecycle management) which is allocated to th…

---

## [Cant analyze byte string ( b'{... \\\\u0633 ... }' )](https://discuss.elastic.co/t/cant-analyze-byte-string-b-u0633/242605)

<div class="topic-metadata">

**Author:** [@momora9809](https://discuss.elastic.co/u/momora9809)\
**Replies:** 6\
**Last updated:** [July 29, 2020, 4:27am UTC](https://discuss.elastic.co/t/cant-analyze-byte-string-b-u0633/242605 "2020-07-29T04:27:11Z")

</div>

First of all, sorry for the title. I don't know what should I call that (byte string?). I have a data that is like this: b'{"id": "2", "words": \["\\\\u0633\\\\u0647\\\\u0627\\\\u0645\\\\u062f\\\\u0627\\\\u0631\\\\u06cc", "\\\\u0634\\\\u06…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1899)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1901)
