# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1817

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1818

---

## [Kibana 7.9.0 does not start when setting path.data](https://discuss.elastic.co/t/kibana-7-9-0-does-not-start-when-setting-path-data/246632)

<div class="topic-metadata">

**Author:** [@jlthorel](https://discuss.elastic.co/u/jlthorel)\
**Replies:** 4\
**Last updated:** [September 9, 2020, 12:23pm UTC](https://discuss.elastic.co/t/kibana-7-9-0-does-not-start-when-setting-path-data/246632 "2020-09-09T12:23:02Z")

</div>

Hello, I have an issue with Kibana 7.9.0. Kibana does not start when I set the parameter path.data I have the following error message Configuring logger failed: { Error: EISDIR: illegal operation on a directory, read…

---

## [How to resolve Unable to revive connection and No living connections](https://discuss.elastic.co/t/how-to-resolve-unable-to-revive-connection-and-no-living-connections/247836)

<div class="topic-metadata">

**Author:** [@CHAIRUL\_ANWAR](https://discuss.elastic.co/u/CHAIRUL_ANWAR)\
**Replies:** 1\
**Last updated:** [September 9, 2020, 12:13pm UTC](https://discuss.elastic.co/t/how-to-resolve-unable-to-revive-connection-and-no-living-connections/247836 "2020-09-09T12:13:36Z")

</div>

i create docker container on my environment docker run -d --name elasticsearch --restart always -p 9200:9200 -p 9300:9300 -e "ES\_JAVA\_OPTS=-Xms1024m -Xmx1024m" -e "discovery.type=single-node" elasticsearch:7.4.0 d…

---

## [Heartbeat Use json with secret store in check.request.body](https://discuss.elastic.co/t/heartbeat-use-json-with-secret-store-in-check-request-body/247869)

<div class="topic-metadata">

**Author:** [@pawarrchetan](https://discuss.elastic.co/u/pawarrchetan)\
**Replies:** 3\
**Last updated:** [September 9, 2020, 11:24am UTC](https://discuss.elastic.co/t/heartbeat-use-json-with-secret-store-in-check-request-body/247869 "2020-09-09T11:24:46Z")

</div>

I need help to figure out the correct json payload for my http monitor to test an authenticated endpoint. Monitor YAML : name: test-xyz-abc-io enabled: true schedule: '@every 1m' # every 10 minutes from start of…

---

## [Cant read metric from apache artemis?](https://discuss.elastic.co/t/cant-read-metric-from-apache-artemis/246609)

<div class="topic-metadata">

**Author:** [@Kiran\_Aher](https://discuss.elastic.co/u/Kiran_Aher)\
**Replies:** 1\
**Last updated:** [September 9, 2020, 11:26am UTC](https://discuss.elastic.co/t/cant-read-metric-from-apache-artemis/246609 "2020-09-09T11:26:40Z")

</div>

Apologize if this is asked already but Im not able to find enough information on either setup document and elastic.co forum as well. We have apache artemis 2.6 running with one broker and trying to get it's metric data …

---

## [Bulk index if not exists](https://discuss.elastic.co/t/bulk-index-if-not-exists/247912)

<div class="topic-metadata">

**Author:** [@noorul.m](https://discuss.elastic.co/u/noorul.m)\
**Replies:** 4\
**Last updated:** [September 9, 2020, 9:45am UTC](https://discuss.elastic.co/t/bulk-index-if-not-exists/247912 "2020-09-09T09:45:52Z")

</div>

I have the following document structure { "id": "977373", "name": "Air Odisha" } I want to create documents in bulk only if id and name are not present already.

---

## [How to config logstash filter to remove new line in the field csv file](https://discuss.elastic.co/t/how-to-config-logstash-filter-to-remove-new-line-in-the-field-csv-file/247985)

<div class="topic-metadata">

**Author:** [@111207](https://discuss.elastic.co/u/111207)\
**Replies:** 0\
**Last updated:** [September 9, 2020, 9:29am UTC](https://discuss.elastic.co/t/how-to-config-logstash-filter-to-remove-new-line-in-the-field-csv-file/247985 "2020-09-09T09:29:23Z")

</div>

Hi Everyone I need to parse csv file with logstash and ingest data to elasticsearch But the some column in csv file have new line This is my input

---

## [Logstash error: cannot parse empty date](https://discuss.elastic.co/t/logstash-error-cannot-parse-empty-date/247983)

<div class="topic-metadata">

**Author:** [@hiba](https://discuss.elastic.co/u/hiba)\
**Replies:** 0\
**Last updated:** [September 9, 2020, 9:21am UTC](https://discuss.elastic.co/t/logstash-error-cannot-parse-empty-date/247983 "2020-09-09T09:21:33Z")

</div>

Hi all, i want to load data from an api to elasticserach via logstash. i have a field "depDate" with date type ....in some documents, this field can be empty . what can i do to load this documents in my index ? \[20…

---

## [Http request response to elastic search](https://discuss.elastic.co/t/http-request-response-to-elastic-search/247959)

<div class="topic-metadata">

**Author:** [@Nupur](https://discuss.elastic.co/u/Nupur)\
**Replies:** 8\
**Last updated:** [September 9, 2020, 9:11am UTC](https://discuss.elastic.co/t/http-request-response-to-elastic-search/247959 "2020-09-09T09:11:32Z")

</div>

when sending 100 parallel http request the http response time is very high .. whereas the took time in for each query response is very low. How can i improve the http response time to ealstic search.

---

## [Elastic search stops at no plugin loaded](https://discuss.elastic.co/t/elastic-search-stops-at-no-plugin-loaded/247555)

<div class="topic-metadata">

**Author:** [@Sourabh](https://discuss.elastic.co/u/Sourabh)\
**Replies:** 3\
**Last updated:** [September 7, 2020, 8:54pm UTC](https://discuss.elastic.co/t/elastic-search-stops-at-no-plugin-loaded/247555 "2020-09-07T20:54:14Z")

</div>

When i started my node on the server it was successfully started.But when due to some reason the node goes down may be due to extensive load or if i down it intentionally and i try to restart it then the log stops at …

---

## [Filebeat stops at a certain time](https://discuss.elastic.co/t/filebeat-stops-at-a-certain-time/247979)

<div class="topic-metadata">

**Author:** [@bornatalebi](https://discuss.elastic.co/u/bornatalebi)\
**Replies:** 0\
**Last updated:** [September 9, 2020, 8:47am UTC](https://discuss.elastic.co/t/filebeat-stops-at-a-certain-time/247979 "2020-09-09T08:47:12Z")

</div>

Hi, I have a filebeat with custom index for cisco logs. Here is my filebeat.yaml config: filebeat.inputs: - type: log enabled: true paths: - /var/log/\*.log #- c:\\programdata\\elastic…

---

## [After deleted metric beat index not able to get data from metric beat agent](https://discuss.elastic.co/t/after-deleted-metric-beat-index-not-able-to-get-data-from-metric-beat-agent/247571)

<div class="topic-metadata">

**Author:** [@pankaj0172](https://discuss.elastic.co/u/pankaj0172)\
**Replies:** 2\
**Last updated:** [September 9, 2020, 8:45am UTC](https://discuss.elastic.co/t/after-deleted-metric-beat-index-not-able-to-get-data-from-metric-beat-agent/247571 "2020-09-09T08:45:59Z")

</div>

Hi Team, Can someone please help with the below error message as I deleted the metricbeat index from elastichsearch through Kibana and now I'm not able to get data from metricbeat agent..

---

## [What are typical memory or cpu intensive workloads?](https://discuss.elastic.co/t/what-are-typical-memory-or-cpu-intensive-workloads/247978)

<div class="topic-metadata">

**Author:** [@vchalmel](https://discuss.elastic.co/u/vchalmel)\
**Replies:** 0\
**Last updated:** [September 9, 2020, 8:37am UTC](https://discuss.elastic.co/t/what-are-typical-memory-or-cpu-intensive-workloads/247978 "2020-09-09T08:37:47Z")

</div>

I would like to get a better understanding of the alternative proposed for elastic-cloud new deployements between "I/O" "CPU" or "memory" optimizations. What they are, and how the selected hardware is balanced is pretty…

---

## [Combine results for user\_agent.device.name from Apache logs](https://discuss.elastic.co/t/combine-results-for-user-agent-device-name-from-apache-logs/247898)

<div class="topic-metadata">

**Author:** [@prophoto](https://discuss.elastic.co/u/prophoto)\
**Replies:** 2\
**Last updated:** [September 9, 2020, 8:13am UTC](https://discuss.elastic.co/t/combine-results-for-user-agent-device-name-from-apache-logs/247898 "2020-09-09T08:13:08Z")

</div>

How would I combine these results into a single item for all Samsung devices?

---

## [How to give json.gz to Elasticsearch docker](https://discuss.elastic.co/t/how-to-give-json-gz-to-elasticsearch-docker/247973)

<div class="topic-metadata">

**Author:** [@Cyril\_Guiet](https://discuss.elastic.co/u/Cyril_Guiet)\
**Replies:** 0\
**Last updated:** [September 9, 2020, 7:55am UTC](https://discuss.elastic.co/t/how-to-give-json-gz-to-elasticsearch-docker/247973 "2020-09-09T07:55:50Z")

</div>

Hello ! I would like to know the "sexiest" way to give my json to ElasticSearch container :slight\_smile: my start command is actually docker run -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" docker.elastic…

---

## [How to leave the indices in mode read write in phase warm after to pass shrink process](https://discuss.elastic.co/t/how-to-leave-the-indices-in-mode-read-write-in-phase-warm-after-to-pass-shrink-process/247879)

<div class="topic-metadata">

**Author:** [@David\_Moya](https://discuss.elastic.co/u/David_Moya)\
**Replies:** 2\
**Last updated:** [September 9, 2020, 7:51am UTC](https://discuss.elastic.co/t/how-to-leave-the-indices-in-mode-read-write-in-phase-warm-after-to-pass-shrink-process/247879 "2020-09-09T07:51:07Z")

</div>

I need to have the indices with permissions of read and write in the phase warm because I still receive old indices that they can't write over indices in phase warm. NOTE: in the phase warm the shrink process is selecte…

---

## [Import Button Grayed Out for a JSON File Import](https://discuss.elastic.co/t/import-button-grayed-out-for-a-json-file-import/247412)

<div class="topic-metadata">

**Author:** [@Broggy-Git](https://discuss.elastic.co/u/Broggy-Git)\
**Replies:** 3\
**Last updated:** [September 9, 2020, 7:50am UTC](https://discuss.elastic.co/t/import-button-grayed-out-for-a-json-file-import/247412 "2020-09-09T07:50:57Z")

</div>

I have recently installed and configured ElasticSearch 7.9 along with Kibana 7.9. When loading a josn file for testing purposes, I manage to arrive to thee data visualization step but cannot finalize this process due to…

---

## [Logstash s3-sqs input plugin to differentiate 2 types of log](https://discuss.elastic.co/t/logstash-s3-sqs-input-plugin-to-differentiate-2-types-of-log/247971)

<div class="topic-metadata">

**Author:** [@vinodjv\_3](https://discuss.elastic.co/u/vinodjv_3)\
**Replies:** 0\
**Last updated:** [September 9, 2020, 7:49am UTC](https://discuss.elastic.co/t/logstash-s3-sqs-input-plugin-to-differentiate-2-types-of-log/247971 "2020-09-09T07:49:43Z")

</div>

Hi all, I have an use case where application logs are pushed to s3 bucket, log types are json and plain. Am using \[logstash-input-s3-sns-sqs\] plugin to read logs from S3 bucket. Both log types are pushed to different p…

---

## [Logstash start failed because of Could not load FFI Provider: (NotImplementedError) FFI not available](https://discuss.elastic.co/t/logstash-start-failed-because-of-could-not-load-ffi-provider-notimplementederror-ffi-not-available/247970)

<div class="topic-metadata">

**Author:** [@qiuwenhui1](https://discuss.elastic.co/u/qiuwenhui1)\
**Replies:** 0\
**Last updated:** [September 9, 2020, 7:47am UTC](https://discuss.elastic.co/t/logstash-start-failed-because-of-could-not-load-ffi-provider-notimplementederror-ffi-not-available/247970 "2020-09-09T07:47:31Z")

</div>

java.lang.IllegalStateException: Logstash stopped processing because of an error: (LoadError) Could not load FFI Provider: (NotImplementedError) FFI not available: java.lang.ClassCastException: java.nio.HeapByteBuffer ca…

---

## [Cluster Filtering is not showing any results](https://discuss.elastic.co/t/cluster-filtering-is-not-showing-any-results/247919)

<div class="topic-metadata">

**Author:** [@Shubhangi](https://discuss.elastic.co/u/Shubhangi)\
**Replies:** 2\
**Last updated:** [September 9, 2020, 7:47am UTC](https://discuss.elastic.co/t/cluster-filtering-is-not-showing-any-results/247919 "2020-09-09T07:47:25Z")

</div>

Hi, I'm using Elastic Stack 7.8. I wanted to decommission a node, in order to do that i used the following command: PUT \_cluster/settings { "transient" : { "cluster.routing.allocation.exclude.\_ip" : "1.2.3.4" }…

---

## [Filebeat with xlsx source](https://discuss.elastic.co/t/filebeat-with-xlsx-source/247969)

<div class="topic-metadata">

**Author:** [@garryrobertson](https://discuss.elastic.co/u/garryrobertson)\
**Replies:** 0\
**Last updated:** [September 9, 2020, 7:36am UTC](https://discuss.elastic.co/t/filebeat-with-xlsx-source/247969 "2020-09-09T07:36:19Z")

</div>

Is it possible to use any of the Beats shippers to send data from an xlsx file from Excel into Elasticsearch? It is straightforward enough with a csv, but how about Excel?

---

## [Failed to parse the query in Kibana](https://discuss.elastic.co/t/failed-to-parse-the-query-in-kibana/247354)

<div class="topic-metadata">

**Author:** [@ankitsingh](https://discuss.elastic.co/u/ankitsingh)\
**Replies:** 1\
**Last updated:** [September 9, 2020, 7:28am UTC](https://discuss.elastic.co/t/failed-to-parse-the-query-in-kibana/247354 "2020-09-09T07:28:31Z")

</div>

Hi , I have this kind of data: message: "message": "2020-09-02 08:11:55.000000000 +0000 state-handler: {"date":"2020-09-02T08:11:55.863Z","nfInstanceId":"0690e150-4c69-4d86-a49c-990bf056f333","instance":"ausf-nausf-aut…

---

## [How to choose between Logstash and Fluentd in Elastic stack?](https://discuss.elastic.co/t/how-to-choose-between-logstash-and-fluentd-in-elastic-stack/247963)

<div class="topic-metadata">

**Author:** [@Ashish1101](https://discuss.elastic.co/u/Ashish1101)\
**Replies:** 0\
**Last updated:** [September 9, 2020, 7:12am UTC](https://discuss.elastic.co/t/how-to-choose-between-logstash-and-fluentd-in-elastic-stack/247963 "2020-09-09T07:12:59Z")

</div>

How do I decide whether to Logstash or Fluentd in elastic stack? what are the criteria? any reference links will be helpful.

---

## [How to parse xml.log via logstash](https://discuss.elastic.co/t/how-to-parse-xml-log-via-logstash/247940)

<div class="topic-metadata">

**Author:** [@gavin-orange](https://discuss.elastic.co/u/gavin-orange)\
**Replies:** 3\
**Last updated:** [September 9, 2020, 6:10am UTC](https://discuss.elastic.co/t/how-to-parse-xml-log-via-logstash/247940 "2020-09-09T06:10:11Z")

</div>

Hello Guys , I am totally new into ES and now I want to use logstash to parse the xml.log , hope could get any help . Here is part of xml.log which I have : \<msg time='2019-10-25T01:50:15.913+08:00' org\_id='oracle…

---

## [Open local file on link field](https://discuss.elastic.co/t/open-local-file-on-link-field/247905)

<div class="topic-metadata">

**Author:** [@Ostr1969](https://discuss.elastic.co/u/Ostr1969)\
**Replies:** 2\
**Last updated:** [September 9, 2020, 6:19am UTC](https://discuss.elastic.co/t/open-local-file-on-link-field/247905 "2020-09-09T06:19:32Z")

</div>

on kibana 7.4.2 i have a link field which point to local file. when i press it i get http://localhost:5601/apps/c:/somefile.txt but this cant be open by click how can i remove the prefix of http://localhost:5601/apps …

---

## [Heartbeat monitor: use of heartbeat secret store](https://discuss.elastic.co/t/heartbeat-monitor-use-of-heartbeat-secret-store/247770)

<div class="topic-metadata">

**Author:** [@pawarrchetan](https://discuss.elastic.co/u/pawarrchetan)\
**Replies:** 2\
**Last updated:** [September 9, 2020, 6:19am UTC](https://discuss.elastic.co/t/heartbeat-monitor-use-of-heartbeat-secret-store/247770 "2020-09-09T06:19:04Z")

</div>

I would like to use the heartbeat secret store to specify passwords for my https request. I tried testing this option with the username and password fields in the monitor configuration. However the Uptime is reported a…

---

## [Help with complex query](https://discuss.elastic.co/t/help-with-complex-query/247887)

<div class="topic-metadata">

**Author:** [@Andreas\_C](https://discuss.elastic.co/u/Andreas_C)\
**Replies:** 1\
**Last updated:** [September 9, 2020, 6:18am UTC](https://discuss.elastic.co/t/help-with-complex-query/247887 "2020-09-09T06:18:55Z")

</div>

Hello, I've just started using Elastic and my use case involves retrieving relevant documents using a natural query string and the following query: { "size": "5", "query": { "bool": { "should": \[ …

---

## [Elastic Cloud Private Link connectivity for clients with CloudID](https://discuss.elastic.co/t/elastic-cloud-private-link-connectivity-for-clients-with-cloudid/247933)

<div class="topic-metadata">

**Author:** [@kiwibel](https://discuss.elastic.co/u/kiwibel)\
**Replies:** 4\
**Last updated:** [September 9, 2020, 5:46am UTC](https://discuss.elastic.co/t/elastic-cloud-private-link-connectivity-for-clients-with-cloudid/247933 "2020-09-09T05:46:29Z")

</div>

Hi, We are using Elastic Cloud (AWS) and the ES client on the app side is configured with CloudID. We have added Private Link to access our deployment as described here: https://www.elastic.co/guide/en/cloud/current/e…

---

## [Packet beat is not showing the status of down if the port is down](https://discuss.elastic.co/t/packet-beat-is-not-showing-the-status-of-down-if-the-port-is-down/247952)

<div class="topic-metadata">

**Author:** [@jerin](https://discuss.elastic.co/u/jerin)\
**Replies:** 2\
**Last updated:** [September 9, 2020, 5:44am UTC](https://discuss.elastic.co/t/packet-beat-is-not-showing-the-status-of-down-if-the-port-is-down/247952 "2020-09-09T05:44:29Z")

</div>

Hello , I have started to use packetbeat for port monitoring in kibana . These are the current issues when I kill the process (http) , its not showing the exact status of port in elastic search . Even if it's down , …

---

## [Implementing Rollover+ILM with Logstash and time based index name](https://discuss.elastic.co/t/implementing-rollover-ilm-with-logstash-and-time-based-index-name/247883)

<div class="topic-metadata">

**Author:** [@xenoid](https://discuss.elastic.co/u/xenoid)\
**Replies:** 2\
**Last updated:** [September 9, 2020, 4:46am UTC](https://discuss.elastic.co/t/implementing-rollover-ilm-with-logstash-and-time-based-index-name/247883 "2020-09-09T04:46:50Z")

</div>

Hi there, I used to index logs with Logstash into time-based indices (logstash-YYYY.MM.DD). Time-based index names make administration easier on us. We already use lifecycle management to pull the indices to slower nod…

---

## [Capitalization of words in nori user dictionary](https://discuss.elastic.co/t/capitalization-of-words-in-nori-user-dictionary/247950)

<div class="topic-metadata">

**Author:** [@Ubeta](https://discuss.elastic.co/u/Ubeta)\
**Replies:** 0\
**Last updated:** [September 9, 2020, 4:46am UTC](https://discuss.elastic.co/t/capitalization-of-words-in-nori-user-dictionary/247950 "2020-09-09T04:46:29Z")

</div>

Hi! My custom nori analyzer uses a nori user dictionary that contains Korean, English, and a mix of Korean-English words. These words are very technical so there was a need to put them in my user dictionary. However, wi…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1816)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1818)
