# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1663

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1664

---

## [No logs found for filebeat](https://discuss.elastic.co/t/no-logs-found-for-filebeat/257519)

<div class="topic-metadata">

**Author:** [@Abdelhalim](https://discuss.elastic.co/u/Abdelhalim)\
**Replies:** 8\
**Last updated:** [December 3, 2020, 4:55pm UTC](https://discuss.elastic.co/t/no-logs-found-for-filebeat/257519 "2020-12-03T16:55:08Z")

</div>

Hello, I am using filebeat 7.10 on Debian machine and I configured it to send data to /var/log/filebeat : logging.level: info logging.to\_file: true logging.files: path: /var/log/filebeat name: filebeat keepfiles…

---

## [Cosine Similarity Script Search does not work](https://discuss.elastic.co/t/cosine-similarity-script-search-does-not-work/257550)

<div class="topic-metadata">

**Author:** [@gustav\_z](https://discuss.elastic.co/u/gustav_z)\
**Replies:** 0\
**Last updated:** [December 3, 2020, 4:37pm UTC](https://discuss.elastic.co/t/cosine-similarity-script-search-does-not-work/257550 "2020-12-03T16:37:54Z")

</div>

Similar to these un-answered and closed topics: https://discuss.elastic.co/t/cosine-similarity-not-working-in-elastic-search/209702 https://discuss.elastic.co/t/elasticsearch-search-error/232784 I am seeing the same E…

---

## [Getting aws internal ip when using dns plugin i want to see actual dns name like abc.test.com](https://discuss.elastic.co/t/getting-aws-internal-ip-when-using-dns-plugin-i-want-to-see-actual-dns-name-like-abc-test-com/257455)

<div class="topic-metadata">

**Author:** [@sujeetjha](https://discuss.elastic.co/u/sujeetjha)\
**Replies:** 1\
**Last updated:** [December 3, 2020, 4:35pm UTC](https://discuss.elastic.co/t/getting-aws-internal-ip-when-using-dns-plugin-i-want-to-see-actual-dns-name-like-abc-test-com/257455 "2020-12-03T16:35:46Z")

</div>

Getting AWS internal IP (ip-11-11-11-11-amazon.com) when using DNS plugin I want to see actual DNS name like abc.test.com.. what should I do plz suggest... here is my code below # Beats -\> Logstash -\> Elasticsearch pip…

---

## [How can I create a sequence diagram using Vega or Vega-lite?](https://discuss.elastic.co/t/how-can-i-create-a-sequence-diagram-using-vega-or-vega-lite/257502)

<div class="topic-metadata">

**Author:** [@shalintha](https://discuss.elastic.co/u/shalintha)\
**Replies:** 3\
**Last updated:** [December 3, 2020, 4:35pm UTC](https://discuss.elastic.co/t/how-can-i-create-a-sequence-diagram-using-vega-or-vega-lite/257502 "2020-12-03T16:35:39Z")

</div>

I want to create a Sequence diagram using Vega visualize for my Kibana Dashboard. Is there a way to create Sequence diagram using Vega or Vega-lite (or using D3js)?

---

## [ML query](https://discuss.elastic.co/t/ml-query/257418)

<div class="topic-metadata">

**Author:** [@Elk\_huh](https://discuss.elastic.co/u/Elk_huh)\
**Replies:** 3\
**Last updated:** [December 3, 2020, 4:26pm UTC](https://discuss.elastic.co/t/ml-query/257418 "2020-12-03T16:26:14Z")

</div>

Is it possible to do an ML job that says If event.code: 4264 and 4265 within 30 minutes ?

---

## [How to change date format in logstash?](https://discuss.elastic.co/t/how-to-change-date-format-in-logstash/257532)

<div class="topic-metadata">

**Author:** [@reillye](https://discuss.elastic.co/u/reillye)\
**Replies:** 1\
**Last updated:** [December 3, 2020, 4:16pm UTC](https://discuss.elastic.co/t/how-to-change-date-format-in-logstash/257532 "2020-12-03T16:16:29Z")

</div>

My raw data comes in epoch format e.g. 430201865. I can parse this to UNIX using the date filter in logstash like so date { match =\> \["time", "UNIX"\] target =\> "timestamp" remove\_field =\> \["time"\] } This produces…

---

## [How to make the "Discover" tab data to Table view](https://discuss.elastic.co/t/how-to-make-the-discover-tab-data-to-table-view/257001)

<div class="topic-metadata">

**Author:** [@qub123](https://discuss.elastic.co/u/qub123)\
**Replies:** 12\
**Last updated:** [December 3, 2020, 4:14pm UTC](https://discuss.elastic.co/t/how-to-make-the-discover-tab-data-to-table-view/257001 "2020-12-03T16:14:43Z")

</div>

Hi, Right now the default looks of the discover mode is not in table view, just wondering is there a setting to change the documents show in a table view, instead of document per document ?

---

## [Logstash Input Plugin Development with File Input Plugin](https://discuss.elastic.co/t/logstash-input-plugin-development-with-file-input-plugin/257486)

<div class="topic-metadata">

**Author:** [@rknd](https://discuss.elastic.co/u/rknd)\
**Replies:** 1\
**Last updated:** [December 3, 2020, 4:07pm UTC](https://discuss.elastic.co/t/logstash-input-plugin-development-with-file-input-plugin/257486 "2020-12-03T16:07:20Z")

</div>

Hello, I would like to ask, if its possible to pass file input plugin output in a new\_input\_plugin. I mean like output of the file input plugin, will be the input of another input plugin. As an example, Read logs from…

---

## [How to create visualisation in kibana for stickiness(Ratio of DAU/MAU)](https://discuss.elastic.co/t/how-to-create-visualisation-in-kibana-for-stickiness-ratio-of-dau-mau/257340)

<div class="topic-metadata">

**Author:** [@dharanesh](https://discuss.elastic.co/u/dharanesh)\
**Replies:** 3\
**Last updated:** [December 3, 2020, 3:59pm UTC](https://discuss.elastic.co/t/how-to-create-visualisation-in-kibana-for-stickiness-ratio-of-dau-mau/257340 "2020-12-03T15:59:34Z")

</div>

Hi, i am new to kibana, i created separate visualisation for DAU and MAU now i want to create another chats which shows Ratio of DAU and MAU, how to do this in kibana , is it possible to create charts for this in kibana. …

---

## [Kibana preserve custom time from dasboard to Discover](https://discuss.elastic.co/t/kibana-preserve-custom-time-from-dasboard-to-discover/257284)

<div class="topic-metadata">

**Author:** [@Rnx](https://discuss.elastic.co/u/Rnx)\
**Replies:** 1\
**Last updated:** [December 3, 2020, 3:55pm UTC](https://discuss.elastic.co/t/kibana-preserve-custom-time-from-dasboard-to-discover/257284 "2020-12-03T15:55:28Z")

</div>

How to preserve chosen time in Kibana Dashboard by clicking on link to Discover panel? I need to view documents from specific time according to peaks in graphs in Dashboard. Therefore my chosen time is within 3-4 min ti…

---

## [Logstah reading from elastic daily based index name](https://discuss.elastic.co/t/logstah-reading-from-elastic-daily-based-index-name/257278)

<div class="topic-metadata">

**Author:** [@lecko](https://discuss.elastic.co/u/lecko)\
**Replies:** 4\
**Last updated:** [December 3, 2020, 3:45pm UTC](https://discuss.elastic.co/t/logstah-reading-from-elastic-daily-based-index-name/257278 "2020-12-03T15:45:47Z")

</div>

Hello, I am new to logstash.I I want to get data out of elasticsearch and filter it and send it to some third party sw. With help of examples and docs the first draft seems to work. But the elasticsearch index name i…

---

## [Kibana requesting too many doc values](https://discuss.elastic.co/t/kibana-requesting-too-many-doc-values/147760)

<div class="topic-metadata">

**Author:** [@mightyguava](https://discuss.elastic.co/u/mightyguava)\
**Replies:** 4\
**Last updated:** [December 3, 2020, 3:40pm UTC](https://discuss.elastic.co/t/kibana-requesting-too-many-doc-values/147760 "2020-12-03T15:40:07Z")

</div>

We have an elasticsearch cluster that indexes some events that flow through our system for debugging use. These events have pretty widely varying formats, so they end up generating a lot of different fields. Kibana maps …

---

## [Logstash with multiple input and output](https://discuss.elastic.co/t/logstash-with-multiple-input-and-output/257524)

<div class="topic-metadata">

**Author:** [@ck\_7](https://discuss.elastic.co/u/ck_7)\
**Replies:** 4\
**Last updated:** [December 3, 2020, 3:18pm UTC](https://discuss.elastic.co/t/logstash-with-multiple-input-and-output/257524 "2020-12-03T15:18:56Z")

</div>

Help me to understand the below logstash config. Trying to configure multiples input and output but index shows only one. Here my config: There is no Error: logstash runs but no index name for the storage. only network…

---

## [Is it possible to combine two datatable from multiple essql filters](https://discuss.elastic.co/t/is-it-possible-to-combine-two-datatable-from-multiple-essql-filters/257290)

<div class="topic-metadata">

**Author:** [@tangkalo](https://discuss.elastic.co/u/tangkalo)\
**Replies:** 3\
**Last updated:** [December 3, 2020, 3:23pm UTC](https://discuss.elastic.co/t/is-it-possible-to-combine-two-datatable-from-multiple-essql-filters/257290 "2020-12-03T15:23:32Z")

</div>

Hi, I have a data source like below: - TYPE VALUE A 123 A 234 B 890 A 789 B 085 I need to pull the latest record for each type i.e. there will be two rows in the resu…

---

## [Kibana plugin limitations/constraints](https://discuss.elastic.co/t/kibana-plugin-limitations-constraints/257508)

<div class="topic-metadata">

**Author:** [@jnc943](https://discuss.elastic.co/u/jnc943)\
**Replies:** 1\
**Last updated:** [December 3, 2020, 2:55pm UTC](https://discuss.elastic.co/t/kibana-plugin-limitations-constraints/257508 "2020-12-03T14:55:23Z")

</div>

I am having difficulty understanding or finding information that document what limitations if any, kibana plugins are subject to. For instance, what capabilities an external kibana plugin would be lacking, or what kind …

---

## [Error creating input: Can only start an input when all related states are finished](https://discuss.elastic.co/t/error-creating-input-can-only-start-an-input-when-all-related-states-are-finished/257527)

<div class="topic-metadata">

**Author:** [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\
**Replies:** 0\
**Last updated:** [December 3, 2020, 2:54pm UTC](https://discuss.elastic.co/t/error-creating-input-can-only-start-an-input-when-all-related-states-are-finished/257527 "2020-12-03T14:54:49Z")

</div>

I am using Filebeat 7.10 to send elasticsearch audit file to my cluster and I am having this error: Error creating input: Can only start an input when all related states are finished in filebeat.yml I disabled all the …

---

## [Batch transform done indicator](https://discuss.elastic.co/t/batch-transform-done-indicator/257345)

<div class="topic-metadata">

**Author:** [@kaijun](https://discuss.elastic.co/u/kaijun)\
**Replies:** 3\
**Last updated:** [December 3, 2020, 2:30pm UTC](https://discuss.elastic.co/t/batch-transform-done-indicator/257345 "2020-12-03T14:30:32Z")

</div>

I am performing a batch transform on my ES index (only transforming for once and not a continuous job). Is there an API or indicator that returns a response once the transformation is done (so that I could then stop the …

---

## [Receive Authorization Header Logstash Http Input Plugin](https://discuss.elastic.co/t/receive-authorization-header-logstash-http-input-plugin/257407)

<div class="topic-metadata">

**Author:** [@sai\_kiran1](https://discuss.elastic.co/u/sai_kiran1)\
**Replies:** 4\
**Last updated:** [December 3, 2020, 2:18pm UTC](https://discuss.elastic.co/t/receive-authorization-header-logstash-http-input-plugin/257407 "2020-12-03T14:18:43Z")

</div>

Hi, I am using the HTTP input plugin to receive data from the postman with Basic Auth enabled, "Authorization" header is available in the postman response but when I print the data in logstash I don't see the Authorizat…

---

## [How to use context.panel.filters for drill down dashboard](https://discuss.elastic.co/t/how-to-use-context-panel-filters-for-drill-down-dashboard/256611)

<div class="topic-metadata">

**Author:** [@Atul\_Gunjal](https://discuss.elastic.co/u/Atul_Gunjal)\
**Replies:** 2\
**Last updated:** [December 3, 2020, 2:13pm UTC](https://discuss.elastic.co/t/how-to-use-context-panel-filters-for-drill-down-dashboard/256611 "2020-12-03T14:13:28Z")

</div>

How to use context.panel.filters for drill-down dashboard from one to another so that filters applied in the first dashboard will be applied in second and dashboard will be opened in new tab using Url drill-down.

---

## [Get the difference between different format of datetime](https://discuss.elastic.co/t/get-the-difference-between-different-format-of-datetime/257325)

<div class="topic-metadata">

**Author:** [@Izek\_Chen](https://discuss.elastic.co/u/Izek_Chen)\
**Replies:** 1\
**Last updated:** [December 3, 2020, 2:10pm UTC](https://discuss.elastic.co/t/get-the-difference-between-different-format-of-datetime/257325 "2020-12-03T14:10:41Z")

</div>

I have data with two date field like this "@buildTimestamp": "2020-12-01T18:55:34.895-0800", "@timestamp": "2020-12-02T03:02:16.723Z" I'd like to use ingest pipeline script processor to get the difference. How can I…

---

## [Search without field name](https://discuss.elastic.co/t/search-without-field-name/257495)

<div class="topic-metadata">

**Author:** [@buzzdeee](https://discuss.elastic.co/u/buzzdeee)\
**Replies:** 4\
**Last updated:** [December 3, 2020, 1:57pm UTC](https://discuss.elastic.co/t/search-without-field-name/257495 "2020-12-03T13:57:54Z")

</div>

Hi, I'm with Kibana 7.10, and in discover, I try to just search without the field name. It seems to me for some fields, this works, for others, not. For example, I have a string field fields.log\_type: "log-type" In Ki…

---

## [Logstash: error when use date filter](https://discuss.elastic.co/t/logstash-error-when-use-date-filter/257517)

<div class="topic-metadata">

**Author:** [@raistlin2912](https://discuss.elastic.co/u/raistlin2912)\
**Replies:** 1\
**Last updated:** [December 3, 2020, 1:46pm UTC](https://discuss.elastic.co/t/logstash-error-when-use-date-filter/257517 "2020-12-03T13:46:01Z")

</div>

Hi, I'm setting up an ELK Stack to process some logs that are sent to us from AKAMAI. An example line: 2020-11-18 14:58:27 2.17.200.11 - - - - GET /unaurl.es/N3X3QDOPYNHGPO5R6ZYCEOWCNM.png - 200 1 36513 848 1 80 HTTP/1…

---

## [Elasticsearch dead but subsys locked](https://discuss.elastic.co/t/elasticsearch-dead-but-subsys-locked/257066)

<div class="topic-metadata">

**Author:** [@ItsMee](https://discuss.elastic.co/u/ItsMee)\
**Replies:** 5\
**Last updated:** [December 3, 2020, 1:33pm UTC](https://discuss.elastic.co/t/elasticsearch-dead-but-subsys-locked/257066 "2020-12-03T13:33:22Z")

</div>

Dear All, I have tried to restart the elasticsearch but getting 'elasticsearch dead but subsys locked' after start. I have removed the lock the file(elasticsearch) under /var/lock/subsys/ multiple times but no luck. Co…

---

## [Data type of fields created in ingest pipeline with KV processor](https://discuss.elastic.co/t/data-type-of-fields-created-in-ingest-pipeline-with-kv-processor/257512)

<div class="topic-metadata">

**Author:** [@hermlam](https://discuss.elastic.co/u/hermlam)\
**Replies:** 0\
**Last updated:** [December 3, 2020, 1:21pm UTC](https://discuss.elastic.co/t/data-type-of-fields-created-in-ingest-pipeline-with-kv-processor/257512 "2020-12-03T13:21:06Z")

</div>

Hi, My Rasberry Pi’s are sending some information via a Syslog server to Elastic (with the Elastic Agent/Filebeat). The event looks like this: "Dec 3 14:00:01 PiMirror piinfo: gpu\_temp=50.1| cpu\_temp=49.1| model=4" I …

---

## [Need Help with kibana Plugin development](https://discuss.elastic.co/t/need-help-with-kibana-plugin-development/257454)

<div class="topic-metadata">

**Author:** [@vehere-ccu3](https://discuss.elastic.co/u/vehere-ccu3)\
**Replies:** 1\
**Last updated:** [December 3, 2020, 1:05pm UTC](https://discuss.elastic.co/t/need-help-with-kibana-plugin-development/257454 "2020-12-03T13:05:00Z")

</div>

Hi, I am using kibana 7.9.1 OSS as base and developing my custom app plugins, and I would be implementing a basic app level RBAC, by hiding the navlinks as per privileges stored in an index for each role/users. I need …

---

## [Kibana canvas datatable in multiple pages](https://discuss.elastic.co/t/kibana-canvas-datatable-in-multiple-pages/257483)

<div class="topic-metadata">

**Author:** [@Hugo\_Barbachano](https://discuss.elastic.co/u/Hugo_Barbachano)\
**Replies:** 2\
**Last updated:** [December 3, 2020, 12:54pm UTC](https://discuss.elastic.co/t/kibana-canvas-datatable-in-multiple-pages/257483 "2020-12-03T12:54:10Z")

</div>

Hello, Is there a way to display data tables in a canvas in such a way that each data table takes multiple pages if needed instead of having it displayed in a scrollbar view? I am asking this because my client needs pr…

---

## [How to relate elasticsearc event error to input log line?](https://discuss.elastic.co/t/how-to-relate-elasticsearc-event-error-to-input-log-line/257375)

<div class="topic-metadata">

**Author:** [@Bootta](https://discuss.elastic.co/u/Bootta)\
**Replies:** 2\
**Last updated:** [December 3, 2020, 12:54pm UTC](https://discuss.elastic.co/t/how-to-relate-elasticsearc-event-error-to-input-log-line/257375 "2020-12-03T12:54:06Z")

</div>

Is there any way that I can link Elasticsearch error with my input logline so I can fix it? I'm trying to fix Elasticsearch event errors from large log file(500MB), so testing line by line is impossible. Here is Eleasti…

---

## [Unable to login when disk is full](https://discuss.elastic.co/t/unable-to-login-when-disk-is-full/257314)

<div class="topic-metadata">

**Author:** [@hazcod](https://discuss.elastic.co/u/hazcod)\
**Replies:** 3\
**Last updated:** [December 3, 2020, 12:40pm UTC](https://discuss.elastic.co/t/unable-to-login-when-disk-is-full/257314 "2020-12-03T12:40:10Z")

</div>

Hi, I am unable to login into Kibana when my elasticsearch cluster is getting full. The log will contain: org.elasticsearch.xpack.monitoring.exporter.ExportException: CLusterBlockException: blocked by: \[TOO\_MANY\_REQUE…

---

## [Filebeat, ECS and fieds.\* namespace](https://discuss.elastic.co/t/filebeat-ecs-and-fieds-namespace/255062)

<div class="topic-metadata">

**Author:** [@A\_B](https://discuss.elastic.co/u/A_B)\
**Replies:** 2\
**Last updated:** [December 3, 2020, 12:05pm UTC](https://discuss.elastic.co/t/filebeat-ecs-and-fieds-namespace/255062 "2020-12-03T12:05:36Z")

</div>

Hello all, I'm looking for some suggestions for the following situation. Some context I'm trying to convince our developers to adopt ECS as their log format for container logs. We run our containers in Kubernetes and…

---

## [90k files amount - cleaning registry too slow?](https://discuss.elastic.co/t/90k-files-amount-cleaning-registry-too-slow/255573)

<div class="topic-metadata">

**Author:** [@Rnx](https://discuss.elastic.co/u/Rnx)\
**Replies:** 2\
**Last updated:** [December 3, 2020, 11:15am UTC](https://discuss.elastic.co/t/90k-files-amount-cleaning-registry-too-slow/255573 "2020-12-03T11:15:32Z")

</div>

Hi, It's bit frustrating to understand what is Filebeat doing during startup. My situation is, I needed to ingest about 90k files from fs, which were simple xml logs. It happend quite fast. No problems at all. Afterwar…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1662)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1664)
