# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1497

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1498

---

## [Filebeat -\> Logstash -\> ElasticSearch with multiple outputs](https://discuss.elastic.co/t/filebeat-logstash-elasticsearch-with-multiple-outputs/267598)

<div class="topic-metadata">

**Author:** [@Satyat500](https://discuss.elastic.co/u/Satyat500)\
**Replies:** 6\
**Last updated:** [March 22, 2021, 11:39am UTC](https://discuss.elastic.co/t/filebeat-logstash-elasticsearch-with-multiple-outputs/267598 "2021-03-22T11:39:01Z")

</div>

Hi team, I am trying to send output to two different index by taking two different inputs in tcp and beats. I am able to send logs to elasticsearch which are coming from filebeat but I am not able to send the logs to lo…

---

## [Question regarding TF/IDF implementation](https://discuss.elastic.co/t/question-regarding-tf-idf-implementation/267933)

<div class="topic-metadata">

**Author:** [@Yaron\_Golan](https://discuss.elastic.co/u/Yaron_Golan)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 11:25am UTC](https://discuss.elastic.co/t/question-regarding-tf-idf-implementation/267933 "2021-03-22T11:25:44Z")

</div>

We have been using an older Elastic version (1.4) for a while and have recently upgraded but wish to continue using the TF/IDF scoring algorithm. In https://www.elastic.co/guide/en/elasticsearch/reference/current/index-…

---

## [NullPointerException in LongComparator.setTopValue](https://discuss.elastic.co/t/nullpointerexception-in-longcomparator-settopvalue/267972)

<div class="topic-metadata">

**Author:** [@mgrafl](https://discuss.elastic.co/u/mgrafl)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 11:17am UTC](https://discuss.elastic.co/t/nullpointerexception-in-longcomparator-settopvalue/267972 "2021-03-22T11:17:45Z")

</div>

Hi all, I get a NullPointerException using Elasticsearch 7.9.1 with Lucene Core 8.6.2 on CentOS 7: "stacktrace": \["org.elasticsearch.action.search.SearchPhaseExecutionException: all shards failed", "at org.…

---

## [Kibana migration 7.10.2 to 7.11.2 Fleet upgrade issues](https://discuss.elastic.co/t/kibana-migration-7-10-2-to-7-11-2-fleet-upgrade-issues/267703)

<div class="topic-metadata">

**Author:** [@PublicName](https://discuss.elastic.co/u/PublicName)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 11:15am UTC](https://discuss.elastic.co/t/kibana-migration-7-10-2-to-7-11-2-fleet-upgrade-issues/267703 "2021-03-22T11:15:14Z")

</div>

Has anyone found a way to upgrade Kibana from 7.10.2 to 7.11.x with Fleet running and activate agents. I have 400ish agents entering data with fleet "yes it's beta" and the upgrade can't finish. On another test cluster w…

---

## [Drawn lines disappear when zoom level less than 2.0](https://discuss.elastic.co/t/drawn-lines-disappear-when-zoom-level-less-than-2-0/267686)

<div class="topic-metadata">

**Author:** [@gohovd](https://discuss.elastic.co/u/gohovd)\
**Replies:** 2\
**Last updated:** [March 22, 2021, 11:10am UTC](https://discuss.elastic.co/t/drawn-lines-disappear-when-zoom-level-less-than-2-0/267686 "2021-03-22T11:10:15Z")

</div>

Hi all, Elasticsearch: v7.9.1 Kibana: v7.8.2 The title sums up it; I draw lines (linestring) between points (coordinates) on the map showing the path of various entities. When I adjust zoom to a level below 2.0 the li…

---

## [Highlight query behaviour in elastic search](https://discuss.elastic.co/t/highlight-query-behaviour-in-elastic-search/267961)

<div class="topic-metadata">

**Author:** [@Pushpak](https://discuss.elastic.co/u/Pushpak)\
**Replies:** 3\
**Last updated:** [March 22, 2021, 11:08am UTC](https://discuss.elastic.co/t/highlight-query-behaviour-in-elastic-search/267961 "2021-03-22T11:08:57Z")

</div>

Hi , My data is stored in below kind of json in elastic search { "number" : "0", "journal" : \[ { "no" : "1", "createdby" : "sanction", "typeofcomment" : "Normal", "comment" : …

---

## [How to overcome letter cropping issue in kibana](https://discuss.elastic.co/t/how-to-overcome-letter-cropping-issue-in-kibana/267969)

<div class="topic-metadata">

**Author:** [@Yashaswini](https://discuss.elastic.co/u/Yashaswini)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 11:03am UTC](https://discuss.elastic.co/t/how-to-overcome-letter-cropping-issue-in-kibana/267969 "2021-03-22T11:03:01Z")

</div>

---

## [Vega scatterplot with scripted field](https://discuss.elastic.co/t/vega-scatterplot-with-scripted-field/267613)

<div class="topic-metadata">

**Author:** [@Shalhevet](https://discuss.elastic.co/u/Shalhevet)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 10:48am UTC](https://discuss.elastic.co/t/vega-scatterplot-with-scripted-field/267613 "2021-03-22T10:48:39Z")

</div>

Hi, I am trying to use a scripted field ("RGBstring") for my visualization but it doesn't work. I can't find the reason. this is the script: { "$schema": "https://vega.github.io/schema/vega-lite/v2.json", "data…

---

## [Heatmap with time spans calculated out of documents](https://discuss.elastic.co/t/heatmap-with-time-spans-calculated-out-of-documents/266669)

<div class="topic-metadata">

**Author:** [@cop077](https://discuss.elastic.co/u/cop077)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 10:32am UTC](https://discuss.elastic.co/t/heatmap-with-time-spans-calculated-out-of-documents/266669 "2021-03-22T10:32:35Z")

</div>

Hi everyone. I have documents that look like this: { "resource":"xyz", "started\_at":"2020-01-01T10:00:00Z", "finished\_at":"2020-01-01T14:23:54Z" } What I want to do is creating a heatmap which uses the resource for…

---

## [Metric visualization with date range calculation](https://discuss.elastic.co/t/metric-visualization-with-date-range-calculation/267644)

<div class="topic-metadata">

**Author:** [@alytkowski](https://discuss.elastic.co/u/alytkowski)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 10:15am UTC](https://discuss.elastic.co/t/metric-visualization-with-date-range-calculation/267644 "2021-03-22T10:15:07Z")

</div>

I have a metric type data that I get every 10s from the EMS Server and one of the properties is: inbound message count. It's a total inbound message count for the EMS server. What I'd like to achieve is to create a metri…

---

## [Get error 'no such index \[pdf\_test\]' after use fscrawer to create index](https://discuss.elastic.co/t/get-error-no-such-index-pdf-test-after-use-fscrawer-to-create-index/267791)

<div class="topic-metadata">

**Author:** [@lxia](https://discuss.elastic.co/u/lxia)\
**Replies:** 7\
**Last updated:** [March 22, 2021, 10:06am UTC](https://discuss.elastic.co/t/get-error-no-such-index-pdf-test-after-use-fscrawer-to-create-index/267791 "2021-03-22T10:06:35Z")

</div>

FSCrawler verssion: 2.7 when I first run the command: bin\\fscrawler --config\_dir ./DS pdf\_test, it showed info: job \[pdf\_test\] does not exist Do you want to create it (Y/N)? Y Settings have been created in \[.\\DS\\pdf\_…

---

## [S3 input plugin](https://discuss.elastic.co/t/s3-input-plugin/267869)

<div class="topic-metadata">

**Author:** [@paano](https://discuss.elastic.co/u/paano)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 10:00am UTC](https://discuss.elastic.co/t/s3-input-plugin/267869 "2021-03-22T10:00:39Z")

</div>

Reading the S3 plugin https://www.elastic.co/guide/en/logstash/current/plugins-inputs-s3.html#plugins-inputs-s3 there is one line Each line from each file generates an event. Files ending in .gz are handled as gzip’ed f…

---

## [Query: Field A contains Field B\`s value](https://discuss.elastic.co/t/query-field-a-contains-field-b-s-value/267505)

<div class="topic-metadata">

**Author:** [@ksremo](https://discuss.elastic.co/u/ksremo)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 9:57am UTC](https://discuss.elastic.co/t/query-field-a-contains-field-b-s-value/267505 "2021-03-22T09:57:52Z")

</div>

Hello, i unsuccessfully try to query a document with his field a contains (not is equal) the value of field b. then negate this. can anybody help? here an example to clarify: fieldA:"test-MATCH", fieldB:"MATCH" -\> no…

---

## [Kibana - Timelion](https://discuss.elastic.co/t/kibana-timelion/267676)

<div class="topic-metadata">

**Author:** [@jaispirit](https://discuss.elastic.co/u/jaispirit)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 9:55am UTC](https://discuss.elastic.co/t/kibana-timelion/267676 "2021-03-22T09:55:33Z")

</div>

Hi there, I am using Kibana 7.11 (current) - Timelion. With following I get the NGINX Request Time of a bunch of servers: .es(index=filebeat\*, timefield=@timestamp, metric=max:nginx.request.request\_time).lines(fill=1,…

---

## [Combine 2 or more beats in one panel / visualization](https://discuss.elastic.co/t/combine-2-or-more-beats-in-one-panel-visualization/267596)

<div class="topic-metadata">

**Author:** [@alipujaistopo](https://discuss.elastic.co/u/alipujaistopo)\
**Replies:** 7\
**Last updated:** [March 22, 2021, 9:54am UTC](https://discuss.elastic.co/t/combine-2-or-more-beats-in-one-panel-visualization/267596 "2021-03-22T09:54:55Z")

</div>

i have 2 beats. filebeat and auditbeat, can i combine that 2 index in 1 panel visualization.

---

## [How can I filter from other index?](https://discuss.elastic.co/t/how-can-i-filter-from-other-index/266653)

<div class="topic-metadata">

**Author:** [@111450](https://discuss.elastic.co/u/111450)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 9:44am UTC](https://discuss.elastic.co/t/how-can-i-filter-from-other-index/266653 "2021-03-22T09:44:00Z")

</div>

Hello, I am new to kibana and have a question. I want to filter specific IDs when I aggregate cardinality. For example, there are \[1,2,3\](this is ID list) in Index A and \[1,2,4,4,5,6,7,7\] in Index B, I want the cardina…

---

## [Browser cache when delivering a custom kibana plugin](https://discuss.elastic.co/t/browser-cache-when-delivering-a-custom-kibana-plugin/267719)

<div class="topic-metadata">

**Author:** [@weand](https://discuss.elastic.co/u/weand)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 9:41am UTC](https://discuss.elastic.co/t/browser-cache-when-delivering-a-custom-kibana-plugin/267719 "2021-03-22T09:41:36Z")

</div>

Hi, this is about kibana and browser cache when delivering a custom kibana plugin regulary into production. we have a custom kibana plugin and integrated it into our CI/CD. when it comes to production, browser clients …

---

## [Facing problem during Logstash(version 7.8.0 and 7.8.1) installation on ubuntu](https://discuss.elastic.co/t/facing-problem-during-logstash-version-7-8-0-and-7-8-1-installation-on-ubuntu/267841)

<div class="topic-metadata">

**Author:** [@gaurav1989](https://discuss.elastic.co/u/gaurav1989)\
**Replies:** 2\
**Last updated:** [March 22, 2021, 9:41am UTC](https://discuss.elastic.co/t/facing-problem-during-logstash-version-7-8-0-and-7-8-1-installation-on-ubuntu/267841 "2021-03-22T09:41:17Z")

</div>

root@abc:~# apt install logstash=7.8.1 Reading package lists... Done Building dependency tree Reading state information... Done E: Version '7.8.1' for 'logstash' was not found root@abc:~# apt install logstash=7.8.0 …

---

## [Automatic deletion of indices older than 3 months in elastic search](https://discuss.elastic.co/t/automatic-deletion-of-indices-older-than-3-months-in-elastic-search/267957)

<div class="topic-metadata">

**Author:** [@Deepz](https://discuss.elastic.co/u/Deepz)\
**Replies:** 5\
**Last updated:** [March 22, 2021, 9:39am UTC](https://discuss.elastic.co/t/automatic-deletion-of-indices-older-than-3-months-in-elastic-search/267957 "2021-03-22T09:39:17Z")

</div>

Hi.. Could someone help me on how to automate the deletion the indices that are older than 3 months old. (Without curator)

---

## [Advice on self hosted elasticsearch architecture](https://discuss.elastic.co/t/advice-on-self-hosted-elasticsearch-architecture/267962)

<div class="topic-metadata">

**Author:** [@Norman\_Khine](https://discuss.elastic.co/u/Norman_Khine)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 9:36am UTC](https://discuss.elastic.co/t/advice-on-self-hosted-elasticsearch-architecture/267962 "2021-03-22T09:36:35Z")

</div>

Hello, We are looking to build a self hosted elasticsearch cluster either on AWS. I have been looking at infrastructure designs for HA ES setup and was wondering at what stage is it worth in migrating to self hosted so…

---

## [Filebeat setup fails to authenticate against Kibana](https://discuss.elastic.co/t/filebeat-setup-fails-to-authenticate-against-kibana/267800)

<div class="topic-metadata">

**Author:** [@sonoroot](https://discuss.elastic.co/u/sonoroot)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 9:32am UTC](https://discuss.elastic.co/t/filebeat-setup-fails-to-authenticate-against-kibana/267800 "2021-03-22T09:32:46Z")

</div>

Hello! I am setting up a PoC for ECK. Kibana is exposed as a Kubernetes Ingress (nginx-controller) on port 80, and I can successfully access via web browser (using the credentials elastic and the password dynamically c…

---

## [Dynamic time period in datatable visulisation](https://discuss.elastic.co/t/dynamic-time-period-in-datatable-visulisation/266968)

<div class="topic-metadata">

**Author:** [@anjilinga](https://discuss.elastic.co/u/anjilinga)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 9:32am UTC](https://discuss.elastic.co/t/dynamic-time-period-in-datatable-visulisation/266968 "2021-03-22T09:32:35Z")

</div>

Hi, How can the Datehistogram period can be configured dynamically. curently the histogram is configured as 1d. to see the data for 1 week, the data is displaying in multiple rows. is there any way to display the data…

---

## [Filebeat multiline concatenates all events that does not match the pattern](https://discuss.elastic.co/t/filebeat-multiline-concatenates-all-events-that-does-not-match-the-pattern/267779)

<div class="topic-metadata">

**Author:** [@seso](https://discuss.elastic.co/u/seso)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 9:28am UTC](https://discuss.elastic.co/t/filebeat-multiline-concatenates-all-events-that-does-not-match-the-pattern/267779 "2021-03-22T09:28:49Z")

</div>

I have the following multiline pattern to handle Java stack traces: multiline.type: pattern multiline.pattern: '^\\d{4}-\\d{2}-\\d{2}\\s\\d{2}:\\d{2}:\\d{2}.\\d{3}' multiline.negate: true multiline.match: after It works fin…

---

## [Geo\_point property](https://discuss.elastic.co/t/geo-point-property/267960)

<div class="topic-metadata">

**Author:** [@fabrizio](https://discuss.elastic.co/u/fabrizio)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 9:24am UTC](https://discuss.elastic.co/t/geo-point-property/267960 "2021-03-22T09:24:57Z")

</div>

Hi, I have an index like log-. The daily index is create by logstash every day. I want to include geo\_point attribute. It was quite easy to create a specific index (for example) log-2021-03-17 with location property se…

---

## [Snapshot\_missing\_exception when deleting multiple snapshots](https://discuss.elastic.co/t/snapshot-missing-exception-when-deleting-multiple-snapshots/266834)

<div class="topic-metadata">

**Author:** [@Norman\_Khine](https://discuss.elastic.co/u/Norman_Khine)\
**Replies:** 8\
**Last updated:** [March 22, 2021, 9:15am UTC](https://discuss.elastic.co/t/snapshot-missing-exception-when-deleting-multiple-snapshots/266834 "2021-03-22T09:15:40Z")

</div>

Hello, from the documentation, https://www.elastic.co/guide/en/elasticsearch/reference/current/delete-snapshots.html I am trying to delete multiple snapshots, but get an error: { "error" : { "root\_cause" : \[ …

---

## [Losing finishing lines of a terminating / crashing container](https://discuss.elastic.co/t/losing-finishing-lines-of-a-terminating-crashing-container/267763)

<div class="topic-metadata">

**Author:** [@AndD](https://discuss.elastic.co/u/AndD)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 9:14am UTC](https://discuss.elastic.co/t/losing-finishing-lines-of-a-terminating-crashing-container/267763 "2021-03-22T09:14:50Z")

</div>

Hello, We are trying to setup Elastic Cloud on Kubernetes 1.4, using Filebeat 7.11.1 to harvest logs of all containers running on our Kubernetes cluster. Since giving an annotation to all Pods we could potentially be i…

---

## [Documents are not getting inserted in ES6.2](https://discuss.elastic.co/t/documents-are-not-getting-inserted-in-es6-2/267806)

<div class="topic-metadata">

**Author:** [@rajat\_singh1](https://discuss.elastic.co/u/rajat_singh1)\
**Replies:** 0\
**Last updated:** [March 19, 2021, 11:48am UTC](https://discuss.elastic.co/t/documents-are-not-getting-inserted-in-es6-2/267806 "2021-03-19T11:48:22Z")

</div>

Hi, I'mm trying to insert documents in ES 6.2. My concern is when I'm inserting data into ES by mapping one of index and mentioning "index": false, Data is not getting populating. And same code is inserting data when …

---

## [Export option missing from Kibana Vizualizations](https://discuss.elastic.co/t/export-option-missing-from-kibana-vizualizations/267458)

<div class="topic-metadata">

**Author:** [@gyterpena](https://discuss.elastic.co/u/gyterpena)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 8:36am UTC](https://discuss.elastic.co/t/export-option-missing-from-kibana-vizualizations/267458 "2021-03-22T08:36:12Z")

</div>

Hello We upgraded our stack to 7.11.2 from 7.10.2 and export option on kibana visualizations is missing for new data table visualizations. I can still export from visualizations created on older versions. Is this expec…

---

## [How to add custom index descriptor mapping to added fields (Nest .net)](https://discuss.elastic.co/t/how-to-add-custom-index-descriptor-mapping-to-added-fields-nest-net/267958)

<div class="topic-metadata">

**Author:** [@Nicolas\_Rey](https://discuss.elastic.co/u/Nicolas_Rey)\
**Replies:** 0\
**Last updated:** [March 22, 2021, 8:24am UTC](https://discuss.elastic.co/t/how-to-add-custom-index-descriptor-mapping-to-added-fields-nest-net/267958 "2021-03-22T08:24:20Z")

</div>

Hi, I use a repository to deal with Elasticsearch CRUD operations. It works but I face a problem : when I add fields to an existing index I don't know how to apply custom Index Descriptor. It works with an AutoMap but …

---

## [Logstash jdbc stuck at \[Api Webserver\] agent - Successfully started Logstash API endpoint {:port=\>9600}](https://discuss.elastic.co/t/logstash-jdbc-stuck-at-api-webserver-agent-successfully-started-logstash-api-endpoint-port-9600/267954)

<div class="topic-metadata">

**Author:** [@Burhanudin](https://discuss.elastic.co/u/Burhanudin)\
**Replies:** 0\
**Last updated:** [March 22, 2021, 8:05am UTC](https://discuss.elastic.co/t/logstash-jdbc-stuck-at-api-webserver-agent-successfully-started-logstash-api-endpoint-port-9600/267954 "2021-03-22T08:05:06Z")

</div>

hi all, i got stuck at \[Api Webserver\] agent - Successfully started Logstash API endpoint {:port=\>9600} and nothing happen after this. could anyone help what's wrong with this? and actually before it's running normaly. …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1496)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1498)
