# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1244

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1245

---

## [Monitoring ingress pipelines](https://discuss.elastic.co/t/monitoring-ingress-pipelines/283823)

<div class="topic-metadata">

**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\
**Replies:** 1\
**Last updated:** [September 11, 2021, 5:03am UTC](https://discuss.elastic.co/t/monitoring-ingress-pipelines/283823 "2021-09-11T05:03:44Z")

</div>

version 7.14 I have just started trying to use an ingest pipeline on some indices produced by winlogbeats. There are two indices because there are two different versions of the agent. I have a very simple pipeline wit…

---

## [Use of wait\_until for deleteByQuery in java rest client](https://discuss.elastic.co/t/use-of-wait-until-for-deletebyquery-in-java-rest-client/283923)

<div class="topic-metadata">

**Author:** [@douglm](https://discuss.elastic.co/u/douglm)\
**Replies:** 7\
**Last updated:** [September 11, 2021, 3:26am UTC](https://discuss.elastic.co/t/use-of-wait-until-for-deletebyquery-in-java-rest-client/283923 "2021-09-11T03:26:50Z")

</div>

I have the following code for a deletion (ES 7.13): final DeleteByQueryRequest delQreq = new DeleteByQueryRequest(targetIndex); final ESQueryFilter esq = getFilters(null); final QueryBuilder qb…

---

## [Link to another dashboard](https://discuss.elastic.co/t/link-to-another-dashboard/281460)

<div class="topic-metadata">

**Author:** [@John\_Doe4](https://discuss.elastic.co/u/John_Doe4)\
**Replies:** 16\
**Last updated:** [September 11, 2021, 3:13am UTC](https://discuss.elastic.co/t/link-to-another-dashboard/281460 "2021-09-11T03:13:05Z")

</div>

Hi, I have some metrics that show a number of events on my dasboard. I would like to be able to click on the metric and it open up a dashboard where it gives me more information about the data instead of just the number…

---

## [Filebeat only reading new lines](https://discuss.elastic.co/t/filebeat-only-reading-new-lines/283858)

<div class="topic-metadata">

**Author:** [@rodri.gz](https://discuss.elastic.co/u/rodri.gz)\
**Replies:** 1\
**Last updated:** [September 11, 2021, 12:18am UTC](https://discuss.elastic.co/t/filebeat-only-reading-new-lines/283858 "2021-09-11T00:18:28Z")

</div>

Hi! my filebeat is reading only new lines and that's perfect but, how can i tell filebeat to read from the beggining of the file? Thank you

---

## [Filebeat v7.14.0 Error in Loading Pipeline](https://discuss.elastic.co/t/filebeat-v7-14-0-error-in-loading-pipeline/283407)

<div class="topic-metadata">

**Author:** [@Mary\_Cane\_Bandohan](https://discuss.elastic.co/u/Mary_Cane_Bandohan)\
**Replies:** 9\
**Last updated:** [September 11, 2021, 12:11am UTC](https://discuss.elastic.co/t/filebeat-v7-14-0-error-in-loading-pipeline/283407 "2021-09-11T00:11:58Z")

</div>

Can someone please help us troubleshoot the error we're having after installing Filebeat version 7.14.0 in our CentOS server? We have disabled ILM in the filebeat.yml file. Our Elasticsearch and Kibana versions are cur…

---

## [How do I fix "Invalid FieldReference" errors?](https://discuss.elastic.co/t/how-do-i-fix-invalid-fieldreference-errors/283912)

<div class="topic-metadata">

**Author:** [@mrled](https://discuss.elastic.co/u/mrled)\
**Replies:** 5\
**Last updated:** [September 10, 2021, 11:18pm UTC](https://discuss.elastic.co/t/how-do-i-fix-invalid-fieldreference-errors/283912 "2021-09-10T23:18:38Z")

</div>

Logstash is reporting errors like this every second or so: \[2021-09-10T19:09:56,647\]\[INFO \]\[org.logstash.beats.BeatsHandler\]\[main\]\[98ee7b7f6aa150efeb06cd1c765e51dc0b1e1cd81424a2538524f239b81fa590\] \[local: 10.0.3.241:504…

---

## [Reindex API and slightly different document counts](https://discuss.elastic.co/t/reindex-api-and-slightly-different-document-counts/283852)

<div class="topic-metadata">

**Author:** [@MattG1](https://discuss.elastic.co/u/MattG1)\
**Replies:** 1\
**Last updated:** [September 10, 2021, 11:00pm UTC](https://discuss.elastic.co/t/reindex-api-and-slightly-different-document-counts/283852 "2021-09-10T23:00:48Z")

</div>

Hello, I have recently created a new index via the reindex API. I am now running both indexes at the same time and indexing/deleting documents to both. I have noticed that the document counts between the two indexes are…

---

## [Saved Objects imported via Kibana API do not display](https://discuss.elastic.co/t/saved-objects-imported-via-kibana-api-do-not-display/283889)

<div class="topic-metadata">

**Author:** [@pheathers](https://discuss.elastic.co/u/pheathers)\
**Replies:** 5\
**Last updated:** [September 10, 2021, 9:29pm UTC](https://discuss.elastic.co/t/saved-objects-imported-via-kibana-api-do-not-display/283889 "2021-09-10T21:29:57Z")

</div>

I have been working to script the import of an index pattern with a fields. The import appears to run successfully, but when I try to display the imported index pattern under Kibana | Index Patterns, it fails to load. …

---

## [Count records form different fields on kibana](https://discuss.elastic.co/t/count-records-form-different-fields-on-kibana/283833)

<div class="topic-metadata">

**Author:** [@cris](https://discuss.elastic.co/u/cris)\
**Replies:** 2\
**Last updated:** [September 10, 2021, 8:55pm UTC](https://discuss.elastic.co/t/count-records-form-different-fields-on-kibana/283833 "2021-09-10T20:55:38Z")

</div>

Hi guys! I'm very new on kibana, I need your help I'm trying to do a pie chart with the count of keywords of different fields: I have like 7 fields that I post like a Json. Like this: { "England": { …

---

## [Is there a way to connect logstash to LinkedIn?](https://discuss.elastic.co/t/is-there-a-way-to-connect-logstash-to-linkedin/283915)

<div class="topic-metadata">

**Author:** [@jcarney](https://discuss.elastic.co/u/jcarney)\
**Replies:** 0\
**Last updated:** [September 10, 2021, 7:46pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-connect-logstash-to-linkedin/283915 "2021-09-10T19:46:14Z")

</div>

This is what I have found so far:

---

## [Logstash elasticsearch output plugin Document\_id and Upserts](https://discuss.elastic.co/t/logstash-elasticsearch-output-plugin-document-id-and-upserts/283909)

<div class="topic-metadata">

**Author:** [@pkward](https://discuss.elastic.co/u/pkward)\
**Replies:** 1\
**Last updated:** [September 10, 2021, 7:27pm UTC](https://discuss.elastic.co/t/logstash-elasticsearch-output-plugin-document-id-and-upserts/283909 "2021-09-10T19:27:51Z")

</div>

Question, does a customized document\_id require an upsert to update the document or can this be accomplished with just the document\_id? I've read that upserts are used if you want create a new document if the document d…

---

## [Office 365 module: data is not showing in dashboard and beat fails after 1 hour](https://discuss.elastic.co/t/office-365-module-data-is-not-showing-in-dashboard-and-beat-fails-after-1-hour/282709)

<div class="topic-metadata">

**Author:** [@jared.smith](https://discuss.elastic.co/u/jared.smith)\
**Replies:** 6\
**Last updated:** [September 10, 2021, 3:47am UTC](https://discuss.elastic.co/t/office-365-module-data-is-not-showing-in-dashboard-and-beat-fails-after-1-hour/282709 "2021-09-10T03:47:56Z")

</div>

After installing and configuring the Office 365 Module according to instructions here, I'm seeing a couple of issues. After running successfully for (exactly) 1 hour, the o365beat process on the Windows 10 machine fail…

---

## [Enabling TLS communication betweeb Kibana & Elasticsearch](https://discuss.elastic.co/t/enabling-tls-communication-betweeb-kibana-elasticsearch/283808)

<div class="topic-metadata">

**Author:** [@vee](https://discuss.elastic.co/u/vee)\
**Replies:** 1\
**Last updated:** [September 10, 2021, 6:10pm UTC](https://discuss.elastic.co/t/enabling-tls-communication-betweeb-kibana-elasticsearch/283808 "2021-09-10T18:10:55Z")

</div>

Hi - I'm trying to establish TLS communication between Kibana and ES clusters so that I could explore the Kibana alerting for anomaly detection in ML (since this is a pre-requisite for Kibana alerts). Existing setup: E…

---

## [Add normal field filter to nested field aggregation](https://discuss.elastic.co/t/add-normal-field-filter-to-nested-field-aggregation/283864)

<div class="topic-metadata">

**Author:** [@jiajun](https://discuss.elastic.co/u/jiajun)\
**Replies:** 0\
**Last updated:** [September 10, 2021, 11:01am UTC](https://discuss.elastic.co/t/add-normal-field-filter-to-nested-field-aggregation/283864 "2021-09-10T11:01:27Z")

</div>

I have document structure like below in ES: { customer\_id: 1, is\_member: true, purchases: \[ { pur\_id: 1, pur\_channel\_id: 1, pur\_amount: 100.00, pur\_date: '2021-08-01' }, { …

---

## [TSVB histogram and metric visualization doesnt match, when math operation is used](https://discuss.elastic.co/t/tsvb-histogram-and-metric-visualization-doesnt-match-when-math-operation-is-used/283819)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 1\
**Last updated:** [September 10, 2021, 4:06pm UTC](https://discuss.elastic.co/t/tsvb-histogram-and-metric-visualization-doesnt-match-when-math-operation-is-used/283819 "2021-09-10T16:06:01Z")

</div>

Hi, I got two visualizations with the same math aggregation one is an histogram and the other a metric visualization. but the value showed in the metric viz, doesnt match the max on the histogram. why this happe…

---

## [Kibana server is not ready yet (license: null)](https://discuss.elastic.co/t/kibana-server-is-not-ready-yet-license-null/283551)

<div class="topic-metadata">

**Author:** [@jceddy](https://discuss.elastic.co/u/jceddy)\
**Replies:** 7\
**Last updated:** [September 10, 2021, 3:39pm UTC](https://discuss.elastic.co/t/kibana-server-is-not-ready-yet-license-null/283551 "2021-09-10T15:39:44Z")

</div>

I am attempting to set up an Elasticsearch cluster consisting of three master-eligible nodes. elasticsearch.yml looks like this on all of the nodes: cluster.name: elkdev node.name: {machinename}.dev.company.local netwo…

---

## [How to compile Script box creating a scripted field to hyperlink values in data table](https://discuss.elastic.co/t/how-to-compile-script-box-creating-a-scripted-field-to-hyperlink-values-in-data-table/283885)

<div class="topic-metadata">

**Author:** [@giammihendrix](https://discuss.elastic.co/u/giammihendrix)\
**Replies:** 1\
**Last updated:** [September 10, 2021, 2:44pm UTC](https://discuss.elastic.co/t/how-to-compile-script-box-creating-a-scripted-field-to-hyperlink-values-in-data-table/283885 "2021-09-10T14:44:59Z")

</div>

Hi everyone, I'll try to make it brief. total noob never wrote any code whatsoever forced to use kibana by employer need to link a dashboard (filtering by the clicked value) to values in a data table when cli…

---

## [Logstash filter plugin](https://discuss.elastic.co/t/logstash-filter-plugin/283847)

<div class="topic-metadata">

**Author:** [@dorinand](https://discuss.elastic.co/u/dorinand)\
**Replies:** 1\
**Last updated:** [September 10, 2021, 2:12pm UTC](https://discuss.elastic.co/t/logstash-filter-plugin/283847 "2021-09-10T14:12:20Z")

</div>

I am using Logstash version 7.14.0. I would like to parse message to the top level of message. So this is my configuration: json { skip\_on\_invalid\_json =\> true source =\> "message" t…

---

## [Manipulating kibana url to display data in kibana](https://discuss.elastic.co/t/manipulating-kibana-url-to-display-data-in-kibana/283810)

<div class="topic-metadata">

**Author:** [@Shreesh\_Narayanan](https://discuss.elastic.co/u/Shreesh_Narayanan)\
**Replies:** 1\
**Last updated:** [September 10, 2021, 2:01pm UTC](https://discuss.elastic.co/t/manipulating-kibana-url-to-display-data-in-kibana/283810 "2021-09-10T14:01:19Z")

</div>

Hello, I'm working on a project that utilizes kibana , we have users that would be parsing logs at different times of different machines. I wanted to know if there's an efficient way to know that a data viz belongs to…

---

## [Error restoring state from URL when Opening Dashboard in a new tab](https://discuss.elastic.co/t/error-restoring-state-from-url-when-opening-dashboard-in-a-new-tab/283812)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 1\
**Last updated:** [September 10, 2021, 1:24pm UTC](https://discuss.elastic.co/t/error-restoring-state-from-url-when-opening-dashboard-in-a-new-tab/283812 "2021-09-10T13:24:00Z")

</div>

Hello, Since I updated to 7.14.1, i often get an error "Error restoring state from URL" when Opening Dashboard in a new tab. Go to Dashboards, right-click one and select "Open link in a new tab" Is this a known issu…

---

## [Multi tenancy drawbacks](https://discuss.elastic.co/t/multi-tenancy-drawbacks/283766)

<div class="topic-metadata">

**Author:** [@BentoumiTech](https://discuss.elastic.co/u/BentoumiTech)\
**Replies:** 2\
**Last updated:** [September 10, 2021, 1:12pm UTC](https://discuss.elastic.co/t/multi-tenancy-drawbacks/283766 "2021-09-10T13:12:02Z")

</div>

Hello, I'm currently using ElasticSearch and storing all the data in one index for all my users. The data sent by each user is by nature different for each user which makes my index fields number growing rapidly and ex…

---

## [\[rally\] Could not connect to your Elasticsearch metrics store](https://discuss.elastic.co/t/rally-could-not-connect-to-your-elasticsearch-metrics-store/283762)

<div class="topic-metadata">

**Author:** [@marone](https://discuss.elastic.co/u/marone)\
**Replies:** 8\
**Last updated:** [September 10, 2021, 12:43pm UTC](https://discuss.elastic.co/t/rally-could-not-connect-to-your-elasticsearch-metrics-store/283762 "2021-09-10T12:43:39Z")

</div>

In long: Hey, I am trying to do a benchmark test against a cluster. The cluster in question contains 3 nodes in virtualbox, with no ssl restriction or authentication (fully for test). Then I have another cluster hosted …

---

## [\["error","savedobjects-service"\],"pid":1214,"message":"Unable to retrieve version information from Elasticsearch nodes. connect ECONNREFUSED 192.168.208.2:9200"}](https://discuss.elastic.co/t/error-savedobjects-service-pid-1214-message-unable-to-retrieve-version-information-from-elasticsearch-nodes-connect-econnrefused-192-168-208-2-9200/283867)

<div class="topic-metadata">

**Author:** [@LombardoAndrea195](https://discuss.elastic.co/u/LombardoAndrea195)\
**Replies:** 0\
**Last updated:** [September 10, 2021, 11:51am UTC](https://discuss.elastic.co/t/error-savedobjects-service-pid-1214-message-unable-to-retrieve-version-information-from-elasticsearch-nodes-connect-econnrefused-192-168-208-2-9200/283867 "2021-09-10T11:51:32Z")

</div>

Error in log: \["error","savedobjects-service"\],"pid":1214,"message":"Unable to retrieve version information from Elasticsearch nodes. connect ECONNREFUSED 192.168.208.2:9200"} {"type":"log","@timestamp":"2021-09-10T11:5…

---

## [Lerna output json](https://discuss.elastic.co/t/lerna-output-json/283854)

<div class="topic-metadata">

**Author:** [@cskiwi](https://discuss.elastic.co/u/cskiwi)\
**Replies:** 2\
**Last updated:** [September 10, 2021, 9:41am UTC](https://discuss.elastic.co/t/lerna-output-json/283854 "2021-09-10T09:41:11Z")

</div>

Hi, I'm trying to setup my logging, for my application, but this is running via lerna. Which means it outputs first the package name and then the log Which makes the output look like this: info cli using local versio…

---

## [Filebeat 7.9+ Registry Format](https://discuss.elastic.co/t/filebeat-7-9-registry-format/283843)

<div class="topic-metadata">

**Author:** [@scott\_stash](https://discuss.elastic.co/u/scott_stash)\
**Replies:** 2\
**Last updated:** [September 10, 2021, 11:23am UTC](https://discuss.elastic.co/t/filebeat-7-9-registry-format/283843 "2021-09-10T11:23:24Z")

</div>

I run a script that checks the status of processing by comparing the file offset in the registry log.json to the byte size on the OS. The offset is generally saved in two places: log.json -\> multiple lines /d/d/d/d/d/…

---

## [Kibana elasticsearch monitoring not showing indices](https://discuss.elastic.co/t/kibana-elasticsearch-monitoring-not-showing-indices/282718)

<div class="topic-metadata">

**Author:** [@Moadh](https://discuss.elastic.co/u/Moadh)\
**Replies:** 1\
**Last updated:** [September 10, 2021, 10:29am UTC](https://discuss.elastic.co/t/kibana-elasticsearch-monitoring-not-showing-indices/282718 "2021-09-10T10:29:13Z")

</div>

Hi, I have a Kibana instance (7.9.2) configured on a cluster dedicated to monitoring and logs data. I also have a second elasticsearch cluster for data on version 7.9.2 and all the monitoring and logs data are configur…

---

## [Make Data Table Field with URL Clickable](https://discuss.elastic.co/t/make-data-table-field-with-url-clickable/283861)

<div class="topic-metadata">

**Author:** [@Gosborne](https://discuss.elastic.co/u/Gosborne)\
**Replies:** 1\
**Last updated:** [September 10, 2021, 10:24am UTC](https://discuss.elastic.co/t/make-data-table-field-with-url-clickable/283861 "2021-09-10T10:24:00Z")

</div>

Good Morning, I have a field in my data that is a URL and I'm trying to get it so that in my Dashboard i can click on the URL field in a data table and have it go to that page. I have found some posts about formatting …

---

## [How to do source to "multi target" translate in logstash?](https://discuss.elastic.co/t/how-to-do-source-to-multi-target-translate-in-logstash/283623)

<div class="topic-metadata">

**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\
**Replies:** 2\
**Last updated:** [September 10, 2021, 10:23am UTC](https://discuss.elastic.co/t/how-to-do-source-to-multi-target-translate-in-logstash/283623 "2021-09-10T10:23:10Z")

</div>

We have got a CSV lookup as follows EmpID,EmpName,EmpSalary,EmpDepartment 1001,Bob,10000,XX 1002,Joe,20000,YY 1003,Foo,30000,ZZ and in Logstash, we need to translate the EmpID to both EmpName & EmpSalary at the same ti…

---

## [Logstash + Telegraf](https://discuss.elastic.co/t/logstash-telegraf/283860)

<div class="topic-metadata">

**Author:** [@hassen\_k](https://discuss.elastic.co/u/hassen_k)\
**Replies:** 0\
**Last updated:** [September 10, 2021, 10:10am UTC](https://discuss.elastic.co/t/logstash-telegraf/283860 "2021-09-10T10:10:23Z")

</div>

Hi, I use Logstash to read a Kafka topic and to send the events to Influxdb. The events in the Kafka topic are sent by Telegraf. Here are a example of events received from Kafka : { "message" =\> "disk,all\_serve…

---

## [Creating an array of values via ruby on logstash config](https://discuss.elastic.co/t/creating-an-array-of-values-via-ruby-on-logstash-config/283649)

<div class="topic-metadata">

**Author:** [@Shreesh\_Narayanan](https://discuss.elastic.co/u/Shreesh_Narayanan)\
**Replies:** 4\
**Last updated:** [September 10, 2021, 9:51am UTC](https://discuss.elastic.co/t/creating-an-array-of-values-via-ruby-on-logstash-config/283649 "2021-09-10T09:51:04Z")

</div>

Hello, Im trying to get the cpu core values in a single array on my logstash config . I'm not familiar with ruby code, however based on my very limited understanding i was able to do this . It has the cpu core values , …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1243)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1245)
