# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1921

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1922

---

## [Logstash memcached not returning value](https://discuss.elastic.co/t/logstash-memcached-not-returning-value/241649)

<div class="topic-metadata">

**Author:** [@WhensTheWeekend](https://discuss.elastic.co/u/WhensTheWeekend)\
**Replies:** 0\
**Last updated:** [July 17, 2020, 1:31pm UTC](https://discuss.elastic.co/t/logstash-memcached-not-returning-value/241649 "2020-07-17T13:31:41Z")

</div>

Hi, New to memcached and am using is as a filter in logstash as follows; memcached { id=\>"getconditionterminology" hosts =\> \["${memcacheserver}"\] namespace =\> "code\_concept" get =\> { "%{rsnstcode}" =\> "\[mm\_rsnstcod…

---

## [Metricbeat-7.2.0-windows-x86\_64 turn off with code exception in windows server 2016](https://discuss.elastic.co/t/metricbeat-7-2-0-windows-x86-64-turn-off-with-code-exception-in-windows-server-2016/239939)

<div class="topic-metadata">

**Author:** [@peter-wang-wsl](https://discuss.elastic.co/u/peter-wang-wsl)\
**Replies:** 2\
**Last updated:** [July 17, 2020, 1:27pm UTC](https://discuss.elastic.co/t/metricbeat-7-2-0-windows-x86-64-turn-off-with-code-exception-in-windows-server-2016/239939 "2020-07-17T13:27:43Z")

</div>

I run metricbeat with admin privilage, after a few hours metric beat turn off with code exception. Please help figrue out the problem, thanks a lot. For the limit I can not post all debug log 2020-07-04T18:31:48.591+08…

---

## [Elasticsearch Ingest Pipeline + index for language identification and text analysis](https://discuss.elastic.co/t/elasticsearch-ingest-pipeline-index-for-language-identification-and-text-analysis/241646)

<div class="topic-metadata">

**Author:** [@yolo](https://discuss.elastic.co/u/yolo)\
**Replies:** 0\
**Last updated:** [July 17, 2020, 1:17pm UTC](https://discuss.elastic.co/t/elasticsearch-ingest-pipeline-index-for-language-identification-and-text-analysis/241646 "2020-07-17T13:17:55Z")

</div>

Hi, i am using elasticsearch ingest pipeline for language identification. Furthermore, i would like to apply to each language-field a language analyzer. To my knowledge there is no ingest pipeline for langauge analyzers…

---

## [Not able to create graphs with new data available (with new data type) in same index pattern](https://discuss.elastic.co/t/not-able-to-create-graphs-with-new-data-available-with-new-data-type-in-same-index-pattern/236700)

<div class="topic-metadata">

**Author:** [@Kartikey\_Bhatore](https://discuss.elastic.co/u/Kartikey_Bhatore)\
**Replies:** 3\
**Last updated:** [July 17, 2020, 1:26pm UTC](https://discuss.elastic.co/t/not-able-to-create-graphs-with-new-data-available-with-new-data-type-in-same-index-pattern/236700 "2020-07-17T13:26:16Z")

</div>

I am using ELK v6.5.3 oss I had some data in a index say abc-xyz-2020.06.05 (its a daily index) in the above index data type of some fields were wrong. I have changed the data type in logstash and ingested data in tod…

---

## [Filebeat is not processing the logs which suppose to be sending to LogStash hosted in same Machine](https://discuss.elastic.co/t/filebeat-is-not-processing-the-logs-which-suppose-to-be-sending-to-logstash-hosted-in-same-machine/241637)

<div class="topic-metadata">

**Author:** [@ramkumar.J](https://discuss.elastic.co/u/ramkumar.J)\
**Replies:** 5\
**Last updated:** [July 17, 2020, 1:05pm UTC](https://discuss.elastic.co/t/filebeat-is-not-processing-the-logs-which-suppose-to-be-sending-to-logstash-hosted-in-same-machine/241637 "2020-07-17T13:05:10Z")

</div>

My filebeat configuration has been working fine. But it suddenly stopped working now. I am confirming this by seeing the filebeat logs, there is no harvester logs. But I used to see the harvester logs before. When i r…

---

## [Cannot receive logs from Filebeat in Logstash, SSL Problem](https://discuss.elastic.co/t/cannot-receive-logs-from-filebeat-in-logstash-ssl-problem/241496)

<div class="topic-metadata">

**Author:** [@ngerpiel](https://discuss.elastic.co/u/ngerpiel)\
**Replies:** 2\
**Last updated:** [July 17, 2020, 12:35pm UTC](https://discuss.elastic.co/t/cannot-receive-logs-from-filebeat-in-logstash-ssl-problem/241496 "2020-07-17T12:35:31Z")

</div>

I have a problem with sending logs from filebeat to logstash node using ssl certificates. The error I get is this: javax.net.ssl.SSLHandshakeException: error:10000412:SSL routines:OPENSSL\_internal:SSLV3\_ALERT\_BAD\_CERTI…

---

## [How to parse haproxy logs using logstash and filebeat](https://discuss.elastic.co/t/how-to-parse-haproxy-logs-using-logstash-and-filebeat/241487)

<div class="topic-metadata">

**Author:** [@Kay\_Khan](https://discuss.elastic.co/u/Kay_Khan)\
**Replies:** 1\
**Last updated:** [July 17, 2020, 12:23pm UTC](https://discuss.elastic.co/t/how-to-parse-haproxy-logs-using-logstash-and-filebeat/241487 "2020-07-17T12:23:47Z")

</div>

I have setup logstash and filebeat on my ECK stack so in kibana/elasticsearch i can view logs from kubernetes. I followed this article to set this up https://medium.com/@raphaeldelio/deploy-logstash-and-filebeat-on-kuber…

---

## [Have logstash automatically parse any .json files](https://discuss.elastic.co/t/have-logstash-automatically-parse-any-json-files/241610)

<div class="topic-metadata">

**Author:** [@elk6](https://discuss.elastic.co/u/elk6)\
**Replies:** 6\
**Last updated:** [July 17, 2020, 11:55am UTC](https://discuss.elastic.co/t/have-logstash-automatically-parse-any-json-files/241610 "2020-07-17T11:55:54Z")

</div>

I'm planning on shipping lots of logs into logstash. Is it possible to configure logstash in such a way so that only if a file ends with .json it would go through: json { source =\> "message" } Thanks ahea…

---

## [Kibana 7.8: modifying the dashboard\_grid.js file for our customization is not reflecting in dashboard\_plugin.js file](https://discuss.elastic.co/t/kibana-7-8-modifying-the-dashboard-grid-js-file-for-our-customization-is-not-reflecting-in-dashboard-plugin-js-file/241413)

<div class="topic-metadata">

**Author:** [@Prathibha\_Y](https://discuss.elastic.co/u/Prathibha_Y)\
**Replies:** 4\
**Last updated:** [July 17, 2020, 11:48am UTC](https://discuss.elastic.co/t/kibana-7-8-modifying-the-dashboard-grid-js-file-for-our-customization-is-not-reflecting-in-dashboard-plugin-js-file/241413 "2020-07-17T11:48:02Z")

</div>

Hi, I have custom modified the dashboard\_grid.js file for for 7.0, 7.6 and prev versions, and it used to get reflected in kibana.plugin.js/dashboard.plugin.js file, after removing the optimize directory completely and r…

---

## [Metricbeat Prometheus Collector Metricset](https://discuss.elastic.co/t/metricbeat-prometheus-collector-metricset/241614)

<div class="topic-metadata">

**Author:** [@RdrgPorto](https://discuss.elastic.co/u/RdrgPorto)\
**Replies:** 1\
**Last updated:** [July 17, 2020, 11:47am UTC](https://discuss.elastic.co/t/metricbeat-prometheus-collector-metricset/241614 "2020-07-17T11:47:05Z")

</div>

Hi, everyone I have a doubt about feature Histograms and Types. I have been working with it in order to collect metrics of CoreDNS and Weave (Kubernetes Tools). I would like to use use\_types: true and rate\_counters: t…

---

## [Filebeat, Kibana and ElasticSearch are configured, but not reading log files](https://discuss.elastic.co/t/filebeat-kibana-and-elasticsearch-are-configured-but-not-reading-log-files/241344)

<div class="topic-metadata">

**Author:** [@byc-art](https://discuss.elastic.co/u/byc-art)\
**Replies:** 5\
**Last updated:** [July 17, 2020, 11:30am UTC](https://discuss.elastic.co/t/filebeat-kibana-and-elasticsearch-are-configured-but-not-reading-log-files/241344 "2020-07-17T11:30:08Z")

</div>

Hi there, I'm setting up filebeats to read log files from Ubuntu machine and send them to ElasticSearch/ Kibana. I made a few changes to .yml settings after reading through previous posts https://github.com/elastic/beat…

---

## [Kibana - Embedding dashboard in website with dynamic filter param](https://discuss.elastic.co/t/kibana-embedding-dashboard-in-website-with-dynamic-filter-param/241518)

<div class="topic-metadata">

**Author:** [@chezhian](https://discuss.elastic.co/u/chezhian)\
**Replies:** 1\
**Last updated:** [July 17, 2020, 11:13am UTC](https://discuss.elastic.co/t/kibana-embedding-dashboard-in-website-with-dynamic-filter-param/241518 "2020-07-17T11:13:54Z")

</div>

Hi I have the same needs as this blog some years back . I want to embbed dashboard on my website: i need to know how to pass URL filters dynamically so i can show each customer only their dashboard data based in cust…

---

## [How to generate certs for Filebeats with elasticsearch-certutil?](https://discuss.elastic.co/t/how-to-generate-certs-for-filebeats-with-elasticsearch-certutil/241618)

<div class="topic-metadata">

**Author:** [@d.silwon](https://discuss.elastic.co/u/d.silwon)\
**Replies:** 2\
**Last updated:** [July 17, 2020, 10:48am UTC](https://discuss.elastic.co/t/how-to-generate-certs-for-filebeats-with-elasticsearch-certutil/241618 "2020-07-17T10:48:42Z")

</div>

Dears, I would like to generate the certs for filebeats service and when I try to do this: /usr/share/elasticsearch/bin/elasticsearch-certutil cert --ca /etc/elasticsearch/certs/ca.crt I've got error message: Enter p…

---

## [Will metricbeat send redundant metrics if deploy to each elasticsearch node](https://discuss.elastic.co/t/will-metricbeat-send-redundant-metrics-if-deploy-to-each-elasticsearch-node/241627)

<div class="topic-metadata">

**Author:** [@CHU\_XU](https://discuss.elastic.co/u/CHU_XU)\
**Replies:** 1\
**Last updated:** [July 17, 2020, 10:09am UTC](https://discuss.elastic.co/t/will-metricbeat-send-redundant-metrics-if-deploy-to-each-elasticsearch-node/241627 "2020-07-17T10:09:47Z")

</div>

Hi there, As described in the graphic metricbeat is deployed to each es node. For some cluster info like "status", will all these metricbeat get cluster status and send to endpoint? If I have a large es cluster, ther…

---

## [We use id to update or delete without routing. I can't find this document. Is there a way to broadcast this operation without routing to all shards?](https://discuss.elastic.co/t/we-use-id-to-update-or-delete-without-routing-i-cant-find-this-document-is-there-a-way-to-broadcast-this-operation-without-routing-to-all-shards/241599)

<div class="topic-metadata">

**Author:** [@Liyes](https://discuss.elastic.co/u/Liyes)\
**Replies:** 11\
**Last updated:** [July 17, 2020, 10:09am UTC](https://discuss.elastic.co/t/we-use-id-to-update-or-delete-without-routing-i-cant-find-this-document-is-there-a-way-to-broadcast-this-operation-without-routing-to-all-shards/241599 "2020-07-17T10:09:08Z")

</div>

Our index has 3 primary shards. Previously, id was used for routing by default. Now we need to change to use another field as routing, and create a docuemnt based on this routing, but when we do update or delete operati…

---

## [Best Cluster Concept, Timeseries Data and more](https://discuss.elastic.co/t/best-cluster-concept-timeseries-data-and-more/241482)

<div class="topic-metadata">

**Author:** [@defalt](https://discuss.elastic.co/u/defalt)\
**Replies:** 4\
**Last updated:** [July 17, 2020, 10:07am UTC](https://discuss.elastic.co/t/best-cluster-concept-timeseries-data-and-more/241482 "2020-07-17T10:07:04Z")

</div>

Hi, I am currently developing some cluster concept and once again asking for your opinions and insight. We will need different clusters for different customers. I have some questions regarding my concepts and I hope you…

---

## [Filebeat is not processing the logs which suppose to be sending to LogStash hosted in same Machine](https://discuss.elastic.co/t/filebeat-is-not-processing-the-logs-which-suppose-to-be-sending-to-logstash-hosted-in-same-machine/241620)

<div class="topic-metadata">

**Author:** [@ramkumar.J](https://discuss.elastic.co/u/ramkumar.J)\
**Replies:** 0\
**Last updated:** [July 17, 2020, 9:10am UTC](https://discuss.elastic.co/t/filebeat-is-not-processing-the-logs-which-suppose-to-be-sending-to-logstash-hosted-in-same-machine/241620 "2020-07-17T09:10:53Z")

</div>

My filebeat configuration has been working fine. But it suddenly stopped working now. I am confirming this by seeing the filebeat logs, there is no harvester logs. But I used to see the harvester logs before. This is …

---

## [Kibana Markdown visualization](https://discuss.elastic.co/t/kibana-markdown-visualization/239340)

<div class="topic-metadata">

**Author:** [@ErwinEnableU](https://discuss.elastic.co/u/ErwinEnableU)\
**Replies:** 2\
**Last updated:** [July 17, 2020, 9:41am UTC](https://discuss.elastic.co/t/kibana-markdown-visualization/239340 "2020-07-17T09:41:55Z")

</div>

The dashboard we created is used by our customers. For layout and the look-and-feel we use several Markdown elements within this Kibana dashboard. I would like some guidance towards layout options for this Markdown visua…

---

## [Problem Loading packetbeat index from different instances](https://discuss.elastic.co/t/problem-loading-packetbeat-index-from-different-instances/241466)

<div class="topic-metadata">

**Author:** [@elkoussaimi\_ayoub](https://discuss.elastic.co/u/elkoussaimi_ayoub)\
**Replies:** 0\
**Last updated:** [July 16, 2020, 1:10pm UTC](https://discuss.elastic.co/t/problem-loading-packetbeat-index-from-different-instances/241466 "2020-07-16T13:10:40Z")

</div>

Hi Guys, For now, I successfully deploy the elk stack and I've loaded the packetbeat index for a machine that I've got on AWS ec2 service, but when I want to load the same index to elasticsearch, it gets replaced every …

---

## [Ingest Pipeline - Check if a field exists](https://discuss.elastic.co/t/ingest-pipeline-check-if-a-field-exists/238040)

<div class="topic-metadata">

**Author:** [@sean\_wills](https://discuss.elastic.co/u/sean_wills)\
**Replies:** 1\
**Last updated:** [July 17, 2020, 9:07am UTC](https://discuss.elastic.co/t/ingest-pipeline-check-if-a-field-exists/238040 "2020-07-17T09:07:48Z")

</div>

Hello, I'm trying to do something that seems like it should be relatively simple, but I haven't been able to track down the correct syntax the documentation. I have a basic ingest pipeline which I want to use to referen…

---

## [Run a subquery for each of the filtered documents](https://discuss.elastic.co/t/run-a-subquery-for-each-of-the-filtered-documents/237925)

<div class="topic-metadata">

**Author:** [@kamboh](https://discuss.elastic.co/u/kamboh)\
**Replies:** 1\
**Last updated:** [July 17, 2020, 8:50am UTC](https://discuss.elastic.co/t/run-a-subquery-for-each-of-the-filtered-documents/237925 "2020-07-17T08:50:50Z")

</div>

I have an index named employees with the following structure: { id: integer, name: text, age: integer, cityId: integer, resumeText: text \<--------- parsed resume text } I want to search employees with certain…

---

## [Trying to use filebeat postgresql conf.d to push logs to kibana](https://discuss.elastic.co/t/trying-to-use-filebeat-postgresql-conf-d-to-push-logs-to-kibana/240550)

<div class="topic-metadata">

**Author:** [@Andrew\_Freitas](https://discuss.elastic.co/u/Andrew_Freitas)\
**Replies:** 10\
**Last updated:** [July 17, 2020, 8:50am UTC](https://discuss.elastic.co/t/trying-to-use-filebeat-postgresql-conf-d-to-push-logs-to-kibana/240550 "2020-07-17T08:50:49Z")

</div>

Hey guys, I'm trying to configure filebeat output to logstash, the full pipeline is as follows: filebeat \> redis cache \> logstash \> elastic \> kibana Below is a screenshot of what I get in kibana About two logs com…

---

## [How to skip second row in log file while processing it through CSV filter](https://discuss.elastic.co/t/how-to-skip-second-row-in-log-file-while-processing-it-through-csv-filter/241314)

<div class="topic-metadata">

**Author:** [@Ashish\_kapoor](https://discuss.elastic.co/u/Ashish_kapoor)\
**Replies:** 4\
**Last updated:** [July 17, 2020, 8:49am UTC](https://discuss.elastic.co/t/how-to-skip-second-row-in-log-file-while-processing-it-through-csv-filter/241314 "2020-07-17T08:49:29Z")

</div>

Hi I want to skip second line in my logs while processing these logs with CSV filter. second line of my logs looks like this: #Remark Values: ComponentType="OAM" ReleaseVersion="11.1.1.9.0" and logstash conf for pro…

---

## [Graph without any aggregation in Kibana](https://discuss.elastic.co/t/graph-without-any-aggregation-in-kibana/241594)

<div class="topic-metadata">

**Author:** [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\
**Replies:** 4\
**Last updated:** [July 17, 2020, 8:47am UTC](https://discuss.elastic.co/t/graph-without-any-aggregation-in-kibana/241594 "2020-07-17T08:47:08Z")

</div>

I have graph without any aggregation and I want to show it in Kibana How can I do that? I’ve already tried to do that in Vega but it’s a static graph and it’s not advanced and I want the graph to show millions of point…

---

## [Errors after updating plugins in 6.8](https://discuss.elastic.co/t/errors-after-updating-plugins-in-6-8/241331)

<div class="topic-metadata">

**Author:** [@jong99](https://discuss.elastic.co/u/jong99)\
**Replies:** 1\
**Last updated:** [July 17, 2020, 8:40am UTC](https://discuss.elastic.co/t/errors-after-updating-plugins-in-6-8/241331 "2020-07-17T08:40:24Z")

</div>

I'm using Logstash 6.8 and am using some updated versions of plugins which have been updated with the command: logstash-plugin update logstash-filter-kv logstash-input-s3 logstash-filter-json This has worked fine for a…

---

## [Collecting from syslog data-lake](https://discuss.elastic.co/t/collecting-from-syslog-data-lake/241363)

<div class="topic-metadata">

**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\
**Replies:** 5\
**Last updated:** [July 17, 2020, 7:27am UTC](https://discuss.elastic.co/t/collecting-from-syslog-data-lake/241363 "2020-07-17T07:27:32Z")

</div>

hi we got a datalake from syslog datasets and the devices/endpoints are logging in format of /data/\<collect\_port\>/\<ip\_address\>/\<severity\>.\<facility\>.log eg /data/514/172.128.4.2/auth.info.log And within the datasets…

---

## [RabbitMq Metricbeat error in logs](https://discuss.elastic.co/t/rabbitmq-metricbeat-error-in-logs/241503)

<div class="topic-metadata">

**Author:** [@mdymel](https://discuss.elastic.co/u/mdymel)\
**Replies:** 1\
**Last updated:** [July 17, 2020, 7:14am UTC](https://discuss.elastic.co/t/rabbitmq-metricbeat-error-in-logs/241503 "2020-07-17T07:14:55Z")

</div>

With Metricbeat 7.8 and RabbitMq 3.8.1 I am getting errors in metricbeat.log: 2020-07-16T13:46:46.712+0200 ERROR \[rabbitmq.queue\] queue/data.go:97 error in mapping: error applying schema: 6 errors: key messages\_unacknow…

---

## [Problem with JSON file import into ElasticSearch](https://discuss.elastic.co/t/problem-with-json-file-import-into-elasticsearch/240871)

<div class="topic-metadata">

**Author:** [@siva4](https://discuss.elastic.co/u/siva4)\
**Replies:** 9\
**Last updated:** [July 17, 2020, 6:35am UTC](https://discuss.elastic.co/t/problem-with-json-file-import-into-elasticsearch/240871 "2020-07-17T06:35:59Z")

</div>

Exported data from Mongo and generated JSON file. Sample JSON File data (1 record): { "\_id": { "$oid": "5d84438f4514cb1f8a" }, "slug": "test-home-technology", "title": "test home technology", "subtitle": …

---

## [Space requirement for logstash and elasticsearch](https://discuss.elastic.co/t/space-requirement-for-logstash-and-elasticsearch/241587)

<div class="topic-metadata">

**Author:** [@falconpurple](https://discuss.elastic.co/u/falconpurple)\
**Replies:** 0\
**Last updated:** [July 17, 2020, 6:33am UTC](https://discuss.elastic.co/t/space-requirement-for-logstash-and-elasticsearch/241587 "2020-07-17T06:33:05Z")

</div>

Hi, I have to ELK stack . The filebeat collects log and then passes to kafka for buffering and then to logstash for analysis and filtering .The data is passes then to elasticsearch and displaying dashboards on kibana. …

---

## [Highlight does not work properly with ScriptScore, version 7.8](https://discuss.elastic.co/t/highlight-does-not-work-properly-with-scriptscore-version-7-8/241584)

<div class="topic-metadata">

**Author:** [@gurjit\_buck](https://discuss.elastic.co/u/gurjit_buck)\
**Replies:** 0\
**Last updated:** [July 17, 2020, 6:22am UTC](https://discuss.elastic.co/t/highlight-does-not-work-properly-with-scriptscore-version-7-8/241584 "2020-07-17T06:22:06Z")

</div>

Elasticsearch version (7.8): OS version (Windows 10): Along with ScriptScore function, Highlight function does not work properly. If we search two words only first word gets higlighted or last word doesn't display hig…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1920)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1922)
