# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1168 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1169 --- ## [ECK on GKE Ingress Health Checks not working](https://discuss.elastic.co/t/eck-on-gke-ingress-health-checks-not-working/288912)
**Author:** [@trudesea](https://discuss.elastic.co/u/trudesea)\ **Replies:** 0\ **Last updated:** [November 10, 2021, 4:03pm UTC](https://discuss.elastic.co/t/eck-on-gke-ingress-health-checks-not-working/288912 "2021-11-10T16:03:53Z")
Hi, So this is my first attempt in getting this working. I was able to get an ingress into Kibana just fine, but using the es-http service as the backend is showing unhealthy. I assume this is because of the path bein… --- ## [Convert duration ms to sec](https://discuss.elastic.co/t/convert-duration-ms-to-sec/288782)
**Author:** [@RickT](https://discuss.elastic.co/u/RickT)\ **Replies:** 3\ **Last updated:** [November 10, 2021, 3:24pm UTC](https://discuss.elastic.co/t/convert-duration-ms-to-sec/288782 "2021-11-10T15:24:25Z")
Today i'm searching how to convert a duration field from ms to sec into a line visualization. as i can't change the advanced params or create a scripted field, i'm trying with the "json input" field but i'm not sure it'… --- ## [Csv filter output splitting a row in two because of some special char](https://discuss.elastic.co/t/csv-filter-output-splitting-a-row-in-two-because-of-some-special-char/288710)
**Author:** [@stillfreem](https://discuss.elastic.co/u/stillfreem)\ **Replies:** 8\ **Last updated:** [November 10, 2021, 2:59pm UTC](https://discuss.elastic.co/t/csv-filter-output-splitting-a-row-in-two-because-of-some-special-char/288710 "2021-11-10T14:59:24Z")
I have a csv file with 7543 entries that I'd like to get to cloud SIEM. My config file is as follows input { file { … --- ## [Bar vertical percentage missing ranges](https://discuss.elastic.co/t/bar-vertical-percentage-missing-ranges/288660)
**Author:** [@adam3](https://discuss.elastic.co/u/adam3)\ **Replies:** 4\ **Last updated:** [November 10, 2021, 2:50pm UTC](https://discuss.elastic.co/t/bar-vertical-percentage-missing-ranges/288660 "2021-11-10T14:50:47Z")
I set up a bar vertical percentage graph with some ranges in it and sometimes the ranges are missing. If I add some filters to the top of my dash they start showing up. Is there a setting I can tweak so these graphs… --- ## ["bad\_certificate" error on elasticsearch input plugin](https://discuss.elastic.co/t/bad-certificate-error-on-elasticsearch-input-plugin/288812)
**Author:** [@plubbs](https://discuss.elastic.co/u/plubbs)\ **Replies:** 5\ **Last updated:** [November 10, 2021, 2:40pm UTC](https://discuss.elastic.co/t/bad-certificate-error-on-elasticsearch-input-plugin/288812 "2021-11-10T14:40:22Z")
Hello, TLDR - Our certificate we use with the output-Elasticsearch plugin does not work on the input-Elasticsearch plugin despite being a valid certificate We are currently attempting to connect to an existing index in… --- ## [Missing socket metrics in 'System' integration in Fleet](https://discuss.elastic.co/t/missing-socket-metrics-in-system-integration-in-fleet/288865)
**Author:** [@dabo](https://discuss.elastic.co/u/dabo)\ **Replies:** 2\ **Last updated:** [November 10, 2021, 2:13pm UTC](https://discuss.elastic.co/t/missing-socket-metrics-in-system-integration-in-fleet/288865 "2021-11-10T14:13:43Z")
Hi, Can see that there is System socket\_summary metrics setting in System Integration in Fleet. Are there any plans to add system socket metrics to System integration as well? We are on 7.13.1. Is this maybe added in … --- ## [What are the possibilities of a Kibana plugin?](https://discuss.elastic.co/t/what-are-the-possibilities-of-a-kibana-plugin/287445)
**Author:** [@Joel\_Hansell](https://discuss.elastic.co/u/Joel_Hansell)\ **Replies:** 6\ **Last updated:** [November 10, 2021, 2:11pm UTC](https://discuss.elastic.co/t/what-are-the-possibilities-of-a-kibana-plugin/287445 "2021-11-10T14:11:15Z")
Hi, The context is Kibana 7.10.1 but I imagine the answer would be quite generic. I have run through a lot of the plugin developer docs but I'm not seeing the kind of overview docs I'm looking for, so please bear with … --- ## [How to add new fields in ingest pipeline based on conditons?](https://discuss.elastic.co/t/how-to-add-new-fields-in-ingest-pipeline-based-on-conditons/288640)
**Author:** [@sidharth\_vijayakumar](https://discuss.elastic.co/u/sidharth_vijayakumar)\ **Replies:** 2\ **Last updated:** [November 10, 2021, 2:05pm UTC](https://discuss.elastic.co/t/how-to-add-new-fields-in-ingest-pipeline-based-on-conditons/288640 "2021-11-10T14:05:45Z")
Need to add a new field called app\_statuscode for in filebeat. The condition is that if message field contains 404 or 502 the value of app\_statuscode must be set to failed. If the Message field contains 200 OK then the … --- ## [Split a specific csv column into multiple fields](https://discuss.elastic.co/t/split-a-specific-csv-column-into-multiple-fields/288875)
**Author:** [@Greninja\_San](https://discuss.elastic.co/u/Greninja_San)\ **Replies:** 2\ **Last updated:** [November 10, 2021, 2:03pm UTC](https://discuss.elastic.co/t/split-a-specific-csv-column-into-multiple-fields/288875 "2021-11-10T14:03:33Z")
I have a csv file, with data like this : field1;field2;field3,field4\_1::field4\_2::field4\_3;field5;field6 The 4th field is composed of 3 values that I want to divide into 3 different fields in Elasticsearch. Is there a… --- ## [Maximum number of records per second in time series bar chart](https://discuss.elastic.co/t/maximum-number-of-records-per-second-in-time-series-bar-chart/288743)
**Author:** [@Bert\_Vanpeteghem](https://discuss.elastic.co/u/Bert_Vanpeteghem)\ **Replies:** 1\ **Last updated:** [November 10, 2021, 1:58pm UTC](https://discuss.elastic.co/t/maximum-number-of-records-per-second-in-time-series-bar-chart/288743 "2021-11-10T13:58:24Z")
Hi, how can i visualize the maximum number of records per second in a time series bar chart (that will choose interval automatically). So when the interval changes to eg hourly, I want to see the maximum number of recor… --- ## [Reset file offset once the harvester reaches end of file](https://discuss.elastic.co/t/reset-file-offset-once-the-harvester-reaches-end-of-file/288847)
**Author:** [@vasu01](https://discuss.elastic.co/u/vasu01)\ **Replies:** 1\ **Last updated:** [November 10, 2021, 1:46pm UTC](https://discuss.elastic.co/t/reset-file-offset-once-the-harvester-reaches-end-of-file/288847 "2021-11-10T13:46:11Z")
Is there a configuration property available in filebeat to start the harvester always from the beginning? The harvester should start from the beginning of the file irrespective of the update. We have specific logs (non-… --- ## [How to read the data displayed inside \[ERROR\]\[org.logstash.Logstash\]?](https://discuss.elastic.co/t/how-to-read-the-data-displayed-inside-error-org-logstash-logstash/288893)
**Author:** [@Robert\_Neagu](https://discuss.elastic.co/u/Robert_Neagu)\ **Replies:** 0\ **Last updated:** [November 10, 2021, 1:45pm UTC](https://discuss.elastic.co/t/how-to-read-the-data-displayed-inside-error-org-logstash-logstash/288893 "2021-11-10T13:45:30Z")
I want to read the data that is displayed inside the \[ERROR\]\[org.logstash.Logstash\] section inside the email plugin. --- ## [Prometheus via micrometer from spring](https://discuss.elastic.co/t/prometheus-via-micrometer-from-spring/288636)
**Author:** [@Ziemowit](https://discuss.elastic.co/u/Ziemowit)\ **Replies:** 1\ **Last updated:** [November 10, 2021, 1:23pm UTC](https://discuss.elastic.co/t/prometheus-via-micrometer-from-spring/288636 "2021-11-10T13:23:51Z")
I am exposing the memory metrics in Prometheus format from my spring application via micrometer. The response is following: # HELP jvm\_buffer\_count\_buffers An estimate of the number of buffers in the pool # TYPE jvm\_bu… --- ## [Suggest query does not work when used with script query?](https://discuss.elastic.co/t/suggest-query-does-not-work-when-used-with-script-query/288888)
**Author:** [@Ejaz\_Ahmed](https://discuss.elastic.co/u/Ejaz_Ahmed)\ **Replies:** 0\ **Last updated:** [November 10, 2021, 1:02pm UTC](https://discuss.elastic.co/t/suggest-query-does-not-work-when-used-with-script-query/288888 "2021-11-10T13:02:50Z")
Suggest query does not return anything when used with script \_score query {"\_source": {"excludes": \["tag", "document\_vector"\]}, "size": 1000, "query": { "script\_score": { "q… --- ## [Trying to rename all elements inside array](https://discuss.elastic.co/t/trying-to-rename-all-elements-inside-array/288884)
**Author:** [@Ankitkumar\_Ravidas](https://discuss.elastic.co/u/Ankitkumar_Ravidas)\ **Replies:** 1\ **Last updated:** [November 10, 2021, 12:36pm UTC](https://discuss.elastic.co/t/trying-to-rename-all-elements-inside-array/288884 "2021-11-10T12:36:23Z")
Hi team, i have tags array in my mongodb contacts collection, which contain mongodb ids, its store as "tags":\[{"$oid":"61822c908200c6b810bfee4d"},{"$oid":"61822c908200c6b810bfee4e"}\] i want to rename all element… --- ## [How cloud I build the filebeat image after change some code in beats/libbeat?](https://discuss.elastic.co/t/how-cloud-i-build-the-filebeat-image-after-change-some-code-in-beats-libbeat/288278)
**Author:** [@Icedroid](https://discuss.elastic.co/u/Icedroid)\ **Replies:** 6\ **Last updated:** [November 10, 2021, 12:29pm UTC](https://discuss.elastic.co/t/how-cloud-i-build-the-filebeat-image-after-change-some-code-in-beats-libbeat/288278 "2021-11-10T12:29:06Z")
I have add following code in the file beats/libbeat/kafka/config.go: if config.EnableIdempotent { k.Producer.Idempotent = true k.Net.MaxOpenRequests = 1 k.Producer.RequiredAcks = sarama.WaitForAll } Now I don't k… --- ## [High cardinality aggregation questions](https://discuss.elastic.co/t/high-cardinality-aggregation-questions/287169)
**Author:** [@galambo](https://discuss.elastic.co/u/galambo)\ **Replies:** 5\ **Last updated:** [November 10, 2021, 12:15pm UTC](https://discuss.elastic.co/t/high-cardinality-aggregation-questions/287169 "2021-11-10T12:15:55Z")
Hello, I'm currently working on a use case with an extremely high cardinality (couple of million combinations) and I'm having trouble understanding how ES behaves with aggregations. Here are sample documents: { … --- ## [ElasticSearch when I index there is like a limit in which It stops indexing and increments the number of docs.deleted](https://discuss.elastic.co/t/elasticsearch-when-i-index-there-is-like-a-limit-in-which-it-stops-indexing-and-increments-the-number-of-docs-deleted/288797)
**Author:** [@Juliito19](https://discuss.elastic.co/u/Juliito19)\ **Replies:** 5\ **Last updated:** [November 10, 2021, 12:06pm UTC](https://discuss.elastic.co/t/elasticsearch-when-i-index-there-is-like-a-limit-in-which-it-stops-indexing-and-increments-the-number-of-docs-deleted/288797 "2021-11-10T12:06:27Z")
Hi, I have an Apliccation in which I have an Elasticsearch template and I Insert with the pattern of template+(yyyy-MM-dd), Well, So far, so good, I think, but for each Index I suppose that have like a Limit in which w… --- ## [Could not read repository data from index blob](https://discuss.elastic.co/t/could-not-read-repository-data-from-index-blob/288880)
**Author:** [@vaclav1](https://discuss.elastic.co/u/vaclav1)\ **Replies:** 0\ **Last updated:** [November 10, 2021, 11:14am UTC](https://discuss.elastic.co/t/could-not-read-repository-data-from-index-blob/288880 "2021-11-10T11:14:20Z")
When trying to read all snaphots from the repository in s3 we are getting the error: \[user@adapt103:~\]$ curl 'http://localhost:9200/\_cat/snapshots/adapt-prod\_202111?pretty' { "error" : { "root\_cause" : \[ { … --- ## [Index PDF with Ingest Attachement Plugin using NodeJS Client](https://discuss.elastic.co/t/index-pdf-with-ingest-attachement-plugin-using-nodejs-client/288870)
**Author:** [@BE-CH](https://discuss.elastic.co/u/BE-CH)\ **Replies:** 3\ **Last updated:** [November 10, 2021, 11:04am UTC](https://discuss.elastic.co/t/index-pdf-with-ingest-attachement-plugin-using-nodejs-client/288870 "2021-11-10T11:04:34Z")
I am having a hard time understanding how I can index files such PDF and .RTF files using the Ingest Attachment Processor Plugin and make them searchable. My main problem seems to be that I can't search for the files af… --- ## [Can't drop events from auditbeat](https://discuss.elastic.co/t/cant-drop-events-from-auditbeat/288221)
**Author:** [@sadux](https://discuss.elastic.co/u/sadux)\ **Replies:** 2\ **Last updated:** [November 10, 2021, 10:52am UTC](https://discuss.elastic.co/t/cant-drop-events-from-auditbeat/288221 "2021-11-10T10:52:09Z")
Hello! Just want to filter some useless logs from auditbeat. Try this config at auditbeat.yml: - module: system processors: - drop\_event: when: equals: event.action: "network\_flow" … --- ## [Failure authentication not displayed at "security-hosts-authentications"](https://discuss.elastic.co/t/failure-authentication-not-displayed-at-security-hosts-authentications/288096)
**Author:** [@sadux](https://discuss.elastic.co/u/sadux)\ **Replies:** 8\ **Last updated:** [November 10, 2021, 10:48am UTC](https://discuss.elastic.co/t/failure-authentication-not-displayed-at-security-hosts-authentications/288096 "2021-11-10T10:48:30Z")
Hello! Just upgrade Kibana and Elasticsearch from 7.8 to 7.15.1 and found, that Failure authentications not displayed at "security-hosts-authentications". With Success auth all good and they displayed at Authentications… --- ## [Results not displayed in kibana](https://discuss.elastic.co/t/results-not-displayed-in-kibana/288874)
**Author:** [@mostafaelsayed](https://discuss.elastic.co/u/mostafaelsayed)\ **Replies:** 0\ **Last updated:** [November 10, 2021, 10:34am UTC](https://discuss.elastic.co/t/results-not-displayed-in-kibana/288874 "2021-11-10T10:34:50Z")
Hello I have an Elasticsearch index that has one primary shard and one replica shard. This is a snapshot of the document count: document count on the primary shard is 677919 document count on the replica shard is 638… --- ## [SSL\_ERROR\_SYSCALL in connection to es01:9200](https://discuss.elastic.co/t/ssl-error-syscall-in-connection-to-es01-9200/288323)
**Author:** [@cocolab](https://discuss.elastic.co/u/cocolab)\ **Replies:** 2\ **Last updated:** [November 10, 2021, 10:32am UTC](https://discuss.elastic.co/t/ssl-error-syscall-in-connection-to-es01-9200/288323 "2021-11-10T10:32:31Z")
Hello, I am aware that other people have asked this before but it seems that none of those answers fit my case. I need to enable encryption on the communication between the nodes with TLS. (Currently one ES node + one … --- ## [Http\_poller plugin and parsing second level of json](https://discuss.elastic.co/t/http-poller-plugin-and-parsing-second-level-of-json/288872)
**Author:** [@111435](https://discuss.elastic.co/u/111435)\ **Replies:** 0\ **Last updated:** [November 10, 2021, 10:09am UTC](https://discuss.elastic.co/t/http-poller-plugin-and-parsing-second-level-of-json/288872 "2021-11-10T10:09:09Z")
Hello, I am using Http\_poller plugin for get api call. My conf.file: input { http\_poller { urls =\> { test2 =\> { method =\> get url =\> "https://somethin.somethin.kz/uapi/tickets?api\_token=fdf… --- ## [Problem getting text search hits](https://discuss.elastic.co/t/problem-getting-text-search-hits/288601)
**Author:** [@TS1997](https://discuss.elastic.co/u/TS1997)\ **Replies:** 1\ **Last updated:** [November 10, 2021, 9:47am UTC](https://discuss.elastic.co/t/problem-getting-text-search-hits/288601 "2021-11-10T09:47:29Z")
Hello, I'm currently trying to implement my first search using Elasticsearch in Pimcore but am having issues getting hits on text strings. I'm currently using the Kibana dev tools to perform my search so Pimcore is only… --- ## [Unfortunately I have deleted some index files](https://discuss.elastic.co/t/unfortunately-i-have-deleted-some-index-files/287878)
**Author:** [@Ravinder28](https://discuss.elastic.co/u/Ravinder28)\ **Replies:** 17\ **Last updated:** [November 10, 2021, 9:24am UTC](https://discuss.elastic.co/t/unfortunately-i-have-deleted-some-index-files/287878 "2021-11-10T09:24:18Z")
unfortunately i have deleted some index files in below path. home/Elasticsearch/data/nodes/0/indices/ Elasticsearch is stopped and we are trying to restart the Elasticsearch but am getting below error. "\[2021-10-25T11… --- ## [Limit of total fields has been exceeded -\> set for dynamic daily index](https://discuss.elastic.co/t/limit-of-total-fields-has-been-exceeded-set-for-dynamic-daily-index/288851)
**Author:** [@INS](https://discuss.elastic.co/u/INS)\ **Replies:** 0\ **Last updated:** [November 10, 2021, 7:46am UTC](https://discuss.elastic.co/t/limit-of-total-fields-has-been-exceeded-set-for-dynamic-daily-index/288851 "2021-11-10T07:46:49Z")
Hi How can I set permanently for my all index index.mapping.total\_fields.limit I've daily indexes index =\> "logstash-test2000-%{+YYYY.MM.dd}" below input was set for only one index PUT logstash-\*/\_settings { "index… --- ## [How to create Alerting/health checks for ELK services (filebeat/metricbeat/logstash)](https://discuss.elastic.co/t/how-to-create-alerting-health-checks-for-elk-services-filebeat-metricbeat-logstash/288844)
**Author:** [@Bharah01](https://discuss.elastic.co/u/Bharah01)\ **Replies:** 0\ **Last updated:** [November 10, 2021, 6:56am UTC](https://discuss.elastic.co/t/how-to-create-alerting-health-checks-for-elk-services-filebeat-metricbeat-logstash/288844 "2021-11-10T06:56:57Z")
I want to configure an Alerting seup for the ELK services (filebeat/metricbeat/logstash). The kibana version running is 6.5.1. The need is because whenever any of these services goes down there should be a trigger to Mi… --- ## [Elasticsearch not working after spring-boot upgrade to 2.2.0.RELEASE](https://discuss.elastic.co/t/elasticsearch-not-working-after-spring-boot-upgrade-to-2-2-0-release/288849)
**Author:** [@simarjsi](https://discuss.elastic.co/u/simarjsi)\ **Replies:** 0\ **Last updated:** [November 10, 2021, 7:43am UTC](https://discuss.elastic.co/t/elasticsearch-not-working-after-spring-boot-upgrade-to-2-2-0-release/288849 "2021-11-10T07:43:09Z")
I am upgrading one of our applications from spring-boot version 2.1.3.RELEASE to 2.2.0.RELEASE but I am facing some issues with Elasticsearch. Here is the error I am getting java.lang.IllegalStateException: Failed to lo… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1167) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1169)