# \#none **URL:** https://discuss.elastic.co/tag/none.md?no_tags=true&page=1062 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1063 --- ## [Syslog pipeline =\> \[host\] error in ElasticSearch](https://discuss.elastic.co/t/syslog-pipeline-host-error-in-elasticsearch/262657)
**Author:** [@expressionlibre](https://discuss.elastic.co/u/expressionlibre)\ **Replies:** 11\ **Last updated:** [February 3, 2021, 10:32am UTC](https://discuss.elastic.co/t/syslog-pipeline-host-error-in-elasticsearch/262657 "2021-02-03T10:32:07Z")
Hi, Sorry may be a newbie question but, I read lots of treads and examples on the net to setup syslog pipeline but I still cannot make my logstash pipeline to function in ES. platform : CentOS 8.3. Epel versions for … --- ## [Rest API for last 30 days data from elasticsearch](https://discuss.elastic.co/t/rest-api-for-last-30-days-data-from-elasticsearch/262877)
**Author:** [@Gauti](https://discuss.elastic.co/u/Gauti)\ **Replies:** 5\ **Last updated:** [February 3, 2021, 10:10am UTC](https://discuss.elastic.co/t/rest-api-for-last-30-days-data-from-elasticsearch/262877 "2021-02-03T10:10:17Z")
Hi All, I am trying to export data from elasticsearch using rest api below is an example which got succeeded, but this will give complete data present in index URL : http://dashboard.iff.com:9200/inctable/\_search/ H… --- ## [One of master pod is not getting restarted](https://discuss.elastic.co/t/one-of-master-pod-is-not-getting-restarted/262985)
**Author:** [@knagasri](https://discuss.elastic.co/u/knagasri)\ **Replies:** 3\ **Last updated:** [February 3, 2021, 9:04am UTC](https://discuss.elastic.co/t/one-of-master-pod-is-not-getting-restarted/262985 "2021-02-03T09:04:35Z")
I have deployed ECK 1.3.0 in GCP with 2 master and 3 data-ingest nodes. For backup purpose, referenced secret in secure settings in elasticsearch file and re applied. All the data-ingest and one of master pods are restar… --- ## [Does ECK 1.3.0 supports workload identity](https://discuss.elastic.co/t/does-eck-1-3-0-supports-workload-identity/263021)
**Author:** [@knagasri](https://discuss.elastic.co/u/knagasri)\ **Replies:** 1\ **Last updated:** [February 3, 2021, 8:56am UTC](https://discuss.elastic.co/t/does-eck-1-3-0-supports-workload-identity/263021 "2021-02-03T08:56:10Z")
For ECK 1.3.0 , does operator supports workload identity feature instead of creating k8s secrets(service account credentials JSON file which has storage admin permissions for that GCS bucket) manually for easticsearch … --- ## [APM Agent is not working on FIPS enabled java application](https://discuss.elastic.co/t/apm-agent-is-not-working-on-fips-enabled-java-application/261815)
**Author:** [@Dhanaraju\_Vasireddy](https://discuss.elastic.co/u/Dhanaraju_Vasireddy)\ **Replies:** 18\ **Last updated:** [February 3, 2021, 8:42am UTC](https://discuss.elastic.co/t/apm-agent-is-not-working-on-fips-enabled-java-application/261815 "2021-02-03T08:42:45Z")
Hi We are trying to using APM agent in an application which is FIPS complaint and using CCJ jar (security.provider.5=com.sun.net.ssl.internal.ssl.Provider CCJ) Problem1: In the Java APM agent, below line keeps failing … --- ## [7.10 RestHighLevelClient - Composable Index Template and Component Template APIs difficult to use](https://discuss.elastic.co/t/7-10-resthighlevelclient-composable-index-template-and-component-template-apis-difficult-to-use/263097)
**Author:** [@Rajath\_H\_G](https://discuss.elastic.co/u/Rajath_H_G)\ **Replies:** 0\ **Last updated:** [February 3, 2021, 8:41am UTC](https://discuss.elastic.co/t/7-10-resthighlevelclient-composable-index-template-and-component-template-apis-difficult-to-use/263097 "2021-02-03T08:41:47Z")
I am planning to migrate from legacy templates to Composable Templates introduced in 7.x. But with Composable Templates we don't have APIs to feed complete template request string directly or build one using XContentBui… --- ## [An we add log retentions for elasticsearch, logstash, kibana and metric beat](https://discuss.elastic.co/t/an-we-add-log-retentions-for-elasticsearch-logstash-kibana-and-metric-beat/263096)
**Author:** [@Somesh\_ng](https://discuss.elastic.co/u/Somesh_ng)\ **Replies:** 0\ **Last updated:** [February 3, 2021, 8:37am UTC](https://discuss.elastic.co/t/an-we-add-log-retentions-for-elasticsearch-logstash-kibana-and-metric-beat/263096 "2021-02-03T08:37:59Z")
Can we add log retentions for elasticsearch, logstash, kibana and metric beat like below in .yml file logging.level: debug logging.to\_files: true logging.to\_syslog: false logging.files: path: /log… --- ## [Error while indexing data to App Search using Logstash](https://discuss.elastic.co/t/error-while-indexing-data-to-app-search-using-logstash/263094)
**Author:** [@sanju1323](https://discuss.elastic.co/u/sanju1323)\ **Replies:** 0\ **Last updated:** [February 3, 2021, 8:34am UTC](https://discuss.elastic.co/t/error-while-indexing-data-to-app-search-using-logstash/263094 "2021-02-03T08:34:19Z")
Hi Team, I have been trying to index the data from local Elasticsearch cluster to App Search engine using logstash. But I'm getting the below error. Copy to clipboard \[2021-02-01T13:45:30,097\]\[DEBUG\]\[logstash.javapipe… --- ## [Header in csv while exporting](https://discuss.elastic.co/t/header-in-csv-while-exporting/262958)
**Author:** [@ritusingh](https://discuss.elastic.co/u/ritusingh)\ **Replies:** 2\ **Last updated:** [February 3, 2021, 8:06am UTC](https://discuss.elastic.co/t/header-in-csv-while-exporting/262958 "2021-02-03T08:06:41Z")
Hi, I want to know that is there any way through which we can add header in csv file while exporting from elasticsearch via logstash? Here is the flow: Elasticsearch -\> logstash -\> csv file --- ## [Draw Pie Chart in Kibana based on field values](https://discuss.elastic.co/t/draw-pie-chart-in-kibana-based-on-field-values/262077)
**Author:** [@Sudarshan\_Reddy](https://discuss.elastic.co/u/Sudarshan_Reddy)\ **Replies:** 2\ **Last updated:** [February 3, 2021, 7:09am UTC](https://discuss.elastic.co/t/draw-pie-chart-in-kibana-based-on-field-values/262077 "2021-02-03T07:09:26Z")
Hi , we have a requirement to some of our test results in kibana pie chart . e.g we have the index pattern as following with the fields and i want to plot passedCount, failedCount values in kibana Pie Chart with each … --- ## [Estimate RAM consumption per index](https://discuss.elastic.co/t/estimate-ram-consumption-per-index/262947)
**Author:** [@gorek](https://discuss.elastic.co/u/gorek)\ **Replies:** 1\ **Last updated:** [February 3, 2021, 4:00am UTC](https://discuss.elastic.co/t/estimate-ram-consumption-per-index/262947 "2021-02-03T04:00:44Z")
I would like to estimate RAM requirements for new node. I plan keep on this node about 88 indices with 2 shards every. Currently one index have about 63GB on disk and 240 millions documents. I know Elasticsearch relies … --- ## [Reindex issue](https://discuss.elastic.co/t/reindex-issue/263013)
**Author:** [@Yogesh\_Chandra](https://discuss.elastic.co/u/Yogesh_Chandra)\ **Replies:** 1\ **Last updated:** [February 3, 2021, 3:57am UTC](https://discuss.elastic.co/t/reindex-issue/263013 "2021-02-03T03:57:07Z")
Hi Team, We are getting the below error during reindexing. Document contains at least one immense term in field="ddm\_\_keyword\_\_28372\_\_body\_of\_text\_en\_US" (whose UTF8 encoding is longer than the max length 32766), all o… --- ## [Remove ^M from message](https://discuss.elastic.co/t/remove-m-from-message/263058)
**Author:** [@daemon](https://discuss.elastic.co/u/daemon)\ **Replies:** 2\ **Last updated:** [February 3, 2021, 3:56am UTC](https://discuss.elastic.co/t/remove-m-from-message/263058 "2021-02-03T03:56:46Z")
Hi, I am trying to ingest Java exceptions into Elasticsearch via logstash. In Kibana, they show up like this, \[2021-01-29 16:00:36.875\] \[139642182200000\] \[INF\] : \[58.122.202.198:57076\] ==\> RTSP OPTIONS Resp: RTSP/1.0… --- ## [Create multiple Index for different steams of data](https://discuss.elastic.co/t/create-multiple-index-for-different-steams-of-data/261203)
**Author:** [@leinad](https://discuss.elastic.co/u/leinad)\ **Replies:** 9\ **Last updated:** [February 3, 2021, 3:45am UTC](https://discuss.elastic.co/t/create-multiple-index-for-different-steams-of-data/261203 "2021-02-03T03:45:05Z")
Hi , I am very new on setting up log stash, but have been using Kibana on user level of createing dashboard and analysis using basic templates My input logs are all JSON types, this is the logstash config which works p… --- ## [Logstash kafka output plugin - What happens if Kafka goes down](https://discuss.elastic.co/t/logstash-kafka-output-plugin-what-happens-if-kafka-goes-down/263012)
**Author:** [@vigneshr35](https://discuss.elastic.co/u/vigneshr35)\ **Replies:** 4\ **Last updated:** [February 3, 2021, 3:28am UTC](https://discuss.elastic.co/t/logstash-kafka-output-plugin-what-happens-if-kafka-goes-down/263012 "2021-02-03T03:28:30Z")
Hi All, I am looking to use the Logstash Kafka output plugin to post events to a Kafka topic. While logstash is pushing logs what happens if Kafka server goes down suddenly for some reason? By the time we bring back Ka… --- ## [Fail to install logstash plugin, version 7.6.2](https://discuss.elastic.co/t/fail-to-install-logstash-plugin-version-7-6-2/262443)
**Author:** [@wink](https://discuss.elastic.co/u/wink)\ **Replies:** 7\ **Last updated:** [February 3, 2021, 2:59am UTC](https://discuss.elastic.co/t/fail-to-install-logstash-plugin-version-7-6-2/262443 "2021-02-03T02:59:01Z")
Hi, I just do everything like on https://www.elastic.co/guide/en/logstash/current/java-filter-plugin.html#\_copy\_the\_example\_repo\_3. I did not change any code. But It comes out some error when I try to install the plug… --- ## [Monitor state transistion of ongoing application](https://discuss.elastic.co/t/monitor-state-transistion-of-ongoing-application/263027)
**Author:** [@schuessa](https://discuss.elastic.co/u/schuessa)\ **Replies:** 1\ **Last updated:** [February 3, 2021, 2:20am UTC](https://discuss.elastic.co/t/monitor-state-transistion-of-ongoing-application/263027 "2021-02-03T02:20:13Z")
I'm trying to set up the ability have some application log jobs such as 2021-02-02T12:55:51-0500 \[JOB:444\] \[START\] My external job has started 2021-02-02T12:55:51-0500 \[JOB:444\] \[MY\_EVENT\] Some update to the job… --- ## [Windows Host Data - Import error](https://discuss.elastic.co/t/windows-host-data-import-error/262312)
**Author:** [@Stud21](https://discuss.elastic.co/u/Stud21)\ **Replies:** 3\ **Last updated:** [February 3, 2021, 1:17am UTC](https://discuss.elastic.co/t/windows-host-data-import-error/262312 "2021-02-03T01:17:35Z")
I've tried to import the windows.json file in Kibana \> Management \> Saved Objects which imported with errors. This is based on Lab Guide: Windows Host Data steps. Now when I view the dashboard it gives the below error: … --- ## [Elastic rolling restart with Kibana instance running - Index ".kibana\_task\_manager\_1" is in red status and master-0 is not restarted](https://discuss.elastic.co/t/elastic-rolling-restart-with-kibana-instance-running-index-kibana-task-manager-1-is-in-red-status-and-master-0-is-not-restarted/263052)
**Author:** [@vinodh-reddy](https://discuss.elastic.co/u/vinodh-reddy)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 10:58pm UTC](https://discuss.elastic.co/t/elastic-rolling-restart-with-kibana-instance-running-index-kibana-task-manager-1-is-in-red-status-and-master-0-is-not-restarted/263052 "2021-02-02T22:58:06Z")
Hi Team, Elastic version:7.9.0 ECK: 1.3.0 Setup: 2 master nodes, 3 data nodes Steps: After creating a secret (GCS bucket Service account key as secret) in k8s all elastic pods are performing a rolling restart. Use c… --- ## [Filter on a field containing multiple values](https://discuss.elastic.co/t/filter-on-a-field-containing-multiple-values/263044)
**Author:** [@aniaks](https://discuss.elastic.co/u/aniaks)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 8:59pm UTC](https://discuss.elastic.co/t/filter-on-a-field-containing-multiple-values/263044 "2021-02-02T20:59:46Z")
{ customer: A, products: \[B, C\], price: \[123, 456\] } { customer: B, products: \[C, D, E\], price: \[123, 789, 987\] } In this example, how do i filter on product field with one value .... basically in the above exa… --- ## [Create a url field pyelasticsearch python](https://discuss.elastic.co/t/create-a-url-field-pyelasticsearch-python/263047)
**Author:** [@Tlm\_Konstantinos](https://discuss.elastic.co/u/Tlm_Konstantinos)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 9:37pm UTC](https://discuss.elastic.co/t/create-a-url-field-pyelasticsearch-python/263047 "2021-02-02T21:37:45Z")
I am using in python the module pyelasticsearch v7.10.1 and I am trying to update a document in one index in the elasticsearch server. What should I do if I want to create a hyperlink field during the update? source\_to\_… --- ## [Parsing multiline stacktrace](https://discuss.elastic.co/t/parsing-multiline-stacktrace/263022)
**Author:** [@RFeiten](https://discuss.elastic.co/u/RFeiten)\ **Replies:** 3\ **Last updated:** [February 2, 2021, 7:36pm UTC](https://discuss.elastic.co/t/parsing-multiline-stacktrace/263022 "2021-02-02T19:36:53Z")
Having a hard time here to index my logs containing multiple stack trace lines, as following Here are a log sample 2021-01-04T00:47:39.6082940+00:00 0HM5E5E2861GQ:00000005 \[ERR\] Something went wrong:(Value cannot be nu… --- ## [Inspect option missing from Lens visualizations](https://discuss.elastic.co/t/inspect-option-missing-from-lens-visualizations/263033)
**Author:** [@ewolfman](https://discuss.elastic.co/u/ewolfman)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 7:29pm UTC](https://discuss.elastic.co/t/inspect-option-missing-from-lens-visualizations/263033 "2021-02-02T19:29:40Z")
Hi, For Lens visualizations I see no Inspect option (using Kibana and Elasticsearch 7.10.2). I do see it for other chart types. Any idea? Thanks. --- ## [Enterprise Search](https://discuss.elastic.co/t/enterprise-search/262523)
**Author:** [@vikram\_singh](https://discuss.elastic.co/u/vikram_singh)\ **Replies:** 8\ **Last updated:** [February 2, 2021, 6:56pm UTC](https://discuss.elastic.co/t/enterprise-search/262523 "2021-02-02T18:56:49Z")
Hi, I setup a 3 node elasticsearch cluster on docker and enable xpack trial licence. Also setup enterprisesearch. Enterprisesearch showing running in log side but in browser side it is not opening and showing This… --- ## [Processing events in json format and do correlation to find the duration based on correlation id](https://discuss.elastic.co/t/processing-events-in-json-format-and-do-correlation-to-find-the-duration-based-on-correlation-id/261320)
**Author:** [@sdingria](https://discuss.elastic.co/u/sdingria)\ **Replies:** 5\ **Last updated:** [February 2, 2021, 6:20pm UTC](https://discuss.elastic.co/t/processing-events-in-json-format-and-do-correlation-to-find-the-duration-based-on-correlation-id/261320 "2021-02-02T18:20:35Z")
Newbie in logstash, 24 hours, so you might find the problem is trivial. input is multiple records in json format. PFB. Below is log stash config file. while executing, getting \_jsonparsefailure. input { stdin{} } … --- ## [Elasticsearch cluster request timeout and slow response time](https://discuss.elastic.co/t/elasticsearch-cluster-request-timeout-and-slow-response-time/263023)
**Author:** [@LurenzZ](https://discuss.elastic.co/u/LurenzZ)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 6:10pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-request-timeout-and-slow-response-time/263023 "2021-02-02T18:10:44Z")
Hi, we are having some problems with our Elasticsearch cluster. For the past few days the requests performed by the master node occassionally start to time out and, after that, every search query executed to elasticsear… --- ## [Unable to parse date in grok and filters](https://discuss.elastic.co/t/unable-to-parse-date-in-grok-and-filters/262988)
**Author:** [@RFeiten](https://discuss.elastic.co/u/RFeiten)\ **Replies:** 4\ **Last updated:** [February 2, 2021, 5:53pm UTC](https://discuss.elastic.co/t/unable-to-parse-date-in-grok-and-filters/262988 "2021-02-02T17:53:38Z")
I have the following message 2021-01-04T00:04:00.8033345+00:00 0HM5E5E28610F:00000001 \[INF\] MyMessage What I'm trying to do is to extract each of those fields into a separate column for my index. This is what I have b… --- ## [Need to fetch only selected data from Grok filter](https://discuss.elastic.co/t/need-to-fetch-only-selected-data-from-grok-filter/262972)
**Author:** [@ankitdevnalkar](https://discuss.elastic.co/u/ankitdevnalkar)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 5:43pm UTC](https://discuss.elastic.co/t/need-to-fetch-only-selected-data-from-grok-filter/262972 "2021-02-02T17:43:30Z")
Sample Log : 2020-12-16T04:43:43Z Bitcoin Core version v0.20.1.0-g7ff64311bee570874c4f0dfa18f518552188df08 (release build) I want to get the only version(v0.20.1.0) from the above log, Note : version string is a whole … --- ## [Convert current time into minutes using painless](https://discuss.elastic.co/t/convert-current-time-into-minutes-using-painless/262991)
**Author:** [@Gokul6](https://discuss.elastic.co/u/Gokul6)\ **Replies:** 5\ **Last updated:** [February 2, 2021, 3:17pm UTC](https://discuss.elastic.co/t/convert-current-time-into-minutes-using-painless/262991 "2021-02-02T15:17:10Z")
def now = new Date().getTime(); return now; in kibana scripted fields i am getting current date and time using the above code. the output of the above code is Feb 2, 2021 @ 16:47:24.807 i want to convert this time ent… --- ## [Logstash is not sending the data to elasticsearch](https://discuss.elastic.co/t/logstash-is-not-sending-the-data-to-elasticsearch/262365)
**Author:** [@sauravsuman689](https://discuss.elastic.co/u/sauravsuman689)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 3:37pm UTC](https://discuss.elastic.co/t/logstash-is-not-sending-the-data-to-elasticsearch/262365 "2021-02-02T15:37:49Z")
Hi Team, My dataflow is as below : filebeat -\> kafka -\> logstash -\> es -\> kibana Messages are coming to Kafka topic but I don't see logstash is processing anything and sending to es cluster. Below is the warning mess… [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1061) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1063)