# Latest **URL:** https://discuss.elastic.co/latest.md?page=1860 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1861 --- ## [Header in csv while exporting](https://discuss.elastic.co/t/header-in-csv-while-exporting/262958)
**Author:** [@ritusingh](https://discuss.elastic.co/u/ritusingh)\ **Replies:** 2\ **Last updated:** [February 3, 2021, 8:06am UTC](https://discuss.elastic.co/t/header-in-csv-while-exporting/262958 "2021-02-03T08:06:41Z")
Hi, I want to know that is there any way through which we can add header in csv file while exporting from elasticsearch via logstash? Here is the flow: Elasticsearch -\> logstash -\> csv file --- ## [Draw Pie Chart in Kibana based on field values](https://discuss.elastic.co/t/draw-pie-chart-in-kibana-based-on-field-values/262077)
**Author:** [@Sudarshan\_Reddy](https://discuss.elastic.co/u/Sudarshan_Reddy)\ **Replies:** 2\ **Last updated:** [February 3, 2021, 7:09am UTC](https://discuss.elastic.co/t/draw-pie-chart-in-kibana-based-on-field-values/262077 "2021-02-03T07:09:26Z")
Hi , we have a requirement to some of our test results in kibana pie chart . e.g we have the index pattern as following with the fields and i want to plot passedCount, failedCount values in kibana Pie Chart with each … --- ## [Filebeat not starting](https://discuss.elastic.co/t/filebeat-not-starting/263076)
**Author:** [@Kaushal\_Kishore1](https://discuss.elastic.co/u/Kaushal_Kishore1)\ **Replies:** 0\ **Last updated:** [February 3, 2021, 6:45am UTC](https://discuss.elastic.co/t/filebeat-not-starting/263076 "2021-02-03T06:45:20Z")
my filebeat.yaml filebeat.inputs: - type: log paths: - /var/log/apache2/whatfix\_access.log tags: \["apache"\] - type: log paths: - /usr/lib/quickonutch/logs/quickoapi.20\* tags: \["api"\] multiline.pattern: '^… --- ## [Transaction for application startup is added to default service name](https://discuss.elastic.co/t/transaction-for-application-startup-is-added-to-default-service-name/262989)
**Author:** [@Wolfram\_Haussig](https://discuss.elastic.co/u/Wolfram_Haussig)\ **Replies:** 6\ **Last updated:** [February 3, 2021, 5:47am UTC](https://discuss.elastic.co/t/transaction-for-application-startup-is-added-to-default-service-name/262989 "2021-02-03T05:47:48Z")
Hello all, I have an application which takes a very long time to startup(depending on the circumstances between 50 seconds and 5 minutes). Therefore, I have added code to instrument the startup(I have subclassed the Spr… --- ## [Help in securing communications between client and elasticsearch](https://discuss.elastic.co/t/help-in-securing-communications-between-client-and-elasticsearch/262955)
**Author:** [@Priya\_Vijay](https://discuss.elastic.co/u/Priya_Vijay)\ **Replies:** 3\ **Last updated:** [February 3, 2021, 5:41am UTC](https://discuss.elastic.co/t/help-in-securing-communications-between-client-and-elasticsearch/262955 "2021-02-03T05:41:11Z")
I have a question and appreciate any guidance. I have an elasticsearch instance without x-pack enabled but it is secure, mTLS is enabled. How can I connect to this elastic from another client like elastalert? How can I g… --- ## [Estimate RAM consumption per index](https://discuss.elastic.co/t/estimate-ram-consumption-per-index/262947)
**Author:** [@gorek](https://discuss.elastic.co/u/gorek)\ **Replies:** 1\ **Last updated:** [February 3, 2021, 4:00am UTC](https://discuss.elastic.co/t/estimate-ram-consumption-per-index/262947 "2021-02-03T04:00:44Z")
I would like to estimate RAM requirements for new node. I plan keep on this node about 88 indices with 2 shards every. Currently one index have about 63GB on disk and 240 millions documents. I know Elasticsearch relies … --- ## [Reindex issue](https://discuss.elastic.co/t/reindex-issue/263013)
**Author:** [@Yogesh\_Chandra](https://discuss.elastic.co/u/Yogesh_Chandra)\ **Replies:** 1\ **Last updated:** [February 3, 2021, 3:57am UTC](https://discuss.elastic.co/t/reindex-issue/263013 "2021-02-03T03:57:07Z")
Hi Team, We are getting the below error during reindexing. Document contains at least one immense term in field="ddm\_\_keyword\_\_28372\_\_body\_of\_text\_en\_US" (whose UTF8 encoding is longer than the max length 32766), all o… --- ## [Remove ^M from message](https://discuss.elastic.co/t/remove-m-from-message/263058)
**Author:** [@daemon](https://discuss.elastic.co/u/daemon)\ **Replies:** 2\ **Last updated:** [February 3, 2021, 3:56am UTC](https://discuss.elastic.co/t/remove-m-from-message/263058 "2021-02-03T03:56:46Z")
Hi, I am trying to ingest Java exceptions into Elasticsearch via logstash. In Kibana, they show up like this, \[2021-01-29 16:00:36.875\] \[139642182200000\] \[INF\] : \[58.122.202.198:57076\] ==\> RTSP OPTIONS Resp: RTSP/1.0… --- ## [Filebeat hint based autodiscover on Openshift/Kubernetes](https://discuss.elastic.co/t/filebeat-hint-based-autodiscover-on-openshift-kubernetes/263019)
**Author:** [@Kosodrom](https://discuss.elastic.co/u/Kosodrom)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 5:50pm UTC](https://discuss.elastic.co/t/filebeat-hint-based-autodiscover-on-openshift-kubernetes/263019 "2021-02-02T17:50:03Z")
Hi folks, I am using following filebeat configuration (7.10). Filebeat is running on openshift: filebeat.autodiscover: providers: - type: kubernetes node: ${NODE\_NAME} hints.enabled: true hints.… --- ## [Create multiple Index for different steams of data](https://discuss.elastic.co/t/create-multiple-index-for-different-steams-of-data/261203)
**Author:** [@leinad](https://discuss.elastic.co/u/leinad)\ **Replies:** 9\ **Last updated:** [February 3, 2021, 3:45am UTC](https://discuss.elastic.co/t/create-multiple-index-for-different-steams-of-data/261203 "2021-02-03T03:45:05Z")
Hi , I am very new on setting up log stash, but have been using Kibana on user level of createing dashboard and analysis using basic templates My input logs are all JSON types, this is the logstash config which works p… --- ## [Logstash kafka output plugin - What happens if Kafka goes down](https://discuss.elastic.co/t/logstash-kafka-output-plugin-what-happens-if-kafka-goes-down/263012)
**Author:** [@vigneshr35](https://discuss.elastic.co/u/vigneshr35)\ **Replies:** 4\ **Last updated:** [February 3, 2021, 3:28am UTC](https://discuss.elastic.co/t/logstash-kafka-output-plugin-what-happens-if-kafka-goes-down/263012 "2021-02-03T03:28:30Z")
Hi All, I am looking to use the Logstash Kafka output plugin to post events to a Kafka topic. While logstash is pushing logs what happens if Kafka server goes down suddenly for some reason? By the time we bring back Ka… --- ## [Fail to install logstash plugin, version 7.6.2](https://discuss.elastic.co/t/fail-to-install-logstash-plugin-version-7-6-2/262443)
**Author:** [@wink](https://discuss.elastic.co/u/wink)\ **Replies:** 7\ **Last updated:** [February 3, 2021, 2:59am UTC](https://discuss.elastic.co/t/fail-to-install-logstash-plugin-version-7-6-2/262443 "2021-02-03T02:59:01Z")
Hi, I just do everything like on https://www.elastic.co/guide/en/logstash/current/java-filter-plugin.html#\_copy\_the\_example\_repo\_3. I did not change any code. But It comes out some error when I try to install the plug… --- ## [ELK APM and Jaeger Integration add Kubernetes metadata and system data to transactions/spans](https://discuss.elastic.co/t/elk-apm-and-jaeger-integration-add-kubernetes-metadata-and-system-data-to-transactions-spans/263035)
**Author:** [@zvazquez](https://discuss.elastic.co/u/zvazquez)\ **Replies:** 1\ **Last updated:** [February 3, 2021, 2:44am UTC](https://discuss.elastic.co/t/elk-apm-and-jaeger-integration-add-kubernetes-metadata-and-system-data-to-transactions-spans/263035 "2021-02-03T02:44:35Z")
Hi, We are working on the integration of Jaeger with ELK APM running on Kubernetes, we noticed that some of the metadata and actual data related with Kubernetes and APM specific is not available, and we could not find a… --- ## [Elasticsearch remote cluster authentication mapping](https://discuss.elastic.co/t/elasticsearch-remote-cluster-authentication-mapping/263057)
**Author:** [@xxlaila](https://discuss.elastic.co/u/xxlaila)\ **Replies:** 0\ **Last updated:** [February 3, 2021, 2:21am UTC](https://discuss.elastic.co/t/elasticsearch-remote-cluster-authentication-mapping/263057 "2021-02-03T02:21:08Z")
Elasticsearch did a cross-cluster mapping There is no problem in creating a new user to get cross-cluster data, but it prompts 404 when getting mapping Execute statement: curl -H "Content-Type: application/json" -XGET -… --- ## [Monitor state transistion of ongoing application](https://discuss.elastic.co/t/monitor-state-transistion-of-ongoing-application/263027)
**Author:** [@schuessa](https://discuss.elastic.co/u/schuessa)\ **Replies:** 1\ **Last updated:** [February 3, 2021, 2:20am UTC](https://discuss.elastic.co/t/monitor-state-transistion-of-ongoing-application/263027 "2021-02-03T02:20:13Z")
I'm trying to set up the ability have some application log jobs such as 2021-02-02T12:55:51-0500 \[JOB:444\] \[START\] My external job has started 2021-02-02T12:55:51-0500 \[JOB:444\] \[MY\_EVENT\] Some update to the job… --- ## [\[REDACTED\] Is the marked field blocked by apm](https://discuss.elastic.co/t/redacted-is-the-marked-field-blocked-by-apm/262931)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 7\ **Last updated:** [February 3, 2021, 1:40am UTC](https://discuss.elastic.co/t/redacted-is-the-marked-field-blocked-by-apm/262931 "2021-02-03T01:40:26Z")
I found that some trace data is marked \[redacted\], but I need them to be displayed. What should I do? I found these --- ## [Windows Host Data - Import error](https://discuss.elastic.co/t/windows-host-data-import-error/262312)
**Author:** [@Stud21](https://discuss.elastic.co/u/Stud21)\ **Replies:** 3\ **Last updated:** [February 3, 2021, 1:17am UTC](https://discuss.elastic.co/t/windows-host-data-import-error/262312 "2021-02-03T01:17:35Z")
I've tried to import the windows.json file in Kibana \> Management \> Saved Objects which imported with errors. This is based on Lab Guide: Windows Host Data steps. Now when I view the dashboard it gives the below error: … --- ## [Parsing Mapping and finding the right ECS fields for logs in general](https://discuss.elastic.co/t/parsing-mapping-and-finding-the-right-ecs-fields-for-logs-in-general/262451)
**Author:** [@cgekoski](https://discuss.elastic.co/u/cgekoski)\ **Replies:** 1\ **Last updated:** [February 2, 2021, 11:43pm UTC](https://discuss.elastic.co/t/parsing-mapping-and-finding-the-right-ecs-fields-for-logs-in-general/262451 "2021-02-02T23:43:52Z")
Hello everyone. I'm going to start with saying sorry TLDR but hope someone can shine the light in the right direction. Pretty new to logstash/elastic and trying to come to grasp with the ECS field guide and want to teach… --- ## [Elastic rolling restart with Kibana instance running - Index ".kibana\_task\_manager\_1" is in red status and master-0 is not restarted](https://discuss.elastic.co/t/elastic-rolling-restart-with-kibana-instance-running-index-kibana-task-manager-1-is-in-red-status-and-master-0-is-not-restarted/263052)
**Author:** [@vinodh-reddy](https://discuss.elastic.co/u/vinodh-reddy)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 10:58pm UTC](https://discuss.elastic.co/t/elastic-rolling-restart-with-kibana-instance-running-index-kibana-task-manager-1-is-in-red-status-and-master-0-is-not-restarted/263052 "2021-02-02T22:58:06Z")
Hi Team, Elastic version:7.9.0 ECK: 1.3.0 Setup: 2 master nodes, 3 data nodes Steps: After creating a secret (GCS bucket Service account key as secret) in k8s all elastic pods are performing a rolling restart. Use c… --- ## [Pipeline UI viewer shows zero events everywhere](https://discuss.elastic.co/t/pipeline-ui-viewer-shows-zero-events-everywhere/262367)
**Author:** [@holobolo0815](https://discuss.elastic.co/u/holobolo0815)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 10:36pm UTC](https://discuss.elastic.co/t/pipeline-ui-viewer-shows-zero-events-everywhere/262367 "2021-02-02T22:36:49Z")
At first I thought it was due to legacy monitoring still active, I switched to metricbeats in any case, but it still does not show the events in the processing pipeline. The overview screen shows received and emitted … --- ## [Filter on a field containing multiple values](https://discuss.elastic.co/t/filter-on-a-field-containing-multiple-values/263044)
**Author:** [@aniaks](https://discuss.elastic.co/u/aniaks)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 8:59pm UTC](https://discuss.elastic.co/t/filter-on-a-field-containing-multiple-values/263044 "2021-02-02T20:59:46Z")
{ customer: A, products: \[B, C\], price: \[123, 456\] } { customer: B, products: \[C, D, E\], price: \[123, 789, 987\] } In this example, how do i filter on product field with one value .... basically in the above exa… --- ## [Create a url field pyelasticsearch python](https://discuss.elastic.co/t/create-a-url-field-pyelasticsearch-python/263047)
**Author:** [@Tlm\_Konstantinos](https://discuss.elastic.co/u/Tlm_Konstantinos)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 9:37pm UTC](https://discuss.elastic.co/t/create-a-url-field-pyelasticsearch-python/263047 "2021-02-02T21:37:45Z")
I am using in python the module pyelasticsearch v7.10.1 and I am trying to update a document in one index in the elasticsearch server. What should I do if I want to create a hyperlink field during the update? source\_to\_… --- ## [Go-template certificate parse error](https://discuss.elastic.co/t/go-template-certificate-parse-error/262986)
**Author:** [@Srinivas\_RK](https://discuss.elastic.co/u/Srinivas_RK)\ **Replies:** 3\ **Last updated:** [February 2, 2021, 9:11pm UTC](https://discuss.elastic.co/t/go-template-certificate-parse-error/262986 "2021-02-02T21:11:37Z")
trying to get certificates and install as mentioned here but here not able to run the command mentioned here kubectl get secret my-elastic-depl-es-http-certs-public -o go-template='{{index .data "tls.crt" | base64deco… --- ## [Error while indexing data to App Search](https://discuss.elastic.co/t/error-while-indexing-data-to-app-search/262801)
**Author:** [@sanju1323](https://discuss.elastic.co/u/sanju1323)\ **Replies:** 1\ **Last updated:** [February 2, 2021, 8:53pm UTC](https://discuss.elastic.co/t/error-while-indexing-data-to-app-search/262801 "2021-02-02T20:53:32Z")
Hi Team, I have been trying to index the data from local Elasticsearch cluster to App Search engine using logstash. But I'm getting the below error. \[2021-02-01T13:45:30,097\]\[DEBUG\]\[logstash.javapipeline \]\[main\] Pip… --- ## [Workplace search is not displaying](https://discuss.elastic.co/t/workplace-search-is-not-displaying/262929)
**Author:** [@vikram\_singh](https://discuss.elastic.co/u/vikram_singh)\ **Replies:** 1\ **Last updated:** [February 2, 2021, 8:39pm UTC](https://discuss.elastic.co/t/workplace-search-is-not-displaying/262929 "2021-02-02T20:39:48Z")
Hi, I am facing weird issue in enterprise search. I setup Enterprise search on docker environment, it was showing to choose App search and Workplace search on home page. I created a role(example\_role) and a user(exampl… --- ## [Parsing multiline stacktrace](https://discuss.elastic.co/t/parsing-multiline-stacktrace/263022)
**Author:** [@RFeiten](https://discuss.elastic.co/u/RFeiten)\ **Replies:** 3\ **Last updated:** [February 2, 2021, 7:36pm UTC](https://discuss.elastic.co/t/parsing-multiline-stacktrace/263022 "2021-02-02T19:36:53Z")
Having a hard time here to index my logs containing multiple stack trace lines, as following Here are a log sample 2021-01-04T00:47:39.6082940+00:00 0HM5E5E2861GQ:00000005 \[ERR\] Something went wrong:(Value cannot be nu… --- ## [Inspect option missing from Lens visualizations](https://discuss.elastic.co/t/inspect-option-missing-from-lens-visualizations/263033)
**Author:** [@ewolfman](https://discuss.elastic.co/u/ewolfman)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 7:29pm UTC](https://discuss.elastic.co/t/inspect-option-missing-from-lens-visualizations/263033 "2021-02-02T19:29:40Z")
Hi, For Lens visualizations I see no Inspect option (using Kibana and Elasticsearch 7.10.2). I do see it for other chart types. Any idea? Thanks. --- ## [Status/progress API for filebeat](https://discuss.elastic.co/t/status-progress-api-for-filebeat/262994)
**Author:** [@jnc943](https://discuss.elastic.co/u/jnc943)\ **Replies:** 1\ **Last updated:** [February 2, 2021, 6:56pm UTC](https://discuss.elastic.co/t/status-progress-api-for-filebeat/262994 "2021-02-02T18:56:50Z")
Hi, I am familiar with https://www.elastic.co/guide/en/beats/filebeat/current/http-endpoint.html but it is too low level for my use case. I would like to be able to drop a bundle of files in a directory that is watched … --- ## [Enterprise Search](https://discuss.elastic.co/t/enterprise-search/262523)
**Author:** [@vikram\_singh](https://discuss.elastic.co/u/vikram_singh)\ **Replies:** 8\ **Last updated:** [February 2, 2021, 6:56pm UTC](https://discuss.elastic.co/t/enterprise-search/262523 "2021-02-02T18:56:49Z")
Hi, I setup a 3 node elasticsearch cluster on docker and enable xpack trial licence. Also setup enterprisesearch. Enterprisesearch showing running in log side but in browser side it is not opening and showing This… --- ## [Processing events in json format and do correlation to find the duration based on correlation id](https://discuss.elastic.co/t/processing-events-in-json-format-and-do-correlation-to-find-the-duration-based-on-correlation-id/261320)
**Author:** [@sdingria](https://discuss.elastic.co/u/sdingria)\ **Replies:** 5\ **Last updated:** [February 2, 2021, 6:20pm UTC](https://discuss.elastic.co/t/processing-events-in-json-format-and-do-correlation-to-find-the-duration-based-on-correlation-id/261320 "2021-02-02T18:20:35Z")
Newbie in logstash, 24 hours, so you might find the problem is trivial. input is multiple records in json format. PFB. Below is log stash config file. while executing, getting \_jsonparsefailure. input { stdin{} } … [Previous page](https://discuss.elastic.co/latest.md?page=1859) [Next page](https://discuss.elastic.co/latest.md?page=1861)