# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1575 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1576 --- ## [Parsing multiline stacktrace](https://discuss.elastic.co/t/parsing-multiline-stacktrace/263022)
**Author:** [@RFeiten](https://discuss.elastic.co/u/RFeiten)\ **Replies:** 3\ **Last updated:** [February 2, 2021, 7:36pm UTC](https://discuss.elastic.co/t/parsing-multiline-stacktrace/263022 "2021-02-02T19:36:53Z")
Having a hard time here to index my logs containing multiple stack trace lines, as following Here are a log sample 2021-01-04T00:47:39.6082940+00:00 0HM5E5E2861GQ:00000005 \[ERR\] Something went wrong:(Value cannot be nu… --- ## [Inspect option missing from Lens visualizations](https://discuss.elastic.co/t/inspect-option-missing-from-lens-visualizations/263033)
**Author:** [@ewolfman](https://discuss.elastic.co/u/ewolfman)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 7:29pm UTC](https://discuss.elastic.co/t/inspect-option-missing-from-lens-visualizations/263033 "2021-02-02T19:29:40Z")
Hi, For Lens visualizations I see no Inspect option (using Kibana and Elasticsearch 7.10.2). I do see it for other chart types. Any idea? Thanks. --- ## [Status/progress API for filebeat](https://discuss.elastic.co/t/status-progress-api-for-filebeat/262994)
**Author:** [@jnc943](https://discuss.elastic.co/u/jnc943)\ **Replies:** 1\ **Last updated:** [February 2, 2021, 6:56pm UTC](https://discuss.elastic.co/t/status-progress-api-for-filebeat/262994 "2021-02-02T18:56:50Z")
Hi, I am familiar with https://www.elastic.co/guide/en/beats/filebeat/current/http-endpoint.html but it is too low level for my use case. I would like to be able to drop a bundle of files in a directory that is watched … --- ## [Processing events in json format and do correlation to find the duration based on correlation id](https://discuss.elastic.co/t/processing-events-in-json-format-and-do-correlation-to-find-the-duration-based-on-correlation-id/261320)
**Author:** [@sdingria](https://discuss.elastic.co/u/sdingria)\ **Replies:** 5\ **Last updated:** [February 2, 2021, 6:20pm UTC](https://discuss.elastic.co/t/processing-events-in-json-format-and-do-correlation-to-find-the-duration-based-on-correlation-id/261320 "2021-02-02T18:20:35Z")
Newbie in logstash, 24 hours, so you might find the problem is trivial. input is multiple records in json format. PFB. Below is log stash config file. while executing, getting \_jsonparsefailure. input { stdin{} } … --- ## [Elasticsearch cluster request timeout and slow response time](https://discuss.elastic.co/t/elasticsearch-cluster-request-timeout-and-slow-response-time/263023)
**Author:** [@LurenzZ](https://discuss.elastic.co/u/LurenzZ)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 6:10pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-request-timeout-and-slow-response-time/263023 "2021-02-02T18:10:44Z")
Hi, we are having some problems with our Elasticsearch cluster. For the past few days the requests performed by the master node occassionally start to time out and, after that, every search query executed to elasticsear… --- ## [Unable to parse date in grok and filters](https://discuss.elastic.co/t/unable-to-parse-date-in-grok-and-filters/262988)
**Author:** [@RFeiten](https://discuss.elastic.co/u/RFeiten)\ **Replies:** 4\ **Last updated:** [February 2, 2021, 5:53pm UTC](https://discuss.elastic.co/t/unable-to-parse-date-in-grok-and-filters/262988 "2021-02-02T17:53:38Z")
I have the following message 2021-01-04T00:04:00.8033345+00:00 0HM5E5E28610F:00000001 \[INF\] MyMessage What I'm trying to do is to extract each of those fields into a separate column for my index. This is what I have b… --- ## [Filebeat Microsoft Module support for Microsoft Defender for Office 365?](https://discuss.elastic.co/t/filebeat-microsoft-module-support-for-microsoft-defender-for-office-365/263018)
**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 5:46pm UTC](https://discuss.elastic.co/t/filebeat-microsoft-module-support-for-microsoft-defender-for-office-365/263018 "2021-02-02T17:46:08Z")
Hello, I was wondering if the following Filebeat module also works for Microsoft Defender for Office 365 (https://www.microsoft.com/en/microsoft-365/security/office-365-defender)? Best regards, Willem --- ## [Need to fetch only selected data from Grok filter](https://discuss.elastic.co/t/need-to-fetch-only-selected-data-from-grok-filter/262972)
**Author:** [@ankitdevnalkar](https://discuss.elastic.co/u/ankitdevnalkar)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 5:43pm UTC](https://discuss.elastic.co/t/need-to-fetch-only-selected-data-from-grok-filter/262972 "2021-02-02T17:43:30Z")
Sample Log : 2020-12-16T04:43:43Z Bitcoin Core version v0.20.1.0-g7ff64311bee570874c4f0dfa18f518552188df08 (release build) I want to get the only version(v0.20.1.0) from the above log, Note : version string is a whole … --- ## [Metric output to elasticsearch via filebeat](https://discuss.elastic.co/t/metric-output-to-elasticsearch-via-filebeat/262560)
**Author:** [@umesh2020](https://discuss.elastic.co/u/umesh2020)\ **Replies:** 3\ **Last updated:** [February 2, 2021, 4:58pm UTC](https://discuss.elastic.co/t/metric-output-to-elasticsearch-via-filebeat/262560 "2021-02-02T16:58:01Z")
I have a question related to metrics collection. The application writes metric data into a file. Can filebeat pickup this information say using log or filestream input and send it to elasticsearch ? What would be the d… --- ## [Convert current time into minutes using painless](https://discuss.elastic.co/t/convert-current-time-into-minutes-using-painless/262991)
**Author:** [@Gokul6](https://discuss.elastic.co/u/Gokul6)\ **Replies:** 5\ **Last updated:** [February 2, 2021, 3:17pm UTC](https://discuss.elastic.co/t/convert-current-time-into-minutes-using-painless/262991 "2021-02-02T15:17:10Z")
def now = new Date().getTime(); return now; in kibana scripted fields i am getting current date and time using the above code. the output of the above code is Feb 2, 2021 @ 16:47:24.807 i want to convert this time ent… --- ## [Reindex parse\_exception](https://discuss.elastic.co/t/reindex-parse-exception/262824)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 5\ **Last updated:** [February 2, 2021, 4:11pm UTC](https://discuss.elastic.co/t/reindex-parse-exception/262824 "2021-02-02T16:11:28Z")
POST \_reindex?wait\_for\_completion=true { "source": { "index": "apm-7.8.1-transaction-000007", "query": { "match\_all": {} } }, "dest": { "index": "apm-7.8.1-transaction-new-000007", "pi… --- ## [Logstash is not sending the data to elasticsearch](https://discuss.elastic.co/t/logstash-is-not-sending-the-data-to-elasticsearch/262365)
**Author:** [@sauravsuman689](https://discuss.elastic.co/u/sauravsuman689)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 3:37pm UTC](https://discuss.elastic.co/t/logstash-is-not-sending-the-data-to-elasticsearch/262365 "2021-02-02T15:37:49Z")
Hi Team, My dataflow is as below : filebeat -\> kafka -\> logstash -\> es -\> kibana Messages are coming to Kafka topic but I don't see logstash is processing anything and sending to es cluster. Below is the warning mess… --- ## [Converting date to TIMESTAMP\_ISO8601 format](https://discuss.elastic.co/t/converting-date-to-timestamp-iso8601-format/262952)
**Author:** [@gloupe](https://discuss.elastic.co/u/gloupe)\ **Replies:** 1\ **Last updated:** [February 2, 2021, 3:24pm UTC](https://discuss.elastic.co/t/converting-date-to-timestamp-iso8601-format/262952 "2021-02-02T15:24:56Z")
Hi, I'm actually receiving logs with timestamp to this format : Mon Feb 1 13:29:48 2021 From Telegraf who's parsing the log with this Grok pattern : SOURCELOG %{DAY} %{MONTH} (?: %{POSINT:MONTHDAY}) %{TIME} %{YEAR} … --- ## [Query DSL, Boolean query. Multiple conditions for must\_not](https://discuss.elastic.co/t/query-dsl-boolean-query-multiple-conditions-for-must-not/263004)
**Author:** [@gneves](https://discuss.elastic.co/u/gneves)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 3:10pm UTC](https://discuss.elastic.co/t/query-dsl-boolean-query-multiple-conditions-for-must-not/263004 "2021-02-02T15:10:15Z")
Hello guys, hope you are doing well and healthy. Im having a little trouble using DSL querys. My objective is this: I want to trigger an event that, the action must be "UserLoggedIn", the country must NOT be Portuga… --- ## [Weighted bars in count barchart](https://discuss.elastic.co/t/weighted-bars-in-count-barchart/262342)
**Author:** [@Bram\_Tervoort](https://discuss.elastic.co/u/Bram_Tervoort)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 2:57pm UTC](https://discuss.elastic.co/t/weighted-bars-in-count-barchart/262342 "2021-02-02T14:57:56Z")
I would like to make a barchart in kibana displaying the counts of bucket. But i would like the bar of 1 XL to be as large a 5 times a single S. I already counted all the documents in my index split them on a weekly and … --- ## [FileBeat Gsuite module deprecated?](https://discuss.elastic.co/t/filebeat-gsuite-module-deprecated/262939)
**Author:** [@ido](https://discuss.elastic.co/u/ido)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 2:04pm UTC](https://discuss.elastic.co/t/filebeat-gsuite-module-deprecated/262939 "2021-02-02T14:04:44Z")
TL;DR - gsuite module does not send logs although it seems that I've done everything right (more details in the post). I looked at the source code and there was a comment saying "Gsuite module is deprecated... use Google… --- ## [ElasticSearch - Latest record per day per ID from elastic](https://discuss.elastic.co/t/elasticsearch-latest-record-per-day-per-id-from-elastic/262993)
**Author:** [@prashantmalik](https://discuss.elastic.co/u/prashantmalik)\ **Replies:** 1\ **Last updated:** [February 2, 2021, 2:03pm UTC](https://discuss.elastic.co/t/elasticsearch-latest-record-per-day-per-id-from-elastic/262993 "2021-02-02T14:03:39Z")
I have index in Elsaticsearch of records of form: Record{ Timestamp; Id; . .} It has multiple records for ID per day. I want to fetch latest record per Id per day. Can you please help me with such query? Exam… --- ## [Reindex failed: search\_context\_missing\_exception](https://discuss.elastic.co/t/reindex-failed-search-context-missing-exception/262992)
**Author:** [@wangxr1985](https://discuss.elastic.co/u/wangxr1985)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 1:53pm UTC](https://discuss.elastic.co/t/reindex-failed-search-context-missing-exception/262992 "2021-02-02T13:53:53Z")
I want to migrate a index from es5 cluster to es7 cluster by using remote reindexing. The number of docs is 5,000,000. I use curl to call the \_reindex api like this: curl -uelastic:xxx -XPOST -H 'Content-Type: applica… --- ## [Reporting Error: Access for Kibana -\>Share -\> CSV Report -\> Generate CSV](https://discuss.elastic.co/t/reporting-error-access-for-kibana-share-csv-report-generate-csv/262658)
**Author:** [@qub123](https://discuss.elastic.co/u/qub123)\ **Replies:** 4\ **Last updated:** [February 2, 2021, 1:48pm UTC](https://discuss.elastic.co/t/reporting-error-access-for-kibana-share-csv-report-generate-csv/262658 "2021-02-02T13:48:12Z")
Hi I have a user with the guest\_role which can "read" access on an index, I have also assigned a Kibana's reporting\_user role, but when the user tries to Share the content of and index using Share -\> CSV Report -\> Gen… --- ## [Filebeat - support for API keys in Logstash outputs](https://discuss.elastic.co/t/filebeat-support-for-api-keys-in-logstash-outputs/262981)
**Author:** [@vigneshr35](https://discuss.elastic.co/u/vigneshr35)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 1:16pm UTC](https://discuss.elastic.co/t/filebeat-support-for-api-keys-in-logstash-outputs/262981 "2021-02-02T13:16:50Z")
Hi, I see that support for API keys in Elasticsearch outputs was provided starting from release 7.6.0. Do we have similar support added for API keys in Logstash outputs? I don't see it in the documentation. So, my unde… --- ## [Percentiles plot in vega-lite](https://discuss.elastic.co/t/percentiles-plot-in-vega-lite/262942)
**Author:** [@deeksha39](https://discuss.elastic.co/u/deeksha39)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 12:54pm UTC](https://discuss.elastic.co/t/percentiles-plot-in-vega-lite/262942 "2021-02-02T12:54:55Z")
Hi , I want a visualization(bar plot) in kibana through vega-lite to aggregate the data on 90th percentile and 10th percentile and groupby the data on multiple fields, on x-axis , I want to display group1 , group2 etc.… --- ## [Best Practises to handle an index of of 1.2TiB](https://discuss.elastic.co/t/best-practises-to-handle-an-index-of-of-1-2tib/262839)
**Author:** [@carmine.fabrizio](https://discuss.elastic.co/u/carmine.fabrizio)\ **Replies:** 6\ **Last updated:** [February 2, 2021, 12:09pm UTC](https://discuss.elastic.co/t/best-practises-to-handle-an-index-of-of-1-2tib/262839 "2021-02-02T12:09:58Z")
Hi there, I have an index of 1.2TiB, split into 9 shards of 200GiB each, also I do have a lifecycle policy that will roll the shards in HOT/WARM/COLD phases. Are there any best practices that I can introduce in order t… --- ## [Pipeline workers configuration](https://discuss.elastic.co/t/pipeline-workers-configuration/262934)
**Author:** [@ritusingh](https://discuss.elastic.co/u/ritusingh)\ **Replies:** 8\ **Last updated:** [February 2, 2021, 11:21am UTC](https://discuss.elastic.co/t/pipeline-workers-configuration/262934 "2021-02-02T11:21:14Z")
Hi, I have reduced pipeline.workers to 1 because I need the output in correct order. Now the problem is when I am giving 10k request (100 per second) it is not reaching elasticsearch, only 9k reaching. Earlier it was no… --- ## [Visualize Group by result](https://discuss.elastic.co/t/visualize-group-by-result/262793)
**Author:** [@deeksha39](https://discuss.elastic.co/u/deeksha39)\ **Replies:** 4\ **Last updated:** [February 2, 2021, 11:00am UTC](https://discuss.elastic.co/t/visualize-group-by-result/262793 "2021-02-02T11:00:52Z")
Hi, I am working on a large dataset with 20000 rows and 40 columns, I want to group by my data based on 10 categorical columns, then I want to create a histogram and percentiles graph to make a comparison between the to… --- ## [How to show mulitple servers logs in kibana separatly from each other](https://discuss.elastic.co/t/how-to-show-mulitple-servers-logs-in-kibana-separatly-from-each-other/262948)
**Author:** [@huzaifa224](https://discuss.elastic.co/u/huzaifa224)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 10:52am UTC](https://discuss.elastic.co/t/how-to-show-mulitple-servers-logs-in-kibana-separatly-from-each-other/262948 "2021-02-02T10:52:24Z")
I have installed ELK on my Ubuntu server and install filebeat on remote server-A and server-B. I have configured Log-stash to receive data from filebeat and forward them to Elasticsearch. Both servers logs are showing in… --- ## [Minus timezone on date histogram aggregation shifts back buckets one day](https://discuss.elastic.co/t/minus-timezone-on-date-histogram-aggregation-shifts-back-buckets-one-day/262959)
**Author:** [@anas-hossam](https://discuss.elastic.co/u/anas-hossam)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 10:28am UTC](https://discuss.elastic.co/t/minus-timezone-on-date-histogram-aggregation-shifts-back-buckets-one-day/262959 "2021-02-02T10:28:03Z")
this is my body request when search in elasticsearch version 1.5 { "body": { "size": 0, "query": { "filtered": { "filter": { "bool": { … --- ## [Add static line for Horizontal bar chart](https://discuss.elastic.co/t/add-static-line-for-horizontal-bar-chart/262338)
**Author:** [@pavank](https://discuss.elastic.co/u/pavank)\ **Replies:** 3\ **Last updated:** [February 2, 2021, 10:18am UTC](https://discuss.elastic.co/t/add-static-line-for-horizontal-bar-chart/262338 "2021-02-02T10:18:03Z")
Kibana version 6.7 We are trying to create a dashboard with a horizontal bar based on a field named duration of type number. We want to add a static line to show the Threshold of sorts for the entire series. We followe… --- ## [ILM: keep all indices on hot node](https://discuss.elastic.co/t/ilm-keep-all-indices-on-hot-node/262861)
**Author:** [@matejzero](https://discuss.elastic.co/u/matejzero)\ **Replies:** 3\ **Last updated:** [February 2, 2021, 10:14am UTC](https://discuss.elastic.co/t/ilm-keep-all-indices-on-hot-node/262861 "2021-02-02T10:14:16Z")
Hello, I'm transitioning to ILM and at the moment, I have hot and warm nodes. Warm nodes don't have any data as I have cluster.routing.allocation.exclude.\_ip set on the warm nodes. I want to create an ILM policy that w… --- ## [Replicas allocation failed](https://discuss.elastic.co/t/replicas-allocation-failed/261768)
**Author:** [@mcosta](https://discuss.elastic.co/u/mcosta)\ **Replies:** 8\ **Last updated:** [February 2, 2021, 10:07am UTC](https://discuss.elastic.co/t/replicas-allocation-failed/261768 "2021-02-02T10:07:48Z")
Hi, After adjusting "index lifecycle policies" several times for this index, some replicas can't be allocated: 1- Is there a way to reallocate those replicas? 2- Is it possible to force all indices to have the same … --- ## [ES node out of memory: Java heap space](https://discuss.elastic.co/t/es-node-out-of-memory-java-heap-space/262787)
**Author:** [@iammanmale](https://discuss.elastic.co/u/iammanmale)\ **Replies:** 15\ **Last updated:** [February 2, 2021, 9:56am UTC](https://discuss.elastic.co/t/es-node-out-of-memory-java-heap-space/262787 "2021-02-02T09:56:51Z")
I often find out of memory: Java heap space in some nodes in our ES cluster. I have already allocated half of the total memory of each node to heap size but I still get this error. And except heap size issue, I never fin… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1574) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1576)