# Latest **URL:** https://discuss.elastic.co/latest.md?page=1861 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1862 --- ## [Elasticsearch cluster request timeout and slow response time](https://discuss.elastic.co/t/elasticsearch-cluster-request-timeout-and-slow-response-time/263023)
**Author:** [@LurenzZ](https://discuss.elastic.co/u/LurenzZ)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 6:10pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-request-timeout-and-slow-response-time/263023 "2021-02-02T18:10:44Z")
Hi, we are having some problems with our Elasticsearch cluster. For the past few days the requests performed by the master node occassionally start to time out and, after that, every search query executed to elasticsear… --- ## [Unable to parse date in grok and filters](https://discuss.elastic.co/t/unable-to-parse-date-in-grok-and-filters/262988)
**Author:** [@RFeiten](https://discuss.elastic.co/u/RFeiten)\ **Replies:** 4\ **Last updated:** [February 2, 2021, 5:53pm UTC](https://discuss.elastic.co/t/unable-to-parse-date-in-grok-and-filters/262988 "2021-02-02T17:53:38Z")
I have the following message 2021-01-04T00:04:00.8033345+00:00 0HM5E5E28610F:00000001 \[INF\] MyMessage What I'm trying to do is to extract each of those fields into a separate column for my index. This is what I have b… --- ## [Filebeat Microsoft Module support for Microsoft Defender for Office 365?](https://discuss.elastic.co/t/filebeat-microsoft-module-support-for-microsoft-defender-for-office-365/263018)
**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 5:46pm UTC](https://discuss.elastic.co/t/filebeat-microsoft-module-support-for-microsoft-defender-for-office-365/263018 "2021-02-02T17:46:08Z")
Hello, I was wondering if the following Filebeat module also works for Microsoft Defender for Office 365 (https://www.microsoft.com/en/microsoft-365/security/office-365-defender)? Best regards, Willem --- ## [Need to fetch only selected data from Grok filter](https://discuss.elastic.co/t/need-to-fetch-only-selected-data-from-grok-filter/262972)
**Author:** [@ankitdevnalkar](https://discuss.elastic.co/u/ankitdevnalkar)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 5:43pm UTC](https://discuss.elastic.co/t/need-to-fetch-only-selected-data-from-grok-filter/262972 "2021-02-02T17:43:30Z")
Sample Log : 2020-12-16T04:43:43Z Bitcoin Core version v0.20.1.0-g7ff64311bee570874c4f0dfa18f518552188df08 (release build) I want to get the only version(v0.20.1.0) from the above log, Note : version string is a whole … --- ## [Metric output to elasticsearch via filebeat](https://discuss.elastic.co/t/metric-output-to-elasticsearch-via-filebeat/262560)
**Author:** [@umesh2020](https://discuss.elastic.co/u/umesh2020)\ **Replies:** 3\ **Last updated:** [February 2, 2021, 4:58pm UTC](https://discuss.elastic.co/t/metric-output-to-elasticsearch-via-filebeat/262560 "2021-02-02T16:58:01Z")
I have a question related to metrics collection. The application writes metric data into a file. Can filebeat pickup this information say using log or filestream input and send it to elasticsearch ? What would be the d… --- ## [Convert current time into minutes using painless](https://discuss.elastic.co/t/convert-current-time-into-minutes-using-painless/262991)
**Author:** [@Gokul6](https://discuss.elastic.co/u/Gokul6)\ **Replies:** 5\ **Last updated:** [February 2, 2021, 3:17pm UTC](https://discuss.elastic.co/t/convert-current-time-into-minutes-using-painless/262991 "2021-02-02T15:17:10Z")
def now = new Date().getTime(); return now; in kibana scripted fields i am getting current date and time using the above code. the output of the above code is Feb 2, 2021 @ 16:47:24.807 i want to convert this time ent… --- ## [Reindex parse\_exception](https://discuss.elastic.co/t/reindex-parse-exception/262824)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 5\ **Last updated:** [February 2, 2021, 4:11pm UTC](https://discuss.elastic.co/t/reindex-parse-exception/262824 "2021-02-02T16:11:28Z")
POST \_reindex?wait\_for\_completion=true { "source": { "index": "apm-7.8.1-transaction-000007", "query": { "match\_all": {} } }, "dest": { "index": "apm-7.8.1-transaction-new-000007", "pi… --- ## [Logstash is not sending the data to elasticsearch](https://discuss.elastic.co/t/logstash-is-not-sending-the-data-to-elasticsearch/262365)
**Author:** [@sauravsuman689](https://discuss.elastic.co/u/sauravsuman689)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 3:37pm UTC](https://discuss.elastic.co/t/logstash-is-not-sending-the-data-to-elasticsearch/262365 "2021-02-02T15:37:49Z")
Hi Team, My dataflow is as below : filebeat -\> kafka -\> logstash -\> es -\> kibana Messages are coming to Kafka topic but I don't see logstash is processing anything and sending to es cluster. Below is the warning mess… --- ## [How to Know how many Metric beat agents are up and running](https://discuss.elastic.co/t/how-to-know-how-many-metric-beat-agents-are-up-and-running/261890)
**Author:** [@sai07](https://discuss.elastic.co/u/sai07)\ **Replies:** 17\ **Last updated:** [February 2, 2021, 3:26pm UTC](https://discuss.elastic.co/t/how-to-know-how-many-metric-beat-agents-are-up-and-running/261890 "2021-02-02T15:26:23Z")
We have configured 100 Metricbeat agents in 100 VM's and we are getting all the logs from that VM's as well. But we need to monitor the Metricbeat agent as well. If any Metricbeat agent is not working we need to identi… --- ## [Converting date to TIMESTAMP\_ISO8601 format](https://discuss.elastic.co/t/converting-date-to-timestamp-iso8601-format/262952)
**Author:** [@gloupe](https://discuss.elastic.co/u/gloupe)\ **Replies:** 1\ **Last updated:** [February 2, 2021, 3:24pm UTC](https://discuss.elastic.co/t/converting-date-to-timestamp-iso8601-format/262952 "2021-02-02T15:24:56Z")
Hi, I'm actually receiving logs with timestamp to this format : Mon Feb 1 13:29:48 2021 From Telegraf who's parsing the log with this Grok pattern : SOURCELOG %{DAY} %{MONTH} (?: %{POSINT:MONTHDAY}) %{TIME} %{YEAR} … --- ## [Query DSL, Boolean query. Multiple conditions for must\_not](https://discuss.elastic.co/t/query-dsl-boolean-query-multiple-conditions-for-must-not/263004)
**Author:** [@gneves](https://discuss.elastic.co/u/gneves)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 3:10pm UTC](https://discuss.elastic.co/t/query-dsl-boolean-query-multiple-conditions-for-must-not/263004 "2021-02-02T15:10:15Z")
Hello guys, hope you are doing well and healthy. Im having a little trouble using DSL querys. My objective is this: I want to trigger an event that, the action must be "UserLoggedIn", the country must NOT be Portuga… --- ## [Weighted bars in count barchart](https://discuss.elastic.co/t/weighted-bars-in-count-barchart/262342)
**Author:** [@Bram\_Tervoort](https://discuss.elastic.co/u/Bram_Tervoort)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 2:57pm UTC](https://discuss.elastic.co/t/weighted-bars-in-count-barchart/262342 "2021-02-02T14:57:56Z")
I would like to make a barchart in kibana displaying the counts of bucket. But i would like the bar of 1 XL to be as large a 5 times a single S. I already counted all the documents in my index split them on a weekly and … --- ## [Apm server secret\_token](https://discuss.elastic.co/t/apm-server-secret-token/262841)
**Author:** [@aman26ps](https://discuss.elastic.co/u/aman26ps)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 2:55pm UTC](https://discuss.elastic.co/t/apm-server-secret-token/262841 "2021-02-02T14:55:52Z")
Hi Team, i would like to change secret\_token of apm server config, i am using the following config, but the token is not getting reflected secureSettings: - secretName: test-apm-token config: apm-server: … --- ## [FileBeat Gsuite module deprecated?](https://discuss.elastic.co/t/filebeat-gsuite-module-deprecated/262939)
**Author:** [@ido](https://discuss.elastic.co/u/ido)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 2:04pm UTC](https://discuss.elastic.co/t/filebeat-gsuite-module-deprecated/262939 "2021-02-02T14:04:44Z")
TL;DR - gsuite module does not send logs although it seems that I've done everything right (more details in the post). I looked at the source code and there was a comment saying "Gsuite module is deprecated... use Google… --- ## [ElasticSearch - Latest record per day per ID from elastic](https://discuss.elastic.co/t/elasticsearch-latest-record-per-day-per-id-from-elastic/262993)
**Author:** [@prashantmalik](https://discuss.elastic.co/u/prashantmalik)\ **Replies:** 1\ **Last updated:** [February 2, 2021, 2:03pm UTC](https://discuss.elastic.co/t/elasticsearch-latest-record-per-day-per-id-from-elastic/262993 "2021-02-02T14:03:39Z")
I have index in Elsaticsearch of records of form: Record{ Timestamp; Id; . .} It has multiple records for ID per day. I want to fetch latest record per Id per day. Can you please help me with such query? Exam… --- ## [Reindex failed: search\_context\_missing\_exception](https://discuss.elastic.co/t/reindex-failed-search-context-missing-exception/262992)
**Author:** [@wangxr1985](https://discuss.elastic.co/u/wangxr1985)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 1:53pm UTC](https://discuss.elastic.co/t/reindex-failed-search-context-missing-exception/262992 "2021-02-02T13:53:53Z")
I want to migrate a index from es5 cluster to es7 cluster by using remote reindexing. The number of docs is 5,000,000. I use curl to call the \_reindex api like this: curl -uelastic:xxx -XPOST -H 'Content-Type: applica… --- ## [Reporting Error: Access for Kibana -\>Share -\> CSV Report -\> Generate CSV](https://discuss.elastic.co/t/reporting-error-access-for-kibana-share-csv-report-generate-csv/262658)
**Author:** [@qub123](https://discuss.elastic.co/u/qub123)\ **Replies:** 4\ **Last updated:** [February 2, 2021, 1:48pm UTC](https://discuss.elastic.co/t/reporting-error-access-for-kibana-share-csv-report-generate-csv/262658 "2021-02-02T13:48:12Z")
Hi I have a user with the guest\_role which can "read" access on an index, I have also assigned a Kibana's reporting\_user role, but when the user tries to Share the content of and index using Share -\> CSV Report -\> Gen… --- ## [Filebeat - support for API keys in Logstash outputs](https://discuss.elastic.co/t/filebeat-support-for-api-keys-in-logstash-outputs/262981)
**Author:** [@vigneshr35](https://discuss.elastic.co/u/vigneshr35)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 1:16pm UTC](https://discuss.elastic.co/t/filebeat-support-for-api-keys-in-logstash-outputs/262981 "2021-02-02T13:16:50Z")
Hi, I see that support for API keys in Elasticsearch outputs was provided starting from release 7.6.0. Do we have similar support added for API keys in Logstash outputs? I don't see it in the documentation. So, my unde… --- ## [Elasticsearch vs Solr vs Vespa](https://discuss.elastic.co/t/elasticsearch-vs-solr-vs-vespa/262980)
**Author:** [@Charlie\_Hull](https://discuss.elastic.co/u/Charlie_Hull)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 1:12pm UTC](https://discuss.elastic.co/t/elasticsearch-vs-solr-vs-vespa/262980 "2021-02-02T13:12:04Z")
We had a Meetup recently featuring Anshum Gupta, VP of Apache Lucene, Josh Devins of Elastic and Jo Kristian Bergum from the Vespa team - what did we learn? https://opensourceconnections.com/blog/2021/02/02/solr-vs-elast… --- ## [Percentiles plot in vega-lite](https://discuss.elastic.co/t/percentiles-plot-in-vega-lite/262942)
**Author:** [@deeksha39](https://discuss.elastic.co/u/deeksha39)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 12:54pm UTC](https://discuss.elastic.co/t/percentiles-plot-in-vega-lite/262942 "2021-02-02T12:54:55Z")
Hi , I want a visualization(bar plot) in kibana through vega-lite to aggregate the data on 90th percentile and 10th percentile and groupby the data on multiple fields, on x-axis , I want to display group1 , group2 etc.… --- ## [Best Practises to handle an index of of 1.2TiB](https://discuss.elastic.co/t/best-practises-to-handle-an-index-of-of-1-2tib/262839)
**Author:** [@carmine.fabrizio](https://discuss.elastic.co/u/carmine.fabrizio)\ **Replies:** 6\ **Last updated:** [February 2, 2021, 12:09pm UTC](https://discuss.elastic.co/t/best-practises-to-handle-an-index-of-of-1-2tib/262839 "2021-02-02T12:09:58Z")
Hi there, I have an index of 1.2TiB, split into 9 shards of 200GiB each, also I do have a lifecycle policy that will roll the shards in HOT/WARM/COLD phases. Are there any best practices that I can introduce in order t… --- ## [Pipeline workers configuration](https://discuss.elastic.co/t/pipeline-workers-configuration/262934)
**Author:** [@ritusingh](https://discuss.elastic.co/u/ritusingh)\ **Replies:** 8\ **Last updated:** [February 2, 2021, 11:21am UTC](https://discuss.elastic.co/t/pipeline-workers-configuration/262934 "2021-02-02T11:21:14Z")
Hi, I have reduced pipeline.workers to 1 because I need the output in correct order. Now the problem is when I am giving 10k request (100 per second) it is not reaching elasticsearch, only 9k reaching. Earlier it was no… --- ## [Visualize Group by result](https://discuss.elastic.co/t/visualize-group-by-result/262793)
**Author:** [@deeksha39](https://discuss.elastic.co/u/deeksha39)\ **Replies:** 4\ **Last updated:** [February 2, 2021, 11:00am UTC](https://discuss.elastic.co/t/visualize-group-by-result/262793 "2021-02-02T11:00:52Z")
Hi, I am working on a large dataset with 20000 rows and 40 columns, I want to group by my data based on 10 categorical columns, then I want to create a histogram and percentiles graph to make a comparison between the to… --- ## [How to show mulitple servers logs in kibana separatly from each other](https://discuss.elastic.co/t/how-to-show-mulitple-servers-logs-in-kibana-separatly-from-each-other/262948)
**Author:** [@huzaifa224](https://discuss.elastic.co/u/huzaifa224)\ **Replies:** 2\ **Last updated:** [February 2, 2021, 10:52am UTC](https://discuss.elastic.co/t/how-to-show-mulitple-servers-logs-in-kibana-separatly-from-each-other/262948 "2021-02-02T10:52:24Z")
I have installed ELK on my Ubuntu server and install filebeat on remote server-A and server-B. I have configured Log-stash to receive data from filebeat and forward them to Elasticsearch. Both servers logs are showing in… --- ## [Minus timezone on date histogram aggregation shifts back buckets one day](https://discuss.elastic.co/t/minus-timezone-on-date-histogram-aggregation-shifts-back-buckets-one-day/262959)
**Author:** [@anas-hossam](https://discuss.elastic.co/u/anas-hossam)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 10:28am UTC](https://discuss.elastic.co/t/minus-timezone-on-date-histogram-aggregation-shifts-back-buckets-one-day/262959 "2021-02-02T10:28:03Z")
this is my body request when search in elasticsearch version 1.5 { "body": { "size": 0, "query": { "filtered": { "filter": { "bool": { … --- ## [Add static line for Horizontal bar chart](https://discuss.elastic.co/t/add-static-line-for-horizontal-bar-chart/262338)
**Author:** [@pavank](https://discuss.elastic.co/u/pavank)\ **Replies:** 3\ **Last updated:** [February 2, 2021, 10:18am UTC](https://discuss.elastic.co/t/add-static-line-for-horizontal-bar-chart/262338 "2021-02-02T10:18:03Z")
Kibana version 6.7 We are trying to create a dashboard with a horizontal bar based on a field named duration of type number. We want to add a static line to show the Threshold of sorts for the entire series. We followe… --- ## [ILM: keep all indices on hot node](https://discuss.elastic.co/t/ilm-keep-all-indices-on-hot-node/262861)
**Author:** [@matejzero](https://discuss.elastic.co/u/matejzero)\ **Replies:** 3\ **Last updated:** [February 2, 2021, 10:14am UTC](https://discuss.elastic.co/t/ilm-keep-all-indices-on-hot-node/262861 "2021-02-02T10:14:16Z")
Hello, I'm transitioning to ILM and at the moment, I have hot and warm nodes. Warm nodes don't have any data as I have cluster.routing.allocation.exclude.\_ip set on the warm nodes. I want to create an ILM policy that w… --- ## [Replicas allocation failed](https://discuss.elastic.co/t/replicas-allocation-failed/261768)
**Author:** [@mcosta](https://discuss.elastic.co/u/mcosta)\ **Replies:** 8\ **Last updated:** [February 2, 2021, 10:07am UTC](https://discuss.elastic.co/t/replicas-allocation-failed/261768 "2021-02-02T10:07:48Z")
Hi, After adjusting "index lifecycle policies" several times for this index, some replicas can't be allocated: 1- Is there a way to reallocate those replicas? 2- Is it possible to force all indices to have the same … --- ## [ES node out of memory: Java heap space](https://discuss.elastic.co/t/es-node-out-of-memory-java-heap-space/262787)
**Author:** [@iammanmale](https://discuss.elastic.co/u/iammanmale)\ **Replies:** 15\ **Last updated:** [February 2, 2021, 9:56am UTC](https://discuss.elastic.co/t/es-node-out-of-memory-java-heap-space/262787 "2021-02-02T09:56:51Z")
I often find out of memory: Java heap space in some nodes in our ES cluster. I have already allocated half of the total memory of each node to heap size but I still get this error. And except heap size issue, I never fin… --- ## [OFFLINE Labs - Issue on loading filebeat data for log-servers](https://discuss.elastic.co/t/offline-labs-issue-on-loading-filebeat-data-for-log-servers/262863)
**Author:** [@Francois\_Protopapa](https://discuss.elastic.co/u/Francois_Protopapa)\ **Replies:** 5\ **Last updated:** [February 2, 2021, 9:39am UTC](https://discuss.elastic.co/t/offline-labs-issue-on-loading-filebeat-data-for-log-servers/262863 "2021-02-02T09:39:55Z")
Dear Team, I started to setup m offline LABS for the EE 1 and all went well, but for some reason, I am not able to import the log files collected in the ZIP file. Here what I did: Followed the step by steps: Running… [Previous page](https://discuss.elastic.co/latest.md?page=1860) [Next page](https://discuss.elastic.co/latest.md?page=1862)