# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1899 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1900 --- ## [Elasticsearch-hadoop Connector](https://discuss.elastic.co/t/elasticsearch-hadoop-connector/243090)
**Author:** [@bastienharmand](https://discuss.elastic.co/u/bastienharmand)\ **Replies:** 0\ **Last updated:** [July 29, 2020, 3:44pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-connector/243090 "2020-07-29T15:44:04Z")
Hello, I want to connect to an Elasticsearch \[7.5\] cluster with elasticsearch-hadoop using the SSL protocol. By providing the user and password with curl : curl -XPUT -k -u "user:pass" https://xxxxxxxxxxx:9200/prefix-t… --- ## [How to set HTTP filter body to whole event](https://discuss.elastic.co/t/how-to-set-http-filter-body-to-whole-event/243041)
**Author:** [@bradley.king](https://discuss.elastic.co/u/bradley.king)\ **Replies:** 2\ **Last updated:** [July 29, 2020, 9:16pm UTC](https://discuss.elastic.co/t/how-to-set-http-filter-body-to-whole-event/243041 "2020-07-29T21:16:07Z")
Hi guys, just a quick question. I can't seem to find the answer on the docs :confused: How do I reference the whole event in logstash? I want to use the HTTP filter to send the whole event to one of our APIs for some q… --- ## [Dns log parsing and display in Kibana](https://discuss.elastic.co/t/dns-log-parsing-and-display-in-kibana/242989)
**Author:** [@rossw](https://discuss.elastic.co/u/rossw)\ **Replies:** 2\ **Last updated:** [July 29, 2020, 9:00pm UTC](https://discuss.elastic.co/t/dns-log-parsing-and-display-in-kibana/242989 "2020-07-29T21:00:55Z")
I think there is an error in the way that Packetbeat (7.8) parses DNS logs, and/or the way that Kibana displays them. If I have a host 1.1.1.1 that sends a dns request for microsoft.com to the DNS server 2.2.2.2, and pa… --- ## [TSVB - match fields from two Indexes V7.3](https://discuss.elastic.co/t/tsvb-match-fields-from-two-indexes-v7-3/241873)
**Author:** [@martb](https://discuss.elastic.co/u/martb)\ **Replies:** 1\ **Last updated:** [July 29, 2020, 8:45pm UTC](https://discuss.elastic.co/t/tsvb-match-fields-from-two-indexes-v7-3/241873 "2020-07-29T20:45:33Z")
Hi, I'm new to the TSVB in Kibana. Im displaying data from one index and trying to tag events from another index where the field contents matches i.e hostname. All works accept the tagging events on match. Please advi… --- ## [Kibana Index time field does not match @timestamp field](https://discuss.elastic.co/t/kibana-index-time-field-does-not-match-timestamp-field/242922)
**Author:** [@Kevin\_f](https://discuss.elastic.co/u/Kevin_f)\ **Replies:** 2\ **Last updated:** [July 29, 2020, 8:20pm UTC](https://discuss.elastic.co/t/kibana-index-time-field-does-not-match-timestamp-field/242922 "2020-07-29T20:20:39Z")
Hello, Within my Kibana, I have an index showing @timestamp and another called "time". The first issue is the field @timestamp does not match the time in Europe/London. The second is issue is that the time field in lo… --- ## [Multiple Advanced Setting after upgrade to 7.8.0](https://discuss.elastic.co/t/multiple-advanced-setting-after-upgrade-to-7-8-0/242178)
**Author:** [@srpine](https://discuss.elastic.co/u/srpine)\ **Replies:** 1\ **Last updated:** [July 29, 2020, 7:51pm UTC](https://discuss.elastic.co/t/multiple-advanced-setting-after-upgrade-to-7-8-0/242178 "2020-07-29T19:51:17Z")
After upgrading from 7.7.0 to 7.8.0 Saved Objects in Kibana shows in Saved Objects: Advanced Settings \[7.8.0\] Advanced Settings \[7.7.0\] Question: Do I need to keep both Advanced Settings and if so why? Can I delete… --- ## [Ssl.verification\_mode options for Filebeat 5.6](https://discuss.elastic.co/t/ssl-verification-mode-options-for-filebeat-5-6/242978)
**Author:** [@alarka](https://discuss.elastic.co/u/alarka)\ **Replies:** 9\ **Last updated:** [July 29, 2020, 7:44pm UTC](https://discuss.elastic.co/t/ssl-verification-mode-options-for-filebeat-5-6/242978 "2020-07-29T19:44:22Z")
As per Filebeat 7.8, https://www.elastic.co/guide/en/elasticsearch/reference/current/security-settings.html ssl.verification\_mode has 3 options: "full", "certificate" and "none". For Filebeat 5.6, I do not see the opti… --- ## [Date histograms -- fixed intervals possible?](https://discuss.elastic.co/t/date-histograms-fixed-intervals-possible/243106)
**Author:** [@Todd\_Sayers](https://discuss.elastic.co/u/Todd_Sayers)\ **Replies:** 2\ **Last updated:** [July 29, 2020, 7:41pm UTC](https://discuss.elastic.co/t/date-histograms-fixed-intervals-possible/243106 "2020-07-29T19:41:40Z")
I'm really struggling with the Date Histogram (in Kibana). We're sending custom metric data to ES (no, none of the Elastic tools are capable of doing this). The data and visualizations are "fine..." with one caveat: we c… --- ## [Is there a way to match Timestamps with the time in the message of the log](https://discuss.elastic.co/t/is-there-a-way-to-match-timestamps-with-the-time-in-the-message-of-the-log/242906)
**Author:** [@Archie\_Crawford](https://discuss.elastic.co/u/Archie_Crawford)\ **Replies:** 9\ **Last updated:** [July 29, 2020, 7:32pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-match-timestamps-with-the-time-in-the-message-of-the-log/242906 "2020-07-29T19:32:29Z")
I have tried to use things like : Filter{ grok { match =\> \["message", "%{TIMESTAMP\_ISO8601:timestamp}"\] } date { match =\> \["timestamp", "ISO8601"\] } } I have been trying to do this for java stack trace logs ... … --- ## [Configure Kibana for TLS 1.1](https://discuss.elastic.co/t/configure-kibana-for-tls-1-1/243110)
**Author:** [@eafrost.cissp](https://discuss.elastic.co/u/eafrost.cissp)\ **Replies:** 1\ **Last updated:** [July 29, 2020, 7:26pm UTC](https://discuss.elastic.co/t/configure-kibana-for-tls-1-1/243110 "2020-07-29T19:26:09Z")
I'm using Chrome as my browser on Windows. I'm running Kibana 7.8.0 and I've created the digital certs and am using SSL. When I configure Chrome to only allow secure connections running TLS 1.1 or above, I receive an err… --- ## [Creating a sub field of GROK filter pattern](https://discuss.elastic.co/t/creating-a-sub-field-of-grok-filter-pattern/238860)
**Author:** [@hemant\_472](https://discuss.elastic.co/u/hemant_472)\ **Replies:** 4\ **Last updated:** [July 29, 2020, 6:52pm UTC](https://discuss.elastic.co/t/creating-a-sub-field-of-grok-filter-pattern/238860 "2020-07-29T18:52:00Z")
Hi Everyone, i have a logstash configuration to parse my current logs but i would like to create a sub field from my message field and that data should be parsed as a fieldname, please suggest how that is possible: For… --- ## [Area visualization](https://discuss.elastic.co/t/area-visualization/242116)
**Author:** [@hiba](https://discuss.elastic.co/u/hiba)\ **Replies:** 1\ **Last updated:** [July 29, 2020, 6:38pm UTC](https://discuss.elastic.co/t/area-visualization/242116 "2020-07-29T18:38:22Z")
Hi, this my data source: { "bookings": \[ { "bookingId": 553267, "bookingRef": "VO20200108460", "statusId": 1, "status": "Confirmed", "rating": 4, "hotelId": 17060, "hotelName": "Nerolia Hotel & SPA 4\*", "hote… --- ## [How to recover unassigned shards and replica for a index](https://discuss.elastic.co/t/how-to-recover-unassigned-shards-and-replica-for-a-index/242917)
**Author:** [@Ganesh2303](https://discuss.elastic.co/u/Ganesh2303)\ **Replies:** 5\ **Last updated:** [July 29, 2020, 5:46pm UTC](https://discuss.elastic.co/t/how-to-recover-unassigned-shards-and-replica-for-a-index/242917 "2020-07-29T17:46:54Z")
HI team, I want to know how to recover the red state into Green and when it try to find the reason and im getting below data, xx-logstash-2020.07 0 p INITIALIZING INDEX\_REOPENED xx-logstash-2020.07 0 … --- ## [Logstash - filebeat](https://discuss.elastic.co/t/logstash-filebeat/242216)
**Author:** [@Arezki76](https://discuss.elastic.co/u/Arezki76)\ **Replies:** 2\ **Last updated:** [July 29, 2020, 5:32pm UTC](https://discuss.elastic.co/t/logstash-filebeat/242216 "2020-07-29T17:32:38Z")
Hi, I'm new in ELK and I'm trying to parse log file as follow: 2019 Nov 12 14:58:01:211 GMT -0500 BW.ypg\_bis\_ful\_campaignservice\_bw-ypg-bis-ful-campaignservice-bw Info \[BW-User\] UPSTREAM\_REQUEST Job-1000 \[ESBCore/Log/S… --- ## [Convert Kibana query (create index pattern) to Python](https://discuss.elastic.co/t/convert-kibana-query-create-index-pattern-to-python/242991)
**Author:** [@momora9809](https://discuss.elastic.co/u/momora9809)\ **Replies:** 5\ **Last updated:** [July 29, 2020, 5:28pm UTC](https://discuss.elastic.co/t/convert-kibana-query-create-index-pattern-to-python/242991 "2020-07-29T17:28:41Z")
Hi, I'm trying to convert this query to python: PUT /.kibana/\_doc/index-pattern:tempindex { "type": "index-pattern", "index-pattern": { "title": "tempindex", "timeFieldName": "sendTime" } } HEADERS = { … --- ## [Adding a new columns to a data table from a calculation based on two different columns in the same row](https://discuss.elastic.co/t/adding-a-new-columns-to-a-data-table-from-a-calculation-based-on-two-different-columns-in-the-same-row/242952)
**Author:** [@MyQuery](https://discuss.elastic.co/u/MyQuery)\ **Replies:** 3\ **Last updated:** [July 29, 2020, 5:14pm UTC](https://discuss.elastic.co/t/adding-a-new-columns-to-a-data-table-from-a-calculation-based-on-two-different-columns-in-the-same-row/242952 "2020-07-29T17:14:42Z")
Hi, The user wants to see if there is a way to add a two additional column (Calculated columns) to data table like below table. Market | Total | D1 | D2 | Total D | Percentage D1 | Percentage D2 | percentage Tot… --- ## [Encrypt filebeat to logstash](https://discuss.elastic.co/t/encrypt-filebeat-to-logstash/242944)
**Author:** [@elk6](https://discuss.elastic.co/u/elk6)\ **Replies:** 3\ **Last updated:** [July 29, 2020, 5:04pm UTC](https://discuss.elastic.co/t/encrypt-filebeat-to-logstash/242944 "2020-07-29T17:04:37Z")
I have a small setup. Filebeat was able to successfully send logs to logstash. I was then asked to encrypt communication between filebeat to logstash. On logstash I've added to the following to the input{ } block: ssl\_… --- ## [Customization of Discover Page (Doc Table)](https://discuss.elastic.co/t/customization-of-discover-page-doc-table/240949)
**Author:** [@Akhil\_Kaithoju](https://discuss.elastic.co/u/Akhil_Kaithoju)\ **Replies:** 12\ **Last updated:** [July 29, 2020, 4:56pm UTC](https://discuss.elastic.co/t/customization-of-discover-page-doc-table/240949 "2020-07-29T16:56:49Z")
Hi, I want to customize Doc Table‌ on the Discover page. Requirement: I want to implement for selecting and multi-selecting all table fields using the check boxes and the data should come when selecting the check boxe… --- ## [Load kibana dashboard in iframe with API KEY authentication](https://discuss.elastic.co/t/load-kibana-dashboard-in-iframe-with-api-key-authentication/242970)
**Author:** [@Muhammad\_Umair\_Baig](https://discuss.elastic.co/u/Muhammad_Umair_Baig)\ **Replies:** 1\ **Last updated:** [July 28, 2020, 10:27pm UTC](https://discuss.elastic.co/t/load-kibana-dashboard-in-iframe-with-api-key-authentication/242970 "2020-07-28T22:27:39Z")
Hi Team, I am wondering if we can achieve this. I did not find any topic related to this on which we are using api key authentication mechanism and load kibana dashboard in iframe Kibana and elastic search version i am… --- ## [Highlight entire row in kibana dashboard](https://discuss.elastic.co/t/highlight-entire-row-in-kibana-dashboard/243056)
**Author:** [@raj\_elk](https://discuss.elastic.co/u/raj_elk)\ **Replies:** 5\ **Last updated:** [July 29, 2020, 4:30pm UTC](https://discuss.elastic.co/t/highlight-entire-row-in-kibana-dashboard/243056 "2020-07-29T16:30:01Z")
Hi, I have extracted error\_type(INFO,ERROR) from logs so want to highlight each row with different color based on type. i have tried but it is highlighting only that field not entire row. how this can be implemented. --- ## [Cidr Plugin - Warn and skipping data... Missing Data](https://discuss.elastic.co/t/cidr-plugin-warn-and-skipping-data-missing-data/242875)
**Author:** [@Apollyon](https://discuss.elastic.co/u/Apollyon)\ **Replies:** 3\ **Last updated:** [July 29, 2020, 3:57pm UTC](https://discuss.elastic.co/t/cidr-plugin-warn-and-skipping-data-missing-data/242875 "2020-07-29T15:57:57Z")
Hello, I've been playing around with the logstash cidr filter plugin and have been coming into a couple of issues. For the most part, with most of the data sets that are coming in, this filter is working well and is doi… --- ## [How to fix this date range](https://discuss.elastic.co/t/how-to-fix-this-date-range/243065)
**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\ **Replies:** 3\ **Last updated:** [July 29, 2020, 3:42pm UTC](https://discuss.elastic.co/t/how-to-fix-this-date-range/243065 "2020-07-29T15:42:58Z")
Hi, Here is sample code from the documentation: GET /\_search { "query": { "range": { "timestamp": { "gte": "now-1d/d", "lt": "now/d" } } } } I want to change it so that now only… --- ## [Logstash filter plugin (Grok) for custom pattern Not match curly bracket!](https://discuss.elastic.co/t/logstash-filter-plugin-grok-for-custom-pattern-not-match-curly-bracket/243053)
**Author:** [@AliMaleki21](https://discuss.elastic.co/u/AliMaleki21)\ **Replies:** 17\ **Last updated:** [July 29, 2020, 3:42pm UTC](https://discuss.elastic.co/t/logstash-filter-plugin-grok-for-custom-pattern-not-match-curly-bracket/243053 "2020-07-29T15:42:57Z")
i have problem with grok plugin, curly bracket not match on Grok filter plugin sample log: {Allowed/Denied} .... regex: ACTION\_FIREWALL (Allowed|Denied) Pattern: {%{ACTION\_FIREWALL:action\_firewall}} when try this … --- ## [By Date Indexes when using Elastic Ingest](https://discuss.elastic.co/t/by-date-indexes-when-using-elastic-ingest/242994)
**Author:** [@tbernhardson](https://discuss.elastic.co/u/tbernhardson)\ **Replies:** 2\ **Last updated:** [July 29, 2020, 3:29pm UTC](https://discuss.elastic.co/t/by-date-indexes-when-using-elastic-ingest/242994 "2020-07-29T15:29:21Z")
When using Logstash it's easy to tell the system to create indices by day (also then making it easy to delete old data). I've tried to figure out how to do the same thing when sending the beats data directly to Elastics… --- ## [Global Logout in ELK](https://discuss.elastic.co/t/global-logout-in-elk/242958)
**Author:** [@nirav.gshah](https://discuss.elastic.co/u/nirav.gshah)\ **Replies:** 2\ **Last updated:** [July 29, 2020, 2:57pm UTC](https://discuss.elastic.co/t/global-logout-in-elk/242958 "2020-07-29T14:57:48Z")
Hi, I am new to ELk, in basic license can we call the global logout option. Is there somehow i can call global logout. Regards Nirav --- ## [How to configure csp.rules for kibana on docker](https://discuss.elastic.co/t/how-to-configure-csp-rules-for-kibana-on-docker/243025)
**Author:** [@Raja\_SP](https://discuss.elastic.co/u/Raja_SP)\ **Replies:** 2\ **Last updated:** [July 29, 2020, 2:52pm UTC](https://discuss.elastic.co/t/how-to-configure-csp-rules-for-kibana-on-docker/243025 "2020-07-29T14:52:21Z")
I want to add the following rule to the kibana.yml for kibana on docker, version 7.7.1. I will externalise the kibana.yml filke using the volume mapping. But what is the right syntax ? The below syntax works for the nati… --- ## [Can't get encryption to Logstash working](https://discuss.elastic.co/t/cant-get-encryption-to-logstash-working/243078)
**Author:** [@elk6](https://discuss.elastic.co/u/elk6)\ **Replies:** 0\ **Last updated:** [July 29, 2020, 2:44pm UTC](https://discuss.elastic.co/t/cant-get-encryption-to-logstash-working/243078 "2020-07-29T14:44:23Z")
I've created elasticsearch users to secure communications between the stack (all on one machine). Now I need to encrypt communications to logstash from remote machines. I'm redoing my step because I just don't know wha… --- ## [Conditional watcher alert](https://discuss.elastic.co/t/conditional-watcher-alert/240210)
**Author:** [@velu](https://discuss.elastic.co/u/velu)\ **Replies:** 4\ **Last updated:** [July 29, 2020, 2:18pm UTC](https://discuss.elastic.co/t/conditional-watcher-alert/240210 "2020-07-29T14:18:17Z")
Hi, Is it possible to set the alert triggering condition like ...the alert should trigger after 10 mins after it reaches threshold value . Note: we have to wait for 10 mins to check whether the value is getting draine… --- ## [Advanced Watch: how to debug](https://discuss.elastic.co/t/advanced-watch-how-to-debug/242893)
**Author:** [@RajeshKumar](https://discuss.elastic.co/u/RajeshKumar)\ **Replies:** 1\ **Last updated:** [July 29, 2020, 2:10pm UTC](https://discuss.elastic.co/t/advanced-watch-how-to-debug/242893 "2020-07-29T14:10:21Z")
Hi, I have created an Advanced Watch which I was able to simulate and it went to Firing mode. I could see the following after simulated: { "watch\_id": "inlined", "node": "p1qF\_EFFTrmz-3EoKpQgDQ", "state": "executed"… --- ## [Multi line logs Javastack trace not showing up correctly](https://discuss.elastic.co/t/multi-line-logs-javastack-trace-not-showing-up-correctly/242903)
**Author:** [@Archie\_Crawford](https://discuss.elastic.co/u/Archie_Crawford)\ **Replies:** 11\ **Last updated:** [July 29, 2020, 1:51pm UTC](https://discuss.elastic.co/t/multi-line-logs-javastack-trace-not-showing-up-correctly/242903 "2020-07-29T13:51:16Z")
The java stack trace logs are not coming in as multi-lines they are still coming in as separate lines Filebeat Config - /var/\*\*\*/catalina\* - /var/\*\*\*/\*.log multiline.pattern: '^\[\[:space:\]\]' multiline.negate:… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1898) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1900)