# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1594 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1595 --- ## [Could I drop @timestamp and @metadata in a event before sending event to Kafka?](https://discuss.elastic.co/t/could-i-drop-timestamp-and-metadata-in-a-event-before-sending-event-to-kafka/261719)
**Author:** [@cy-zheng](https://discuss.elastic.co/u/cy-zheng)\ **Replies:** 1\ **Last updated:** [January 21, 2021, 4:40am UTC](https://discuss.elastic.co/t/could-i-drop-timestamp-and-metadata-in-a-event-before-sending-event-to-kafka/261719 "2021-01-21T04:40:23Z")
Could I drop @timestamp and @metadata in a event before sending event to Kafka? --- ## [Filebeat cisco asa module source and destination IP showing reversed](https://discuss.elastic.co/t/filebeat-cisco-asa-module-source-and-destination-ip-showing-reversed/261327)
**Author:** [@ajesh](https://discuss.elastic.co/u/ajesh)\ **Replies:** 2\ **Last updated:** [January 21, 2021, 4:25am UTC](https://discuss.elastic.co/t/filebeat-cisco-asa-module-source-and-destination-ip-showing-reversed/261327 "2021-01-21T04:25:23Z")
Hi Team, We are using the filebeat cisco asa module in filebeat to parse the data from cisco asa firewalls. One issues we noticed is the source IP and destination IP are actually showing as reversed when its parsed. Fi… --- ## [Cannot ship ssh logs from filebeat to logstash](https://discuss.elastic.co/t/cannot-ship-ssh-logs-from-filebeat-to-logstash/261575)
**Author:** [@john8](https://discuss.elastic.co/u/john8)\ **Replies:** 3\ **Last updated:** [January 21, 2021, 3:44am UTC](https://discuss.elastic.co/t/cannot-ship-ssh-logs-from-filebeat-to-logstash/261575 "2021-01-21T03:44:36Z")
I sent syslog from filebeat to logstash it appeared in kibana as well then when I changed the path of the log file to /var/logs/auth.log it did not work. My main goal is to visualize the ssh logs. Thanks in advance. --- ## [Elasticsearch SQL query](https://discuss.elastic.co/t/elasticsearch-sql-query/261635)
**Author:** [@Sathish22](https://discuss.elastic.co/u/Sathish22)\ **Replies:** 2\ **Last updated:** [January 21, 2021, 3:13am UTC](https://discuss.elastic.co/t/elasticsearch-sql-query/261635 "2021-01-21T03:13:52Z")
Hi, I have three questions Can we push Elasticsearcsh SQL query output to a new index It is possible to use Elasticsearch SQL query in Dashboard/Visualization Is it possible to convert Elasticsearch SQL query to KQL q… --- ## [How can I restore an index pattern and dashboards?](https://discuss.elastic.co/t/how-can-i-restore-an-index-pattern-and-dashboards/261709)
**Author:** [@marcosvrrs](https://discuss.elastic.co/u/marcosvrrs)\ **Replies:** 2\ **Last updated:** [January 21, 2021, 2:33am UTC](https://discuss.elastic.co/t/how-can-i-restore-an-index-pattern-and-dashboards/261709 "2021-01-21T02:33:14Z")
Hi all, I made a mistake and deleted an index pattern that broke 3 dashboards I have. I don't know exactly how to reconstruct the visualizations inside the dashboard, as it was not named correctly, and when I click in t… --- ## [How does es fetch the right source with stale docIDs, after lucene merged queried segments](https://discuss.elastic.co/t/how-does-es-fetch-the-right-source-with-stale-docids-after-lucene-merged-queried-segments/261511)
**Author:** [@vsop\_479](https://discuss.elastic.co/u/vsop_479)\ **Replies:** 4\ **Last updated:** [January 21, 2021, 2:13am UTC](https://discuss.elastic.co/t/how-does-es-fetch-the-right-source-with-stale-docids-after-lucene-merged-queried-segments/261511 "2021-01-21T02:13:32Z")
Deleted documents are dropped when segments are merged, which will change the follows' docID. so how does es fetch the right source with stale docIDs. --- ## [Logstash Centralized management pipeline](https://discuss.elastic.co/t/logstash-centralized-management-pipeline/261691)
**Author:** [@esijati](https://discuss.elastic.co/u/esijati)\ **Replies:** 7\ **Last updated:** [January 21, 2021, 12:09am UTC](https://discuss.elastic.co/t/logstash-centralized-management-pipeline/261691 "2021-01-21T00:09:03Z")
Hi, I am trying to enable the logstash centralized pipeline management with X-Pack security enabled, but with limited documentation from ELK I am unable to proceed further on how it will look at Kibana side. Regards J… --- ## [Split API: shard sizing issue post split process](https://discuss.elastic.co/t/split-api-shard-sizing-issue-post-split-process/261526)
**Author:** [@elk11](https://discuss.elastic.co/u/elk11)\ **Replies:** 1\ **Last updated:** [January 20, 2021, 9:58pm UTC](https://discuss.elastic.co/t/split-api-shard-sizing-issue-post-split-process/261526 "2021-01-20T21:58:57Z")
Hi, elasticsearch version: 7.3.1 I had an index of size 107GB with a single shard (replicas: 0, primary shards: 1). Since it was too large and messing up the load distribution (based on disk), I decided to use split-ap… --- ## [Removing comma from values generated in Enhanced table](https://discuss.elastic.co/t/removing-comma-from-values-generated-in-enhanced-table/261637)
**Author:** [@sam7](https://discuss.elastic.co/u/sam7)\ **Replies:** 4\ **Last updated:** [January 20, 2021, 9:56pm UTC](https://discuss.elastic.co/t/removing-comma-from-values-generated-in-enhanced-table/261637 "2021-01-20T21:56:07Z")
I am using Enhanced table to generate a table showing some values. I want to remove comma generated in the table between values. Example - \["de","ne","us","ni"\] I want to hide comma between values. Is there a way … --- ## [Looking for Elasticsearch expert as Elastic sporadically is overloaded and stop responding](https://discuss.elastic.co/t/looking-for-elasticsearch-expert-as-elastic-sporadically-is-overloaded-and-stop-responding/261699)
**Author:** [@pamamolf](https://discuss.elastic.co/u/pamamolf)\ **Replies:** 0\ **Last updated:** [January 20, 2021, 8:13pm UTC](https://discuss.elastic.co/t/looking-for-elasticsearch-expert-as-elastic-sporadically-is-overloaded-and-stop-responding/261699 "2021-01-20T20:13:09Z")
Hello I am looking for an expert for my Invision forum as Elasticsearch sporadically is overloaded and stop responding... It will be great if he can check in depth and not only the config ..... Of course it will be a … --- ## [Request Entity Too Large when importing Kibana saved objects](https://discuss.elastic.co/t/request-entity-too-large-when-importing-kibana-saved-objects/261497)
**Author:** [@oskrdt](https://discuss.elastic.co/u/oskrdt)\ **Replies:** 6\ **Last updated:** [January 20, 2021, 9:31pm UTC](https://discuss.elastic.co/t/request-entity-too-large-when-importing-kibana-saved-objects/261497 "2021-01-20T21:31:48Z")
I'm trying to import a ndjson file with size 11.2 MB, but I'm getting the error 413 Request Entity Too Large when trying to do that. I tried increasing the following values on kibana.yml server.maxPayloadBytes: 104857… --- ## [ILM Rollover Issue](https://discuss.elastic.co/t/ilm-rollover-issue/261560)
**Author:** [@dfoot](https://discuss.elastic.co/u/dfoot)\ **Replies:** 1\ **Last updated:** [January 20, 2021, 9:15pm UTC](https://discuss.elastic.co/t/ilm-rollover-issue/261560 "2021-01-20T21:15:51Z")
Issue with ILM rollover after updated elasticsearch output: input\_storage-alias is the name of index I created policy name as input\_storage\_policy but from Index Management I am getting error message 'illegal\_argument\_… --- ## [Calculating the time remaining for re-indexing process](https://discuss.elastic.co/t/calculating-the-time-remaining-for-re-indexing-process/261702)
**Author:** [@sandeepkanabar](https://discuss.elastic.co/u/sandeepkanabar)\ **Replies:** 2\ **Last updated:** [January 20, 2021, 8:44pm UTC](https://discuss.elastic.co/t/calculating-the-time-remaining-for-re-indexing-process/261702 "2021-01-20T20:44:29Z")
While curator is a fantastic tool, I wish it was showing the approximate time remaining for a re-indexing process. Right now, I calculate the approximate time using the following: Fire GET \_tasks?detailed=true&action… --- ## [Elastic-agent fleet apache integration illegal\_argument\_exception](https://discuss.elastic.co/t/elastic-agent-fleet-apache-integration-illegal-argument-exception/261644)
**Author:** [@gregorys](https://discuss.elastic.co/u/gregorys)\ **Replies:** 2\ **Last updated:** [January 20, 2021, 8:35pm UTC](https://discuss.elastic.co/t/elastic-agent-fleet-apache-integration-illegal-argument-exception/261644 "2021-01-20T20:35:52Z")
Hi, Running on 7.10.2. I have added the "Apache" integration to collect only logfiles, not metrics. When I go to discover to browse the logs-\* index, these errors appear: 1 of 8 shards failed ## illegal\_argument\_exce… --- ## [Kibana reporting](https://discuss.elastic.co/t/kibana-reporting/261698)
**Author:** [@Akhil2](https://discuss.elastic.co/u/Akhil2)\ **Replies:** 3\ **Last updated:** [January 20, 2021, 8:22pm UTC](https://discuss.elastic.co/t/kibana-reporting/261698 "2021-01-20T20:22:48Z")
Hello there, I have a few indexes and a lot of data and I need to generate report and graphs for that data. can anyone please tell me how do I do that? Thanks, Akhil --- ## [Remove/hide comma separator between multiple values in a cell of Enhanced Data Table Visualization](https://discuss.elastic.co/t/remove-hide-comma-separator-between-multiple-values-in-a-cell-of-enhanced-data-table-visualization/261561)
**Author:** [@preeti1211](https://discuss.elastic.co/u/preeti1211)\ **Replies:** 2\ **Last updated:** [January 20, 2021, 7:55pm UTC](https://discuss.elastic.co/t/remove-hide-comma-separator-between-multiple-values-in-a-cell-of-enhanced-data-table-visualization/261561 "2021-01-20T19:55:18Z")
Hi Team, i have one usecase which i am able to achieve via Enhanced Data Table Visualization in Kibana. But since we are having multiple values in a single cell, they are coming as comma separated by default. Is there… --- ## [Unable to delete snapshot - no space left on device - Solved?](https://discuss.elastic.co/t/unable-to-delete-snapshot-no-space-left-on-device-solved/261675)
**Author:** [@mcosta](https://discuss.elastic.co/u/mcosta)\ **Replies:** 4\ **Last updated:** [January 20, 2021, 7:50pm UTC](https://discuss.elastic.co/t/unable-to-delete-snapshot-no-space-left-on-device-solved/261675 "2021-01-20T19:50:14Z")
Hi all, Using 7.10.2 Basic licence After let my snapshot file system run out of space (100% full), I face the error were no more daily snapshots could run. This file system has nothing but snapshots, so I couldn't del… --- ## [Calculate the percentage based on two calculations - one for future data and another for past data and finally create a bar chart for every team](https://discuss.elastic.co/t/calculate-the-percentage-based-on-two-calculations-one-for-future-data-and-another-for-past-data-and-finally-create-a-bar-chart-for-every-team/261429)
**Author:** [@preeti1211](https://discuss.elastic.co/u/preeti1211)\ **Replies:** 1\ **Last updated:** [January 20, 2021, 7:18pm UTC](https://discuss.elastic.co/t/calculate-the-percentage-based-on-two-calculations-one-for-future-data-and-another-for-past-data-and-finally-create-a-bar-chart-for-every-team/261429 "2021-01-20T19:18:03Z")
Calculation - 95/120 (First value being the number of PBIs approved for future 3 sprints and second value being the number of PBIs completed in the past 3 sprints). If the divided value is =\<33% the bar chart should be … --- ## [\[Logstash\] Can't update document for status (entity-centric)](https://discuss.elastic.co/t/logstash-cant-update-document-for-status-entity-centric/261692)
**Author:** [@Joao\_Palma](https://discuss.elastic.co/u/Joao_Palma)\ **Replies:** 0\ **Last updated:** [January 20, 2021, 7:17pm UTC](https://discuss.elastic.co/t/logstash-cant-update-document-for-status-entity-centric/261692 "2021-01-20T19:17:26Z")
Hello, I have this logs: {"process": "123", "status:red", "@timestamp":"2020-12-31T16:14:13.886+0000" } {"process": "122", "status:red", "@timestamp":"2020-12-31T16:14:14.886+0000" } {"process": "123", "status:green", … --- ## [Restrict the kibana user for one machine only](https://discuss.elastic.co/t/restrict-the-kibana-user-for-one-machine-only/261568)
**Author:** [@mrunalini](https://discuss.elastic.co/u/mrunalini)\ **Replies:** 1\ **Last updated:** [January 20, 2021, 6:48pm UTC](https://discuss.elastic.co/t/restrict-the-kibana-user-for-one-machine-only/261568 "2021-01-20T18:48:23Z")
HI , My basic requirement here is to restrict any Kibana user for one machine only ,so that same user can not login from different machine at the same time. is there any setting needs to modify in kibana.yml file or an… --- ## [Generate a pdf report from kibana](https://discuss.elastic.co/t/generate-a-pdf-report-from-kibana/261654)
**Author:** [@suibgui](https://discuss.elastic.co/u/suibgui)\ **Replies:** 1\ **Last updated:** [January 20, 2021, 6:47pm UTC](https://discuss.elastic.co/t/generate-a-pdf-report-from-kibana/261654 "2021-01-20T18:47:24Z")
Hello Team, when i want to genarate a pdf report from Kibana ,I have this issue message: {"type":"error","@timestamp":"2021-01-18T14:43:54Z","tags":\["reporting","printable\_pdf","execute","kk2oi8v30bb44cba349ldzfe","err… --- ## [I need guy who can install and configure elasticsearch](https://discuss.elastic.co/t/i-need-guy-who-can-install-and-configure-elasticsearch/261358)
**Author:** [@avagyanlevon](https://discuss.elastic.co/u/avagyanlevon)\ **Replies:** 22\ **Last updated:** [January 20, 2021, 6:44pm UTC](https://discuss.elastic.co/t/i-need-guy-who-can-install-and-configure-elasticsearch/261358 "2021-01-20T18:44:31Z")
I need guy who can install and configure elasticsearch. I have problem with elasticsearch with my website, it was stop works after restarting server, now I need expert who can install and configuration it. Sorry for my E… --- ## [Unable to limit FileBeat fields](https://discuss.elastic.co/t/unable-to-limit-filebeat-fields/261405)
**Author:** [@ChrisaT](https://discuss.elastic.co/u/ChrisaT)\ **Replies:** 2\ **Last updated:** [January 20, 2021, 5:50pm UTC](https://discuss.elastic.co/t/unable-to-limit-filebeat-fields/261405 "2021-01-20T17:50:27Z")
Good morning, a housekeeping question We are processing data from a number of API's using Filebeat. The fields we define are working fine but what we have found is that field for all modules are also being added. The in… --- ## [How to configure kibana docker to redirect kibana logs to syslog](https://discuss.elastic.co/t/how-to-configure-kibana-docker-to-redirect-kibana-logs-to-syslog/260499)
**Author:** [@akshatsharma](https://discuss.elastic.co/u/akshatsharma)\ **Replies:** 3\ **Last updated:** [January 20, 2021, 4:11pm UTC](https://discuss.elastic.co/t/how-to-configure-kibana-docker-to-redirect-kibana-logs-to-syslog/260499 "2021-01-20T16:11:16Z")
Hi, Currently, Kibana generates logs as plain text and outputs them to stdout. For our use-case, we need to reformat kibana logs in a different format, for which we need to send Kibana's container logs to Syslog sidecar… --- ## [What future for Curator?](https://discuss.elastic.co/t/what-future-for-curator/261661)
**Author:** [@mikewillis](https://discuss.elastic.co/u/mikewillis)\ **Replies:** 1\ **Last updated:** [January 20, 2021, 3:56pm UTC](https://discuss.elastic.co/t/what-future-for-curator/261661 "2021-01-20T15:56:28Z")
The most recent release notes for Curator contain this: No, Curator isn't going away. But as you can tell, it's not as actively developed as it once was. I am gratified to find there are still users who make it a par… --- ## [Security when using Selenium RemoteWebdriver with Kibana](https://discuss.elastic.co/t/security-when-using-selenium-remotewebdriver-with-kibana/260418)
**Author:** [@NicklausKew](https://discuss.elastic.co/u/NicklausKew)\ **Replies:** 3\ **Last updated:** [January 20, 2021, 3:29pm UTC](https://discuss.elastic.co/t/security-when-using-selenium-remotewebdriver-with-kibana/260418 "2021-01-20T15:29:38Z")
Morning all, I am having some issues with how selenium is interacting with Kibana. For the body of work completed I was running on version 7.6.1 of Kibana with all of my automated tests passing on both the Selenium Chro… --- ## [Add users in Kibana with basic license using 7.10.1](https://discuss.elastic.co/t/add-users-in-kibana-with-basic-license-using-7-10-1/261535)
**Author:** [@Richie](https://discuss.elastic.co/u/Richie)\ **Replies:** 15\ **Last updated:** [January 20, 2021, 3:24pm UTC](https://discuss.elastic.co/t/add-users-in-kibana-with-basic-license-using-7-10-1/261535 "2021-01-20T15:24:49Z")
Hi, I recently upgraded my ELK stack from 6.6 to 7.10. I wanted to use the role management feature to allow users to only view dashboards specific to them which would be secured via authentication. I tried this function… --- ## [Question about doing a rolling upgrade from 6.8.6 to 7.9.3](https://discuss.elastic.co/t/question-about-doing-a-rolling-upgrade-from-6-8-6-to-7-9-3/261659)
**Author:** [@johnbonanchovy](https://discuss.elastic.co/u/johnbonanchovy)\ **Replies:** 4\ **Last updated:** [January 20, 2021, 3:24pm UTC](https://discuss.elastic.co/t/question-about-doing-a-rolling-upgrade-from-6-8-6-to-7-9-3/261659 "2021-01-20T15:24:22Z")
Hi, We are preparing to do a rolling upgrade on a fairly large cluster. As part of that, we have done the rolling upgrade on a much smaller development cluster. We left it half upgraded to see how the services will beh… --- ## [Create custom fields for each host in heartbeat.yml](https://discuss.elastic.co/t/create-custom-fields-for-each-host-in-heartbeat-yml/261410)
**Author:** [@anjana1](https://discuss.elastic.co/u/anjana1)\ **Replies:** 3\ **Last updated:** [January 20, 2021, 3:40am UTC](https://discuss.elastic.co/t/create-custom-fields-for-each-host-in-heartbeat-yml/261410 "2021-01-20T03:40:49Z")
I am trying to combine my heartbeat visualization with APM visualization in same dashboards. Since the field names are not similar, the filter wont work correctly. So I was thinking of creating similar field names and la… --- ## [Spring Data Elastic - FIxing Client Version issue](https://discuss.elastic.co/t/spring-data-elastic-fixing-client-version-issue/261524)
**Author:** [@hcaupert](https://discuss.elastic.co/u/hcaupert)\ **Replies:** 3\ **Last updated:** [January 20, 2021, 2:44pm UTC](https://discuss.elastic.co/t/spring-data-elastic-fixing-client-version-issue/261524 "2021-01-20T14:44:51Z")
Hi, I am using a 7.3.1 cluster. Using Spring Data Elastic in Spring Boot 2.3 brings a client in version 7.6.2. As seen on this forum I add the version to match my cluster in my pom.xml : \ \