# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1966 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1967 --- ## [Can we delete .monitoring-kibana (disk issue) - red shard](https://discuss.elastic.co/t/can-we-delete-monitoring-kibana-disk-issue-red-shard/238731)
**Author:** [@dimitris\_sb](https://discuss.elastic.co/u/dimitris_sb)\ **Replies:** 1\ **Last updated:** [June 28, 2020, 9:28pm UTC](https://discuss.elastic.co/t/can-we-delete-monitoring-kibana-disk-issue-red-shard/238731 "2020-06-28T21:28:40Z")
Could I delete .monitoring-kibana\_2020.MM.dd system index? I experienced a disk failure which damaged the lvm and after fixing this some system shards are corrupted blocking indexing. Thank you in advance! --- ## [Grok parse does not work, but looks fine on the debugger](https://discuss.elastic.co/t/grok-parse-does-not-work-but-looks-fine-on-the-debugger/238974)
**Author:** [@tenaz3](https://discuss.elastic.co/u/tenaz3)\ **Replies:** 9\ **Last updated:** [June 28, 2020, 8:26pm UTC](https://discuss.elastic.co/t/grok-parse-does-not-work-but-looks-fine-on-the-debugger/238974 "2020-06-28T20:26:28Z")
ELK: 7.71 On the debugger grok looks good, but when I send filebeat-\>logstash-\>elasticsearch, on kibana none of the fields I mapped is there. Any on has an idea? I have the following log structure: 2020-06-18T23:10:43… --- ## [Support for Spark 3.0 connector](https://discuss.elastic.co/t/support-for-spark-3-0-connector/239029)
**Author:** [@Swapnil\_Nawale](https://discuss.elastic.co/u/Swapnil_Nawale)\ **Replies:** 0\ **Last updated:** [June 28, 2020, 8:10pm UTC](https://discuss.elastic.co/t/support-for-spark-3-0-connector/239029 "2020-06-28T20:10:40Z")
Is there a plan to support elasticsearch-spark connector for Apache Spark 3.0 ? If yes, is there an ETA on the same ? --- ## [Org.elsticsearch -- trying to run scripted upserts, written in painless language, from Spark -- {type=null\_pointer\_exception, reason=null}](https://discuss.elastic.co/t/org-elsticsearch-trying-to-run-scripted-upserts-written-in-painless-language-from-spark-type-null-pointer-exception-reason-null/238968)
**Author:** [@Eman\_Mughal](https://discuss.elastic.co/u/Eman_Mughal)\ **Replies:** 1\ **Last updated:** [June 28, 2020, 7:34pm UTC](https://discuss.elastic.co/t/org-elsticsearch-trying-to-run-scripted-upserts-written-in-painless-language-from-spark-type-null-pointer-exception-reason-null/238968 "2020-06-28T19:34:59Z")
Hi There, I am trying to run the following code df.write .format("org.elasticsearch.spark.sql") .option("es.nodes.wan.only","true") // .option("es.nodes.discovery", "false") // .option("es.nodes.client.only", "fa… --- ## [Transform doesn't recognize all the documents](https://discuss.elastic.co/t/transform-doesnt-recognize-all-the-documents/237591)
**Author:** [@OmarDacca](https://discuss.elastic.co/u/OmarDacca)\ **Replies:** 9\ **Last updated:** [June 28, 2020, 6:51pm UTC](https://discuss.elastic.co/t/transform-doesnt-recognize-all-the-documents/237591 "2020-06-28T18:51:49Z")
Hi, I created a new transform and It doesn't recognize all the documents in source index. The source index name is user\_data. The destination index name is session\_data. The transform is so simple: runs on the last … --- ## [Metricbeats only ships node\_stats, but not cluster\_stats to x-pack monitoring](https://discuss.elastic.co/t/metricbeats-only-ships-node-stats-but-not-cluster-stats-to-x-pack-monitoring/238948)
**Author:** [@souravsahoo](https://discuss.elastic.co/u/souravsahoo)\ **Replies:** 1\ **Last updated:** [June 28, 2020, 6:47pm UTC](https://discuss.elastic.co/t/metricbeats-only-ships-node-stats-but-not-cluster-stats-to-x-pack-monitoring/238948 "2020-06-28T18:47:10Z")
Hi, I have a 3 master, multiple data node architecture. Metricbeat's elasticsearch-xpack module is configured to ship elasticsearch metrics to a separate monitoring cluster. However, I see only node\_stats are sent and no… --- ## [How to packetbeat for captuer traffic switch cisco SPAN port](https://discuss.elastic.co/t/how-to-packetbeat-for-captuer-traffic-switch-cisco-span-port/239028)
**Author:** [@jam\_mahmoudi](https://discuss.elastic.co/u/jam_mahmoudi)\ **Replies:** 0\ **Last updated:** [June 28, 2020, 6:37pm UTC](https://discuss.elastic.co/t/how-to-packetbeat-for-captuer-traffic-switch-cisco-span-port/239028 "2020-06-28T18:37:16Z")
Hi guys how to packetbeat for capture traffic switch cisco SPAN port ؟ I didn't find anything in the packetbeat document .! Thank you for your help --- ## [Error with logstash-input-rss](https://discuss.elastic.co/t/error-with-logstash-input-rss/238997)
**Author:** [@Terizian](https://discuss.elastic.co/u/Terizian)\ **Replies:** 6\ **Last updated:** [June 28, 2020, 6:02pm UTC](https://discuss.elastic.co/t/error-with-logstash-input-rss/238997 "2020-06-28T18:02:37Z")
I was trying the RSS plugin with Logstash, and I'm facing an error as detailed below: Version: Logstash 7.7.1 Operating System: CentOS 7.8.2003 Config File: input { rss { url =\> "https://www.alit… --- ## [CheckPoint logs error with filebeat](https://discuss.elastic.co/t/checkpoint-logs-error-with-filebeat/239024)
**Author:** [@julianksanchez](https://discuss.elastic.co/u/julianksanchez)\ **Replies:** 0\ **Last updated:** [June 28, 2020, 3:58pm UTC](https://discuss.elastic.co/t/checkpoint-logs-error-with-filebeat/239024 "2020-06-28T15:58:40Z")
Hello, I am trying to obtain firewall logs from syslog. I configurate checkpoint module of filebeat. I dont know if anyone did yet, because I have problems I can see the logs of filebeat and I see it message in var/lo/s… --- ## [Can not get input from elasticsearch](https://discuss.elastic.co/t/can-not-get-input-from-elasticsearch/238988)
**Author:** [@AayushPatel](https://discuss.elastic.co/u/AayushPatel)\ **Replies:** 1\ **Last updated:** [June 28, 2020, 3:53pm UTC](https://discuss.elastic.co/t/can-not-get-input-from-elasticsearch/238988 "2020-06-28T15:53:14Z")
Hi, I wanna to get input from my elasticsearch and doing enrichment on the data in it but the problem is connecting to es via SSL, i get this error every time and can not handle it anyway the code input { elastic… --- ## [Force logstash to reindex a CSV](https://discuss.elastic.co/t/force-logstash-to-reindex-a-csv/239003)
**Author:** [@Youssef\_SBAI](https://discuss.elastic.co/u/Youssef_SBAI)\ **Replies:** 3\ **Last updated:** [June 28, 2020, 3:46pm UTC](https://discuss.elastic.co/t/force-logstash-to-reindex-a-csv/239003 "2020-06-28T15:46:52Z")
Hello, Sometimes I need to force the re-indexing of files csv from the beginning. my config logstash is input { file { path =\> "/data/volumes/monitoring/logstash/dernier\_passage/stocks.csv" sincedb\_path =\> "/dev/null"… --- ## [How use DataTable or any component of Visualization to build below report](https://discuss.elastic.co/t/how-use-datatable-or-any-component-of-visualization-to-build-below-report/238840)
**Author:** [@jaytran](https://discuss.elastic.co/u/jaytran)\ **Replies:** 4\ **Last updated:** [June 28, 2020, 3:05pm UTC](https://discuss.elastic.co/t/how-use-datatable-or-any-component-of-visualization-to-build-below-report/238840 "2020-06-28T15:05:46Z")
Hi all, I have below data: "hits" : \[ { "\_index" : "test-2020.05", "\_source" : { "@version" : "1", "status" : "DONE", "level" : "ERROR" } }, { "\_index" : "test-2020.05", "\_s… --- ## [Logs UI with cross cluster search](https://discuss.elastic.co/t/logs-ui-with-cross-cluster-search/239009)
**Author:** [@a3984](https://discuss.elastic.co/u/a3984)\ **Replies:** 0\ **Last updated:** [June 28, 2020, 1:08pm UTC](https://discuss.elastic.co/t/logs-ui-with-cross-cluster-search/239009 "2020-06-28T13:08:45Z")
I have created a cross cluster search configuration where I have one kibana/elasticsearch connecting to two other elasticsearch instances using cross cluster search. I know that it is configured correctly as I have crea… --- ## [Create Empty array when logstash outputs](https://discuss.elastic.co/t/create-empty-array-when-logstash-outputs/239005)
**Author:** [@recordable542](https://discuss.elastic.co/u/recordable542)\ **Replies:** 0\ **Last updated:** [June 28, 2020, 12:10pm UTC](https://discuss.elastic.co/t/create-empty-array-when-logstash-outputs/239005 "2020-06-28T12:10:49Z")
input { jdbc { jdbc\_driver\_library =\> "..." jdbc\_driver\_class =\> "com.mysql.jdbc.Driver" jdbc\_paging\_enabled =\> true tracking\_column =\> "unix\_ts\_in\_secs" use\_column\_value =\> tr… --- ## [Need server/system serial number output in kibana dashboard](https://discuss.elastic.co/t/need-server-system-serial-number-output-in-kibana-dashboard/238949)
**Author:** [@D\_ELK](https://discuss.elastic.co/u/D_ELK)\ **Replies:** 3\ **Last updated:** [June 28, 2020, 10:54am UTC](https://discuss.elastic.co/t/need-server-system-serial-number-output-in-kibana-dashboard/238949 "2020-06-28T10:54:07Z")
Hi, I have build my ELK stack on local machine (ELK version- 6.8.10) . In order to get more details like machine/server serial number, I have added few entries in filebeat.yml file. After adding few lines under add\_h… --- ## [Logstash pipline optimization](https://discuss.elastic.co/t/logstash-pipline-optimization/236280)
**Author:** [@abhisheksimion](https://discuss.elastic.co/u/abhisheksimion)\ **Replies:** 3\ **Last updated:** [June 28, 2020, 6:20am UTC](https://discuss.elastic.co/t/logstash-pipline-optimization/236280 "2020-06-28T06:20:37Z")
I have multiple configurations defined in the pipelines.yml. All the configurations are responsible for pushing data from a jDBC source to Elasticsearch. I want to know what is the optimal settings required to do so. As … --- ## [Logstash install error in ubuntu](https://discuss.elastic.co/t/logstash-install-error-in-ubuntu/238987)
**Author:** [@Srini2](https://discuss.elastic.co/u/Srini2)\ **Replies:** 1\ **Last updated:** [June 28, 2020, 5:43am UTC](https://discuss.elastic.co/t/logstash-install-error-in-ubuntu/238987 "2020-06-28T05:43:55Z")
Hi, I'm new to ELK. I have successfully installed elasticsearch and kibana in Ubuntu 19.10 instance with OpenJDK 11 installed. But getting below error while installing Logstash. Any help on this please. $ sudo apt-get … --- ## [Can't get text on a START\_OBJECT at 1:708](https://discuss.elastic.co/t/cant-get-text-on-a-start-object-at-1-708/238965)
**Author:** [@mastersmit](https://discuss.elastic.co/u/mastersmit)\ **Replies:** 1\ **Last updated:** [June 28, 2020, 4:21am UTC](https://discuss.elastic.co/t/cant-get-text-on-a-start-object-at-1-708/238965 "2020-06-28T04:21:51Z")
I am trying to configure SpringBoot \<\> FileBeat \<\> LogStash \<\> ElasticSearch \<\> Kibana. But I am getting error at LogStash, here is my code snippets: filebeat.yml: filebeat: inputs: - type: log paths: … --- ## [Unable to connect mysql using logstash](https://discuss.elastic.co/t/unable-to-connect-mysql-using-logstash/238969)
**Author:** [@sandy1](https://discuss.elastic.co/u/sandy1)\ **Replies:** 1\ **Last updated:** [June 28, 2020, 3:19am UTC](https://discuss.elastic.co/t/unable-to-connect-mysql-using-logstash/238969 "2020-06-28T03:19:49Z")
logstash.config: \> input { \> jdbc { \> jdbc\_connection\_string =\> "jdbc:mysql://localhost:3306/db\_name?ssl=false" \> jdbc\_user =\> "admin" \> jdbc\_password =\> "password" \> jdbc\_driver\_library =\> "D:/el… --- ## [Runtime: VirtualAlloc of 1056768 bytes failed with errno=1455](https://discuss.elastic.co/t/runtime-virtualalloc-of-1056768-bytes-failed-with-errno-1455/238983)
**Author:** [@bevano](https://discuss.elastic.co/u/bevano)\ **Replies:** 0\ **Last updated:** [June 28, 2020, 3:03am UTC](https://discuss.elastic.co/t/runtime-virtualalloc-of-1056768-bytes-failed-with-errno-1455/238983 "2020-06-28T03:03:48Z")
Hi All, Wondering whether any one can help me understand what happened. Been running filebeat for the past 6 months, and have been upgrading accordingly to our logstash. Currently on version 7.7 Never has it crashed ou… --- ## [How to create a filebeat processor?](https://discuss.elastic.co/t/how-to-create-a-filebeat-processor/238417)
**Author:** [@xvdy](https://discuss.elastic.co/u/xvdy)\ **Replies:** 2\ **Last updated:** [June 28, 2020, 2:59am UTC](https://discuss.elastic.co/t/how-to-create-a-filebeat-processor/238417 "2020-06-28T02:59:47Z")
We want to use filebeat to gather mysql slow log. I want to create a filebeat processor to convert mysql slow log to json format and add a sql fingerprint field. I find a related issue here: https://github.com/elastic/b… --- ## [Filebeat can't get the older iis files](https://discuss.elastic.co/t/filebeat-cant-get-the-older-iis-files/238981)
**Author:** [@chairxiao](https://discuss.elastic.co/u/chairxiao)\ **Replies:** 0\ **Last updated:** [June 28, 2020, 1:50am UTC](https://discuss.elastic.co/t/filebeat-cant-get-the-older-iis-files/238981 "2020-06-28T01:50:20Z")
Hello, I use es+kibana+filebeat to analyze the iis logs.filebeat.yml use the default setting except the ip of the es and kibana. But I can only get one week logs. I want to get all the logs in the path.the version is 7.… --- ## [Error Elasticsearch Unreachable](https://discuss.elastic.co/t/error-elasticsearch-unreachable/238964)
**Author:** [@Youssef\_SBAI](https://discuss.elastic.co/u/Youssef_SBAI)\ **Replies:** 1\ **Last updated:** [June 27, 2020, 10:49pm UTC](https://discuss.elastic.co/t/error-elasticsearch-unreachable/238964 "2020-06-27T22:49:29Z")
I use logstash to ingest a csv file in elastic i have this error \[2020-06-27T18:46:09,043\]\[WARN \]\[logstash.outputs.elasticsearch\] Marking url as dead. Last error: \[LogStash::Outputs::ElasticSearch::HttpClient::Pool::Hos… --- ## [Top 10 doc of a User get changed when i insert data in another user's space](https://discuss.elastic.co/t/top-10-doc-of-a-user-get-changed-when-i-insert-data-in-another-users-space/238939)
**Author:** [@RAHUL\_PATEL](https://discuss.elastic.co/u/RAHUL_PATEL)\ **Replies:** 3\ **Last updated:** [June 27, 2020, 10:00pm UTC](https://discuss.elastic.co/t/top-10-doc-of-a-user-get-changed-when-i-insert-data-in-another-users-space/238939 "2020-06-27T22:00:05Z")
Problem Statement: I have 1000 users in my index when I use this query { "query": { "bool": { "must": \[ { "match": { "keywords": { "query":… --- ## [Refused to load the script 'https://maps.googleapis.com/...' because it violates the following Content Security Policy directive:](https://discuss.elastic.co/t/refused-to-load-the-script-https-maps-googleapis-com-because-it-violates-the-following-content-security-policy-directive/238954)
**Author:** [@Raja\_SP](https://discuss.elastic.co/u/Raja_SP)\ **Replies:** 1\ **Last updated:** [June 27, 2020, 3:28pm UTC](https://discuss.elastic.co/t/refused-to-load-the-script-https-maps-googleapis-com-because-it-violates-the-following-content-security-policy-directive/238954 "2020-06-27T15:28:58Z")
Hi, I am developing a plugin that uses googlemaps api for geofencing purposes. I have the csp.rules configured in kibana.yml as below: csp.rules: "script-src 'unsafe-eval' 'self' 'https://maps.googleapis.com'" "worker… --- ## [Can i connect aws elasticsearch data to swift engine?](https://discuss.elastic.co/t/can-i-connect-aws-elasticsearch-data-to-swift-engine/238944)
**Author:** [@Sagar\_jain](https://discuss.elastic.co/u/Sagar_jain)\ **Replies:** 1\ **Last updated:** [June 27, 2020, 2:34pm UTC](https://discuss.elastic.co/t/can-i-connect-aws-elasticsearch-data-to-swift-engine/238944 "2020-06-27T14:34:45Z")
Can i connect aws elasticsearch data to swift engine? --- ## [I need help! elastic doesn't get my mapping!](https://discuss.elastic.co/t/i-need-help-elastic-doesnt-get-my-mapping/238932)
**Author:** [@sina12](https://discuss.elastic.co/u/sina12)\ **Replies:** 3\ **Last updated:** [June 27, 2020, 2:18pm UTC](https://discuss.elastic.co/t/i-need-help-elastic-doesnt-get-my-mapping/238932 "2020-06-27T14:18:20Z")
Hi Guys! I am in trouble. I need to visualize my data but elasticsearch doesn't accept my mapping. I edited the mapping like that: PUT /my\_example/\_mappings { "properties" : { "id" :{ "type": "boolean" }, … --- ## [Visualize command history](https://discuss.elastic.co/t/visualize-command-history/238892)
**Author:** [@elk6](https://discuss.elastic.co/u/elk6)\ **Replies:** 1\ **Last updated:** [June 27, 2020, 2:10pm UTC](https://discuss.elastic.co/t/visualize-command-history/238892 "2020-06-27T14:10:12Z")
I'm a complete noob at Elastic Stack. I need to display command history in kibana in an easy to read format, I'm looking for something like this. For that, I've set auditbeat with this rule to log every command someone r… --- ## [Input from 3 log files on 1 visualization on kibana](https://discuss.elastic.co/t/input-from-3-log-files-on-1-visualization-on-kibana/238941)
**Author:** [@falconpurple](https://discuss.elastic.co/u/falconpurple)\ **Replies:** 2\ **Last updated:** [June 27, 2020, 1:25pm UTC](https://discuss.elastic.co/t/input-from-3-log-files-on-1-visualization-on-kibana/238941 "2020-06-27T13:25:59Z")
Hi, I have to connect 3 log files. The Logfile 1 contains fields: Logdate,request\_type,responsetime The Logfile 2 contains fields: Logdate,request\_type,responsetime The Logfile 3 contains fields: Logdate,request\_t… --- ## [API Integration with Elastic + KIBANA](https://discuss.elastic.co/t/api-integration-with-elastic-kibana/238951)
**Author:** [@get2saravanan](https://discuss.elastic.co/u/get2saravanan)\ **Replies:** 0\ **Last updated:** [June 27, 2020, 1:15pm UTC](https://discuss.elastic.co/t/api-integration-with-elastic-kibana/238951 "2020-06-27T13:15:37Z")
Hi Team, I have a requirement to display the Currency rates in the Kibana dashboard. I have few restAPI which serve data for the Currency. I couldn't understand how to load this live data in Elastic. Kindly share your … [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1965) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1967)