# Elastic won't send data to Kibana

**URL:** https://discuss.elastic.co/t/elastic-wont-send-data-to-kibana/318833
**Category:** Kibana
**Created:** [November 14, 2022, 7:02am UTC](https://discuss.elastic.co/t/elastic-wont-send-data-to-kibana/318833 "2022-11-14T07:02:02Z")
**Posts on this page:** 7
**Page:** 1

<div class="post-metadata">

### Author: ![zerratriani](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zerratriani/32/113308_2.png) [@zerratriani](https://discuss.elastic.co/u/zerratriani)
#### Post date: [November 14, 2022, 7:02am UTC](https://discuss.elastic.co/t/elastic-wont-send-data-to-kibana/318833/1 "2022-11-14T07:02:02Z")

</div>

Hallo, I have a configuration like the following, but elastic can't retrieve the logs. And the plain-log .log also doesn't show the activation log. How else can I confirm that logstash and filebeat are connected and transmitting data. Thank you  
The Filebeat

```auto
filebeat.inputs:      
  - type: log
    enabled: true
    paths:
      - :X\xxxx\xxx\xxx\log\xxxdriver.log
    multiline.pattern: ^R10\.97389
    multiline.negate: true
    multiline.match: after
    fields:
      data_source: XXXDriverxx

# ============================== Filebeat modules ==============================

filebeat.config.modules:
  # Glob pattern for configuration loading
  path: ${path.config}/modules.d/*.yml

  # Set to true to enable config reloading
  reload.enabled: false

# ------------------------------ Logstash Output -------------------------------
output.logstash:
  # The Logstash hosts
  hosts: ["xxx.xxx.xxx:5046"]
# ================================= Processors =================================
processors:
  - add_host_metadata:
      when.not.contains.tags: forwarded
  - add_cloud_metadata: ~
  - add_docker_metadata: ~
  - add_kubernetes_metadata: ~

```

**The Logstash**

```auto
input {
  beats {
    port => 5046
  }

}

filter {
if [fields][data_source] == "global"
	{
		 grok {
                match => { "rawMessage" => "%{TIMESTAMP_ISO8601:datetime}\s\[%{GREEDYDATA:thread}\]\s%{LOGLEVEL:logLevel}\s%{GREEDYDATA:category1}\s\s\-\s%{GREEDYDATA:message}"}
        }
        date {
                match => ["datetime", "yyyy-MM-dd HH:mm:ss,SSS"]
                target => "@timestamp"
        }
		mutate 
		{
			add_field => { "logtype" => "Temenos_global" }
		}
		
	}
	
else
	{

		 mutate { 
			rename => ["message", "rawMessage"]
		}
		mutate {
			gsub => ["rawMessage", "[\r\n\t]", ""]
			gsub => ["rawMessage", "\\r", ""]
			gsub => ["rawMessage", "\\n", ""]
			gsub => ["rawMessage", "\\t", ""]
		}
				
		ruby 
			{
				code => " event.set('dashgetter', event.get('rawMessage').scan(/-/).length )" 
			}
			
		if [dashgetter] > 6
			{
				mutate
				{
					gsub => ["rawMessage", "-(?!.*-)", ""]	
				}
			}
		
		
			grok {
				   pattern_definitions => { "F_DATETIME_XML" => "%{DAY:day}\s*%{MONTH:month}\s*%{MONTHDAY:monthday}\s*%{TIME:time}" }
				   match => { "rawMessage" => "%{GREEDYDATA:nama_produk_dan_versi}\s-\s%{F_DATETIME_XML:tanggal}%{GREEDYDATA:category3}\s-\s%{GREEDYDATA:table}\s-\s%{GREEDYDATA:alias}\s-\s%{GREEDYDATA:message}"}
				  }
					  date {
					   match => ["category3" , "EEE MMM dd HH:mm:ss"]
					   target => "@timestamp" 
					   
				}                        

			if "ERROR" in [rawMessage]
			{
				mutate {
					add_field => { "LogLevel" => "ERROR" }
					
				}
			}
			else if "deadlock" in [rawMessage] or "WARNING" in [rawMessage]
			{
				mutate {
					add_field => { "LogLevel" => "WARN" }				
				}
			}
			else 
			{
				mutate {
					add_field => { "LogLevel" => "INFO"}				
					}
			}
			mutate 	
			{
				remove_field => ["category3"]
				remove_field => ["dashgetter"]
				remove_field => ["day","month","monthday","time","HOUR","MINUTE","SECOND"]
				add_field => { "logtype" => "Temenos_XMLdriver" }
				add_field => {"table_alias" => "%{table} - %{alias}"}
				add_field => {"hostname" => "CBS-APP1-JKT.ibsm.net"}
			}
		
			if ![alias] and ![table]
			{
				mutate{
					remove_field => ["table_alias"]
					}
			}
			else if ![table]
			{
				mutate {
					gsub => ["table_alias", "%{table} -", ""]
					}
			} 
			else if ![alias]
			{ 
				mutate{
					gsub => ["table_alias", " - %{alias}", ""]
					}
			}
			
	}
		}

output {
 if "ERROR" in [LogLevel] or "WARN" in [LogLevel]
  {
  dynatrace {
   ingest_endpoint_url => "xxxxx.com"
   api_key => "xxxxxxx"
   ssl_verify_none => true
   }
}
else {
 else {
  elasticsearch {
        hosts => ["xxx.xxx.xxx:9200"]
        index => "xxxxxxlogs-10.xx.x.xx"
		user => "elastic"
		password => "xxxx123"
        }

 }
}

```

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [November 14, 2022, 7:08am UTC](https://discuss.elastic.co/t/elastic-wont-send-data-to-kibana/318833/2 "2022-11-14T07:08:44Z")

</div>

Welcome to our community! 😃

What do your Filebeat logs show?

---

<div class="post-metadata">

### Author: ![zerratriani](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zerratriani/32/113308_2.png) [@zerratriani](https://discuss.elastic.co/u/zerratriani)
#### Post date: [November 14, 2022, 7:16am UTC](https://discuss.elastic.co/t/elastic-wont-send-data-to-kibana/318833/3 "2022-11-14T07:16:53Z")

</div>

I think filebeat is running fine because the log with dynatrace output is running. But for other outputs can't come out in kibana

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [November 14, 2022, 7:19am UTC](https://discuss.elastic.co/t/elastic-wont-send-data-to-kibana/318833/4 "2022-11-14T07:19:38Z")

</div>

Please share the log, it'll show us what it's doing.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [December 12, 2022, 7:05am UTC](https://discuss.elastic.co/t/elastic-wont-send-data-to-kibana/318833/5 "2022-12-12T07:05:44Z")

</div>



---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [January 9, 2023, 3:37am UTC](https://discuss.elastic.co/t/elastic-wont-send-data-to-kibana/318833/6 "2023-01-09T03:37:57Z")

</div>



---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [February 6, 2023, 3:38am UTC](https://discuss.elastic.co/t/elastic-wont-send-data-to-kibana/318833/7 "2023-02-06T03:38:23Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
