# The whole log of openedr is inside the message feild in kibana. Urgent!

**URL:** https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535
**Category:** Beats
**Tags:** filebeat
**Created:** [May 1, 2024, 5:42am UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535 "2024-05-01T05:42:10Z")
**Posts on this page:** 20
**Page:** 1

<div class="post-metadata">

### Author: ![sandraimmaculate](https://avatars.discourse-cdn.com/v4/letter/s/b487fb/32.png) [@sandraimmaculate](https://discuss.elastic.co/u/sandraimmaculate)
#### Post date: [May 1, 2024, 5:42am UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/1 "2024-05-01T05:42:10Z")

</div>

Hi, my openedr application is in windows i have downloaded filebeat there and configure it to send logs to logstash so that i can view in kibana and yes it done successfully. I'm able to see logs in kibana\>discover,  
But the whole log entry is inside the message field it was not parsing it correctly  
i have created a filebeat\* as index pattern and dataview as openedr\_logs because it creating new index pattern with the name filebeat along with the date everyday, it has all the fields which the log entry required but still those fields are empty the whole log entry is inside the message field and also in event.original field

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/6/f/6fe26153aa6b87addd977d7b745b1c7da0326b7e.png)

my logstash conf is:

# Beats -\> Logstash -\> Elasticsearch pipeline.

input {  
beats {  
port =\> 5044  
}  
}

filter {  
json {  
source =\> "event.original"  
target =\> "parsed\_event"  
}

if [parsed\_event] {  
mutate {  
add\_field =\> { "customer\_id" =\> "%{[parsed\_event][customerId]}" }  
add\_field =\> { "device\_name" =\> "%{[parsed\_event][deviceName]}" }  
add\_field =\> { "base\_event\_type" =\> "%{[parsed\_event][baseEventType]}" }  
add\_field =\> { "base\_type" =\> "%{[parsed\_event][baseType]}" }  
add\_field =\> { "session\_user" =\> "%{[parsed\_event][sessionUser]}" }  
add\_field =\> { "event\_type" =\> "%{[parsed\_event][eventType]}" }  
add\_field =\> { "version" =\> "%{[parsed\_event][version]}" }  
# Add similar lines for other desired fields  
}  
}  
}

output {  
elasticsearch {  
hosts =\> ["[https://ip-addr:9200](https://ip-addr:9200)"]  
user =\> "elastic"  
password =\> "password"  
index =\> "%{[@metadata][beat]}-%{[@metadata][version]}-%{+YYYY.MM.dd}"  
ssl\_verification\_mode =\> "full"  
ssl\_certificate\_authorities =\> "/etc/elasticsearch/certs/http\_ca.crt"  
ssl\_enabled =\> true  
}  
}  
even though in conf i mention as index =\> "%{[@metadata][beat]}-%{[@metadata][version]}-%{+YYYY.MM.dd}" the logs are getting stored in filebeat\* index. If i change index pattern as filebeat\* its not taking.

please suggest!

---

<div class="post-metadata">

### Author: ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)
#### Post date: [May 1, 2024, 6:50am UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/2 "2024-05-01T06:50:17Z")

</div>

> [@sandraimmaculate](#):
>
> json {  
> source =\> "event.original"  
> target =\> "parsed\_event"  
> }

Should be:

```auto
json {
source => "[event][original]"
target => "parsed_event"
}

```

---

<div class="post-metadata">

### Author: ![sandraimmaculate](https://avatars.discourse-cdn.com/v4/letter/s/b487fb/32.png) [@sandraimmaculate](https://discuss.elastic.co/u/sandraimmaculate)
#### Post date: [May 1, 2024, 7:24am UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/3 "2024-05-01T07:24:04Z")

</div>

thanks for the reply  
if i add the below one

```auto
json {
source => "[event][original]"
target => "parsed_event"
}

```

i'm not able to see the any logs in kibana.

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/2/8/281afbc88b60efee925fb85d84698be37beadc4e.png)

if i add the below one i'm able to see the logs but whole log entry inside event.original and in message.  
json {  
source =\> "event.original"  
target =\> "parsed\_event"  
}

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/0/7/075b760266c05fa24f64fb00e09d5d4c2c1dd727.png)

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/4/1/4105db8d056122ba0d473394ed63a8d5b17737a3.png)

even i have tried with  
filter {  
json {  
source =\> "message"  
target =\> "parsed\_event"  
}  
same im not able to see any logs in kibana.

---

<div class="post-metadata">

### Author: ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)
#### Post date: [May 1, 2024, 8:47am UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/4 "2024-05-01T08:47:53Z")

</div>

You cen use source =\> "[event][original]" or source =\> "message". Parsed data will be in [parsed\_event][fieldname]. If you don't set, fields will on the root.

> If this setting is omitted, the JSON data will be stored at the root (top level) of the event.

Take longer range and check index name. Your data should be in filebeat\_8.12.2(by default) or openEDR\_logs if you set this, depend on FB settings, in filebeat.yml.  
Also, might be some delay take a wider range.

To see your data structure, add in the output part, temporarily :  
` stdout { codec => rubydebug{} }`

---

<div class="post-metadata">

### Author: ![sandraimmaculate](https://avatars.discourse-cdn.com/v4/letter/s/b487fb/32.png) [@sandraimmaculate](https://discuss.elastic.co/u/sandraimmaculate)
#### Post date: [May 1, 2024, 9:36am UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/5 "2024-05-01T09:36:56Z")

</div>

source =\> "[event][original]" or source =\> "message" this both is not working, only source =\> "event.original" is working this stores the whole log entry inside the event.original field. I'm not able to see any field called [parsed\_event]. Actually it have to parse the log in individual fields right it not doing that.

And i'm using the default index pattern only as it is creating daily one index pattern so i have set it filebeat\*

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/3/9/3973bd5ae8112cdb8d207e10fc729d1d8ca0c8fa.png)

In filebeat.yml file i'm using output as logstash i commented elasticsearch output, filebeat and elk is in different machine

---

<div class="post-metadata">

### Author: ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)
#### Post date: [May 1, 2024, 9:42am UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/6 "2024-05-01T09:42:18Z")

</div>

Can you show the message field -data when arrived in LS? In the text format, not the image.

---

<div class="post-metadata">

### Author: ![sandraimmaculate](https://avatars.discourse-cdn.com/v4/letter/s/b487fb/32.png) [@sandraimmaculate](https://discuss.elastic.co/u/sandraimmaculate)
#### Post date: [May 1, 2024, 9:44am UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/7 "2024-05-01T09:44:53Z")

</div>

message

{"baseEventType":1,"baseType":1,"childProcess":{"cmdLine":"C:\Windows\system32\svchost.exe -k netsvcs -p -s gpsvc","creationTime":1714556553033,"elevationType":1,"flsVerdict":3,"id":5349677356,"imageHash":"445f5f38396f0e3ee50a1d8","imagePath":"C:\Windows\System32\svchost.exe","pid":14048,"scriptContent":"","verdict":1},"customerId":"","deviceName":"IZDT-6","endpointId":"","eventType":null,"processes":[{"creationTime":171430626,"flsVerdict":3,"id":13324682947529074784,"imageHash":"2dfb00cd9a44a8a016452e1df01c0cec51870407","imagePath":"C:\Windows\System32\wininit.exe","pid":784,"userName":"SYSTEM@NT AUTHORITY","verdict":1},{"creationTime":1714392570787,"flsVerdict":3,"id":763785080847475,"imageHash":"e5704d8e560122c2a23de8912ae63b213d67c860","imagePath":"C:\Windows\System32\services.exe","pid":856,"userName":"SYS@NT AUTHORITY","verdict":1}],"sessionUser":"SYS@NT AUTHORITY","time":17145085,"type":"RP1.1","version":"1.1"}

---

<div class="post-metadata">

### Author: ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)
#### Post date: [May 1, 2024, 12:59pm UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/8 "2024-05-01T12:59:28Z")

</div>

If I am not wrong, the json plugin have some "strange features" with the backslashes. So, replace \ with / then return back 🙂  
This works:

```auto
 input {
     generator {
       message => '{"baseEventType":1,"baseType":1,"childProcess":{"cmdLine":"C:\Windows\system32\svchost.exe -k netsvcs -p -s gpsvc","creationTime":1714556553033,"elevationType":1,"flsVerdict":3,"id":5349677356,"imageHash":"445f5f38396f0e3ee50a1d8","imagePath":"C:\Windows\System32\svchost.exe","pid":14048,"scriptContent":"","verdict":1},"customerId":"","deviceName":"IZDT-6","endpointId":"","eventType":null,"processes":[{"creationTime":171430626,"flsVerdict":3,"id":13324682947529074784,"imageHash":"2dfb00cd9a44a8a016452e1df01c0cec51870407","imagePath":"C:\Windows\System32\wininit.exe","pid":784,"userName":"SYSTEM@NT AUTHORITY","verdict":1},{"creationTime":1714392570787,"flsVerdict":3,"id":763785080847475,"imageHash":"e5704d8e560122c2a23de8912ae63b213d67c860","imagePath":"C:\Windows\System32\services.exe","pid":856,"userName":"SYS@NT AUTHORITY","verdict":1}],"sessionUser":"SYS@NT AUTHORITY","time":17145085,"type":"RP1.1","version":"1.1"}'
	   count => 1
  }
}
filter {
	mutate { gsub => ["message", "[\\]", "/" ] }
	json{ source=>"message"}
	
	ruby{
    code => ' 
	event.set("[childProcess][cmdLine]", event.get("[childProcess][cmdLine]").gsub("/", "\\\\") ) 
	event.set("[childProcess][imagePath]", event.get("[childProcess][imagePath]").gsub("/", "\\\\") ) 
	event.set("message", event.get("message").gsub("/", "\\\\") ) 
	
    proc = event.get("processes")
    proc.each_with_index do |value, index|
         event.set("[processes][#{index}][imagePath]", event.get("[processes][#{index}][imagePath]").gsub("/", "\\\\"))
    end
	'
  }
}
output {
 stdout { codec => rubydebug{} }
}

```

Maybe someone has better idea.

---

<div class="post-metadata">

### Author: ![sandraimmaculate](https://avatars.discourse-cdn.com/v4/letter/s/b487fb/32.png) [@sandraimmaculate](https://discuss.elastic.co/u/sandraimmaculate)
#### Post date: [May 1, 2024, 1:03pm UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/9 "2024-05-01T13:03:16Z")

</div>

thank you for spending your precious time on my issues 😇  
i will try the above one and let you know

---

<div class="post-metadata">

### Author: ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)
#### Post date: [May 1, 2024, 2:17pm UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/10 "2024-05-01T14:17:21Z")

</div>

What is your Logstash version? You didn't say, the version is importanto for the troubleshooting.

My suggestion is to only add the Elasticsearch output after you fixed the parse of your data.

For example, configure a `file` output to see what logstash is receiving.

Start with a single pipeline without any filters, just the input and output, this way you will know what is the raw message logstash is receiving and the right field name to use.

Use this:

```auto
input {
    beats {
        port => 5044
    }
}
output {
    file {
        path => "/tmp/logstash-raw-input.log"
    }
}

```

Then share some lines of the output file.

---

<div class="post-metadata">

### Author: ![sandraimmaculate](https://avatars.discourse-cdn.com/v4/letter/s/b487fb/32.png) [@sandraimmaculate](https://discuss.elastic.co/u/sandraimmaculate)
#### Post date: [May 2, 2024, 6:03am UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/11 "2024-05-02T06:03:34Z")

</div>

hi, my logstash version is 8.13.2. If i use the below pipeline  
input {  
beats {  
port =\> 5044  
}  
}  
output {  
file {  
paht =\> "/tmp/logstash-raw-input.log"  
}  
}  
im getting the below error while when i run the logstash

cmd: bin/logstash -f /etc/logstash/conf.d/openedr.conf

o/p:  
Using bundled JDK: /usr/share/logstash/jdk  
/usr/share/logstash/vendor/bundle/jruby/3.1.0/gems/concurrent-ruby-1.1.9/lib/concurrent-ruby/concurrent/executor/java\_thread\_pool\_executor.rb:13: warning: method redefined; discarding old to\_int  
/usr/share/logstash/vendor/bundle/jruby/3.1.0/gems/concurrent-ruby-1.1.9/lib/concurrent-ruby/concurrent/executor/java\_thread\_pool\_executor.rb:13: warning: method redefined; discarding old to\_f  
WARNING: Could not find logstash.yml which is typically located in $LS\_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults  
Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console  
[WARN] 2024-05-02 11:27:25.886 [main] runner - NOTICE: Running Logstash as superuser is not recommended and won't be allowed in the future. Set 'allow\_superuser' to 'false' to avoid startup errors in future releases.  
[INFO] 2024-05-02 11:27:25.894 [main] runner - Starting Logstash {"logstash.version"=\>"8.13.2", "jruby.version"=\>"jruby 9.4.5.0 (3.1.4) 2023-11-02 1abae2700f OpenJDK 64-Bit Server VM 17.0.10+7 on 17.0.10+7 +indy +jit [x86\_64-linux]"}  
[INFO] 2024-05-02 11:27:25.896 [main] runner - JVM bootstrap flags: [-Xms1g, -Xmx1g, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djruby.compile.invokedynamic=true, -XX:+HeapDumpOnOutOfMemoryError, -Djava.security.egd=file:/dev/urandom, -Dlog4j2.isThreadContextMapInheritable=true, -Dlogstash.jackson.stream-read-constraints.max-string-length=200000000, -Dlogstash.jackson.stream-read-constraints.max-number-length=10000, -Djruby.regexp.interruptible=true, -Djdk.io.File.enableADS=true, --add-exports=jdk.compiler/com.sun.tools.javac.api=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.parser=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.tree=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.util=ALL-UNNAMED, --add-opens=java.base/java.security=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.nio.channels=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.management/sun.management=ALL-UNNAMED, -Dio.netty.allocator.maxOrder=11]  
[INFO] 2024-05-02 11:27:25.899 [main] runner - Jackson default value override `logstash.jackson.stream-read-constraints.max-string-length` configured to `200000000`  
[INFO] 2024-05-02 11:27:25.899 [main] runner - Jackson default value override `logstash.jackson.stream-read-constraints.max-number-length` configured to `10000`  
[WARN] 2024-05-02 11:27:26.055 [LogStash::Runner] multilocal - Ignoring the 'pipelines.yml' file because modules or command line options are specified  
[INFO] 2024-05-02 11:27:26.481 [Api Webserver] agent - Successfully started Logstash API endpoint {:port=\>9601, :ssl\_enabled=\>false}  
[INFO] 2024-05-02 11:27:26.686 [Converge PipelineAction::Create] Reflections - Reflections took 80 ms to scan 1 urls, producing 132 keys and 468 values  
[INFO] 2024-05-02 11:27:26.900 [Converge PipelineAction::Create] jsonlines - ECS compatibility is enabled but `target` option was not specified. This may cause fields to be set at the top-level of the event where they are likely to clash with the Elastic Common Schema. It is recommended to set the `target` option to avoid potential schema conflicts (if your data is ECS compliant or non-conflicting, feel free to ignore this message)  
[ERROR] 2024-05-02 11:27:26.901 [Converge PipelineAction::Create] file - Unknown setting 'paht' for file  
[ERROR] 2024-05-02 11:27:26.906 [Converge PipelineAction::Create] agent - Failed to execute action {:action=\>LogStash::PipelineAction::Create/pipeline\_id:main, :exception=\>"Java::JavaLang::IllegalStateException", :message=\>"Unable to configure plugins: (ConfigurationError) Something is wrong with your configuration.", :backtrace=\>["org.logstash.config.ir.CompiledPipeline.(CompiledPipeline.java:120)", "org.logstash.execution.AbstractPipelineExt.initialize(AbstractPipelineExt.java:186)", "org.logstash.execution.AbstractPipelineExt$INVOKER$i$initialize.call(AbstractPipelineExt$INVOKER$i$initialize.gen)", "org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:847)", "org.jruby.ir.runtime.IRRuntimeHelpers.instanceSuper(IRRuntimeHelpers.java:1319)", "org.jruby.ir.instructions.InstanceSuperInstr.interpret(InstanceSuperInstr.java:139)", "org.jruby.ir.interpreter.InterpreterEngine.processCall(InterpreterEngine.java:367)", "org.jruby.ir.interpreter.StartupInterpreterEngine.interpret(StartupInterpreterEngine.java:66)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.INTERPRET\_METHOD(MixedModeIRMethod.java:128)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:115)", "org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:446)", "org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:92)", "org.jruby.RubyClass.newInstance(RubyClass.java:931)", "org.jruby.RubyClass$INVOKER$i$newInstance.call(RubyClass$INVOKER$i$newInstance.gen)", "org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:446)", "org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:92)", "org.jruby.ir.instructions.CallBase.interpret(CallBase.java:548)", "org.jruby.ir.interpreter.InterpreterEngine.processCall(InterpreterEngine.java:367)", "org.jruby.ir.interpreter.StartupInterpreterEngine.interpret(StartupInterpreterEngine.java:66)", "org.jruby.ir.interpreter.InterpreterEngine.interpret(InterpreterEngine.java:88)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.INTERPRET\_METHOD(MixedModeIRMethod.java:238)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:225)", "org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:228)", "org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:476)", "org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:293)", "org.jruby.ir.interpreter.InterpreterEngine.processCall(InterpreterEngine.java:328)", "org.jruby.ir.interpreter.StartupInterpreterEngine.interpret(StartupInterpreterEngine.java:66)", "org.jruby.ir.interpreter.Interpreter.INTERPRET\_BLOCK(Interpreter.java:116)", "org.jruby.runtime.MixedModeIRBlockBody.commonYieldPath(MixedModeIRBlockBody.java:136)", "org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:66)", "org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:58)", "org.jruby.runtime.Block.call(Block.java:144)", "org.jruby.RubyProc.call(RubyProc.java:352)", "org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:111)", "java.base/java.lang.Thread.run(Thread.java:840)"]}  
[INFO] 2024-05-02 11:27:26.918 [LogStash::Runner] runner - Logstash shut down.

and the ```  
logstash-raw-input.log

```auto
cat /tmp/logstash-raw-input.log
```

---

<div class="post-metadata">

### Author: ![sandraimmaculate](https://avatars.discourse-cdn.com/v4/letter/s/b487fb/32.png) [@sandraimmaculate](https://discuss.elastic.co/u/sandraimmaculate)
#### Post date: [May 2, 2024, 6:12am UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/12 "2024-05-02T06:12:47Z")

</div>

hi,  
cat /etc/logstash/conf.d/openedr.conf for the below pipeline  
input {  
beats {  
port =\> 5044  
}  
generator {  
message =\> '{"baseEventType":1,"baseType":1,"childProcess":{"cmdLine":"C:\Windows\system32\svchost.exe -k netsvcs -p -s gpsvc","creationTime":1714556553033,"elevationType":1,"flsVerdict":3,"id":5349677356,"imageHash":"445f5f38396f0e3ee50a1d8","imagePath":"C:\Windows\System32\svchost.exe","pid":14048,"scriptContent":"","verdict":1},"customerId":"","deviceName":"IZDT-6","endpointId":"","eventType":null,"processes":[{"creationTime":171430626,"flsVerdict":3,"id":13324682947529074784,"imageHash":"2dfb00cd9a44a8a016452e1df01c0cec51870407","imagePath":"C:\Windows\System32\wininit.exe","pid":784,"userName":"SYSTEM@NT AUTHORITY","verdict":1},{"creationTime":1714392570787,"flsVerdict":3,"id":763785080847475,"imageHash":"e5704d8e560122c2a23de8912ae63b213d67c860","imagePath":"C:\Windows\System32\services.exe","pid":856,"userName":"SYS@NT AUTHORITY","verdict":1}],"sessionUser":"SYS@NT AUTHORITY","time":17145085,"type":"RP1.1","version":"1.1"}'  
count =\> 1  
}  
}  
filter {  
mutate { gsub =\> ["message", "[\]", "/" ] }  
json{ source=\>"message"}

```
ruby{
code => ' 
event.set("[childProcess][cmdLine]", event.get("[childProcess][cmdLine]").gsub("/", "\\\\") ) 
event.set("[childProcess][imagePath]", event.get("[childProcess][imagePath]").gsub("/", "\\\\") ) 
event.set("message", event.get("message").gsub("/", "\\\\") ) 

proc = event.get("processes")
proc.each_with_index do |value, index|
     event.set("[processes][#{index}][imagePath]", event.get("[processes][#{index}][imagePath]").gsub("/", "\\\\"))
end
'

```

}  
}  
output {  
stdout { codec =\> rubydebug{} }  
}

i have added beats port as extra because the logs are in another server.

when i run the logstash it parsing some of the feilds for only 2 to 3 log entry and repeating some error .

o/p:

},  
"time" =\> 17145085,  
"version" =\> "1.1",  
"sessionUser" =\> "SYS@NT AUTHORITY",  
"@timestamp" =\> 2024-05-02T05:59:50.623008193Z,  
"customerId" =\> "",  
"message" =\> "{"baseEventType":1,"baseType":1,"childProcess":{"cmdLine":"C:\Windows\system32\svchost.exe -k netsvcs -p -s gpsvc","creationTime":1714556553033,"elevationType":1,"flsVerdict":3,"id":5349677356,"imageHash":"445f5f38396f0e3ee50a1d8","imagePath":"C:\Windows\System32\svchost.exe","pid":14048,"scriptContent":"","verdict":1},"customerId":"","deviceName":"IZDT-6","endpointId":"","eventType":null,"processes":[{"creationTime":171430626,"flsVerdict":3,"id":13324682947529074784,"imageHash":"2dfb00cd9a44a8a016452e1df01c0cec51870407","imagePath":"C:\Windows\System32\wininit.exe","pid":784,"userName":"SYSTEM@NT AUTHORITY","verdict":1},{"creationTime":1714392570787,"flsVerdict":3,"id":763785080847475,"imageHash":"e5704d8e560122c2a23de8912ae63b213d67c860","imagePath":"C:\Windows\System32\services.exe","pid":856,"userName":"SYS@NT AUTHORITY","verdict":1}],"sessionUser":"SYS@NT AUTHORITY","time":17145085,"type":"RP1.1","version":"1.1"}",  
"endpointId" =\> "",  
"childProcess" =\> {  
"cmdLine" =\> "C:\Windows\system32\svchost.exe -k netsvcs -p -s gpsvc",  
"flsVerdict" =\> 3,  
"elevationType" =\> 1,  
"id" =\> 5349677356,  
"imageHash" =\> "445f5f38396f0e3ee50a1d8",  
"creationTime" =\> 1714556553033,  
"imagePath" =\> "C:\Windows\System32\svchost.exe",  
"pid" =\> 14048,  
"scriptContent" =\> "",  
"verdict" =\> 1  
},  
"event" =\> {  
"original" =\> "{"baseEventType":1,"baseType":1,"childProcess":{"cmdLine":"C:\Windows\system32\svchost.exe -k netsvcs -p -s gpsvc","creationTime":1714556553033,"elevationType":1,"flsVerdict":3,"id":5349677356,"imageHash":"445f5f38396f0e3ee50a1d8","imagePath":"C:\Windows\System32\svchost.exe","pid":14048,"scriptContent":"","verdict":1},"customerId":"","deviceName":"IZDT-6","endpointId":"","eventType":null,"processes":[{"creationTime":171430626,"flsVerdict":3,"id":13324682947529074784,"imageHash":"2dfb00cd9a44a8a016452e1df01c0cec51870407","imagePath":"C:\Windows\System32\wininit.exe","pid":784,"userName":"SYSTEM@NT AUTHORITY","verdict":1},{"creationTime":1714392570787,"flsVerdict":3,"id":763785080847475,"imageHash":"e5704d8e560122c2a23de8912ae63b213d67c860","imagePath":"C:\Windows\System32\services.exe","pid":856,"userName":"SYS@NT AUTHORITY","verdict":1}],"sessionUser":"SYS@NT AUTHORITY","time":17145085,"type":"RP1.1","version":"1.1"}",  
"sequence" =\> 0  
}  
}  
[ERROR] 2024-05-02 11:29:56.746 [[main]\<beats] javapipeline - A plugin had an unrecoverable error. Will restart this plugin.  
Pipeline\_id:main  
Plugin: \<LogStash::Inputs::Beats port=\>5044, id=\>"875fa50123dc0a9dc3730a16fd05809d155d20bb15fdd4a07f21f6c301321990", enable\_metric=\>true, codec=\>\<LogStash::Codecs::Plain id=\>"plain\_cacf6798-fcf2-493f-9f8f-69736f8ba519", enable\_metric=\>true, charset=\>"UTF-8"\>, host=\>"0.0.0.0", ssl=\>false, ssl\_enabled=\>false, ssl\_client\_authentication=\>"none", ssl\_verify\_mode=\>"none", ssl\_peer\_metadata=\>false, include\_codec\_tag=\>true, ssl\_handshake\_timeout=\>10000, ssl\_cipher\_suites=\>["TLS\_AES\_256\_GCM\_SHA384", "TLS\_AES\_128\_GCM\_SHA256", "TLS\_CHACHA20\_POLY1305\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_256\_GCM\_SHA384", "TLS\_ECDHE\_RSA\_WITH\_AES\_256\_GCM\_SHA384", "TLS\_ECDHE\_ECDSA\_WITH\_CHACHA20\_POLY1305\_SHA256", "TLS\_ECDHE\_RSA\_WITH\_CHACHA20\_POLY1305\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_128\_GCM\_SHA256", "TLS\_ECDHE\_RSA\_WITH\_AES\_128\_GCM\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_256\_CBC\_SHA384", "TLS\_ECDHE\_RSA\_WITH\_AES\_256\_CBC\_SHA384", "TLS\_ECDHE\_RSA\_WITH\_AES\_128\_CBC\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_128\_CBC\_SHA256"], ssl\_supported\_protocols=\>["TLSv1.2", "TLSv1.3"], client\_inactivity\_timeout=\>60, executor\_threads=\>4, event\_loop\_threads=\>0, add\_hostname=\>false, tls\_min\_version=\>1, tls\_max\_version=\>1.3\>  
Error: Address already in use  
Exception: Java::JavaNet::BindException  
Stack: sun.nio.ch.Net.bind0(Native Method)  
sun.nio.ch.Net.bind(sun/nio/ch/Net.java:555)  
sun.nio.ch.ServerSocketChannelImpl.netBind(sun/nio/ch/ServerSocketChannelImpl.java:337)  
sun.nio.ch.ServerSocketChannelImpl.bind(sun/nio/ch/ServerSocketChannelImpl.java:294)  
io.netty.channel.socket.nio.NioServerSocketChannel.doBind(io/netty/channel/socket/nio/NioServerSocketChannel.java:141)  
io.netty.channel.AbstractChannel$AbstractUnsafe.bind(io/netty/channel/AbstractChannel.java:562)  
io.netty.channel.DefaultChannelPipeline$HeadContext.bind(io/netty/channel/DefaultChannelPipeline.java:1334)  
io.netty.channel.AbstractChannelHandlerContext.invokeBind(io/netty/channel/AbstractChannelHandlerContext.java:600)  
io.netty.channel.AbstractChannelHandlerContext.bind(io/netty/channel/AbstractChannelHandlerContext.java:579)  
io.netty.channel.DefaultChannelPipeline.bind(io/netty/channel/DefaultChannelPipeline.java:973)  
io.netty.channel.AbstractChannel.bind(io/netty/channel/AbstractChannel.java:260)  
io.netty.bootstrap.AbstractBootstrap$2.run(io/netty/bootstrap/AbstractBootstrap.java:356)  
io.netty.util.concurrent.AbstractEventExecutor.runTask(io/netty/util/concurrent/AbstractEventExecutor.java:173)  
io.netty.util.concurrent.AbstractEventExecutor.safeExecute(io/netty/util/concurrent/AbstractEventExecutor.java:166)  
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(io/netty/util/concurrent/SingleThreadEventExecutor.java:470)  
io.netty.channel.nio.NioEventLoop.run(io/netty/channel/nio/NioEventLoop.java:569)  
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(io/netty/util/concurrent/SingleThreadEventExecutor.java:997)  
io.netty.util.internal.ThreadExecutorMap$2.run(io/netty/util/internal/ThreadExecutorMap.java:74)  
io.netty.util.concurrent.FastThreadLocalRunnable.run(io/netty/util/concurrent/FastThreadLocalRunnable.java:30)  
java.lang.Thread.run(java/lang/Thread.java:840)  
[INFO] 2024-05-02 11:29:57.748 [[main]\<beats] Server - Starting server on port: 5044  
[ERROR] 2024-05-02 11:30:03.766 [[main]\<beats] javapipeline - A plugin had an unrecoverable error. Will restart this plugin.  
Pipeline\_id:main  
Plugin: \<LogStash::Inputs::Beats port=\>5044, id=\>"875fa50123dc0a9dc3730a16fd05809d155d20bb15fdd4a07f21f6c301321990", enable\_metric=\>true, codec=\>\<LogStash::Codecs::Plain id=\>"plain\_cacf6798-fcf2-493f-9f8f-69736f8ba519", enable\_metric=\>true, charset=\>"UTF-8"\>, host=\>"0.0.0.0", ssl=\>false, ssl\_enabled=\>false, ssl\_client\_authentication=\>"none", ssl\_verify\_mode=\>"none", ssl\_peer\_metadata=\>false, include\_codec\_tag=\>true, ssl\_handshake\_timeout=\>10000, ssl\_cipher\_suites=\>["TLS\_AES\_256\_GCM\_SHA384", "TLS\_AES\_128\_GCM\_SHA256", "TLS\_CHACHA20\_POLY1305\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_256\_GCM\_SHA384", "TLS\_ECDHE\_RSA\_WITH\_AES\_256\_GCM\_SHA384", "TLS\_ECDHE\_ECDSA\_WITH\_CHACHA20\_POLY1305\_SHA256", "TLS\_ECDHE\_RSA\_WITH\_CHACHA20\_POLY1305\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_128\_GCM\_SHA256", "TLS\_ECDHE\_RSA\_WITH\_AES\_128\_GCM\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_256\_CBC\_SHA384", "TLS\_ECDHE\_RSA\_WITH\_AES\_256\_CBC\_SHA384", "TLS\_ECDHE\_RSA\_WITH\_AES\_128\_CBC\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_128\_CBC\_SHA256"], ssl\_supported\_protocols=\>["TLSv1.2", "TLSv1.3"], client\_inactivity\_timeout=\>60, executor\_threads=\>4, event\_loop\_threads=\>0, add\_hostname=\>false, tls\_min\_version=\>1, tls\_max\_version=\>1.3\>  
Error: Address already in use  
Exception: Java::JavaNet::BindException  
Stack: sun.nio.ch.Net.bind0(Native Method)  
sun.nio.ch.Net.bind(sun/nio/ch/Net.java:555)  
sun.nio.ch.ServerSocketChannelImpl.netBind(sun/nio/ch/ServerSocketChannelImpl.java:337)  
sun.nio.ch.ServerSocketChannelImpl.bind(sun/nio/ch/ServerSocketChannelImpl.java:294)  
io.netty.channel.socket.nio.NioServerSocketChannel.doBind(io/netty/channel/socket/nio/NioServerSocketChannel.java:141)  
io.netty.channel.AbstractChannel$AbstractUnsafe.bind(io/netty/channel/AbstractChannel.java:562)  
io.netty.channel.DefaultChannelPipeline$HeadContext.bind(io/netty/channel/DefaultChannelPipeline.java:1334)  
io.netty.channel.AbstractChannelHandlerContext.invokeBind(io/netty/channel/AbstractChannelHandlerContext.java:600)  
io.netty.channel.AbstractChannelHandlerContext.bind(io/netty/channel/AbstractChannelHandlerContext.java:579)  
io.netty.channel.DefaultChannelPipeline.bind(io/netty/channel/DefaultChannelPipeline.java:973)  
io.netty.channel.AbstractChannel.bind(io/netty/channel/AbstractChannel.java:260)  
io.netty.bootstrap.AbstractBootstrap$2.run(io/netty/bootstrap/AbstractBootstrap.java:356)  
io.netty.util.concurrent.AbstractEventExecutor.runTask(io/netty/util/concurrent/AbstractEventExecutor.java:173)  
io.netty.util.concurrent.AbstractEventExecutor.safeExecute(io/netty/util/concurrent/AbstractEventExecutor.java:166)  
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(io/netty/util/concurrent/SingleThreadEventExecutor.java:470)  
io.netty.channel.nio.NioEventLoop.run(io/netty/channel/nio/NioEventLoop.java:569)  
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(io/netty/util/concurrent/SingleThreadEventExecutor.java:997)  
io.netty.util.internal.ThreadExecutorMap$2.run(io/netty/util/internal/ThreadExecutorMap.java:74)  
io.netty.util.concurrent.FastThreadLocalRunnable.run(io/netty/util/concurrent/FastThreadLocalRunnable.java:30)  
java.lang.Thread.run(java/lang/Thread.java:840)  
[INFO] 2024-05-02 11:30:04.769 [[main]\<beats] Server - Starting server on port: 5044  
[ERROR] 2024-05-02 11:30:10.790 [[main]\<beats] javapipeline - A plugin had an unrecoverable error. Will restart this plugin.  
Pipeline\_id:main  
Plugin: \<LogStash::Inputs::Beats port=\>5044, id=\>"875fa50123dc0a9dc3730a16fd05809d155d20bb15fdd4a07f21f6c301321990", enable\_metric=\>true, codec=\>\<LogStash::Codecs::Plain id=\>"plain\_cacf6798-fcf2-493f-9f8f-69736f8ba519", enable\_metric=\>true, charset=\>"UTF-8"\>, host=\>"0.0.0.0", ssl=\>false, ssl\_enabled=\>false, ssl\_client\_authentication=\>"none", ssl\_verify\_mode=\>"none", ssl\_peer\_metadata=\>false, include\_codec\_tag=\>true, ssl\_handshake\_timeout=\>10000, ssl\_cipher\_suites=\>["TLS\_AES\_256\_GCM\_SHA384", "TLS\_AES\_128\_GCM\_SHA256", "TLS\_CHACHA20\_POLY1305\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_256\_GCM\_SHA384", "TLS\_ECDHE\_RSA\_WITH\_AES\_256\_GCM\_SHA384", "TLS\_ECDHE\_ECDSA\_WITH\_CHACHA20\_POLY1305\_SHA256", "TLS\_ECDHE\_RSA\_WITH\_CHACHA20\_POLY1305\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_128\_GCM\_SHA256", "TLS\_ECDHE\_RSA\_WITH\_AES\_128\_GCM\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_256\_CBC\_SHA384", "TLS\_ECDHE\_RSA\_WITH\_AES\_256\_CBC\_SHA384", "TLS\_ECDHE\_RSA\_WITH\_AES\_128\_CBC\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_128\_CBC\_SHA256"], ssl\_supported\_protocols=\>["TLSv1.2", "TLSv1.3"], client\_inactivity\_timeout=\>60, executor\_threads=\>4, event\_loop\_threads=\>0, add\_hostname=\>false, tls\_min\_version=\>1, tls\_max\_version=\>1.3\>  
Error: Address already in use  
Exception: Java::JavaNet::BindException  
Stack: sun.nio.ch.Net.bind0(Native Method)  
sun.nio.ch.Net.bind(sun/nio/ch/Net.java:555)  
sun.nio.ch.ServerSocketChannelImpl.netBind(sun/nio/ch/ServerSocketChannelImpl.java:337)  
sun.nio.ch.ServerSocketChannelImpl.bind(sun/nio/ch/ServerSocketChannelImpl.java:294)  
io.netty.channel.socket.nio.NioServerSocketChannel.doBind(io/netty/channel/socket/nio/NioServerSocketChannel.java:141)  
io.netty.channel.AbstractChannel$AbstractUnsafe.bind(io/netty/channel/AbstractChannel.java:562)  
io.netty.channel.DefaultChannelPipeline$HeadContext.bind(io/netty/channel/DefaultChannelPipeline.java:1334)  
io.netty.channel.AbstractChannelHandlerContext.invokeBind(io/netty/channel/AbstractChannelHandlerContext.java:600)  
io.netty.channel.AbstractChannelHandlerContext.bind(io/netty/channel/AbstractChannelHandlerContext.java:579)  
io.netty.channel.DefaultChannelPipeline.bind(io/netty/channel/DefaultChannelPipeline.java:973)  
io.netty.channel.AbstractChannel.bind(io/netty/channel/AbstractChannel.java:260)  
io.netty.bootstrap.AbstractBootstrap$2.run(io/netty/bootstrap/AbstractBootstrap.java:356)  
io.netty.util.concurrent.AbstractEventExecutor.runTask(io/netty/util/concurrent/AbstractEventExecutor.java:173)  
io.netty.util.concurrent.AbstractEventExecutor.safeExecute(io/netty/util/concurrent/AbstractEventExecutor.java:166)  
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(io/netty/util/concurrent/SingleThreadEventExecutor.java:470)  
io.netty.channel.nio.NioEventLoop.run(io/netty/channel/nio/NioEventLoop.java:569)  
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(io/netty/util/concurrent/SingleThreadEventExecutor.java:997)  
io.netty.util.internal.ThreadExecutorMap$2.run(io/netty/util/internal/ThreadExecutorMap.java:74)  
io.netty.util.concurrent.FastThreadLocalRunnable.run(io/netty/util/concurrent/FastThreadLocalRunnable.java:30)  
java.lang.Thread.run(java/lang/Thread.java:840)  
[INFO] 2024-05-02 11:30:11.793 [[main]\<beats] Server - Starting server on port: 5044  
[ERROR] 2024-05-02 11:30:17.812 [[main]\<beats] javapipeline - A plugin had an unrecoverable error. Will restart this plugin.  
Pipeline\_id:main  
Plugin: \<LogStash::Inputs::Beats port=\>5044, id=\>"875fa50123dc0a9dc3730a16fd05809d155d20bb15fdd4a07f21f6c301321990", enable\_metric=\>true, codec=\>\<LogStash::Codecs::Plain id=\>"plain\_cacf6798-fcf2-493f-9f8f-69736f8ba519", enable\_metric=\>true, charset=\>"UTF-8"\>, host=\>"0.0.0.0", ssl=\>false, ssl\_enabled=\>false, ssl\_client\_authentication=\>"none", ssl\_verify\_mode=\>"none", ssl\_peer\_metadata=\>false, include\_codec\_tag=\>true, ssl\_handshake\_timeout=\>10000, ssl\_cipher\_suites=\>["TLS\_AES\_256\_GCM\_SHA384", "TLS\_AES\_128\_GCM\_SHA256", "TLS\_CHACHA20\_POLY1305\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_256\_GCM\_SHA384", "TLS\_ECDHE\_RSA\_WITH\_AES\_256\_GCM\_SHA384", "TLS\_ECDHE\_ECDSA\_WITH\_CHACHA20\_POLY1305\_SHA256", "TLS\_ECDHE\_RSA\_WITH\_CHACHA20\_POLY1305\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_128\_GCM\_SHA256", "TLS\_ECDHE\_RSA\_WITH\_AES\_128\_GCM\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_256\_CBC\_SHA384", "TLS\_ECDHE\_RSA\_WITH\_AES\_256\_CBC\_SHA384", "TLS\_ECDHE\_RSA\_WITH\_AES\_128\_CBC\_SHA256", "TLS\_ECDHE\_ECDSA\_WITH\_AES\_128\_CBC\_SHA256"], ssl\_supported\_protocols=\>["TLSv1.2", "TLSv1.3"], client\_inactivity\_timeout=\>60, executor\_threads=\>4, event\_loop\_threads=\>0, add\_hostname=\>false, tls\_min\_version=\>1, tls\_max\_version=\>1.3\>  
Error: Address already in use  
Exception: Java::JavaNet::BindException  
Stack: sun.nio.ch.Net.bind0(Native Method)  
sun.nio.ch.Net.bind(sun/nio/ch/Net.java:555)  
sun.nio.ch.ServerSocketChannelImpl.netBind(sun/nio/ch/ServerSocketChannelImpl.java:337)  
sun.nio.ch.ServerSocketChannelImpl.bind(sun/nio/ch/ServerSocketChannelImpl.java:294)  
io.netty.channel.socket.nio.NioServerSocketChannel.doBind(io/netty/channel/socket/nio/NioServerSocketChannel.java:141)  
io.netty.channel.AbstractChannel$AbstractUnsafe.bind(io/netty/channel/AbstractChannel.java:562)  
io.netty.channel.DefaultChannelPipeline$HeadContext.bind(io/netty/channel/DefaultChannelPipeline.java:1334)  
io.netty.channel.AbstractChannelHandlerContext.invokeBind(io/netty/channel/AbstractChannelHandlerContext.java:600)  
io.netty.channel.AbstractChannelHandlerContext.bind(io/netty/channel/AbstractChannelHandlerContext.java:579)  
io.netty.channel.DefaultChannelPipeline.bind(io/netty/channel/DefaultChannelPipeline.java:973)  
io.netty.channel.AbstractChannel.bind(io/netty/channel/AbstractChannel.java:260)  
io.netty.bootstrap.AbstractBootstrap$2.run(io/netty/bootstrap/AbstractBootstrap.java:356)  
io.netty.util.concurrent.AbstractEventExecutor.runTask(io/netty/util/concurrent/AbstractEventExecutor.java:173)  
io.netty.util.concurrent.AbstractEventExecutor.safeExecute(io/netty/util/concurrent/AbstractEventExecutor.java:166)  
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(io/netty/util/concurrent/SingleThreadEventExecutor.java:470)  
io.netty.channel.nio.NioEventLoop.run(io/netty/channel/nio/NioEventLoop.java:569)  
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(io/netty/util/concurrent/SingleThreadEventExecutor.java:997)  
io.netty.util.internal.ThreadExecutorMap$2.run(io/netty/util/internal/ThreadExecutorMap.java:74)  
io.netty.util.concurrent.FastThreadLocalRunnable.run(io/netty/util/concurrent/FastThreadLocalRunnable.java:30)  
java.lang.Thread.run(java/lang/Thread.java:840)  
^C[WARN] 2024-05-02 11:30:18.260 [SIGINT handler] runner - SIGINT received. Shutting down.  
[INFO] 2024-05-02 11:30:18.815 [[main]\<beats] Server - Starting server on port: 5044  
^C[FATAL] 2024-05-02 11:30:19.643 [SIGINT handler] runner - SIGINT received. Terminating immediately..  
^Croot@freeipa:/usr/share/logstash# cat /etc/logstash/conf.d/openedr.conf

if i mention elasticsearch in the output plugin it not showing any logs in discover\>kibana  
same output in the console.

---

<div class="post-metadata">

### Author: ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)
#### Post date: [May 2, 2024, 12:21pm UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/13 "2024-05-02T12:21:54Z")

</div>

> [@sandraimmaculate](#):
>
> [ERROR] 2024-05-02 11:27:26.901 [Converge PipelineAction::Create] file - Unknown setting 'paht' for file

There was a type, the output needs to be:

```auto
output {
    file {
        path => "/tmp/logstash-raw-input.log"
    }
}

```

---

<div class="post-metadata">

### Author: ![sandraimmaculate](https://avatars.discourse-cdn.com/v4/letter/s/b487fb/32.png) [@sandraimmaculate](https://discuss.elastic.co/u/sandraimmaculate)
#### Post date: [May 2, 2024, 1:10pm UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/14 "2024-05-02T13:10:38Z")

</div>

sorry,

```auto
input {
    beats {
        port => 5044
    }
}
output {
    file {
        path => "/tmp/logstash-raw-input.log"
    }
}

```

this was my conf file and the error is

```auto
Pipeline_id:main
  Plugin: <LogStash::Inputs::Beats port=>5044, id=>"bd4b83cf08f23a0dabb7fd175613f2eed2178dc3259f903844c0418c7d6817ef", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_14b864b2-c224-4c38-b2ef-7b916c612351", enable_metric=>true, charset=>"UTF-8">, host=>"0.0.0.0", ssl=>false, ssl_enabled=>false, ssl_client_authentication=>"none", ssl_verify_mode=>"none", ssl_peer_metadata=>false, include_codec_tag=>true, ssl_handshake_timeout=>10000, ssl_cipher_suites=>["TLS_AES_256_GCM_SHA384", "TLS_AES_128_GCM_SHA256", "TLS_CHACHA20_POLY1305_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384", "TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384", "TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256", "TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256", "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384", "TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384", "TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256"], ssl_supported_protocols=>["TLSv1.2", "TLSv1.3"], client_inactivity_timeout=>60, executor_threads=>4, event_loop_threads=>0, add_hostname=>false, tls_min_version=>1, tls_max_version=>1.3>
  Error: Address already in use
  Exception: Java::JavaNet::BindException
  Stack: sun.nio.ch.Net.bind0(Native Method)
sun.nio.ch.Net.bind(sun/nio/ch/Net.java:555)
sun.nio.ch.ServerSocketChannelImpl.netBind(sun/nio/ch/ServerSocketChannelImpl.java:337)
sun.nio.ch.ServerSocketChannelImpl.bind(sun/nio/ch/ServerSocketChannelImpl.java:294)
io.netty.channel.socket.nio.NioServerSocketChannel.doBind(io/netty/channel/socket/nio/NioServerSocketChannel.java:141)
io.netty.channel.AbstractChannel$AbstractUnsafe.bind(io/netty/channel/AbstractChannel.java:562)
io.netty.channel.DefaultChannelPipeline$HeadContext.bind(io/netty/channel/DefaultChannelPipeline.java:1334)
io.netty.channel.AbstractChannelHandlerContext.invokeBind(io/netty/channel/AbstractChannelHandlerContext.java:600)
io.netty.channel.AbstractChannelHandlerContext.bind(io/netty/channel/AbstractChannelHandlerContext.java:579)
io.netty.channel.DefaultChannelPipeline.bind(io/netty/channel/DefaultChannelPipeline.java:973)
io.netty.channel.AbstractChannel.bind(io/netty/channel/AbstractChannel.java:260)
io.netty.bootstrap.AbstractBootstrap$2.run(io/netty/bootstrap/AbstractBootstrap.java:356)
io.netty.util.concurrent.AbstractEventExecutor.runTask(io/netty/util/concurrent/AbstractEventExecutor.java:173)
io.netty.util.concurrent.AbstractEventExecutor.safeExecute(io/netty/util/concurrent/AbstractEventExecutor.java:166)
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(io/netty/util/concurrent/SingleThreadEventExecutor.java:470)
io.netty.channel.nio.NioEventLoop.run(io/netty/channel/nio/NioEventLoop.java:569)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(io/netty/util/concurrent/SingleThreadEventExecutor.java:997)
io.netty.util.internal.ThreadExecutorMap$2.run(io/netty/util/internal/ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(io/netty/util/concurrent/FastThreadLocalRunnable.java:30)
java.lang.Thread.run(java/lang/Thread.java:840)
[INFO] 2024-05-02 18:37:26.818 [[main]<beats] Server - Starting server on port: 5044
[ERROR] 2024-05-02 18:37:32.837 [[main]<beats] javapipeline - A plugin had an unrecoverable error. Will restart this plugin.
  Pipeline_id:main
  Plugin: <LogStash::Inputs::Beats port=>5044, id=>"bd4b83cf08f23a0dabb7fd175613f2eed2178dc3259f903844c0418c7d6817ef", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_14b864b2-c224-4c38-b2ef-7b916c612351", enable_metric=>true, charset=>"UTF-8">, host=>"0.0.0.0", ssl=>false, ssl_enabled=>false, ssl_client_authentication=>"none", ssl_verify_mode=>"none", ssl_peer_metadata=>false, include_codec_tag=>true, ssl_handshake_timeout=>10000, ssl_cipher_suites=>["TLS_AES_256_GCM_SHA384", "TLS_AES_128_GCM_SHA256", "TLS_CHACHA20_POLY1305_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384", "TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384", "TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256", "TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256", "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384", "TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384", "TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256"], ssl_supported_protocols=>["TLSv1.2", "TLSv1.3"], client_inactivity_timeout=>60, executor_threads=>4, event_loop_threads=>0, add_hostname=>false, tls_min_version=>1, tls_max_version=>1.3>
  Error: Address already in use
  Exception: Java::JavaNet::BindException
  Stack: sun.nio.ch.Net.bind0(Native Method)
sun.nio.ch.Net.bind(sun/nio/ch/Net.java:555)
sun.nio.ch.ServerSocketChannelImpl.netBind(sun/nio/ch/ServerSocketChannelImpl.java:337)
sun.nio.ch.ServerSocketChannelImpl.bind(sun/nio/ch/ServerSocketChannelImpl.java:294)
io.netty.channel.socket.nio.NioServerSocketChannel.doBind(io/netty/channel/socket/nio/NioServerSocketChannel.java:141)
io.netty.channel.AbstractChannel$AbstractUnsafe.bind(io/netty/channel/AbstractChannel.java:562)
io.netty.channel.DefaultChannelPipeline$HeadContext.bind(io/netty/channel/DefaultChannelPipeline.java:1334)
io.netty.channel.AbstractChannelHandlerContext.invokeBind(io/netty/channel/AbstractChannelHandlerContext.java:600)
io.netty.channel.AbstractChannelHandlerContext.bind(io/netty/channel/AbstractChannelHandlerContext.java:579)
io.netty.channel.DefaultChannelPipeline.bind(io/netty/channel/DefaultChannelPipeline.java:973)
io.netty.channel.AbstractChannel.bind(io/netty/channel/AbstractChannel.java:260)
io.netty.bootstrap.AbstractBootstrap$2.run(io/netty/bootstrap/AbstractBootstrap.java:356)
io.netty.util.concurrent.AbstractEventExecutor.runTask(io/netty/util/concurrent/AbstractEventExecutor.java:173)
io.netty.util.concurrent.AbstractEventExecutor.safeExecute(io/netty/util/concurrent/AbstractEventExecutor.java:166)
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(io/netty/util/concurrent/SingleThreadEventExecutor.java:470)
io.netty.channel.nio.NioEventLoop.run(io/netty/channel/nio/NioEventLoop.java:569)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(io/netty/util/concurrent/SingleThreadEventExecutor.java:997)
io.netty.util.internal.ThreadExecutorMap$2.run(io/netty/util/internal/ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(io/netty/util/concurrent/FastThreadLocalRunnable.java:30)
java.lang.Thread.run(java/lang/Thread.java:840)
[INFO] 2024-05-02 18:37:33.838 [[main]<beats] Server - Starting server on port: 5044
[ERROR] 2024-05-02 18:37:39.857 [[main]<beats] javapipeline - A plugin had an unrecoverable error. Will restart this plugin.
  Pipeline_id:main
  Plugin: <LogStash::Inputs::Beats port=>5044, id=>"bd4b83cf08f23a0dabb7fd175613f2eed2178dc3259f903844c0418c7d6817ef", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_14b864b2-c224-4c38-b2ef-7b916c612351", enable_metric=>true, charset=>"UTF-8">, host=>"0.0.0.0", ssl=>false, ssl_enabled=>false, ssl_client_authentication=>"none", ssl_verify_mode=>"none", ssl_peer_metadata=>false, include_codec_tag=>true, ssl_handshake_timeout=>10000, ssl_cipher_suites=>["TLS_AES_256_GCM_SHA384", "TLS_AES_128_GCM_SHA256", "TLS_CHACHA20_POLY1305_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384", "TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384", "TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256", "TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256", "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384", "TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384", "TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256"], ssl_supported_protocols=>["TLSv1.2", "TLSv1.3"], client_inactivity_timeout=>60, executor_threads=>4, event_loop_threads=>0, add_hostname=>false, tls_min_version=>1, tls_max_version=>1.3>
  Error: Address already in use
  Exception: Java::JavaNet::BindException
  Stack: sun.nio.ch.Net.bind0(Native Method)
sun.nio.ch.Net.bind(sun/nio/ch/Net.java:555)
sun.nio.ch.ServerSocketChannelImpl.netBind(sun/nio/ch/ServerSocketChannelImpl.java:337)
sun.nio.ch.ServerSocketChannelImpl.bind(sun/nio/ch/ServerSocketChannelImpl.java:294)
io.netty.channel.socket.nio.NioServerSocketChannel.doBind(io/netty/channel/socket/nio/NioServerSocketChannel.java:141)
io.netty.channel.AbstractChannel$AbstractUnsafe.bind(io/netty/channel/AbstractChannel.java:562)
io.netty.channel.DefaultChannelPipeline$HeadContext.bind(io/netty/channel/DefaultChannelPipeline.java:1334)
io.netty.channel.AbstractChannelHandlerContext.invokeBind(io/netty/channel/AbstractChannelHandlerContext.java:600)
io.netty.channel.AbstractChannelHandlerContext.bind(io/netty/channel/AbstractChannelHandlerContext.java:579)
io.netty.channel.DefaultChannelPipeline.bind(io/netty/channel/DefaultChannelPipeline.java:973)
io.netty.channel.AbstractChannel.bind(io/netty/channel/AbstractChannel.java:260)
io.netty.bootstrap.AbstractBootstrap$2.run(io/netty/bootstrap/AbstractBootstrap.java:356)
io.netty.util.concurrent.AbstractEventExecutor.runTask(io/netty/util/concurrent/AbstractEventExecutor.java:173)
io.netty.util.concurrent.AbstractEventExecutor.safeExecute(io/netty/util/concurrent/AbstractEventExecutor.java:166)
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(io/netty/util/concurrent/SingleThreadEventExecutor.java:470)
io.netty.channel.nio.NioEventLoop.run(io/netty/channel/nio/NioEventLoop.java:569)
io.netty.util.concurrent.SingleThreadEventExecutor$4.run(io/netty/util/concurrent/SingleThreadEventExecutor.java:997)
io.netty.util.internal.ThreadExecutorMap$2.run(io/netty/util/internal/ThreadExecutorMap.java:74)
io.netty.util.concurrent.FastThreadLocalRunnable.run(io/netty/util/concurrent/FastThreadLocalRunnable.java:30)
java.lang.Thread.run(java/lang/Thread.java:840)
[INFO] 2024-05-02 18:37:40.859 [[main]<beats] Server - Starting server on port: 5044
[ERROR] 2024-05-02 18:37:46.877 [[main]<beats] javapipeline - A plugin had an unrecoverable error. Will restart this plugin.
  Pipeline_id:main
  Plugin: <LogStash::Inputs::Beats port=>5044, id=>"bd4b83cf08f23a0dabb7fd175613f2eed2178dc3259f903844c0418c7d6817ef", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_14b864b2-c224-4c38-b2ef-7b916c612351", enable_metric=>true, charset=>"UTF-8">, host=>"0.0.0.0", ssl=>false, ssl_enabled=>false, ssl_client_authentication=>"none", ssl_verify_mode=>"none", ssl_peer_metadata=>false, include_codec_tag=>true, ssl_handshake_timeout=>10000, ssl_cipher_suites=>["TLS_AES_256_GCM_SHA384", "TLS_AES_128_GCM_SHA256", "TLS_CHACHA20_POLY1305_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384", "TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384", "TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256", "TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256", "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384", "TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384", "TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256"], ssl_supported_protocols=>["TLSv1.2", "TLSv1.3"], client_inactivity_timeout=>60, executor_threads=>4, event_loop_threads=>0, add_hostname=>false, tls_min_version=>1, tls_max_version=>1.3>
  Error: Address already in use
  Exception: Java::JavaNet::BindException
  Stack: sun.nio.ch.Net.bind0(Native Method)

```

---

<div class="post-metadata">

### Author: ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)
#### Post date: [May 2, 2024, 1:15pm UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/15 "2024-05-02T13:15:31Z")

</div>

Hello, please do not share logs without using the preformatted text option, it makes everything way hard to read.

Use the `</>` button.

Also, check the error messages, it has hints of the issue.

> [@sandraimmaculate](#):
>
> Error: Address already in use  
> Exception: Java::JavaNet::BindException

This means that the port `5044` is already being used. Do you have another Logstash instance running?

---

<div class="post-metadata">

### Author: ![sandraimmaculate](https://avatars.discourse-cdn.com/v4/letter/s/b487fb/32.png) [@sandraimmaculate](https://discuss.elastic.co/u/sandraimmaculate)
#### Post date: [May 2, 2024, 1:22pm UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/16 "2024-05-02T13:22:01Z")

</div>

sorry for the inconvenience idk about this `</>` button.  
no only one logstash is running i have executed the below command

` ` `  
sudo netstat -tuln | grep 5044

```auto
o/p:
tcp6 0 0 :::5044 :::* LISTEN
` ` `
```

---

<div class="post-metadata">

### Author: ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)
#### Post date: [May 2, 2024, 1:26pm UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/17 "2024-05-02T13:26:17Z")

</div>

To format your code put 3 back ticks before after your code

```` `  
Your code...  
`````

---

<div class="post-metadata">

### Author: ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)
#### Post date: [May 2, 2024, 1:36pm UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/18 "2024-05-02T13:36:04Z")

</div>

> [@sandraimmaculate](#):
>
> no only one logstash is running i have executed the below command

The error in Logstash says that it cannot bind to the port because it is already being used, you need to check what is using the port.

---

<div class="post-metadata">

### Author: ![sandraimmaculate](https://avatars.discourse-cdn.com/v4/letter/s/b487fb/32.png) [@sandraimmaculate](https://discuss.elastic.co/u/sandraimmaculate)
#### Post date: [May 2, 2024, 1:41pm UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/19 "2024-05-02T13:41:57Z")

</div>

```auto
sudo netstat -tuln | grep 5044

```

o/p:

```auto
tcp6 0 0 :::5044 :::* LISTEN

```

according to this command only one process is running right with that port

---

<div class="post-metadata">

### Author: ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)
#### Post date: [May 2, 2024, 1:43pm UTC](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535/20 "2024-05-02T13:43:55Z")

</div>

> [@sandraimmaculate](#):
>
> according to this command only one process is running right with that port

Which process? Check the PID and see if it is another logstash instance.

[Next page](https://discuss.elastic.co/t/the-whole-log-of-openedr-is-inside-the-message-feild-in-kibana-urgent/358535.md?page=2)
