# Logstash showing error when executed from python but executes from terminal

**URL:** <https://discuss.elastic.co/t/logstash-showing-error-when-executed-from-python-but-executes-from-terminal/311508>\
**Category:** Logstash\
**Created:** [August 5, 2022, 11:05am UTC](https://discuss.elastic.co/t/logstash-showing-error-when-executed-from-python-but-executes-from-terminal/311508 "2022-08-05T11:05:50Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Morning\_Star](https://avatars.discourse-cdn.com/v4/letter/m/b9bd4f/32.png) [@Morning\_Star](https://discuss.elastic.co/u/Morning_Star)\
**Post date:** [August 5, 2022, 11:05am UTC](https://discuss.elastic.co/t/logstash-showing-error-when-executed-from-python-but-executes-from-terminal/311508/1 "2022-08-05T11:05:50Z")

</div>

I'm new to ELK stack and any help would be appriciated  
I have tried both os and subprocess both are giving same error

This is getting executed from terminal  
`

> /usr/share/logstash/bin/logstash -f /root/folder1/folder2/demo.conf

`

but the Python code:

> `os.system("/usr/share/logstash/bin/logstash -f /root/folder1/folder2/demo.conf")`

similar thing was working on my windows machine but on server it's giving error

Can see the error output below:

> [ERROR] 2022-08-05 10:43:45.366 [Ruby-0-Thread-13: :1] javapipeline - Worker loop initialization error {:pipeline\_id=\>"main", :error=\>"Missing Filter End Vertex", :exception=\>Java::JavaLang::IllegalStateException, :stacktrace=\>"org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileFilters$1(org/logstash/config/ir/CompiledPipeline.java:384)\njava.util.Optional.orElseThrow(java/util/Optional.java:408)\norg.logstash.config.ir.CompiledPipeline$CompiledExecution.compileFilters(org/logstash/config/ir/CompiledPipeline.java:384)\norg.logstash.config.ir.CompiledPipeline$CompiledExecution.(org/logstash/config/ir/CompiledPipeline.java:363)\norg.logstash.config.ir.CompiledPipeline$CompiledUnorderedExecution.(org/logstash/config/ir/CompiledPipeline.java:322)\norg.logstash.config.ir.CompiledPipeline.buildExecution(org/logstash/config/ir/CompiledPipeline.java:154)\norg.logstash.execution.WorkerLoop.(org/logstash/execution/WorkerLoop.java:67)\njdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)\njdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(jdk/internal/reflect/NativeConstructorAccessorImpl.java:62)\njdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(jdk/internal/reflect/DelegatingConstructorAccessorImpl.java:45)\njava.lang.reflect.Constructor.newInstance(java/lang/reflect/Constructor.java:490)\norg.jruby.javasupport.JavaConstructor.newInstanceDirect(org/jruby/javasupport/JavaConstructor.java:253)\norg.jruby.RubyClass.newInstance(org/jruby/RubyClass.java:939)\norg.jruby.RubyClass$INVOKER$i$newInstance.call(org/jruby/RubyClass$INVOKER$i$newInstance.gen)\nRUBY.init\_worker\_loop(/usr/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb:578)\nusr.share.logstash.logstash\_minus\_core.lib.logstash.java\_pipeline.start\_workers(/usr/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb:285)\norg.jruby.RubyProc.call(org/jruby/RubyProc.java:318)\njava.lang.Thread.run(java/lang/Thread.java:829)", :thread=\>"#\<Thread:0x5b2c8287 sleep\>"}

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [August 5, 2022, 2:36pm UTC](https://discuss.elastic.co/t/logstash-showing-error-when-executed-from-python-but-executes-from-terminal/311508/2 "2022-08-05T14:36:45Z")

</div>

> [@Morning\_Star](#):
>
> /root/folder1/folder2/demo.conf

What does that file look like on the server that is producing that error?

---

<div class="post-metadata">

**Author:** ![Morning\_Star](https://avatars.discourse-cdn.com/v4/letter/m/b9bd4f/32.png) [@Morning\_Star](https://discuss.elastic.co/u/Morning_Star)\
**Post date:** [August 5, 2022, 5:30pm UTC](https://discuss.elastic.co/t/logstash-showing-error-when-executed-from-python-but-executes-from-terminal/311508/3 "2022-08-05T17:30:45Z")

</div>

Here is the demo.conf file. Can there be an issue with access to this file or unable to read from this file?

```auto
input 
{
    file 
    {   
        path => "path/demo.json"
        mode => "read"
        file_completed_action => 'log'
        file_completed_log_path => 'path/writen_files.log'
        exit_after_read => 'true'
        sincedb_path => "/dev/null"
        exclude => "*.gz"
    }
}

filter {
    json {
        source => "message" 
    }

    mutate {
        remove_field => ["host","path","@version","message"]
    }
}

output {
    elasticsearch { 
        codec => json
        hosts => ["http://host:9200/"]
        index => "req_idx"
    }
    stdout {}
}

```

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [August 5, 2022, 7:21pm UTC](https://discuss.elastic.co/t/logstash-showing-error-when-executed-from-python-but-executes-from-terminal/311508/4 "2022-08-05T19:21:31Z")

</div>

> [@Morning\_Star](#):
>
> Can there be an issue with access to this file or unable to read from this file?

Neither of those problems would cause that message. Not sure what is wrong.

---

<div class="post-metadata">

**Author:** ![Morning\_Star](https://avatars.discourse-cdn.com/v4/letter/m/b9bd4f/32.png) [@Morning\_Star](https://discuss.elastic.co/u/Morning_Star)\
**Post date:** [August 6, 2022, 6:15am UTC](https://discuss.elastic.co/t/logstash-showing-error-when-executed-from-python-but-executes-from-terminal/311508/5 "2022-08-06T06:15:49Z")

</div>

Executing it from a different script fixed it. (External python file)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 3, 2022, 6:16am UTC](https://discuss.elastic.co/t/logstash-showing-error-when-executed-from-python-but-executes-from-terminal/311508/6 "2022-09-03T06:16:23Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
