HTTP Input/Output


I am working on connecting two instances of logstash by an HTTP plugin.

On node 1, the config is set to ingest from a CSV and outputs those docs to a local HTTP url. As in, the URL is set to a port on node 1.

On node 2, the config's HTTP input is set to connect to the URL on node 1.

I keep getting vague errors about this, such as the plugin had an unrecoverable error and that a thread was rejected. I Was wondering if the HTTP input plugin's "host" option can only be set to local hosts and cannot connect to other hosts, like how I am trying to set "host" on node 2 to connect to node 1? Should it be the other way around?

A logstash http input creates an http server that listens on a local address. You can use a remote value for host.

If you want logstash to connect to an http server as a client then use an http_poller input.

Thank you! I did end up using http_poller, but now I'm realizing the http output is not an http server, is this correct? Does directing http_poller to an http output URL not work?

I'm asking this because I keep getting the following error:
[HTTP Output Failure] Could not fetch URL

Correct. An http output is an http client.

You can connect two logstash instances using an http output and an http input. However, the recommended method is a lumberjack output and a beats input.

Thank you! I appreciate the guidance on this

This might be a silly question but is there a reason why setting the host IP in the http input plugin to a remote host still only opens the port up locally?

In my experience it does not do so.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.