HTTP Input/Output

Elastic Stack Logstash
1

Hello,

I am working on connecting two instances of logstash by an HTTP plugin.

On node 1, the config is set to ingest from a CSV and outputs those docs to a local HTTP url. As in, the URL is set to a port on node 1.

On node 2, the config's HTTP input is set to connect to the URL on node 1.

I keep getting vague errors about this, such as the plugin had an unrecoverable error and that a thread was rejected. I Was wondering if the HTTP input plugin's "host" option can only be set to local hosts and cannot connect to other hosts, like how I am trying to set "host" on node 2 to connect to node 1? Should it be the other way around?

2

A logstash http input creates an http server that listens on a local address. You can use a remote value for host.

If you want logstash to connect to an http server as a client then use an http_poller input.

3

Thank you! I did end up using http_poller, but now I'm realizing the http output is not an http server, is this correct? Does directing http_poller to an http output URL not work?

I'm asking this because I keep getting the following error:
[HTTP Output Failure] Could not fetch URL

4

Correct. An http output is an http client.

You can connect two logstash instances using an http output and an http input. However, the recommended method is a lumberjack output and a beats input.

5

Thank you! I appreciate the guidance on this

6

This might be a silly question but is there a reason why setting the host IP in the http input plugin to a remote host still only opens the port up locally?

7

In my experience it does not do so.

8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.