How to run Cloud Logstash Pipeline

[Holguinmora (Alejandro Holguin M)]

Hi

I´m trying to run a cloud logstash pipeline that has the next code to start working with the mail filters but I have not been able to find code to try it inside the pipeline or how to run it outside of the pipeline

On the image the location or place where I´m putting the code.

Any ideas?

#email_log.conf
input {
imap {
 host => "imap.gmail.com"
 password => "XXXXX"
 user => "alejandrotrading1@gmail.com"
# check_interval => 10
# folder => "Inbox"
 }
}

output {
 elasticsearch {
 index => "emails"
 document_type => "email"}
}

[Luca_Belluccini]

Hello @Holguinmora

You can create a Logstash pipeline using the Logstash Centralized Management, but you then need a Logstash instance running somewhere (your computer, a server or a cloud provider) which reads the configuration from your Elastic Cloud instance.

How to configure Logstash to use Central Management?

You can follow the steps detailed in our documentation.

Some comments:

• The elasticsearch output must define the target hosts and credentials. See more here.

  elasticsearch {
    cloud_id => ...
    cloud_auth => "user:pass"
    index => "emails"
    document_type => "email"
  }
  

• The Logstash instance must have the following settings:

  xpack.management.enabled: true
  xpack.management.elasticsearch.cloud_id: ...
  xpack.management.elasticsearch.cloud_auth: "user:pass"
  xpack.management.logstash.poll_interval: 5s
  xpack.management.pipeline.id: ["correo1", ...]