How schedule works in logstash when moving data from one cluster to the other cluster of elasticsearch

Elastic Stack Logstash
1

I am trying to move customer index from one cluster to ther other cluster removing some fields. Will schedule backups data incrementally.

Data is updated to the input from the application

We want logstash to move data every 5 soconds to output cluster.

Here ios my logstash.conf

input {
    elasticsearch {
      hosts => ["192.31.24.100:9200"]
      index => "customer"
      size => 1000
      scroll => "1m"
      schedule => "5 * * * *"
    }
} 
filter {
    mutate {
      remove_field => [ "alternateEmails", "email" ]
    }
}
output {
    elasticsearch {
      hosts => ["192.31.24.101:9200"]
      index => "customer-without-email"
      workers => 1
    }
}
2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.