Hi Im trying to consume data from Azure Event Hub, I have 15 different logstash pipelines pointing to different storages, and Even Hubs, they all work well,and I can get data when I run the single pipelines alone, but when I run the pipelines.yml or logstash as a service I get this error on all pipelines
][logstash.inputs.azureeventhubs
][metrics-bkp-arzo
][ece431cc89008326a8e46c6b0e0ec28357f92c64c183e722de71771ea1aca4c8
] Event Hub encountered an error. {
:event_hub_name=>"eve-arzo",
:exception=>java.util.concurrent.CompletionException: com.microsoft.azure.eventhubs.IllegalEntityException: Failure getting partition ids for event hub,
:backtrace=>[
"com.microsoft.azure.eventprocessorhost.PartitionManager.lambda$cachePartitionIds$4(PartitionManager.java:80)",
"java.base/java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:930)",
"java.base/java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:907)",
"java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:478)",
"java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)",
"java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)",
"java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)",
"java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)",
"java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)",
"java.base/java.lang.Thread.run(Thread.java:829)"
]
}
This in one of my logstash inputs:
input {
azure_event_hubs {
codec => json{ }
decorate_events => true
config_mode => "advanced"
storage_connection => "<redacted>"
event_hubs => [{
"eventb" => {
event_hub_connection => "<redacted>"
initial_position => "beginning"
consumer_group => "eventb"
storage_container => "stglogsb"
}
}]
}
}
At the end I receive these messages and nothing else happens
[
2022-02-28T10: 47: 36,
866
][WARN
][com.microsoft.azure.eventhubs.impl.MessagingFactory
][<pipeline-name>
][14edef9298d9eecd0699f2ef64afda41428d26d85c7f02d7fb62fa
] messagingFactory[MessagingFactory5d2108
], hostName[eventallpa.servicebus.windows.net
], message[Processing all pending tasks and closing old reactor.
]
[
2022-02-28T10: 47: 36,
866
][INFO
][com.microsoft.azure.eventhubs.impl.ReactorHandler
][<pipeline-name>
][14edef9298d9eecd0699f2ef64afda41428d26d85c7f02d7fb62fa
] reactor.onReactorFinal