I am having azure event hub as input logstash code , please advise how can i controlling events the write to storage account for event Hub Acess , this method will help in cost saving. please advise your thoughts

Can you give more context? It is not clear what you want to do and what is your issue. You want to limit the writes in the storage account that logstash uses while reading from an Event Hub?

Yes , currently writing every 5 seconds from azure event hub input , need to increase 30 or 60 seconds , but i dont know how to do that , where to make changes please help me

There is nothing in the configuration of the input that controls that, I'm afraid. What you can try to do maybe is to increase the value of max_batch_size to increase the number of events retrieved each time.

Thank you , I have tried to increase checkpoint_interval => 30 in logstash code from this above default value , i tried to increase 10 or 30 seconds instead of 5 seconds , but still events are writing events to storage account every 5 seconds ,because this is default my aim here to delay from 5 se…

as per your recommendation i have tried to increase batch size from current size 290 to 300 in azure event hub logstash input code , but no improvement , if i increase more than 300 like 320 , log stash not at all receiving events , getting Below error, is there is any maximum batch size limit fo…

my logstash code for your reference , its writing events every 5 seconds , i want to make it delay like every 30 seconds , how can i achieve this , help me input { azure_event_hubs { event_hub_connections => ["${CLCEHPRIMARYCONNECTIONSTRING};EntityPath=cef"] storage_connection => "${CLCSTORAGEPR…

leandrojmp hi Leandrojmp , and all looking forward for your earliest reply

any update will be highly appreciated

As I said before [image] leandrojmp: There is nothing in the configuration of the input that controls that, I'm afraid. Also this is not an error, it is a warning stopping the reactor because thread was interrupted or the reactor has no more events to process It means that there were no …

thank you for your Reply , this error came in as per your recommendation when i increased batch size from 290 to 320 , if i put it back to 300 this error go away immediately , i want to delay getting events from azure event hub in log stash , can you help me how can i achieve this , currently gett…

Need to know ways of controlling the write to storage account for event hub access

Elastic Stack Logstash

Topic		Replies	Views
Need to know ways of controlling the write to storage account for event hub access Logstash	3	253	March 9, 2023
How to Increase checkpoint interval in azure event Hub logstash Logstash	1	241	September 30, 2022
How to Improve throughput of Azure EventHub input plugin Logstash	2	605	December 10, 2021
I am using EVENTHUB input Plugin of Logstash for Capturing Azure event hub Audit logs. But there is Data loss Logstash	1	196	September 14, 2023
Lots of Documents getting failed and dropped at the Logstash(seen in logstash logs) Elastic Search	2	74	January 14, 2026

Need to know ways of controlling the write to storage account for event hub access

Related topics