I'm trying to correlate requests and responses via logstash. what i am doing is keep the request in the logstash untill the response receive. then will emit the correlated event to elasticsearch.
In this approach I had to run the logstash in to single worker pipeline due the memory can't be shared between workers. hence now we observing poor performance.
Can you help me how can avoid this? any better approach to do the correlation?