I'm a bit new to ELK but have a environment that sends high-volume and bursty logs in the following configuration:
Fluentd (around 15 instances) -> (via HTTP) -> LogStash (1 containerized instance) -> AWS ElasticSearch (3 node)
I'm currently seeing my Fluentd instances fail to send logs to LogStash with multiple http error 429s. Once this happens, I no longer see any results show up in Kibana. Searching online seems to tell me that this is a problem with indexing at the ElasticSearch stage not keeping up. I would like to understand what my options are to resolve this.