Elasticsearch scaling and configuration


(Navneet Mathpal) #1

Hi ,

I am using elk for log monitoring , I have around 1 GB of data that comes every day. and around 50 users will be using 20 dashboard simultaneously.

what should be the production configuration ?

Thanks


(Magnus B├Ąck) #2

Nobody can give you an exact answer to that question because it depends on so many factors.

  • How many messages per day?
  • How many days' logs are kept? Will you have any replicas (assuming more than one node)?
  • Are you using doc values?
  • What kind of queries? How often?
  • How big are the messages and how are the fields mapped?
  • What's the acceptable response time for queries?

I suggest you start small and prepare for scaling up and/or out. If you can, try pushing the limits until things start misbehaving.


(system) #3