Index and Type creation

Elastic Stack Elasticsearch
1

Hi,

I would like to ask you about some strategy about index and types. I will send to Elasticsearch about 1 million messages per day and i have 6 kind of messages. Should i creeate 6 types?
And about index performance, should i create an index per month or could be better has a index per day?

2

Have a look at this thread which discussed much the same thing. With such a low volume I would recommend using monthly rather than daily indices and store all data in a single index if possible.

3

Hi Christian,

Did you link the wrong thread? The link you sent me was the discussion
between the two of us!

Also, not exactly sure how you ascertained that our usage would be low
volume. We are trying to aggregate logs from various
projects/departments... the raw apache access+error logs from one project
alone are typically over 1.5G/day. Does that really constitute low volume?
Do you really think we can get away combining those logs with logs from
other projects and use a monthly index? That doesn't sound right at all...

Mike Charnoky

4

Hi Mike,

I posted a link to your thread in this thread as it discusses how to organise data into indices and types. This thread discusses a million messages per day, which I suspect is a relatively low volume, so the advice does not necessarily apply to your use case.

Christian

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.