Equivalence of log file versus space size stored in elastic search


(JulioCezar Kenji Miyahira) #1

Good afternoon, I am in doubt about the storage space elasticsearch, for
example, I have a 100mb log file when that file is read and stored by
elasticsearch, what is the amount of space consumed by elasticsearch?

100Mb file X ?MB elasticsearch

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/82245276-ffde-42d7-87ff-1bbbd3e5410e%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(David Pilato) #2

It depends on so many parameters that there is no answer.
Are you keeping _source and _all fields? What kind of analyzer are you using for each field?
In addition to this, there is compression...

Basically, you should test it with your use case to get a real size index.

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 5 déc. 2013 à 20:07, JulioCezar Kenji Miyahira juliojapa@gmail.com a écrit :

Good afternoon, I am in doubt about the storage space elasticsearch, for example, I have a 100mb log file when that file is read and stored by elasticsearch, what is the amount of space consumed by elasticsearch?

100Mb file X ?MB elasticsearch

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/82245276-ffde-42d7-87ff-1bbbd3e5410e%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/55218082-11EE-4413-8E4D-A51F3D2AFB21%40pilato.fr.
For more options, visit https://groups.google.com/groups/opt_out.


(system) #3