ES index creation & population time

Elastic Stack Elasticsearch
1

I'm trying to do some benchmark tests and want to know if there is a way to
determine how long it will take elastic search to create indices and then
populate them. I'm not seeing any logging information that I can use to
determine the elapsed time. Any ideas? Thanks!

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/18ce8427-90d6-473e-a448-8f04fe976df6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

Once you get a response from ES then the index is created. As for
populating, it'd depend how you do it, but if you use bulk then again, once
you get a response then it's completed the request and indexed the docs.

You'd have to time that via your test framework though.

On 4 February 2015 at 03:22, Kurt aklbmcs@gmail.com wrote:

I'm trying to do some benchmark tests and want to know if there is a way
to determine how long it will take Elasticsearch to create indices and
then populate them. I'm not seeing any logging information that I can use
to determine the elapsed time. Any ideas? Thanks!

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/18ce8427-90d6-473e-a448-8f04fe976df6%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/18ce8427-90d6-473e-a448-8f04fe976df6%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9_ObuBhqnbrJFAf3%3DjhHt5QrG3H2xYOxRJqfso-iHqrQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

Could you please add more details?

  • Are you trying to create indices programmatically (or calling ES rest
    endpoint)?
  • How much data you are populating in the index?
  • Are you using bulk index api or single index api?

As Mark said in his post time the operation in your application layer. You
total time will vary based on how you index (single/bulk) and how much data
you plan to index. In addition to that your hardware will dictate your
indexing rate. Any tests done on local would be totally different from that
on actual production servers.

On Tuesday, 3 February 2015 08:22:04 UTC-8, Kurt wrote:

I'm trying to do some benchmark tests and want to know if there is a way
to determine how long it will take Elasticsearch to create indices and
then populate them. I'm not seeing any logging information that I can use
to determine the elapsed time. Any ideas? Thanks!

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/5b321638-7628-46b7-8b9c-4f4034baf89a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.