Following the suggestion from Jörg, I calculated a rough 72MB per second
(500 docs per second x 144KB/doc). Not too shabby!
One thing to do sustain a higher docs/second rate is to carefully craft a
mapping and:
-
Disable the _all field. I rarely (never!) need this in a production
application. My locked-down mappings always direct queries to specific
fields and always get-by-id for the best overall performance whenever
possible. And my recent ELK stack exploration shows me that the message
field contains the entire source of each log entry, so there is no need for
_all there either; just tell Kibana to search message instead of _all. -
Set "index" : "no" for the fields that you don't want to query or don't
need to query.
You would be pleasantly surprised at how quickly a large document goes in
when you only index the subset of fields you actually wish to query, and
also disable the _all field.
Hope this helps!
Brian
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/5f1a9c25-6fae-41e0-a12c-b0ce1201f847%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.