Which node should I BI(Bulk Insert)?

Elastic Stack Elasticsearch
1

Hello,

We have 10 data nodes and 1 master node and we have 20,000 lines
of logs/sec (peek).
Now we send our logs through our program by using BI(Bulk Insert) to 1
master node.

I'm wondering if I could BI to other node(data or master), because we will
add more logs.

Or should I add more master nodes and BI to those
master nodes ?

Sincerely,
Nobuo Miwa

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/4420bd56-bed0-48b4-8602-f2424c198020%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

You should spin up a client node (master and data: false) and use it. That
way you prevent your master from OOMing.
Otherwise you can use any of your data nodes.

On 7 January 2015 at 14:52, nobuo.miwa@gmail.com wrote:

Hello,

We have 10 data nodes and 1 master node and we have 20,000 lines
of logs/sec (peek).
Now we send our logs through our program by using BI(Bulk Insert) to 1
master node.

I'm wondering if I could BI to other node(data or master), because we will
add more logs.

Or should I add more master nodes and BI to those
master nodes ?

Sincerely,
Nobuo Miwa

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/4420bd56-bed0-48b4-8602-f2424c198020%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/4420bd56-bed0-48b4-8602-f2424c198020%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_vp1nzb7MBWXqd%2Boc_x5Eif2vx%2B1HYZ6Q9%3DDhHYEq-aQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

Thanks !

I will try to add Client Nodes into my cluster.

Nobuo Miwa

2015年1月7日水曜日 13時22分02秒 UTC+9 Mark Walkom:

You should spin up a client node (master and data: false) and use it. That
way you prevent your master from OOMing.
Otherwise you can use any of your data nodes.

On 7 January 2015 at 14:52, <nobuo...@gmail.com <javascript:>> wrote:

Hello,

We have 10 data nodes and 1 master node and we have 20,000 lines
of logs/sec (peek).
Now we send our logs through our program by using BI(Bulk Insert) to 1
master node.

I'm wondering if I could BI to other node(data or master), because we will
add more logs.

Or should I add more master nodes and BI to those
master nodes ?

Sincerely,
Nobuo Miwa

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/4420bd56-bed0-48b4-8602-f2424c198020%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/4420bd56-bed0-48b4-8602-f2424c198020%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/0fa7f056-a028-45b4-ade3-d41560e5f168%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.