Master CPU time


(Zaharije) #1

hi

is it normal to have master spent much more time on cpu during search
than other nodes. In my case master spent 4582:00 on cpu, and nodes (7
of them) 3478:16, 3379:40, ...

Here is configuration of ES:

name: katta

cluster:
name: ES-test

discovery:
type: zen
zen:
ping:
unicast:
hosts: [
"k00:9301","k01:9302","k02:9303","k03:9304","k04:9305","k06:9306","k07:9307"
]
transport:
tcp:
port: 9300
connections_per_node: 7
network:
host: katta

gateway:
type: hdfs
fs:
location: /search-sharing
hdfs:
uri: hdfs://hmaster:8020
path: /user/hadoop/elastic

index:
store:
type: fs
fs:
memory:
enabled: false

and client java app has:

Properties props = System.getProperties();
props.setProperty("java.net.preferIPv4Stack", "true");
System.setProperties(props);

HashMap<String, String> settings = new HashMap<String, String>();
settings.put("name", "es-client-test-" + option);
settings.put("cluster.name", "ES-test");
settings.put("discovery.type", "zen");
settings.put("discovery.zen.ping.unicast.hosts",
"k00:9301,k01:9302,k02:9303,k03:9304,k04:9305,k06:9306,k07:9307");
settings.put("transport.tcp.port", port);
settings.put("network.host", ip);

Best
Zaharije


(Shay Banon) #2

The master is not involved when executing a search request. It does do more
work than others though.

-shay.banon

p.s. You don't need to set the preferIPv4 system property anymore, thats an
old jgroups relic.

On Tue, Jul 13, 2010 at 11:37 AM, Zaharije Pasalic <
pasalic.zaharije@gmail.com> wrote:

hi

is it normal to have master spent much more time on cpu during search
than other nodes. In my case master spent 4582:00 on cpu, and nodes (7
of them) 3478:16, 3379:40, ...

Here is configuration of ES:

name: katta

cluster:
name: ES-test

discovery:
type: zen
zen:
ping:
unicast:
hosts: [

"k00:9301","k01:9302","k02:9303","k03:9304","k04:9305","k06:9306","k07:9307"
]
transport:
tcp:
port: 9300
connections_per_node: 7
network:
host: katta

gateway:
type: hdfs
fs:
location: /search-sharing
hdfs:
uri: hdfs://hmaster:8020
path: /user/hadoop/elastic

index:
store:
type: fs
fs:
memory:
enabled: false

and client java app has:

Properties props = System.getProperties();
props.setProperty("java.net.preferIPv4Stack", "true");
System.setProperties(props);

HashMap<String, String> settings = new HashMap<String, String>();
settings.put("name", "es-client-test-" + option);
settings.put("cluster.name", "ES-test");
settings.put("discovery.type", "zen");
settings.put("discovery.zen.ping.unicast.hosts",
"k00:9301,k01:9302,k02:9303,k03:9304,k04:9305,k06:9306,k07:9307");
settings.put("transport.tcp.port", port);
settings.put("network.host", ip);

Best
Zaharije


(system) #3