ES search IO


(allwefantasy) #1

i have three nodes to run ES.
the IOs are like theses:

es1
17:24:32 1183 8792.00 0.00 0.00 java
17:24:33 1183 5864.00 0.00 0.00 java
17:24:34 1183 9048.00 0.00 0.00 java
17:24:35 1183 10380.00 0.00 0.00 java
17:24:36 1183 5672.00 0.00 0.00 java
17:24:37 1183 9824.00 0.00 0.00 java
17:24:38 1183 8296.00 0.00 0.00 java
17:24:39 1183 7704.00 12.00 0.00 java
17:24:40 1183 12184.00 0.00 0.00 java
17:24:41 1183 15508.00 0.00 0.00 java
17:24:42 1183 13048.00 0.00 0.00 java
17:24:43 1183 14576.00 0.00 0.00 java
17:24:44 1183 11460.00 0.00 0.00 java
17:24:45 1183 7624.00 0.00 0.00 java
17:24:46 1183 4664.00 0.00 0.00 java
17:24:47 1183 4904.00 0.00 0.00 java
17:24:48 1183 7576.00 0.00 0.00 java
17:24:49 1183 9640.00 0.00 0.00 java
17:24:50 1183 8012.00 0.00 0.00 java
17:24:51 1183 10140.00 0.00 0.00 java
17:24:52 1183 12888.00 0.00 0.00 java
17:24:53 1183 4460.00 0.00 0.00 java
17:24:54 1183 7556.00 0.00 0.00 java
17:24:55 1183 6832.00 0.00 0.00 java
17:24:56 1183 8084.00 0.00 0.00 java

es2

17:34:23 8125 80.00 0.00 0.00 java
17:34:24 8125 168.00 4.00 0.00 java
17:34:25 8125 3768.00 0.00 0.00 java
17:34:26 8125 1152.00 0.00 0.00 java
17:34:27 8125 2596.00 0.00 0.00 java
17:34:28 8125 1060.00 4.00 0.00 java
17:34:29 8125 172.00 0.00 0.00 java
17:34:30 8125 1208.00 8.00 0.00 java
17:34:31 8125 1860.00 20.00 0.00 java
17:34:32 8125 216.00 8.00 0.00 java
17:34:33 8125 156.00 16.00 0.00 java
17:34:34 8125 200.00 4.00 0.00 java
17:34:35 8125 240.00 4.00 0.00 java
17:34:36 8125 140.00 0.00 0.00 java
17:34:37 8125 288.00 0.00 0.00 java
17:34:38 8125 84.00 0.00 0.00 java
17:34:39 8125 40.00 8.00 0.00 java
17:34:40 8125 80.00 4.00 0.00 java
17:34:41 8125 2408.00 0.00 0.00 java
17:34:42 8125 2936.00 0.00 0.00 java
17:34:43 8125 4904.00 0.00 0.00 java
17:34:44 8125 556.00 0.00 0.00 java
17:34:45 8125 80.00 4.00 0.00 java
17:34:46 8125 108.00 0.00 0.00 java
17:34:47 8125 216.00 0.00 0.00 java

es3

17:31:08 24134 16.00 0.00 0.00 java
17:31:09 24134 12.00 12.00 0.00 java
17:31:10 24134 20.00 0.00 0.00 java
17:31:11 24134 264.00 0.00 0.00 java
17:31:12 24134 212.00 4.00 0.00 java
17:31:13 24134 68.00 0.00 0.00 java
17:31:14 24134 56.00 0.00 0.00 java
17:31:15 24134 408.00 0.00 0.00 java
17:31:16 24134 2300.00 0.00 0.00 java
17:31:17 24134 1312.00 0.00 0.00 java
17:31:18 24134 124.00 0.00 0.00 java
17:31:19 24134 88.00 0.00 0.00 java
17:31:20 24134 0.00 0.00 0.00 java
17:31:21 24134 0.00 0.00 0.00 java
17:31:22 24134 0.00 0.00 0.00 java
17:31:23 24134 188.00 0.00 0.00 java
17:31:24 24134 68.00 0.00 0.00 java
17:31:25 24134 352.00 0.00 0.00 java
17:31:26 24134 48.00 0.00 0.00 java
17:31:27 24134 312.00 0.00 0.00 java
17:31:28 24134 188.00 0.00 0.00 java
17:31:29 24134 0.00 0.00 0.00 java
17:31:30 24134 0.00 0.00 0.00 java

i use pidstat command to monitor java io.
pidstat -p $(ps -ef |grep bootstrap |grep -v grep |awk '{print $2}') -d 1
at first i thought may be loading _source fileds cause high io.so when i search i use fields:[].and the real _source filed content i save in mysql.but still the io is very high!
can anyone help?


(allwefantasy) #2

i use es 0.17
and the data title like this:
PID kB_rd/s kB_wr/s kB_ccwr/s Command


(system) #3