Hi,
I am a new user of elasticsearch, i want to test the single node performance. So i create an indice named "nba", with 1 shard and 0 replica. And try to upload 140 000 000 documents to it. I upload this document by an bulkProcessor. It setting is :
concurrent requests : 1
bulkActions :100,
bulksize: 1GB
flushInterval ：5s
Elasticsearch work well at first，it index about 14 000 docs less than one hour. However the elasticsearch corrupt suddenly, the failure log is:
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
^C[2015-04-14 18:11:00,390][INFO ][node ] [Bennet du Paris] stopping ...
[2015-04-14 18:11:00,597][INFO ][node ] [Bennet du Paris] stopped
[2015-04-14 18:11:00,597][INFO ][node ] [Bennet du Paris] closing ...
[2015-04-14 18:11:00,604][INFO ][node ] [Bennet du Paris] closed
When i run my index process, it work again, and elasticsearch index more thousands of documents again.
It is wired , i am looking for you help.