Does ES has a limit on size of _bulk POST? Looks like no more than 103M
curl -XPOST -o Z:\projects\demo\elasticsearch\demo\out\output.json
--data-binary @Z:\projects\demo\elasticsearch\demo\out\es-mods.txt http://localhost:9200/_bulk
% Total % Received % Xferd Average Speed Time Time Time
Current Upload Total Spent Left Speed
97 103M 0 0 97 100M 0 14.9M 0:00:06 0:00:06 --:--:--
1569k
curl: (55) Send failure: Connection was aborted
org.elasticsearch.common.netty.handler.codec.frame.TooLongFrameException:
HTTP content length exceeded 104857600 bytes.
at
org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator.messageReceived(HttpChunkAggregator.java:167)
at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787)
at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)
at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:459)
at
org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:536)
You must increase the http content length limit in
http.max_content_length, default is 100MB
Jörg
Am 26.01.13 17:14, schrieb AlexR:
Does ES has a limit on size of _bulk POST? Looks like no more than 103M
curl -XPOST -o Z:\projects\demo\elasticsearch\demo\out\output.json
--data-binary @Z:\projects\demo\elasticsearch\demo\out\es-mods.txt http://localhost:9200/_bulk
% Total % Received % Xferd Average Speed Time Time Time
Current Upload Total Spent Left Speed
97 103M 0 0 97 100M 0 14.9M 0:00:06 0:00:06
--:--:-- 1569k
curl: (55) Send failure: Connection was aborted
org.elasticsearch.common.netty.handler.codec.frame.TooLongFrameException:
HTTP content length exceeded 104857600 bytes.
at
org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator.messageReceived(HttpChunkAggregator.java:167)
at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:560)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:787)
at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)
at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:459)
at
org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:536)
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.