[Java] Stream large file while indexing

Elastic Stack Elasticsearch
3

Its not on search side.
Mine is a multi threaded application and it is trying to index tonns of a
file at a time to ES.
So am trying to access main memory as les as possible.

Thanks
Vineeth

On Wed, Feb 15, 2012 at 2:25 AM, ppearcy ppearcy@gmail.com wrote:

I don't believe this is possible. Would need some soft of JSON
streaming support.

How big are you talking about? If you're not storing as its own stored
field or part of the _source JSON, probably should be OK search side.

Thanks,
Paul

On Feb 14, 8:15 am, Vineeth Mohan vineethmo...@algotree.com wrote:

Hi ,

While indexing i have a field whose value is quite large.
This value is stored in a file as text.

I prefer not to load the entire file into main memory to read the
content.
Instead i would prefer this file is streamed directly to ES without
affecting much of RAM.

Is this possible with java API of ES ?

Thanks
Vineeth