1GB single json record

Elastic Stack Beats
1

Hi all,

We are trying to let the filebeat to collect a json file.
Which is a single record json file, but it got 1GB file size.
We tried filebeat send to logstash also the filebeat send to ES directly.
Unfortunately we are not lucky enough.

Does any body face this problem before?
Any replies will be very helpful.
Thanks,
From Mulder

2

That is generally far too large for Elasticsearch. What do you expect to do with this file? What does it contain? Does it even make sense to index and search this as a single document?

3

Hi Christian,
It's a partial gene data for one person after the gene tool analyzed.
We will discuss to them about how to partiton those data into smaller result sets.

Thanks,
From Mulder

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.