Ingest-Attachment performance issue

Elastic Stack Elasticsearch
1

I am upgrading from ES 1.6 to ES 5.3. Everything is working ok except the ingest-attachment. I installed the plugin and configured the mappings according to the documentation. I am even able to index small documents but ES consumes the whole heap when trying to index big documents which were correctly and smoothly indexed with the previous version.

I am trying to index 300 pdf documents with sizes between 400.000 and 1.500.000 characters. I am running just one ES Node in my local machine with 16 Gb. I have tried with serveral max heap configurations. I also installed the depracated mapping plugin and it worked just fine.

2

Interesting. Can you open an issue and link to this thread?

May be there are some optimisations we can do in ingest? // cc @spinscale

4

Here it is https://github.com/elastic/elasticsearch/issues/23882

1 Like
5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.