Enrich execution takes long time (about 3 min)

[hyungsun_lim]

We use elasticsearch 7.5.0 version, and we use enrich pipelint to join two index every 15 min.

However, enrich execution time takes about 3-5 min.

It's so long time...

I don't know the exact cause.

What is the alternative option for enrich?

or How can I reduce the time it takes to execute?

[system]

elasticsearch 7.5 is EOL and no longer supported. Please upgrade ASAP.

(This is an automated response from your friendly Elastic bot. Please report this post if you have any suggestions or concerns )

[stephenb (Stephen Brown)]

Hi @hyungsun_lim

You're going to need to provide a lot more information to help us debug.

At the minimum you need to provide

How many documents are in the enrich / lookup index?

How many documents are in the source index that gets enriched.

Are you running the entire source index through the enriched processor every time?

What is your enrich policy?

What are the mappings for these different indexes?

And of course any performance issue could have to do with the actual architecture of your cluster.

How many nodes? What kind of hardware is it running on?

So many questions before we can even attempt to give you an answer.

So the more detail you provide the better chance we have to help.

Oh yes, and as the automated message, you're on an extremely old version, which of course has been many performance enhancements between that version and the latest version, even if you updated the 717. You would be doing much better.