We are in the process of migrating our code to use elastic 5.x instead of 2.1.
In the index we have products, where many of them contain the same words in the suggest field.
In 2.1 this was not an issue, because the result from the query was automatically deduplicated.
What happens in 5.1 is that instead of getting 5 unique suggestions back, we get 5 identical suggestions, but from different source documents.
Is there a way to make the Completion Suggester deduplicate the result in 5.1, or do we need to move to a different feature to achieve the same functionality?
If so, what would be the way to get unique suggestions back, based on the users search term?