How to Limit Search With-In Selected Document ID or Document ID List

Elastic Stack Elasticsearch
1

Use Case: If we have 10 Million documents index on single server in Elastic
Search in single index, If user want to search but limit search result in
given 1 Million Doc ID filter so ES only return result within given 1
million Doc ID filter

When apply search - divide 1 million Doc in 10K doc ID list batches and
apply with search and loop through all batches On each result return - keep
merge the result and send one merge result to end user in website

Is there any other better way to do search which get faster result and no
need do batch search etc if we want to limit search result with in selected
1 million Doc ID

Thanks
-V

--

Notice of Confidentiality

This email message and its attachments (if any) are intended solely for
the use of the addressees hereof. In addition, this message and any
attachments may contain information that is confidential, privileged and
exempt from disclosure under applicable law. If you are not the intended
recipient of this message, you are prohibited from reading, disclosing,
reproducing, distributing, disseminating or otherwise using this
transmission. Delivery of this message to any person other than the
intended recipient is not intended to waive any right or privilege. If you
have received this message in error, please promptly notify the sender by
reply email and immediately delete this message from your system.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/7a0bf27c-f36f-48f8-942c-571158633ac1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

Hi,

This use-case typically looks like a join (search within the results of
another search request) so you should look at whether you can change the
way that you model your data in order to be able to use nested docs or the
parent/child functionality. Otherwise, there is no better way,
elasticsearch does not support general-purpose joins.

On Thu, Jan 15, 2015 at 5:50 PM, ATL vrajpara@legaldiscoveryllc.com wrote:

Use Case: If we have 10 Million documents index on single server in
Elastic Search in single index, If user want to search but limit search
result in given 1 Million Doc ID filter so ES only return result within
given 1 million Doc ID filter

When apply search - divide 1 million Doc in 10K doc ID list batches and
apply with search and loop through all batches On each result return - keep
merge the result and send one merge result to end user in website

Is there any other better way to do search which get faster result and no
need do batch search etc if we want to limit search result with in selected
1 million Doc ID

Thanks
-V

Notice of Confidentiality

This email message and its attachments (if any) are intended solely for
the use of the addressees hereof. In addition, this message and any
attachments may contain information that is confidential, privileged and
exempt from disclosure under applicable law. If you are not the intended
recipient of this message, you are prohibited from reading, disclosing,
reproducing, distributing, disseminating or otherwise using this
transmission. Delivery of this message to any person other than the
intended recipient is not intended to waive any right or privilege. If you
have received this message in error, please promptly notify the sender by
reply email and immediately delete this message from your system.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/7a0bf27c-f36f-48f8-942c-571158633ac1%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/7a0bf27c-f36f-48f8-942c-571158633ac1%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
Adrien Grand

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j7rLKF94s7C%2BNFhgqdQp2yW1A-qLOWJ0zqKFPBhQK8%2BQQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.