Use Case: If we have 10 Million documents index on single server in Elastic
Search in single index, If user want to search but limit search result in
given 1 Million Doc ID filter so ES only return result within given 1
million Doc ID filter
When apply search - divide 1 million Doc in 10K doc ID list batches and
apply with search and loop through all batches On each result return - keep
merge the result and send one merge result to end user in website
Is there any other better way to do search which get faster result and no
need do batch search etc if we want to limit search result with in selected
1 million Doc ID
Thanks
-V
--
Notice of Confidentiality
This email message and its attachments (if any) are intended solely for
the use of the addressees hereof. In addition, this message and any
attachments may contain information that is confidential, privileged and
exempt from disclosure under applicable law. If you are not the intended
recipient of this message, you are prohibited from reading, disclosing,
reproducing, distributing, disseminating or otherwise using this
transmission. Delivery of this message to any person other than the
intended recipient is not intended to waive any right or privilege. If you
have received this message in error, please promptly notify the sender by
reply email and immediately delete this message from your system.
This use-case typically looks like a join (search within the results of
another search request) so you should look at whether you can change the
way that you model your data in order to be able to use nested docs or the
parent/child functionality. Otherwise, there is no better way,
elasticsearch does not support general-purpose joins.
Use Case: If we have 10 Million documents index on single server in
Elastic Search in single index, If user want to search but limit search
result in given 1 Million Doc ID filter so ES only return result within
given 1 million Doc ID filter
When apply search - divide 1 million Doc in 10K doc ID list batches and
apply with search and loop through all batches On each result return - keep
merge the result and send one merge result to end user in website
Is there any other better way to do search which get faster result and no
need do batch search etc if we want to limit search result with in selected
1 million Doc ID
Thanks
-V
Notice of Confidentiality
This email message and its attachments (if any) are intended solely for
the use of the addressees hereof. In addition, this message and any
attachments may contain information that is confidential, privileged and
exempt from disclosure under applicable law. If you are not the intended
recipient of this message, you are prohibited from reading, disclosing,
reproducing, distributing, disseminating or otherwise using this
transmission. Delivery of this message to any person other than the
intended recipient is not intended to waive any right or privilege. If you
have received this message in error, please promptly notify the sender by
reply email and immediately delete this message from your system.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.