Looking for some advice…
(i'm sure this is a question that has been asked before --- feel free to point me to a url)
We are about to scale a system to accommodate thousands of data feeds. Each data feed contains millions of documents. We need to search across all of those feeds with arbitrarily complex queries. (We will need filtering, custom scoring, etc.)
What are the pros and cons to using a single index for all of those feeds?
Are there any constraints we may run into if we create one index per feed?
Any impact on query time performance/storage requirements, etc?
Or are we safe to implement either given that it all boils down to shards in the end?
Health Market Science
The Science of Better Results
2700 Horizon Drive • King of Prussia, PA • 19406
M: 215.588.6024 • @boneill42 • healthmarketscience.com
This information transmitted in this email message is for the intended recipient only and may contain confidential and/or privileged material. If you received this email in error and are not the intended recipient, or the person responsible to deliver it to the intended recipient, please contact the sender at the email above and delete this email and any attachments and destroy any copies thereof. Any review, retransmission, dissemination, copying or other use of, or taking any action in reliance upon, this information by persons or entities other than the intended recipient is strictly prohibited.
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to firstname.lastname@example.org.
For more options, visit https://groups.google.com/groups/opt_out.