ES use cases


(sirmak) #1

hi,

if I understand correctly, elasticsearch can index any json structure
and can filter and sort these documents by their fields. So, what is
the recommended way; do You use ES for all listings (eg main page
product list), paging, search, I mean for every select operation
excluding form input pages. Or do I have to use it for only search ?
If I can do everything with ES is it durable and suitable for main
storage, is there a data loss probability ? For consistency do you
rebuild all your indexes periodically, what is your timespan, eg :1
day ?

my best
Serdar


(sirmak) #2

any ideas ?

On Jan 31, 12:16 pm, si irmakser...@gmail.com wrote:

hi,

if I understand correctly, elasticsearch can index any json structure
and can filter and sort these documents by their fields. So, what is
the recommended way; do You use ES for all listings (eg main page
product list), paging, search, I mean for every select operation
excluding form input pages. Or do I have to use it for only search ?
If I can do everything with ES is it durable and suitable for main
storage, is there a data loss probability ? For consistency do you
rebuild all your indexes periodically, what is your timespan, eg :1
day ?

my best
Serdar


(Shay Banon) #3

Since ES is in beta, it is recommended that you will have a way to reindex the data.
On Monday, January 31, 2011 at 6:12 PM, si wrote:

any ideas ?

On Jan 31, 12:16 pm, si irmakser...@gmail.com wrote:

hi,

if I understand correctly, elasticsearch can index any json structure
and can filter and sort these documents by their fields. So, what is
the recommended way; do You use ES for all listings (eg main page
product list), paging, search, I mean for every select operation
excluding form input pages. Or do I have to use it for only search ?
If I can do everything with ES is it durable and suitable for main
storage, is there a data loss probability ? For consistency do you
rebuild all your indexes periodically, what is your timespan, eg :1
day ?

my best
Serdar


(sirmak) #4

thank you, is there a recommended timespan for full reindex ?

On Jan 31, 10:06 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

Since ES is in beta, it is recommended that you will have a way to reindex the data.

On Monday, January 31, 2011 at 6:12 PM, si wrote:

any ideas ?

On Jan 31, 12:16 pm, si irmakser...@gmail.com wrote:

hi,

if I understand correctly, elasticsearch can index any json structure
and can filter and sort these documents by their fields. So, what is
the recommended way; do You use ES for all listings (eg main page
product list), paging, search, I mean for every select operation
excluding form input pages. Or do I have to use it for only search ?
If I can do everything with ES is it durable and suitable for main
storage, is there a data loss probability ? For consistency do you
rebuild all your indexes periodically, what is your timespan, eg :1
day ?

my best
Serdar


(Shay Banon) #5

You don't need to reindex in ES. It is recommended that you have that option.
On Monday, January 31, 2011 at 10:16 PM, si wrote:

thank you, is there a recommended timespan for full reindex ?

On Jan 31, 10:06 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

Since ES is in beta, it is recommended that you will have a way to reindex the data.

On Monday, January 31, 2011 at 6:12 PM, si wrote:

any ideas ?

On Jan 31, 12:16 pm, si irmakser...@gmail.com wrote:

hi,

if I understand correctly, elasticsearch can index any json structure
and can filter and sort these documents by their fields. So, what is
the recommended way; do You use ES for all listings (eg main page
product list), paging, search, I mean for every select operation
excluding form input pages. Or do I have to use it for only search ?
If I can do everything with ES is it durable and suitable for main
storage, is there a data loss probability ? For consistency do you
rebuild all your indexes periodically, what is your timespan, eg :1
day ?

my best
Serdar


(sirmak) #6

Thanks again Shay, one last question; I have an opinion to use ES with
Cassandra. as you know cassandra has weak query & sorting options, so
I plan to use ES not only for search, but also for page listings (eg:
products..), too. Is it feasable and a solid approach, or do I have to
use ES for only search ?

my best

On Jan 31, 10:22 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

You don't need to reindex in ES. It is recommended that you have that option.

On Monday, January 31, 2011 at 10:16 PM, si wrote:

thank you, is there a recommended timespan for full reindex ?

On Jan 31, 10:06 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

Since ES is in beta, it is recommended that you will have a way to reindex the data.

On Monday, January 31, 2011 at 6:12 PM, si wrote:

any ideas ?

On Jan 31, 12:16 pm, si irmakser...@gmail.com wrote:

hi,

if I understand correctly, elasticsearch can index any json structure
and can filter and sort these documents by their fields. So, what is
the recommended way; do You use ES for all listings (eg main page
product list), paging, search, I mean for every select operation
excluding form input pages. Or do I have to use it for only search ?
If I can do everything with ES is it durable and suitable for main
storage, is there a data loss probability ? For consistency do you
rebuild all your indexes periodically, what is your timespan, eg :1
day ?

my best
Serdar


(Shay Banon) #7

Yea, makes perfect sense. people are using ES for much more than "just" search.
On Monday, January 31, 2011 at 10:29 PM, si wrote:

Thanks again Shay, one last question; I have an opinion to use ES with
Cassandra. as you know cassandra has weak query & sorting options, so
I plan to use ES not only for search, but also for page listings (eg:
products..), too. Is it feasable and a solid approach, or do I have to
use ES for only search ?

my best

On Jan 31, 10:22 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

You don't need to reindex in ES. It is recommended that you have that option.

On Monday, January 31, 2011 at 10:16 PM, si wrote:

thank you, is there a recommended timespan for full reindex ?

On Jan 31, 10:06 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

Since ES is in beta, it is recommended that you will have a way to reindex the data.

On Monday, January 31, 2011 at 6:12 PM, si wrote:

any ideas ?

On Jan 31, 12:16 pm, si irmakser...@gmail.com wrote:

hi,

if I understand correctly, elasticsearch can index any json structure
and can filter and sort these documents by their fields. So, what is
the recommended way; do You use ES for all listings (eg main page
product list), paging, search, I mean for every select operation
excluding form input pages. Or do I have to use it for only search ?
If I can do everything with ES is it durable and suitable for main
storage, is there a data loss probability ? For consistency do you
rebuild all your indexes periodically, what is your timespan, eg :1
day ?

my best
Serdar


(sirmak) #8

thak you very much :slight_smile:

On Jan 31, 10:38 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

Yea, makes perfect sense. people are using ES for much more than "just" search.

On Monday, January 31, 2011 at 10:29 PM, si wrote:

Thanks again Shay, one last question; I have an opinion to use ES with
Cassandra. as you know cassandra has weak query & sorting options, so
I plan to use ES not only for search, but also for page listings (eg:
products..), too. Is it feasable and a solid approach, or do I have to
use ES for only search ?

my best

On Jan 31, 10:22 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

You don't need to reindex in ES. It is recommended that you have that option.

On Monday, January 31, 2011 at 10:16 PM, si wrote:

thank you, is there a recommended timespan for full reindex ?

On Jan 31, 10:06 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

Since ES is in beta, it is recommended that you will have a way to reindex the data.

On Monday, January 31, 2011 at 6:12 PM, si wrote:

any ideas ?

On Jan 31, 12:16 pm, si irmakser...@gmail.com wrote:

hi,

if I understand correctly, elasticsearch can index any json structure
and can filter and sort these documents by their fields. So, what is
the recommended way; do You use ES for all listings (eg main page
product list), paging, search, I mean for every select operation
excluding form input pages. Or do I have to use it for only search ?
If I can do everything with ES is it durable and suitable for main
storage, is there a data loss probability ? For consistency do you
rebuild all your indexes periodically, what is your timespan, eg :1
day ?

my best
Serdar


(sirmak) #9

Thank you very much Shay

On Jan 31, 10:38 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

Yea, makes perfect sense. people are using ES for much more than "just" search.

On Monday, January 31, 2011 at 10:29 PM, si wrote:

Thanks again Shay, one last question; I have an opinion to use ES with
Cassandra. as you know cassandra has weak query & sorting options, so
I plan to use ES not only for search, but also for page listings (eg:
products..), too. Is it feasable and a solid approach, or do I have to
use ES for only search ?

my best

On Jan 31, 10:22 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

You don't need to reindex in ES. It is recommended that you have that option.

On Monday, January 31, 2011 at 10:16 PM, si wrote:

thank you, is there a recommended timespan for full reindex ?

On Jan 31, 10:06 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

Since ES is in beta, it is recommended that you will have a way to reindex the data.

On Monday, January 31, 2011 at 6:12 PM, si wrote:

any ideas ?

On Jan 31, 12:16 pm, si irmakser...@gmail.com wrote:

hi,

if I understand correctly, elasticsearch can index any json structure
and can filter and sort these documents by their fields. So, what is
the recommended way; do You use ES for all listings (eg main page
product list), paging, search, I mean for every select operation
excluding form input pages. Or do I have to use it for only search ?
If I can do everything with ES is it durable and suitable for main
storage, is there a data loss probability ? For consistency do you
rebuild all your indexes periodically, what is your timespan, eg :1
day ?

my best
Serdar


(system) #10