Data in different indexes depending of a field

How can I put data from one source to different indexes depending of a
field? Let say I have some data and I want to put it in two different
indexes depending of timestamp.
And if it possible to make this from mappping.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

On Mon, 2013-03-18 at 02:45 -0700, Voyager wrote:

How can I put data from one source to different indexes depending of a
field? Let say I have some data and I want to put it in two different
indexes depending of timestamp.
And if it possible to make this from mappping.

You need to handle this in your application

clint

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

I know that, but I'm asking if there is another solution, because I can't
do it from my source application. One solution is to have a script between
source application, which is not my application, and elasticsearch, but I'm
searching for a better and easier solution.

On Monday, March 18, 2013 1:03:18 PM UTC+2, Clinton Gormley wrote:

On Mon, 2013-03-18 at 02:45 -0700, Voyager wrote:

How can I put data from one source to different indexes depending of a
field? Let say I have some data and I want to put it in two different
indexes depending of timestamp.
And if it possible to make this from mappping.

You need to handle this in your application

clint

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Nobody knows another solution?

On Monday, March 18, 2013 1:16:20 PM UTC+2, Voyager wrote:

I know that, but I'm asking if there is another solution, because I can't
do it from my source application. One solution is to have a script between
source application, which is not my application, and elasticsearch, but I'm
searching for a better and easier solution.

On Monday, March 18, 2013 1:03:18 PM UTC+2, Clinton Gormley wrote:

On Mon, 2013-03-18 at 02:45 -0700, Voyager wrote:

How can I put data from one source to different indexes depending of a
field? Let say I have some data and I want to put it in two different
indexes depending of timestamp.
And if it possible to make this from mappping.

You need to handle this in your application

clint

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

You could technically write a plugin that will do the routing for you, but
it would far more complicated than simply writing code on the application
side. This type of logic belongs at the application level, not at the
storage level.

Perhaps an alternative solution would be to reconsider the use of multiple
indices and change the data model. Of course, it is use-case dependent.

--
Ivan

On Tue, Mar 19, 2013 at 1:22 AM, Voyager voyagersm@gmail.com wrote:

Nobody knows another solution?

On Monday, March 18, 2013 1:16:20 PM UTC+2, Voyager wrote:

I know that, but I'm asking if there is another solution, because I can't
do it from my source application. One solution is to have a script between
source application, which is not my application, and elasticsearch, but I'm
searching for a better and easier solution.

On Monday, March 18, 2013 1:03:18 PM UTC+2, Clinton Gormley wrote:

On Mon, 2013-03-18 at 02:45 -0700, Voyager wrote:

How can I put data from one source to different indexes depending of a
field? Let say I have some data and I want to put it in two different
indexes depending of timestamp.
And if it possible to make this from mappping.

You need to handle this in your application

clint

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Thanks for the answer but I need to send logs from couchbase, with an
plugin (
http://blog.couchbase.com/couchbase-and-full-text-search-couchbase-transport-elastic-search)
and it doesn't have some much settings, and I can't modify it. That's why I
ask for another solution.

On Tue, Mar 19, 2013 at 4:56 PM, Ivan Brusic ivan@brusic.com wrote:

You could technically write a plugin that will do the routing for you, but
it would far more complicated than simply writing code on the application
side. This type of logic belongs at the application level, not at the
storage level.

Perhaps an alternative solution would be to reconsider the use of multiple
indices and change the data model. Of course, it is use-case dependent.

--
Ivan

On Tue, Mar 19, 2013 at 1:22 AM, Voyager voyagersm@gmail.com wrote:

Nobody knows another solution?

On Monday, March 18, 2013 1:16:20 PM UTC+2, Voyager wrote:

I know that, but I'm asking if there is another solution, because I
can't do it from my source application. One solution is to have a script
between source application, which is not my application, and elasticsearch,
but I'm searching for a better and easier solution.

On Monday, March 18, 2013 1:03:18 PM UTC+2, Clinton Gormley wrote:

On Mon, 2013-03-18 at 02:45 -0700, Voyager wrote:

How can I put data from one source to different indexes depending of
a
field? Let say I have some data and I want to put it in two different
indexes depending of timestamp.
And if it possible to make this from mappping.

You need to handle this in your application

clint

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Hmmmm. I now understand your concern.

From a couch base point of view, one bucket = one ES index.
So you can put your logs in different Couchbase buckets and replicate each bucket to a given index, can't you?

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 20 mars 2013 à 09:16, Mihai Sandu voyagersm@gmail.com a écrit :

Thanks for the answer but I need to send logs from couchbase, with an plugin (http://blog.couchbase.com/couchbase-and-full-text-search-couchbase-transport-elastic-search) and it doesn't have some much settings, and I can't modify it. That's why I ask for another solution.

On Tue, Mar 19, 2013 at 4:56 PM, Ivan Brusic ivan@brusic.com wrote:
You could technically write a plugin that will do the routing for you, but it would far more complicated than simply writing code on the application side. This type of logic belongs at the application level, not at the storage level.

Perhaps an alternative solution would be to reconsider the use of multiple indices and change the data model. Of course, it is use-case dependent.

--
Ivan

On Tue, Mar 19, 2013 at 1:22 AM, Voyager voyagersm@gmail.com wrote:
Nobody knows another solution?

On Monday, March 18, 2013 1:16:20 PM UTC+2, Voyager wrote:
I know that, but I'm asking if there is another solution, because I can't do it from my source application. One solution is to have a script between source application, which is not my application, and elasticsearch, but I'm searching for a better and easier solution.

On Monday, March 18, 2013 1:03:18 PM UTC+2, Clinton Gormley wrote:
On Mon, 2013-03-18 at 02:45 -0700, Voyager wrote:

How can I put data from one source to different indexes depending of a
field? Let say I have some data and I want to put it in two different
indexes depending of timestamp.
And if it possible to make this from mappping.

You need to handle this in your application

clint

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Thanks but I will modify the couchbase plugin.

On Wed, Mar 20, 2013 at 10:53 AM, David Pilato david@pilato.fr wrote:

Hmmmm. I now understand your concern.

From a couch base point of view, one bucket = one ES index.
So you can put your logs in different Couchbase buckets and replicate each
bucket to a given index, can't you?

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfrhttps://twitter.com/elasticsearchfr
| @scrutmydocs https://twitter.com/scrutmydocs

Le 20 mars 2013 à 09:16, Mihai Sandu voyagersm@gmail.com a écrit :

Thanks for the answer but I need to send logs from couchbase, with an
plugin (
http://blog.couchbase.com/couchbase-and-full-text-search-couchbase-transport-elastic-search)
and it doesn't have some much settings, and I can't modify it. That's why I
ask for another solution.

On Tue, Mar 19, 2013 at 4:56 PM, Ivan Brusic ivan@brusic.com wrote:

You could technically write a plugin that will do the routing for you,
but it would far more complicated than simply writing code on the
application side. This type of logic belongs at the application level, not
at the storage level.

Perhaps an alternative solution would be to reconsider the use of
multiple indices and change the data model. Of course, it is use-case
dependent.

--
Ivan

On Tue, Mar 19, 2013 at 1:22 AM, Voyager voyagersm@gmail.com wrote:

Nobody knows another solution?

On Monday, March 18, 2013 1:16:20 PM UTC+2, Voyager wrote:

I know that, but I'm asking if there is another solution, because I
can't do it from my source application. One solution is to have a script
between source application, which is not my application, and elasticsearch,
but I'm searching for a better and easier solution.

On Monday, March 18, 2013 1:03:18 PM UTC+2, Clinton Gormley wrote:

On Mon, 2013-03-18 at 02:45 -0700, Voyager wrote:

How can I put data from one source to different indexes depending of
a
field? Let say I have some data and I want to put it in two
different
indexes depending of timestamp.
And if it possible to make this from mappping.

You need to handle this in your application

clint

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.