_source disabled

hi

how i can get result ( fields ) if _source field is disabled ??

thank you

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Hello!

If you disable the _source field you need to have the contents of the fields stored in order to retrieve them.

--

Regards,

Rafał Kuć

Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - ElasticSearch

hi

how i can get result ( fields ) if _source field is disabled ??

thank you

--

You received this message because you are subscribed to the Google Groups "elasticsearch" group.

To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

how i can do that ?

On Wed, May 8, 2013 at 10:15 AM, Rafał Kuć r.kuc@solr.pl wrote:

Hello!

If you disable the _source field you need to have the contents of the
fields stored in order to retrieve them.

*--
Regards,
Rafał Kuć
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch -
Elasticsearch

hi

how i can get result ( fields ) if _source field is disabled ??

thank you

You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/3yU-n-aLeuw/unsubscribe?hl=en-US
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

For fields you want to retrieve, set store to true in mapping.

That said, why do you need to disable source?

HTH
David

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 8 mai 2013 à 11:12, Fadel Chafai fadelmohamed@gmail.com a écrit :

hi

how i can get result ( fields ) if _source field is disabled ??

thank you

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Hello!

For example like this:

{

"mappings": {

"properties": {

"name": {"type":"string", "store":"yes" }            

}

}

}

}

--

Regards,

Rafał Kuć

Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - ElasticSearch

how i can do that ?

On Wed, May 8, 2013 at 10:15 AM, Rafał Kuć <r.kuc@solr.pl> wrote:

Hello!

If you disable the _source field you need to have the contents of the fields stored in order to retrieve them.

--

Regards,

Rafał Kuć

Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - ElasticSearch

hi

how i can get result ( fields ) if _source field is disabled ??

thank you

--

You received this message because you are subscribed to the Google Groups "elasticsearch" group.

To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--

You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.

To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/3yU-n-aLeuw/unsubscribe?hl=en-US.

To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--

You received this message because you are subscribed to the Google Groups "elasticsearch" group.

To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

I already asked about the relation between the size of my index and the
size of my server RAM, and since I have not had any response. I tried to
disactiver _source to optimizes the size of my index.

the size of my index (_source = enable) 9 gb
Serverr RAM = 16G
Elasticsearch HEAP SIZE = 8G

thank you

On Wed, May 8, 2013 at 10:24 AM, Rafał Kuć r.kuc@solr.pl wrote:

Hello!

For example like this:

{
"mappings": {
"properties": {
"name": {"type":"string", "store":"yes" }

}
}
}
}

--
Regards,
Rafał Kuć
Sematext :: *
http://sematext.com/
:: Solr - Lucene - Nutch - Elasticsearch

how i can do that ?

On Wed, May 8, 2013 at 10:15 AM, Rafał Kuć r.kuc@solr.pl wrote:
Hello!

If you disable the _source field you need to have the contents of the
fields stored in order to retrieve them.

*--
Regards,
Rafał Kuć
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch -
Elasticsearch

hi

how i can get result ( fields ) if _source field is disabled ??

thank you

You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/3yU-n-aLeuw/unsubscribe?hl=en-US
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/3yU-n-aLeuw/unsubscribe?hl=en-US
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

I have not seen your original question, but since source can be compressed,
you might get more index size benefits if you remove indexed fields and not
stored fields.

--
Ivan

On Wed, May 8, 2013 at 2:28 AM, Fadel Chafai fadelchafai@gmail.com wrote:

I already asked about the relation between the size of my index and the
size of my server RAM, and since I have not had any response. I tried to
disactiver _source to optimizes the size of my index.

the size of my index (_source = enable) 9 gb
Serverr RAM = 16G
Elasticsearch HEAP SIZE = 8G

thank you

On Wed, May 8, 2013 at 10:24 AM, Rafał Kuć r.kuc@solr.pl wrote:

Hello!

For example like this:

{
"mappings": {
"properties": {
"name": {"type":"string", "store":"yes" }

}
}
}
}

--
Regards,
Rafał Kuć
Sematext :: *
http://sematext.com/
:: Solr - Lucene - Nutch - Elasticsearch

how i can do that ?

On Wed, May 8, 2013 at 10:15 AM, Rafał Kuć r.kuc@solr.pl wrote:
Hello!

If you disable the _source field you need to have the contents of the
fields stored in order to retrieve them.

*--
Regards,
Rafał Kuć
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch -
Elasticsearch

hi

how i can get result ( fields ) if _source field is disabled ??

thank you

You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/3yU-n-aLeuw/unsubscribe?hl=en-US
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/3yU-n-aLeuw/unsubscribe?hl=en-US
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

David,

I am also pondering in some of the implementation of setting "store" value
for a field, if one sets the store value to "no" for a field and also
_source for a type is disabled. What is the purpose of that field other
than querying/indexing? Can you explain real world use case?

thanks

On Wednesday, May 8, 2013 2:17:47 AM UTC-7, David Pilato wrote:

For fields you want to retrieve, set store to true in mapping.

That said, why do you need to disable source?

HTH
David

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 8 mai 2013 à 11:12, Fadel Chafai <fadelm...@gmail.com <javascript:>> a
écrit :

hi

how i can get result ( fields ) if _source field is disabled ??

thank you

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Some features that come to me:

  • Reindexing from Elasticsearch itself.
  • Debugging (what was the source when I indexed?).
  • Showing results to user. If you did not store the field, you will have to reindex everything.

IMHO, you should disable source only if you really need to disable it (real hard disk constraint, very very big source docs...).

My 2 cents

David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 9 mai 2013 à 01:56, vinod eligeti veligeti999@gmail.com a écrit :

David,

I am also pondering in some of the implementation of setting "store" value for a field, if one sets the store value to "no" for a field and also _source for a type is disabled. What is the purpose of that field other than querying/indexing? Can you explain real world use case?

thanks

On Wednesday, May 8, 2013 2:17:47 AM UTC-7, David Pilato wrote:

For fields you want to retrieve, set store to true in mapping.

That said, why do you need to disable source?

HTH
David

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 8 mai 2013 à 11:12, Fadel Chafai fadelm...@gmail.com a écrit :

hi

how i can get result ( fields ) if _source field is disabled ??

thank you

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Historically, Lucene has no concept of source. A field is either indexed,
stored or both (neither does not make sense). Indexed fields can be
queried/filtered-in and stored fields can be returned as the result
document. So to answer your question, if the source is disabled and a field
is not stored, then it either should be indexed or simply ignored.

Elasticsearch introduced the concept of source. The biggest issue with
stored fields is that each field required a read from the index. With
source, only one read is required, although the result is much bigger. If
you need only a handful of fields, then storing and retrieving those fields
is probably more efficient, but you required many fields or all of them,
getting the source is more efficient.

--

Ivan

On Wed, May 8, 2013 at 4:56 PM, vinod eligeti veligeti999@gmail.com wrote:

David,

I am also pondering in some of the implementation of setting "store" value
for a field, if one sets the store value to "no" for a field and also
_source for a type is disabled. What is the purpose of that field other
than querying/indexing? Can you explain real world use case?

thanks

On Wednesday, May 8, 2013 2:17:47 AM UTC-7, David Pilato wrote:

For fields you want to retrieve, set store to true in mapping.

That said, why do you need to disable source?

HTH
David

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 8 mai 2013 à 11:12, Fadel Chafai fadelm...@gmail.com a écrit :

hi

how i can get result ( fields ) if _source field is disabled ??

thank you

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@**googlegroups.com.

For more options, visit https://groups.google.com/**groups/opt_outhttps://groups.google.com/groups/opt_out
.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Thanks David and Ivan for the explanation. I guess it make sense to store
_source since the log messages which I store are not huge.

On Wed, May 8, 2013 at 8:55 PM, Ivan Brusic ivan@brusic.com wrote:

Historically, Lucene has no concept of source. A field is either indexed,
stored or both (neither does not make sense). Indexed fields can be
queried/filtered-in and stored fields can be returned as the result
document. So to answer your question, if the source is disabled and a field
is not stored, then it either should be indexed or simply ignored.

Elasticsearch introduced the concept of source. The biggest issue with
stored fields is that each field required a read from the index. With
source, only one read is required, although the result is much bigger. If
you need only a handful of fields, then storing and retrieving those fields
is probably more efficient, but you required many fields or all of them,
getting the source is more efficient.

--

Ivan

On Wed, May 8, 2013 at 4:56 PM, vinod eligeti veligeti999@gmail.comwrote:

David,

I am also pondering in some of the implementation of setting "store"
value for a field, if one sets the store value to "no" for a field and also
_source for a type is disabled. What is the purpose of that field other
than querying/indexing? Can you explain real world use case?

thanks

On Wednesday, May 8, 2013 2:17:47 AM UTC-7, David Pilato wrote:

For fields you want to retrieve, set store to true in mapping.

That said, why do you need to disable source?

HTH
David

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 8 mai 2013 à 11:12, Fadel Chafai fadelm...@gmail.com a écrit :

hi

how i can get result ( fields ) if _source field is disabled ??

thank you

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@**googlegroups.com.

For more options, visit https://groups.google.com/**groups/opt_outhttps://groups.google.com/groups/opt_out
.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/3yU-n-aLeuw/unsubscribe?hl=en-US
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.