Field updates (via LUCENE-5189?)


(Otis Gospodnetić) #1

Hi,

Does ES offer support for field updates (vs. having to do a complete doc
delete + add), say via https://issues.apache.org/jira/browse/LUCENE-5189 ?

Thanks,
Otis

Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/ac21e1dc-7a05-48ec-923a-db5d7c0ff3fb%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Adrien Grand) #2

Hi Otis,

No, Elasticsearch doesn't expose field updates.

Field updates are only supported by numeric doc values, which are
single-valued. In Elasticsearch, all fields may be multi-valued so we
actually use binary doc values in order to store numeric fields[1].

Moreover, field updates may not scale well when applied to few documents of
a very large segment since values for all documents need to be rewritten.
For instance, if you have a large segment that has 100MB of numeric doc
values and want to update the value for a single document, you need to
rewrite the 100MB of doc values anyway. So in practice it may be a better
trade-off to use Elasticsearch's parent/child support with the static data
in the parent document and frequently changing data in the child documents.

We may use field updates in the future, eg. if we can make sure that there
is a big enough batch of updates so that rewriting all values is less
expensive that doing a delete-then-insert for the whole document, but we
don't have concrete plans at this point.

[1] https://github.com/elasticsearch/elasticsearch/issues/3993

On Fri, Dec 27, 2013 at 3:16 PM, Otis Gospodnetic <
otis.gospodnetic@gmail.com> wrote:

Hi,

Does ES offer support for field updates (vs. having to do a complete doc
delete + add), say via https://issues.apache.org/jira/browse/LUCENE-5189 ?

Thanks,
Otis

Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/ac21e1dc-7a05-48ec-923a-db5d7c0ff3fb%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
Adrien Grand

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j4LqxLHgOwgcFoWB%3D13HXHOeWzpi77VLSoO3qf_bsprLg%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.


(system) #3