Incrementing an integer field

Frank_LaRosa · February 8, 2012, 6:18pm

Hi,

Is there a more efficient way to increment an integer field besides
reading the entire document, updating the number, and re-indexing the
document?

Thanks,

Frank

lukeforehand_2 · February 8, 2012, 6:58pm

I believe you can do it with a script in the new release candidate:

specific issue:

github.com/elastic/elasticsearch

Update API: Allow to update a document based on a script

opened 08:01PM - 02 Jan 12 UTC

closed 08:02PM - 02 Jan 12 UTC

kimchy

>feature v0.19.0.RC1

The update action allows to directly update a specific document based on a scrip…t. The operation gets the document (collocated with the shard) from the index, runs the script (with optional script language and parameters), and index back the result (also allows to delete, or ignore the operation). Note, this operation still means full reindex of the document, it just removes some network roundtrips and reduces chances of version conflicts between the get and the index. For example, lets index a simple doc: ``` curl -XPUT localhost:9200/test/type1/1 -d '{ "counter" : 1, "tags" : ["red"] }' ``` Now, we can execute a script that would increment the counter ``` curl -XPOST 'localhost:9200/test/type1/1/_update' -d '{ "script" : "ctx._source.counter += count", "params" : { "count" : 4 } }' ``` We can also add a tag to the list of tags: ``` curl -XPOST 'localhost:9200/test/type1/1/_update' -d '{ "script" : "ctx._source.tags += tag", "params" : { "tag" : "blue" } }' ``` And, we can delete the doc if the tags contain `blue`, or ignore (noop): ``` curl -XPOST 'localhost:9200/test/type1/1/_update' -d '{ "script" : "ctx._source.tags.contains(tag) ? ctx.op = \"delete\" : ctx.op = \"none\"", "params" : { "tag" : "blue" } }' ``` ## Parameters: - `routing`: Sets the routing that will be used to route the document to the relevant shard. - `parent`: Simply sets the routing. - `timeout`: Timeout waiting for a shard to become available. - `replication`: The replication type for the delete/index operation (`sync` or `async`). - `consistency`: The write consistency of the index/delete operation. - `retry_on_conflict`: How many times to retry if there is a version conflict between getting the document and indexing / deleting it. Defaults to `0`.

-Luke

On Feb 8, 12:18 pm, Frank LaRosa fr...@studyblue.com wrote:

Hi,

Is there a more efficient way to increment an integer field besides
reading the entire document, updating the number, and re-indexing the
document?

Thanks,

Frank

Frank_LaRosa · February 8, 2012, 8:45pm

Thanks Luke. That looks extremely powerful indeed, if it works as
advertised.

I'm somewhat curious as to how the server actually executes the script
-- I'm guessing that since ES is based on Lucene, it still has to read
and rewrite the entire document to the index. However, not having to
pass the document over the network is still a substantial benefit.

Frank

On Feb 8, 12:58 pm, lukeforehand lukeforeh...@gmail.com wrote:

I believe you can do it with a script in the new release candidate:

Elasticsearch Platform — Find real-time answers at scale | Elastic

specific issue:Update API: Allow to update a document based on a script · Issue #1583 · elastic/elasticsearch · GitHub

-Luke

On Feb 8, 12:18 pm, Frank LaRosa fr...@studyblue.com wrote:

Hi,

Is there a more efficient way to increment an integer field besides
reading the entire document, updating the number, and re-indexing the
document?

Thanks,

Frank

kimchy · February 8, 2012, 10:35pm

Yea, the document still needs to be reindexed (I explicitly stated it at the issue and in the guide, just to make sure ).

On Wednesday, February 8, 2012 at 10:45 PM, Frank LaRosa wrote:

Thanks Luke. That looks extremely powerful indeed, if it works as
advertised.

I'm somewhat curious as to how the server actually executes the script
-- I'm guessing that since ES is based on Lucene, it still has to read
and rewrite the entire document to the index. However, not having to
pass the document over the network is still a substantial benefit.

Frank

On Feb 8, 12:58 pm, lukeforehand <lukeforeh...@gmail.com (http://gmail.com)> wrote:

I believe you can do it with a script in the new release candidate:

Elasticsearch Platform — Find real-time answers at scale | Elastic

specific issue:Update API: Allow to update a document based on a script · Issue #1583 · elastic/elasticsearch · GitHub

-Luke

On Feb 8, 12:18 pm, Frank LaRosa <fr...@studyblue.com (http://studyblue.com)> wrote:

Hi,

Is there a more efficient way to increment an integer field besides
reading the entire document, updating the number, and re-indexing the
document?

Thanks,

Frank