# Document\_id in redis

**URL:** <https://discuss.elastic.co/t/document-id-in-redis/51323>\
**Category:** Logstash\
**Created:** [May 30, 2016, 1:14pm UTC](https://discuss.elastic.co/t/document-id-in-redis/51323 "2016-05-30T13:14:11Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Swen](https://avatars.discourse-cdn.com/v4/letter/s/e8c25b/32.png) [@Swen](https://discuss.elastic.co/u/Swen)\
**Post date:** [May 30, 2016, 1:14pm UTC](https://discuss.elastic.co/t/document-id-in-redis/51323/1 "2016-05-30T13:14:11Z")

</div>

My input comes from a rest service that is digging in a database. Every time I request the service, I get events from the last 24 hours (for instance). That means, when I request the service every hour I will get a few same events as that got already with the last request.

I've learned that elesticsearch will override double events when the \_id is the same. OK, then I try to set the document\_id.  
I send the data via a redis server. How can I set document\_id in the config?

input {  
stdin { }

```
exec {
 codec => json
 command => "C:\Data\RequestRest.exe"
 interval => 20  
}

```

}

filter {  
split {  
field =\> "results"  
}

date {  
match =\> ["[results][StartTime]","yyyy-MM-dd'T'HH:mm:ss.SSS"]  
timezone =\> "UTC"  
}

mutate {  
add\_field =\> {  
"log\_domain" =\> "cio"  
"log\_component" =\> "disflower\_input\_test"  
}  
}  
}

output {  
redis { host =\> "log4all-redis-sandbox.europe.intranet:6379"  
data\_type =\> "list"  
key =\> "logstash"  
}

```
stdout { 
    codec => rubydebug
}

```

}

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 30, 2016, 11:31pm UTC](https://discuss.elastic.co/t/document-id-in-redis/51323/2 "2016-05-30T23:31:24Z")

</div>

[https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html#plugins-outputs-elasticsearch-document\_id](https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html#plugins-outputs-elasticsearch-document_id) is what you want, but you set that when you send to ES, not to redis.

---

<div class="post-metadata">

**Author:** ![Swen](https://avatars.discourse-cdn.com/v4/letter/s/e8c25b/32.png) [@Swen](https://discuss.elastic.co/u/Swen)\
**Post date:** [May 31, 2016, 5:34am UTC](https://discuss.elastic.co/t/document-id-in-redis/51323/3 "2016-05-31T05:34:17Z")

</div>

I know. But problem is, that I do not send to ES but to Redis. Question again: How to set id then?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 31, 2016, 5:44am UTC](https://discuss.elastic.co/t/document-id-in-redis/51323/4 "2016-05-31T05:44:06Z")

</div>

Redis has no ID, it is just a list.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:55am UTC](https://discuss.elastic.co/t/document-id-in-redis/51323/5 "2017-07-06T04:55:24Z")

</div>

Closed on July 6, 2017, 4:55am UTC