# How to create two kv filter

**URL:** <https://discuss.elastic.co/t/how-to-create-two-kv-filter/129580>\
**Category:** Logstash\
**Created:** [April 26, 2018, 3:13am UTC](https://discuss.elastic.co/t/how-to-create-two-kv-filter/129580 "2018-04-26T03:13:04Z")\
**Posts on this page:** 3\
**Page:** 2

<div class="post-metadata">

**Author:** ![lcguy](https://avatars.discourse-cdn.com/v4/letter/l/35a633/32.png) [@lcguy](https://discuss.elastic.co/u/lcguy)\
**Post date:** [April 30, 2018, 10:17am UTC](https://discuss.elastic.co/t/how-to-create-two-kv-filter/129580/21 "2018-04-30T10:17:16Z")

</div>

Thanks a lot. Let me try.

---

<div class="post-metadata">

**Author:** ![lcguy](https://avatars.discourse-cdn.com/v4/letter/l/35a633/32.png) [@lcguy](https://discuss.elastic.co/u/lcguy)\
**Post date:** [May 2, 2018, 8:24am UTC](https://discuss.elastic.co/t/how-to-create-two-kv-filter/129580/22 "2018-05-02T08:24:14Z")

</div>

@guyboertje,  
I just tested the config and getting the below error.

None of the log from first firewall was hit. Only logs from second firewall are showing in ELK.  
It said date format can't parse. Any idea?

**Error From Logstash**  
[2018-05-02T16:20:18,245][WARN][logstash.outputs.elasticsearch] Could not index event to Elasticsearch. {:status=\>400, :action=\>["index", {:\_id=\>nil, :\_index=\>"logstash-2018.05.02", :\_type=\>"t\_nettraffic", :\_routing=\>nil}, 2018-05-02T08:20:18.123Z 10.10.10.10 %{message}], :response=\>{"index"=\>{"\_index"=\>"logstash-2018.05.02", "\_type"=\>"t\_nettraffic", "\_id"=\>"AGEREERTEREWDFWERSDFRSD", "status"=\>400, "error"=\>{"type"=\>"mapper\_parsing\_exception", "reason"=\>"failed to parse [date]", "caused\_by"=\>{"type"=\>"illegal\_argument\_exception", "reason"=\>"Invalid format: "2018-05-02 08:20:18 +0000" is malformed at " 08:20:18 +0000""}}}}}

+++++++++++++++++++++++++++++++++++++++++++  
**Here is the log from elasticsearch.log**

[2018-05-02T16:29:27,523][DEBUG][o.e.a.b.TransportShardBulkAction] [70m8uRn] [logstash-2018.05.02][0] failed to execute bulk item (index) BulkShardRequest [[logstash-2018.05.02][0]] containing [index {[logstash-2018.05.02][t\_nettraffic][AWMf-HhjeHqNa56vZixR], source[{"date":"2018-05-02 08:29:27 +0000","bytes\_written\_to\_client":"41667","srcip":"10.10.10.10","dstport":"443","bytes\_written\_to\_server":"2426","pid":"18895","type":"t\_nettraffic","hostname":"XXX.local.host","host":"x.x.x.x","devname":"FIREWALL1","dstip":"x.x.x.x.x","event":"session end","rule\_name":"TESTING RULE","pri":"p\_major","priority":"45","dst\_geo":"HK","srczone":"VL\_1","start\_time":"2018-05-02 08:27:48 +0000","@timestamp":"2018-05-02T08:29:27.515Z","application":"TCP 443","proto":"6","srcport":"21396","dstzone":"VL\_EXT","logid":"0","cmd":"httpp"}]}]  
org.elasticsearch.index.mapper.MapperParsingException: failed to parse [date]

```
    at org.elasticsearch.index.mapper.FieldMapper.parse(FieldMapper.java:298) ~[elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.index.mapper.DocumentParser.parseObjectOrField(DocumentParser.java:468) ~[elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.index.mapper.DocumentParser.parseDynamicValue(DocumentParser.java:816) ~[elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.index.mapper.DocumentParser.parseValue(DocumentParser.java:598) ~[elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.index.mapper.DocumentParser.innerParseObject(DocumentParser.java:396) ~[elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.index.mapper.DocumentParser.parseObjectOrNested(DocumentParser.java:373) ~[elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.index.mapper.DocumentParser.internalParseDocument(DocumentParser.java:93) ~[elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.index.mapper.DocumentParser.parseDocument(DocumentParser.java:66) ~[elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:277) ~[elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.index.shard.IndexShard.prepareIndex(IndexShard.java:530) ~[elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.index.shard.IndexShard.prepareIndexOnPrimary(IndexShard.java:507) ~[elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.bulk.TransportShardBulkAction.prepareIndexOperationOnPrimary(TransportShardBulkAction.java:459) ~[elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.bulk.TransportShardBulkAction.executeIndexRequestOnPrimary(TransportShardBulkAction.java:467) ~[elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.bulk.TransportShardBulkAction.executeBulkItemRequest(TransportShardBulkAction.java:146) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:115) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:70) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:975) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:944) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:113) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.onResponse(TransportReplicationAction.java:345) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.onResponse(TransportReplicationAction.java:270) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.support.replication.TransportReplicationAction$1.onResponse(TransportReplicationAction.java:924) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.support.replication.TransportReplicationAction$1.onResponse(TransportReplicationAction.java:921) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.index.shard.IndexShardOperationsLock.acquire(IndexShardOperationsLock.java:151) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationLock(IndexShard.java:1659) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryShardReference(TransportReplicationAction.java:933) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.support.replication.TransportReplicationAction.access$500(TransportReplicationAction.java:92) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:291) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-5.6.9.jar:5.6.9]
    at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:266) [elasticsearch-5.6.9.jar:5.6.9]
    at 
    ... 37 more
```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 30, 2018, 8:24am UTC](https://discuss.elastic.co/t/how-to-create-two-kv-filter/129580/23 "2018-05-30T08:24:16Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

[Previous page](https://discuss.elastic.co/t/how-to-create-two-kv-filter/129580.md?page=1)
