# Logstash - File mentioned in last\_run\_metadata\_path is not getting created

**URL:** <https://discuss.elastic.co/t/logstash-file-mentioned-in-last-run-metadata-path-is-not-getting-created/96989>\
**Category:** Logstash\
**Created:** [August 14, 2017, 2:56pm UTC](https://discuss.elastic.co/t/logstash-file-mentioned-in-last-run-metadata-path-is-not-getting-created/96989 "2017-08-14T14:56:47Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![vincentmarian](https://avatars.discourse-cdn.com/v4/letter/v/85f322/32.png) [@vincentmarian](https://discuss.elastic.co/u/vincentmarian)\
**Post date:** [August 14, 2017, 2:56pm UTC](https://discuss.elastic.co/t/logstash-file-mentioned-in-last-run-metadata-path-is-not-getting-created/96989/1 "2017-08-14T14:56:47Z")

</div>

I am using Logstash 5.4

File mentioned in last\_run\_metadata\_path is not getting created after starting Logstash.

Logstash config file:

input  
{  
jdbc  
{  
jdbc\_driver\_library =\> "/app/logstash/dbdrivers/mariadb/mariadb-java-client-2.1.0.jar"  
jdbc\_driver\_class =\> "org.mariadb.jdbc.Driver"  
jdbc\_connection\_string =\> "############"  
jdbc\_user =\> "######"  
jdbc\_password =\> "######"  
schedule =\> "\* \* \* \* \*"  
use\_column\_value =\> true  
tracking\_column =\> "id"  
jdbc\_fetch\_size =\> "100000"  
last\_run\_metadata\_path =\> "/app/logstash/var/.logstash\_jdbc\_last\_run"  
statement =\> "select id,nodeinstanceid,nodename,processinstanceid,@timestamp,processid from NodeInstanceLog where id \> :sql\_last\_value"

```
    }

```

}

output  
{  
file  
{  
path =\> "/app/applications/logs/bpm/NodeInstanceLog.log"  
}  
}

The file NodeInstanceLog.log gets updated as shown below,

[root@##### bin]# tail -f /app/applications/logs/bpm/NodeInstanceLog.log  
{"nodename":"ULIO Signal Point","processinstanceid":94853,"@timestamp":"2017-08-14T14:19:26.884Z","processid":"M2MActivation.M2M\_Subprocess","@version":"1","id":3400949,"nodeinstanceid":"17"}  
{"nodename":"PERFORM\_VISION","processinstanceid":94775,"@timestamp":"2017-08-14T14:19:26.884Z","processid":"M2MActivation.M2M\_Subprocess","@version":"1","id":3400952,"nodeinstanceid":"37"}  
{"nodename":"","processinstanceid":94781,"@timestamp":"2017-08-14T14:19:26.884Z","processid":"M2MActivation.M2M\_Subprocess","@version":"1","id":3400955,"nodeinstanceid":"32"}  
{"nodename":"Initialize Request","processinstanceid":96392,"@timestamp":"2017-08-14T14:19:26.884Z","processid":"M2MActivation.PERFORM\_VISION","@version":"1","id":3400958,"nodeinstanceid":"1"}  
{"nodename":"","processinstanceid":94826,"@timestamp":"2017-08-14T14:19:26.884Z","processid":"M2MActivation.M2M\_Subprocess","@version":"1","id":3400961,"nodeinstanceid":"36"}  
{"nodename":"Parse MTAS Response and Validate Critical Elements","processinstanceid":95837,"@timestamp":"2017-08-14T14:19:26.884Z","processid":"M2MActivation.M2M\_Subprocess","@version":"1","id":3400964,"nodeinstanceid":"6"}  
{"nodename":"VP Signal Point","processinstanceid":94754,"@timestamp":"2017-08-14T14:19:26.884Z","processid":"M2MActivation.M2M\_Subprocess","@version":"1","id":3400967,"nodeinstanceid":"23"}  
{"nodename":"","processinstanceid":94838,"@timestamp":"2017-08-14T14:19:26.884Z","processid":"M2MActivation.M2M\_Subprocess","@version":"1","id":3400970,"nodeinstanceid":"24"}  
{"nodename":"Initialize Request","processinstanceid":96380,"@timestamp":"2017-08-14T14:19:26.884Z","processid":"M2MActivation.PERFORM\_VISION","@version":"1","id":3400973,"nodeinstanceid":"1"}  
{"nodename":"PERFORM\_VISION","processinstanceid":94778,"@timestamp":"2017-08-14T14:19:26.884Z","processid":"M2MActivation.M2M\_Subprocess","@version":"1","id":3400976,"nodeinstanceid":"37"}

But file not getting created in last\_run\_metadata\_path,

[root@10-119-12-32 var]# pwd  
/app/logstash/var  
[root@10-119-12-32 var]# ls -al  
total 24  
drwxrwxrwx 2 root root 4096 Aug 2 12:05 .  
drwxrwxr-x 14 root root 4096 Jul 31 09:52 ..  
-rw-r--r-- 1 root root 276 Jul 31 10:14 orbpm\_bpmnodes\_cluster.sincedb  
-rw-r--r-- 1 root root 254 Jul 31 10:14 orbpm\_bpmnodes\_nitcluster.sincedb  
-rw-r--r-- 1 root root 256 Jul 31 10:14 orbpm\_bpmprocess\_cluster.sincedb  
-rw-r--r-- 1 root root 224 Jul 31 10:14 orbpm\_bpmprocess\_nitcluster.sincedb

Log file contents:

[root@####### logs]# tail -f logstash-plain.log  
[2017-08-14T10:08:00,466][INFO][logstash.outputs.file] Opening file {:path=\>"/app/applications/logs/bpm/NodeInstanceLog.log"}  
[2017-08-14T10:08:40,600][WARN][logstash.runner] SIGTERM received. Shutting down the agent.  
[2017-08-14T10:08:40,613][WARN][logstash.agent] stopping pipeline {:id=\>"main"}  
[2017-08-14T10:17:12,032][INFO][logstash.pipeline] Starting pipeline {"id"=\>"main", "pipeline.workers"=\>2, "pipeline.batch.size"=\>125, "pipeline.batch.delay"=\>5, "pipeline.max\_inflight"=\>250}  
[2017-08-14T10:17:12,587][INFO][logstash.pipeline] Pipeline main started  
[2017-08-14T10:17:12,657][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=\>9600}  
[2017-08-14T10:18:00,229][INFO][logstash.inputs.jdbc] (0.131000s) select id,nodeinstanceid,nodename,processinstanceid,@timestamp,processid from NodeInstanceLog where id \> 0  
[2017-08-14T10:18:00,497][INFO][logstash.outputs.file] Opening file {:path=\>"/app/applications/logs/bpm/NodeInstanceLog.log"}

Can anyone please let me know what is causing the issue ? and what configuration I need to change to get the last\_run\_metadata\_path file created?

Thanks in advance

---

<div class="post-metadata">

**Author:** ![vincentmarian](https://avatars.discourse-cdn.com/v4/letter/v/85f322/32.png) [@vincentmarian](https://discuss.elastic.co/u/vincentmarian)\
**Post date:** [August 16, 2017, 2:07pm UTC](https://discuss.elastic.co/t/logstash-file-mentioned-in-last-run-metadata-path-is-not-getting-created/96989/2 "2017-08-16T14:07:07Z")

</div>

The problem has been solved by changing the jdbc\_connection\_string as shown below ,

jdbc\_connection\_string =\> "jdbc:mariadb://127.0.0.1:3306/database?sessionVariables=sql\_mode=ANSI\_QUOTES"

Note the "sql\_mode=ANSI\_QUOTES"  
From the MariaDB documentation: [https://mariadb.com/kb/en/mariadb/sql-mode/](https://mariadb.com/kb/en/mariadb/sql-mode/)

ANSI\_QUOTES: Changes " to be treated as `, the identifier quote character. This may break old MariaDB applications which assume that " is used as a string quote character.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 13, 2017, 2:07pm UTC](https://discuss.elastic.co/t/logstash-file-mentioned-in-last-run-metadata-path-is-not-getting-created/96989/3 "2017-09-13T14:07:37Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
