# How to set the configuration in logstash to run dynamically

**URL:** <https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387>\
**Category:** Elasticsearch\
**Created:** [February 5, 2018, 6:18am UTC](https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387 "2018-02-05T06:18:10Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![venkat545](https://avatars.discourse-cdn.com/v4/letter/v/f1d935/32.png) [@venkat545](https://discuss.elastic.co/u/venkat545)\
**Post date:** [February 5, 2018, 6:18am UTC](https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387/1 "2018-02-05T06:18:10Z")

</div>

I am pulling the data from pgadmin and pushing to elastic search through logstash..I am using JDBC driver in Logstash but how can i update dynamically like postgres updates ..can any one suggest..E.s &L.s ,kibana Version is 6.1.2...Thankz

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 5, 2018, 7:14am UTC](https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387/2 "2018-02-05T07:14:58Z")

</div>

With LS or any other ETL you can only schedule an execution every x seconds/minutes/xxx

You can't do that in real time if this is what you meant.

---

<div class="post-metadata">

**Author:** ![venkat545](https://avatars.discourse-cdn.com/v4/letter/v/f1d935/32.png) [@venkat545](https://discuss.elastic.co/u/venkat545)\
**Post date:** [February 5, 2018, 7:54am UTC](https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387/3 "2018-02-05T07:54:10Z")

</div>

Thankz a lot for your valuable information..actually i am working on report part i had choose the kibana to generate reports i am new to 'ELK'... as per my understanding after reading your reply there is no option to update dynamically in real time..is m correct ?? ..i am facing this thing If i need last day information (data) from 'pgadmin' i need to run logstash ,this is very useless .so every morning i am keep doing this thing to get the refresh data..can u suggest me if any other options have..thankz

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 5, 2018, 8:11am UTC](https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387/4 "2018-02-05T08:11:15Z")

</div>

I wrote some of my thoughts there: [https://david.pilato.fr/blog/2015-05-09-advanced-search-for-your-legacy-application/](http://david.pilato.fr/blog/2015/05/09/advanced-search-for-your-legacy-application/)

May be it can help.

> as per my understanding after reading your reply there is no option to update dynamically in real time..is m correct ??

No. If you have in your SQL table a date field like `lastModified`, then you can probably SELECT all records that have been modified since the last run of LS.  
But that's more something to solve on the SQL database end IMO.

---

<div class="post-metadata">

**Author:** ![venkat545](https://avatars.discourse-cdn.com/v4/letter/v/f1d935/32.png) [@venkat545](https://discuss.elastic.co/u/venkat545)\
**Post date:** [February 5, 2018, 9:15am UTC](https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387/5 "2018-02-05T09:15:56Z")

</div>

Thanks for such prompt reply ..i will follow your steps.

---

<div class="post-metadata">

**Author:** ![venkat545](https://avatars.discourse-cdn.com/v4/letter/v/f1d935/32.png) [@venkat545](https://discuss.elastic.co/u/venkat545)\
**Post date:** [February 9, 2018, 7:40am UTC](https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387/6 "2018-02-09T07:40:57Z")

</div>

facing issue at logstash..just i need the updated data i dont know how to use schedule in my config file for a day..can i discuss here or should i start new thread..??this is my config file

# stdin: db.conf

input {  
jdbc {

```
	jdbc_connection_string=>"jdbc:postgresql://localhost/joy"
	
	jdbc_user=>"yyy"
	
	jdbc_password=>"yyy"
	
	jdbc_driver_library=>"Desktop/Drivers/postgresql-9.1-901.jdbc4.jar"
	#the name of the driver class for postgres
	jdbc_driver_class=>"org.postgresql.Driver"
          
	#our query
	statement=>"SELECT * from arron;"
}

```

}  
output {  
stdout{codec=\>json\_lines  
}  
elasticsearch {  
#protocol=\>http  
index=\>"joy"  
document\_type=\>"tem"  
hosts =\> ["local"]  
user =\> "alexjon"  
password =\> "thomas"

```
}

```

}

Just suggest me how to use per a day "schedule =\> "\* \* \* \* \*"" not for a second/minute..  
In my config file i am not using any filters or plugins like grok..so plz suggest me..thankz

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 9, 2018, 7:58am UTC](https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387/7 "2018-02-09T07:58:05Z")

</div>

Please format your code using `</>` icon as explained in [this guide](https://discuss.elastic.co/t/about-the-elasticsearch-category/21) and not the citation button. It will make your post more readable.

Or use markdown style like:

````
```
CODE
```

````

Please edit your post.

---

<div class="post-metadata">

**Author:** ![venkat545](https://avatars.discourse-cdn.com/v4/letter/v/f1d935/32.png) [@venkat545](https://discuss.elastic.co/u/venkat545)\
**Post date:** [February 9, 2018, 9:38am UTC](https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387/8 "2018-02-09T09:38:09Z")

</div>

Sry to say I am very new to elastic search..plz help me to understand ,should i post by putting my index name in dev tools??like in this format GET my index/\_search  
{  
"query": {  
"match": {  
"foo": "bar"  
}  
}  
}..  
is i am on wrong track??

---

<div class="post-metadata">

**Author:** ![venkat545](https://avatars.discourse-cdn.com/v4/letter/v/f1d935/32.png) [@venkat545](https://discuss.elastic.co/u/venkat545)\
**Post date:** [February 9, 2018, 1:52pm UTC](https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387/9 "2018-02-09T13:52:29Z")

</div>

i am facing issue with logstash.

1. i just stucked with this issue When i try to run the logstash duplicate data generated.  
so plz suggest me how to solve this issue..thankz

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 9, 2018, 1:52pm UTC](https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387/10 "2018-03-09T13:52:33Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
