I am using http_poller input plugin of Logstash to read logs stored in an URL endpoint. But the URL is not constant. It will change every time. I can restart the Logstash agent every time whenever new URL comes but it not seems a good way to handle. Please suggest me any better option to overcome this situation.
Also these URLs are stored in a SQL table. I am running another Logstash agent which is taking the URL endpoint from the table and writing the same to http_poller Logstash config file. But restart require whenever new entry comes in the table as config will change. please suggest a better solution for this entire scenario.
Ask for any further information, if required. Thanks in advance.