I am trying to ingest csv data into Elasticsearch by using logstash, when i run the conf file manually the data is getting ingested, but when i add the conf file into pipelines.yml and then start logstash as a service the data never gets ingested.
Logs says logstash is started successfully with the pipelines
Is there something i'm doing wrong?
Here is my config file:
When you run logstash as a service it runs with the user logstash, you need to make sure that this user has reading permissions to the file you want to ingest.
If you installed logstash using a package manager like apt or yum, and you are running it as a service, you are not running it as the root user, but as the logstash user, unless you changed the service file.
Can you check which user is running logstash when you start it as a service?
If you run it manually as the root user it will have permission to the folder, but it may not have permissions when you run as a service.
If you installed logstash using a package manager like apt or yum , and you are running it as a service, you are not running it as the root user, but as the logstash user, unless you changed the service file
I have downloaded the logstash package and installed it as " rpm -ivh logstash"
Can you check which user is running logstash when you start it as a service?
I grep for logstash service, i think its running as logstash user
If you run it manually as the root user it will have permission to the folder, but it may not have permissions when you run as a service.
If i change the ownership to logstash user, will it work?
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.