During loadtesting Logstash failed to load files with permission denied

Elastic Stack Logstash
1

error.png1334×564 3.61 KB

Trying to do load testing .When logstash reaches certain limit it start throwing the "failed to open "..."permission denied " error ....but full permission given for the file.

In single index "xyz" the total hits 3341.Two document_type is there "type1": 2135,"type2" : 1186.

After certain amount of log files pushed into ES from LS we face this issue.kindly help us in understanding & resolving the issue.

2

Please don't post pictures of text, they are difficult to read and some people may not be even able to see them.

What version are you on? What does your config look like? What does your load testing entail?

3

we use Logstash 2.1.0,Elasticsearch 2.1.0

Load testing involve like loading more jobs to the ES via LS so that we can ensure it can handle huge entries on realtime scenario.
We query ES data and push them into our UI .
Now After certain limit it stops pushing the data into ES so we are missing the data for the particular job.
ERROR : failed to open file "<log file /.log>"permission denied <log file/.log>

Config file : we have one config file for "type1" document_type and 4 config file for "type2" document_type.
From the log file we fetch certain data using grok,ruby code and pushed into the ES.

4

hi mark ,
any other info needed ??

5

Solution :
The problem was due to open file limit in linux:

Open /etc/sysctl.conf and Add fs.file-max = 2097152

Above will increase “total” number of files that can
remain open system-wide.

Also We need to increase heap size of Logstash and Elasticsearch for it automatically update in UI page.

\opt\logstash\bin\logstash

LS_HEAP_SIZE=2gb

\opt\elasticsearch\config\elasticsearch.yml

ES_HEAP_SIZE=2gb

This solution helped us to resolve the problem of loading more data into UI page.Now load testing is successfully proceeding.