# Multiple server resource metrics stats

**URL:** <https://discuss.elastic.co/t/multiple-server-resource-metrics-stats/77288>\
**Category:** Logstash\
**Created:** [March 3, 2017, 9:34am UTC](https://discuss.elastic.co/t/multiple-server-resource-metrics-stats/77288 "2017-03-03T09:34:35Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![Prateek\_Kshtriya](https://avatars.discourse-cdn.com/v4/letter/p/c37758/32.png) [@Prateek\_Kshtriya](https://discuss.elastic.co/u/Prateek_Kshtriya)\
**Post date:** [March 3, 2017, 9:34am UTC](https://discuss.elastic.co/t/multiple-server-resource-metrics-stats/77288/1 "2017-03-03T09:34:35Z")

</div>

Hi All ,

I am trying to get the resource metrics data from 5 machines forming a cluster to have a one view dashboard on kibana.  
There are five different config files are created for each individual machines and are initiate through individual logstash instance(1 command line initiation for one logstash instance i.e 5 instances).

Problem statement- Not able to see the data from 5th logstash instance also only 4 sincedb files are getting created when started together.

Version -5

Please suggest how to start multiple instances and fetch the data in real time

Regards,  
Prateek

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [March 5, 2017, 9:49pm UTC](https://discuss.elastic.co/t/multiple-server-resource-metrics-stats/77288/2 "2017-03-05T21:49:38Z")

</div>

> [@Prateek\_Kshtriya](#):
>
> There are five different config files are created for each individual machines and are initiate through individual logstash instance(1 command line initiation for one logstash instance i.e 5 instances).

Why do it that way?

What does your config on the 5th instance look like?

---

<div class="post-metadata">

**Author:** ![Prateek\_Kshtriya](https://avatars.discourse-cdn.com/v4/letter/p/c37758/32.png) [@Prateek\_Kshtriya](https://discuss.elastic.co/u/Prateek_Kshtriya)\
**Post date:** [March 6, 2017, 5:24am UTC](https://discuss.elastic.co/t/multiple-server-resource-metrics-stats/77288/3 "2017-03-06T05:24:10Z")

</div>

I have to collect metrics from all the machines .As per my understanding Logstash is a single pipeline so either I have to apply logical condition(If Tags== XYZ) in a single config file or start that many individual logstash cmd instances.  
Please suggest if I am missing anything.

Its not any specific error because of config file as they are working fine when tried posting data running single logstash config file at a time. I am able to see the data on to elasticsearch and kibana correspondingly.

PFB the config file sample for one of the machine-

input {  
file {  
path =\> "C:/PerfLogs/PerfmonLogs/\*/DataCollector01.csv"  
start\_position =\> "beginning"  
}  
}

filter {  
csv {

```
	columns => ["LogTime", "APPPOOLWASTotal_CurrentWorkerProcesses", "APPPOOLWASTotal_MaximumWorkerProcesses", "APPPOOLWASTotal_Recent_WorkerProcessFailures", "APPPOOLWASTotalTotal_WorkerProcessFailures", "LogicalDiskTotal_DiskTime", "LogicalDiskTotal_IdleTime", "MemoryAvailable_MBytes", "MemoryCommitted_Bytes", "MemoryPage_Readssec", "MemoryPage_Writessec", "PhysicalDiskTotal_DiskTime", "PhysicalDiskTotal_IdleTime", "PhysicalDiskTotal_AvgDiskQueueLength", "ProcessorTotal_IdleTime", "ProcessorTotal_ProcessorTime"]
	add_field => { "MachineName" => "AppServer" }
	separator => ","
}
mutate {
convert => ["APPPOOLWASTotal_CurrentWorkerProcesses", "float"]
convert => ["APPPOOLWASTotal_MaximumWorkerProcesses", "float"]
convert => ["APPPOOLWASTotal_Recent_WorkerProcessFailures", "float"]
convert => ["APPPOOLWASTotalTotal_WorkerProcessFailures", "float"]
convert => ["LogicalDiskTotal_DiskTime", "float"]
convert => ["LogicalDiskTotal_IdleTime", "float"]
convert => ["MemoryAvailable_MBytes", "float"]
convert => ["MemoryCommitted_Bytes", "float"]
convert => ["MemoryPage_Readssec", "float"]
convert => ["MemoryPage_Writessec", "float"]
convert => ["PhysicalDiskTotal_DiskTime", "float"]
convert => ["PhysicalDiskTotal_IdleTime", "float"]
convert => ["PhysicalDiskTotal_AvgDiskQueueLength", "float"]
convert => ["ProcessorTotal_IdleTime", "float"]
convert => ["ProcessorTotal_ProcessorTime", "float"]

}
grok {
    
        match => { "message" => "%{DATESTAMP:timestamp}" }
        }
	date {
        match => ["timestamp", "MM/dd/yy HH:mm:ss.SSS"]
        }

```

}

output {  
elasticsearch {  
action =\> "index"  
index =\> "resourceindex-%{+YYYY.MM.dd}"  
}  
}

---

<div class="post-metadata">

**Author:** ![Prateek\_Kshtriya](https://avatars.discourse-cdn.com/v4/letter/p/c37758/32.png) [@Prateek\_Kshtriya](https://discuss.elastic.co/u/Prateek_Kshtriya)\
**Post date:** [March 8, 2017, 12:34pm UTC](https://discuss.elastic.co/t/multiple-server-resource-metrics-stats/77288/4 "2017-03-08T12:34:16Z")

</div>

Please suggest if I am missing anything.

Regards,  
Prateek

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [March 8, 2017, 7:35pm UTC](https://discuss.elastic.co/t/multiple-server-resource-metrics-stats/77288/5 "2017-03-08T19:35:42Z")

</div>

> [@Prateek\_Kshtriya](#):
>
> As per my understanding Logstash is a single pipeline so either I have to apply logical condition(If Tags== XYZ) in a single config file or start that many individual logstash cmd instances.

So why not use conditionals? It'll be a lot more efficient.

---

<div class="post-metadata">

**Author:** ![Prateek\_Kshtriya](https://avatars.discourse-cdn.com/v4/letter/p/c37758/32.png) [@Prateek\_Kshtriya](https://discuss.elastic.co/u/Prateek_Kshtriya)\
**Post date:** [March 9, 2017, 11:54am UTC](https://discuss.elastic.co/t/multiple-server-resource-metrics-stats/77288/6 "2017-03-09T11:54:09Z")

</div>

But how to add different input file locations in the "input{}" section.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 6, 2017, 11:54am UTC](https://discuss.elastic.co/t/multiple-server-resource-metrics-stats/77288/7 "2017-04-06T11:54:22Z")

</div>

Closed on April 6, 2017, 11:54am UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.