# Filebeat seems not interact with Logstash - Windows

**URL:** <https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [January 8, 2016, 11:57am UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720 "2016-01-08T11:57:47Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![john22122015](https://avatars.discourse-cdn.com/v4/letter/j/4491bb/32.png) [@john22122015](https://discuss.elastic.co/u/john22122015)\
**Post date:** [January 8, 2016, 11:57am UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720/1 "2016-01-08T11:57:47Z")

</div>

Hi, Colleagues!

I have installed ELK in Windows and runs successfully, creatings all indexes.  
But it need to be integrate with Filebeat. Then, the structure is FB \> LS \> ES.  
But, despite of promt says "2016/01/08 11:08:13.170670 outputs.go:111: INFO Activated logstash as output plugin.", the indices have not been created in Elasticsearch.

Steps:  
Iniciate Elasticsearch - OK

Iniciate Logstash - OK  
cd C:\logstash-2.1.1\bin logstash -f logstash.conf

Iniciate Filebeat - OK  
cd C:\filebeat-1.0.1-windows .\filebeat.exe -e -c .\filebeat.yml -d "service"

## When I check in Elasticsearch, the indeces have not been created.

Configuration

Logstash - logstash-2.1.1 - logstash.conf

```
input {
  beats {
    port => 5044
	type => "systemout_teste"
  }
}

filter {
	if [type] == "systemout_teste" {
              ...
}
}

output {
  elasticsearch {
	hosts => ["localhost:9200"] 
	index => "systemout_teste"
  }
}

```

* * *

Filebeat - filebeat-1.0.1-windows - filebeat.yml

```
filebeat:
  prospectors:
    -
      paths:
        - C:\files\SystemOut.log
      input_type: log

      document_type: systemout_teste

  registry_file: "C:\filebeat-1.0.1-windows\registry"
  config_dir:

output:
  logstash:
    hosts: ["localhost:5044"]
    worker: 1

```

* * *

Outputs

Logstash

```
io/console not supported; tty will not be manipulated
Settings: Default filter workers: 1
Logstash startup completed

```

Filebeat

```
2016/01/08 11:51:57.498070 geolite.go:24: INFO GeoIP disabled: No paths were set under output.geoip.paths
2016/01/08 11:51:57.504070 outputs.go:111: INFO Activated logstash as output plugin.
2016/01/08 11:51:57.504070 publish.go:249: INFO Publisher name: CTS08152138
2016/01/08 11:51:57.510070 beat.go:107: INFO Init Beat: filebeat; Version: 1.0.1
2016/01/08 11:51:57.510070 beat.go:133: INFO filebeat sucessfully setup. Start running.
2016/01/08 11:51:57.511070 registrar.go:66: INFO Registry file set to: C:\filebeegistry1-windows\♀ilebeat-1.0.1-windows
2016/01/08 11:51:57.512070 service_windows.go:49: DBG Windows is interactive: true
2016/01/08 11:51:57.512070 crawler.go:78: INFO All prospectors initialised with0 states to persist
2016/01/08 11:51:57.512070 registrar.go:83: INFO Starting Registrar
2016/01/08 11:51:57.512070 spooler.go:77: INFO Starting spooler: spool_size: 1024; idle_timeout: 5s
2016/01/08 11:51:57.512070 filebeat.go:122: INFO Start sending events to output

```

As I said above, seems like all is working, but no index was created. Anyone knows how to solve this situation?

Thanks a lot!

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [January 8, 2016, 4:20pm UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720/2 "2016-01-08T16:20:27Z")

</div>

Hm... can you start filebeat with `-d` ?

---

<div class="post-metadata">

**Author:** ![john22122015](https://avatars.discourse-cdn.com/v4/letter/j/4491bb/32.png) [@john22122015](https://discuss.elastic.co/u/john22122015)\
**Post date:** [January 8, 2016, 4:48pm UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720/3 "2016-01-08T16:48:41Z")

</div>

The -d command which you are saying is " cd C:\filebeat-1.0.1-windows .\filebeat.exe -e -c .\filebeat.yml **-d**"service" "?

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [January 11, 2016, 11:36am UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720/4 "2016-01-11T11:36:48Z")

</div>

You have to run filebeat with `.\filebeat.exe -e -c .\filebeat.yml -d '*'`

---

<div class="post-metadata">

**Author:** ![john22122015](https://avatars.discourse-cdn.com/v4/letter/j/4491bb/32.png) [@john22122015](https://discuss.elastic.co/u/john22122015)\
**Post date:** [January 11, 2016, 4:37pm UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720/5 "2016-01-11T16:37:17Z")

</div>

I have runned with '_', but the indices still not being created.  
Below is the output drom Power Shell:  
C:\filebeat-1.0.1-windows\>.\filebeat.exe -e -c .\filebeat.yml -d "_"  
2016/01/11 16:17:09.307195 beat.go:97: DBG Initializing output plugins  
2016/01/11 16:17:09.308195 geolite.go:24: INFO GeoIP disabled: No paths were set under output.geoip.paths  
2016/01/11 16:17:09.321195 outputs.go:111: INFO Activated logstash as output plugin.  
2016/01/11 16:17:09.321195 publish.go:198: DBG create output worker: 0x0, 0x0  
2016/01/11 16:17:09.321195 publish.go:235: DBG No output is defined to store the topology. The server fields might not be filled.

2016/01/11 16:17:09.321195 publish.go:249: INFO Publisher name: CTS08152138  
2016/01/11 16:17:09.324195 async.go:95: DBG create bulk processing worker (interval=1s, bulk size=200)  
2016/01/11 16:17:09.325195 beat.go:107: INFO Init Beat: filebeat; Version: 1.0.1

2016/01/11 16:17:09.325195 beat.go:133: INFO filebeat sucessfully setup. Start running.  
2016/01/11 16:17:09.326195 registrar.go:66: INFO Registry file set to: C:\filebeegistry1-windows\♀ilebeat-1.0.1-windows

2016/01/11 16:17:09.327195 spooler.go:44: DBG Set idleTimeoutDuration to 5s  
2016/01/11 16:17:09.327195 crawler.go:38: DBG File Configs: [C:\files\SystemOut.log]

2016/01/11 16:17:09.328195 prospector.go:128: DBG Set ignore\_older duration to 24h0m0s  
2016/01/11 16:17:09.328195 prospector.go:128: DBG Set scan\_frequency duration to 10s  
2016/01/11 16:17:09.329195 prospector.go:128: DBG Set backoff duration to 1s  
2016/01/11 16:17:09.330195 prospector.go:128: DBG Set max\_backoff duration to 10s  
2016/01/11 16:17:09.331195 prospector.go:128: DBG Set partial\_line\_waiting duration to 5s  
2016/01/11 16:17:09.331195 crawler.go:58: DBG Waiting for 1 prospectors to initialise  
2016/01/11 16:17:09.327195 service\_windows.go:49: DBG Windows is interactive: true  
2016/01/11 16:17:09.328195 spooler.go:77: INFO Starting spooler: spool\_size: 1024; idle\_timeout: 5s  
2016/01/11 16:17:09.332195 prospector.go:141: DBG Harvest path: C:\files\SystemOut.log  
2016/01/11 16:17:09.333195 prospector.go:207: DBG scan path C:\files\SystemOut.log  
2016/01/11 16:17:09.382195 prospector.go:219: DBG Check file for harvesting: C:\files\SystemOut.log

2016/01/11 16:17:09.382195 prospector.go:273: DBG Start harvesting unknown file: C:\files\SystemOut.log

2016/01/11 16:17:09.382195 prospector.go:289: DBG Fetching old state of file to resume: C:\files\SystemOut.log  
2016/01/11 16:17:09.383195 prospector.go:306: DBG Skipping file (older than ign  
ore older of 24h0m0s, 676h43m14.413036s): C:\files\SystemOut.log  
2016/01/11 16:17:09.383195 prospector.go:207: DBG scan path C:\files\SystemOut.log  
2016/01/11 16:17:09.384195 prospector.go:219: DBG Check file for harvesting: C:\files\SystemOut.log  
2016/01/11 16:17:09.384195 prospector.go:341: DBG Update existing file for harvesting: C:\files\SystemOut.log  
2016/01/11 16:17:09.385195 prospector.go:383: DBG Not harvesting, file didn't change: C:\files\SystemOut.log  
...

Notice:  
No registry file was created.

Is this right?

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [January 12, 2016, 7:57am UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720/6 "2016-01-12T07:57:03Z")

</div>

See debug output:

```
2016/01/11 16:17:09.383195 prospector.go:306: DBG Skipping file (older than ignore older of 24h0m0s, 676h43m14.413036s): C:\files\SystemOut.log
...
2016/01/11 16:17:09.385195 prospector.go:383: DBG Not harvesting, file didn't change: C:\files\SystemOut.log

```

You file seems to be very very old and ignore\_older options ensures file is not collected. Update the file's last modified timestamp (e.g. [https://support.microsoft.com/en-us/kb/69581](https://support.microsoft.com/en-us/kb/69581)).

---

<div class="post-metadata">

**Author:** ![john22122015](https://avatars.discourse-cdn.com/v4/letter/j/4491bb/32.png) [@john22122015](https://discuss.elastic.co/u/john22122015)\
**Post date:** [January 12, 2016, 10:56am UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720/7 "2016-01-12T10:56:38Z")

</div>

This is the "error" that don't creates the indices. Problem solved.

Thanks a lot Steffens!

---

<div class="post-metadata">

**Author:** ![alvaroca1](https://avatars.discourse-cdn.com/v4/letter/a/58f4c7/32.png) [@alvaroca1](https://discuss.elastic.co/u/alvaroca1)\
**Post date:** [July 26, 2016, 6:47pm UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720/8 "2016-07-26T18:47:23Z")

</div>

I am New to Elastic and I have a similar config. I'm using two sets of beats winlog beat and file beat. the winlog beat is fine and it created an index and I see data.... However file beat is not creating an index. I performed the test as mention above and this is what I get as an output.. Please help.

PS C:\filebeat\> .\filebeat.exe -e -c .\filebeat.yml -d '\*'  
.\filebeat.exe : 2016/07/26 18:41:21.104877 beat.go:135: DBG Initializing output plugins  
At line:1 char:2

- .\filebeat.exe -e -c .\filebeat.yml -d '\*'
- 

```auto
 + CategoryInfo : NotSpecified: (2016/07/26 18:4... output plugins:String) [], RemoteException
 + FullyQualifiedErrorId : NativeCommandError

```

2016/07/26 18:41:21.104877 geolite.go:24: INFO GeoIP disabled: No paths were set under output.geoip.paths  
2016/07/26 18:41:21.104877 client.go:297: DBG ES Ping(url=http://192.168.110.100:9200, timeout=1m30s)  
2016/07/26 18:41:21.106847 client.go:306: DBG Ping status code: 200  
2016/07/26 18:41:21.106847 outputs.go:126: INFO Activated elasticsearch as output plugin.  
2016/07/26 18:41:21.106847 file.go:39: INFO File output base filename set to: filebeat  
2016/07/26 18:41:21.106847 file.go:50: INFO Rotate every bytes set to: 10485760  
2016/07/26 18:41:21.106847 file.go:57: INFO Number of files set to: 7  
2016/07/26 18:41:21.107349 outputs.go:126: INFO Activated file as output plugin.  
2016/07/26 18:41:21.107349 publish.go:232: DBG Create output worker  
2016/07/26 18:41:21.107349 publish.go:232: DBG Create output worker  
2016/07/26 18:41:21.107349 publish.go:274: DBG No output is defined to store the topology. The server fields might not be filled.  
2016/07/26 18:41:21.107349 publish.go:288: INFO Publisher name: ##$$ Computer name  
2016/07/26 18:41:21.114908 async.go:78: INFO Flush Interval set to: 1s  
2016/07/26 18:41:21.114908 async.go:84: INFO Max Bulk Size set to: 50  
2016/07/26 18:41:21.114908 async.go:92: DBG create bulk processing worker (interval=1s, bulk size=50)  
2016/07/26 18:41:21.114908 async.go:78: INFO Flush Interval set to: -1ms  
2016/07/26 18:41:21.114908 async.go:84: INFO Max Bulk Size set to: -1  
2016/07/26 18:41:21.114908 beat.go:147: INFO Init Beat: filebeat; Version: 1.2.3  
2016/07/26 18:41:21.116912 beat.go:173: INFO filebeat sucessfully setup. Start running.  
2016/07/26 18:41:21.116912 registrar.go:68: INFO Registry file set to: C:\ProgramData\filebeat\registry  
2016/07/26 18:41:21.116912 registrar.go:80: INFO Loading registrar data from C:\ProgramData\filebeat\registry  
2016/07/26 18:41:21.116912 spooler.go:44: DBG Set idleTimeoutDuration to 5s  
2016/07/26 18:41:21.116912 crawler.go:38: DBG File Configs: [C:\Filebeat\log\*.txt]  
2016/07/26 18:41:21.116912 prospector.go:133: INFO Set ignore\_older duration to 0  
2016/07/26 18:41:21.116912 prospector.go:133: INFO Set close\_older duration to 1h0m0s  
2016/07/26 18:41:21.116912 prospector.go:133: INFO Set scan\_frequency duration to 10s  
2016/07/26 18:41:21.116912 prospector.go:93: INFO Input type set to: log  
2016/07/26 18:41:21.116912 prospector.go:133: INFO Set backoff duration to 1s  
2016/07/26 18:41:21.116912 prospector.go:133: INFO Set max\_backoff duration to 10s  
2016/07/26 18:41:21.116912 prospector.go:113: INFO force\_close\_file is disabled  
2016/07/26 18:41:21.116912 crawler.go:58: DBG Waiting for 1 prospectors to initialise  
2016/07/26 18:41:21.116912 prospector.go:143: INFO Starting prospector of type: log  
2016/07/26 18:41:21.116912 prospector.go:161: DBG exclude\_files: []  
2016/07/26 18:41:21.116912 prospector.go:261: DBG scan path C:\Filebeat\log\*.txt  
2016/07/26 18:41:21.116912 prospector.go:261: DBG scan path C:\Filebeat\log\*.txt  
2016/07/26 18:41:21.116912 crawler.go:65: DBG No pending prospectors. Finishing setup  
2016/07/26 18:41:21.116912 crawler.go:78: INFO All prospectors initialised with 0 states to persist  
2016/07/26 18:41:21.116912 registrar.go:87: INFO Starting Registrar  
2016/07/26 18:41:21.116912 publish.go:88: INFO Start sending events to output  
2016/07/26 18:41:21.116912 service\_windows.go:49: DBG Windows is interactive: true  
2016/07/26 18:41:21.116912 spooler.go:77: INFO Starting spooler: spool\_size: 2048; idle\_timeout: 5s  
2016/07/26 18:41:23.617957 spooler.go:97: DBG Flushing spooler because of timeout. Events flushed: 0  
2016/07/26 18:41:31.117402 prospector.go:185: DBG Start next scan

---

<div class="post-metadata">

**Author:** ![alvaroca1](https://avatars.discourse-cdn.com/v4/letter/a/58f4c7/32.png) [@alvaroca1](https://discuss.elastic.co/u/alvaroca1)\
**Post date:** [July 26, 2016, 6:52pm UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720/9 "2016-07-26T18:52:32Z")

</div>

And this is my filebeat configuration file aggregated so it can fit

filebeat:

# List of prospectors to fetch data.

prospectors:

```
    - C:\Filebeat\log\*.txt
   

  encoding: utf-8

  input_type: log
  document_type: log
  registry_file: "C:/ProgramData/filebeat/registry"
  utput:

```

### Elasticsearch as output

elasticsearch:

```
hosts: ["192.168.110.100:9200"]
index: "filebeat"

```

### File as output

```
file:
# Path to the directory where to save the generated files. The option is mandatory.
path: C:\filebeat\Logs\outPut

# Name of the generated files. The default is `filebeat` and it generates files: `filebeat`, `filebeat.1`, `filebeat.2`, etc.
filename: filebeat

logging:
rotateeverybytes: 10485760 # = 10MB
```

---

<div class="post-metadata">

**Author:** ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)\
**Post date:** [July 27, 2016, 8:22am UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720/10 "2016-07-27T08:22:51Z")

</div>

@alvaroca1 Can you please open a new topic with your question as the previous problem seems to be resolved.

---

<div class="post-metadata">

**Author:** ![alvaroca1](https://avatars.discourse-cdn.com/v4/letter/a/58f4c7/32.png) [@alvaroca1](https://discuss.elastic.co/u/alvaroca1)\
**Post date:** [July 27, 2016, 12:22pm UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720/11 "2016-07-27T12:22:41Z")

</div>

@ruflin will do.

---

<div class="post-metadata">

**Author:** ![alvaroca1](https://avatars.discourse-cdn.com/v4/letter/a/58f4c7/32.png) [@alvaroca1](https://discuss.elastic.co/u/alvaroca1)\
**Post date:** [July 27, 2016, 12:27pm UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720/12 "2016-07-27T12:27:42Z")

</div>

All done here is the link to the new topic for help [FileBeat not sending info to elastic](https://discuss.elastic.co/t/filebeat-not-sending-infor-to-elastic/56516/2)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 9:50pm UTC](https://discuss.elastic.co/t/filebeat-seems-not-interact-with-logstash-windows/38720/13 "2017-07-05T21:50:52Z")

</div>


