# Pipeline not discovering with correct paths

**URL:** <https://discuss.elastic.co/t/pipeline-not-discovering-with-correct-paths/242243>\
**Category:** Logstash\
**Created:** [July 22, 2020, 6:07pm UTC](https://discuss.elastic.co/t/pipeline-not-discovering-with-correct-paths/242243 "2020-07-22T18:07:28Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![mattr](https://avatars.discourse-cdn.com/v4/letter/m/2acd7d/32.png) [@mattr](https://discuss.elastic.co/u/mattr)\
**Post date:** [July 22, 2020, 6:07pm UTC](https://discuss.elastic.co/t/pipeline-not-discovering-with-correct-paths/242243/1 "2020-07-22T18:07:28Z")

</div>

I am having trouble with the logstash `pipeline`. I've had the pipeline working with the exact same settings on a different server.

The config works when I run it manually using the command line command.

The discoverer does not find any files at the specified location.

Is there anything that I'm missing? I can't figure out why it is not discovering any files when all the paths are correct.

`pipeline log`

```auto
[2020-07-22T14:00:06,380][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.
[2020-07-22T14:00:11,380][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.
[2020-07-22T14:00:16,380][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.
[2020-07-22T14:00:17,469][TRACE][filewatch.discoverer] discover_files {"count"=>0}
[2020-07-22T14:00:21,380][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.
[2020-07-22T14:00:26,380][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.
[2020-07-22T14:00:31,380][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.
[2020-07-22T14:00:32,474][TRACE][filewatch.discoverer] discover_files {"count"=>0}

```

```auto
[root@dev-01 /path/version7-0/integrations/test/data]# ls -la
drwxr-xr-x. 2 root root 4096 Jul 21 15:17 .
drw-r--r--. 3 root root 80 Jul 21 11:03 ..
-rw-r--r--. 1 root root 5997 Jul 21 15:16 167772682.json
-rw-r--r--. 1 root root 5996 Jul 21 15:16 167772684.json
-rw-r--r--. 1 root root 5331 Jul 21 15:17 2887132417.json

```

`/etc/logstash/conf.d/test.conf`

```auto
input {
  file {
    path => "/path/version7-0/integrations/test/data/*.json"
    start_position => "beginning"
    sincedb_path => "/dev/null"
    type => "json"
    mode => "read"
    file_completed_action => "delete"
    file_chunk_size => 64000
  }
}

filter {
  json {
    source => "message"
  }
  mutate {
    remove_field => ["message"]
  }
}

output {
  elasticsearch {
    hosts => "127.0.0.1:9200"
    index => "test-%{+YYYY.MM.dd.HH}"
    manage_template => true
    template => '/path/version7-0/integrations/templates/test_template.json'
    template_name => 'test_template' # The default is logstash
    template_overwrite => true
  }

  stdout {
    codec => rubydebug
  }
  
}

```

`pipeline.yml`

```auto
- pipeline.id: test-pipeline
  path.config: "/etc/logstash/conf.d/test.conf"

```

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [July 22, 2020, 6:26pm UTC](https://discuss.elastic.co/t/pipeline-not-discovering-with-correct-paths/242243/2 "2020-07-22T18:26:35Z")

</div>

> [@mattr](#):
>
> `drw-r--r--. 3 root root 80 Jul 21 11:03 ..`

You do not have execute permission on the parent directory. I do not think the file input will be able to find the files.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 19, 2020, 6:26pm UTC](https://discuss.elastic.co/t/pipeline-not-discovering-with-correct-paths/242243/3 "2020-08-19T18:26:40Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.