# Something is wrong with pipeline

**URL:** https://discuss.elastic.co/t/something-is-wrong-with-pipeline/140766
**Category:** Beats
**Tags:** filebeat
**Created:** [July 19, 2018, 2:32pm UTC](https://discuss.elastic.co/t/something-is-wrong-with-pipeline/140766 "2018-07-19T14:32:30Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![g.myznikov.tinkoff](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/g.myznikov.tinkoff/32/33582_2.png) [@g.myznikov.tinkoff](https://discuss.elastic.co/u/g.myznikov.tinkoff)
#### Post date: [July 19, 2018, 2:32pm UTC](https://discuss.elastic.co/t/something-is-wrong-with-pipeline/140766/1 "2018-07-19T14:32:30Z")

</div>

I have Stack without Logstash. But I need to correct some fields in kibana (timestamp for example). I try to use pipeline for this purpose. This is my config file:  
filebeat.yml

```auto

filebeat.inputs:
- type: log
  enabled: true
  paths:
    - /var/log/*.log

multiline.pattern: '^\['
multiline.negate: true
multiline.match: after

output.elasticsearch:
  hosts: ["localhost:9200"]
  pipeline: "rename_hostname"

setup.template.overwrite: true
setup.dashboards.overwrite: true
output.elasticsearch.index: "docker-one"
setup.template.name: "docker"
setup.template.pattern: "docker-*"
setup.dashboards.index: "docker-*"

setup.kibana:
  host: "localhost:5601"
```

And I execute this command in devtools in Kibana:

```auto
 PUT _ingest/pipeline/rename_hostname
{
  "processors": [
    {
      "rename": {
        "field": "hostname",
        "target_field": "host",
        "ignore_missing": true
      }
    }
  ]
}
```

... and nothing changes in kibana interface. What I did wrong?

---

<div class="post-metadata">

### Author: ![andrewkroh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrewkroh/32/3784_2.png) [@andrewkroh](https://discuss.elastic.co/u/andrewkroh)
#### Post date: [July 19, 2018, 9:13pm UTC](https://discuss.elastic.co/t/something-is-wrong-with-pipeline/140766/2 "2018-07-19T21:13:40Z")

</div>

Are there any errors in your Filebeat logs? Such as a mapping error for `host`? You might need to customize your index template if you intent to make `host` a keyword because in the latest version `host` [is mapped](https://github.com/elastic/beats/blob/v6.3.1/libbeat/processors/add_host_metadata/_meta/fields.yml#L7-L10) as an object. It does have a `host.name` field though.

---

<div class="post-metadata">

### Author: ![g.myznikov.tinkoff](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/g.myznikov.tinkoff/32/33582_2.png) [@g.myznikov.tinkoff](https://discuss.elastic.co/u/g.myznikov.tinkoff)
#### Post date: [July 20, 2018, 7:35am UTC](https://discuss.elastic.co/t/something-is-wrong-with-pipeline/140766/3 "2018-07-20T07:35:07Z")

</div>

Filebeat working fine and I dont get any errors. It does not matter for me what type of processors I have used. For example if my pipeline like:

```auto
PUT _ingest/pipeline/examplepipe
{
  "description" : "Change smth",
  "processors": [
    ]
}
```

then how I can understand: are me log files go through this pipeline? Because other processors seems do not work.

---

<div class="post-metadata">

### Author: ![andrewkroh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrewkroh/32/3784_2.png) [@andrewkroh](https://discuss.elastic.co/u/andrewkroh)
#### Post date: [July 20, 2018, 8:25pm UTC](https://discuss.elastic.co/t/something-is-wrong-with-pipeline/140766/4 "2018-07-20T20:25:47Z")

</div>

> [@g.myznikov.tinkoff](#):
>
> are me log files go through this pipeline?

Elasticsearch provides stats about each pipeline that you can use to check if any events are passing through.

`GET _nodes/stats/ingest`

Your config appears correct to me. But how about trying to put `pipeline` as part of the filebeat input config instead. [reference](https://www.elastic.co/guide/en/beats/filebeat/master/filebeat-input-log.html#_literal_pipeline_literal)

```auto
filebeat.inputs:
- type: log
  paths:
    - /var/log/*.log
  pipeline: my_pipeline

```

---

<div class="post-metadata">

### Author: ![g.myznikov.tinkoff](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/g.myznikov.tinkoff/32/33582_2.png) [@g.myznikov.tinkoff](https://discuss.elastic.co/u/g.myznikov.tinkoff)
#### Post date: [July 23, 2018, 7:35am UTC](https://discuss.elastic.co/t/something-is-wrong-with-pipeline/140766/5 "2018-07-23T07:35:44Z")

</div>

My problems seems to be solved. But I can't describe what exactly I was doing wrong. Thanks for some helpfull advices.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [August 20, 2018, 7:36am UTC](https://discuss.elastic.co/t/something-is-wrong-with-pipeline/140766/6 "2018-08-20T07:36:11Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
