# Not seeing the logs up in Kibana after updating my pipelines thru the API

**URL:** <https://discuss.elastic.co/t/not-seeing-the-logs-up-in-kibana-after-updating-my-pipelines-thru-the-api/96802>\
**Category:** Kibana\
**Created:** [August 11, 2017, 4:31pm UTC](https://discuss.elastic.co/t/not-seeing-the-logs-up-in-kibana-after-updating-my-pipelines-thru-the-api/96802 "2017-08-11T16:31:59Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![mmugabo](https://avatars.discourse-cdn.com/v4/letter/m/f08c70/32.png) [@mmugabo](https://discuss.elastic.co/u/mmugabo)\
**Post date:** [August 11, 2017, 4:31pm UTC](https://discuss.elastic.co/t/not-seeing-the-logs-up-in-kibana-after-updating-my-pipelines-thru-the-api/96802/1 "2017-08-11T16:31:59Z")

</div>

Morning all,  
I have an issue, my logs were being pushed and view-able into kibana until I made pipeline update, I am using:

- Elastic search 5.4.0
- Filebeat 5.3.1
- Kibana not sure but it must be 5.4.0 too, I did not set the environment up...

So, in short, my logs were being pushed fine, but when I wanted to update my grok pattern, I made a pipeline update thru my postman successfully, then I am not seeing my logs in kibana anymore, I can see that the logs are being pushed while tailing the filebeat log, but when I refresh kibana, I don't see my logs anymore. Please tell me what could be the reason?

And what is STRANGE is, there is one log file that keeps working fine, meaning, if I edit my filebeat.yml and say "paths: /mypath/logs/\*.log OR /request.log" only one log goes into kibana, that is the request.log, but if I put "paths: /mypath/logs/myproject.log", nothing comes up in kibana, and this same file together with all others were showing up before I made a pipeline update...

Here is my pipeline update "PUT" request payload, and I am sending it to: {{host}}/\_ingest/pipeline/xyz\_pipeline

* * *

## { "description" : "Description xyz pipeline", "processors": [{ "gsub": { "field": "message", "pattern": "\n", "replacement": "\\n" } }, { "grok": { "field": "message", "patterns": ["%{IPORHOST:log.clientip} %{USER:log.ident} %{USER:log.auth} %{HTTPDATE:log.rawdatetime} "(?:%{WORD:log.verb} %{NOTSPACE:log.request}(?: HTTP/%{NUMBER:log.httpversion})?|%{DATA:log.rawrequest})" %{NUMBER:log.response} (?:%{NUMBER:log.bytes}|-)","%{DATE\_EU:log.date} %{TIME:log.time} %{DATA:log.module} %{GREEDYDATA:log.message}"], "on\_failure": [{ "set":{ "field": "ingestError", "value": "{{ \_ingest.on\_failure\_message }}" } }, { "set":{ "field": "log.datetime", "value": "{{ @timestamp }}" } }] } } ] }

I can see this being printed out in my filebeat log, which tells me (I think) that the logs are being pushed to elastic:

2017-08-11T12:16:37-04:00 INFO Non-zero metrics in the last 30s: filebeat.harvester.open\_files=1 filebeat.harvester.running=1 filebeat.harvester.started=1 libbeat.es.call\_count.PublishEvents=1 libbeat.es.publish.read\_bytes=1804 libbeat.es.publish.write\_bytes=136541 libbeat.es.published\_and\_acked\_events=1 libbeat.publisher.published\_events=1 publish.events=10 registrar.states.current=153 registrar.states.update=10 registrar.writes=2

Advice appreciated....

---

<div class="post-metadata">

**Author:** ![bhavyarm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bhavyarm/32/22392_2.png) [@bhavyarm](https://discuss.elastic.co/u/bhavyarm)\
**Post date:** [August 14, 2017, 4:42pm UTC](https://discuss.elastic.co/t/not-seeing-the-logs-up-in-kibana-after-updating-my-pipelines-thru-the-api/96802/2 "2017-08-14T16:42:19Z")

</div>

Hi,

Do you have data in ES? After you updated your pipeline?  
If you can do [http://localhost:9200/\_ca/indices?v](http://localhost:9200/_ca/indices?v) and see if you are getting your data?

Thanks,  
Bhavya

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 11, 2017, 4:42pm UTC](https://discuss.elastic.co/t/not-seeing-the-logs-up-in-kibana-after-updating-my-pipelines-thru-the-api/96802/3 "2017-09-11T16:42:20Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
