# There are no data output to es with no error **URL:** \ **Category:** Logstash\ **Created:** [August 18, 2018, 11:49am UTC](https://discuss.elastic.co/t/there-are-no-data-output-to-es-with-no-error/145004 "2018-08-18T11:49:22Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![kennymarx0](https://avatars.discourse-cdn.com/v4/letter/k/8797f3/32.png) [@kennymarx0](https://discuss.elastic.co/u/kennymarx0)\ **Post date:** [August 18, 2018, 11:49am UTC](https://discuss.elastic.co/t/there-are-no-data-output-to-es-with-no-error/145004/1 "2018-08-18T11:49:23Z")
there are no data output to es with no error in logs. why haven't my data been imported? logs is below > [2018-08-18T19:42:13,315][INFO][logstash.outputs.elasticsearch] Attempting to install template {:manage\_template=\>{"index\_patterns"=\>"trxdetail-\*", "settings"=\>{"index"=\>{"analysis"=\>{"analyzer"=\>{"default"=\>{"type"=\>"ik\_max\_word"}}}}, "index.refresh\_interval"=\>"-1", "number\_of\_replicas"=\>"0", "number\_of\_shards"=\>"5"}, "mappings"=\>{"trx"=\>{"dynamic\_templates"=\>[{"dates"=\>{"match\_mapping\_type"=\>"date", "mapping"=\>{"type"=\>"date"}}}, {"strings"=\>{"match\_mapping\_type"=\>"string", "mapping"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"type"=\>"keyword", "ignore\_above"=\>256}}}}}], "properties"=\>{"ID"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "CUSNO"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "CUSACC"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "CUSNAME"=\>{"type"=\>"text", "analyzer"=\>"ik\_max\_word", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "OPPCUSNO"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "OPPACC"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "OPPNAME"=\>{"type"=\>"text", "analyzer"=\>"ik\_max\_word", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "OPPACCFLAG"=\>{"type"=\>"text", "analyzer"=\>"ik\_max\_word", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "CDFLAG"=\>{"type"=\>"text", "analyzer"=\>"ik\_max\_word", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "AMT"=\>{"type"=\>"double"}, "TRXDATE"=\>{"type"=\>"date", "format"=\>"yyyyMMdd"}, "TRXTIME"=\>{"type"=\>"date", "format"=\>"HHmmss"}, "TRXFLOW"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "TRXFLOWNO"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "ACCCODE"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "ACCNAME"=\>{"type"=\>"text", "analyzer"=\>"ik\_max\_word", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "BANKNO"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "BANKNAME"=\>{"type"=\>"text", "analyzer"=\>"ik\_max\_word", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "BRANCHNO"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "BRANCHNAME"=\>{"type"=\>"text", "analyzer"=\>"ik\_max\_word", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "TELLER"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "TERMINAL"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "CUSWILL"=\>{"type"=\>"text", "analyzer"=\>"ik\_max\_word", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "BUSICODE"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "BUSINAME"=\>{"type"=\>"text", "analyzer"=\>"ik\_max\_word", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "BUSICMMCODE"=\>{"type"=\>"text", "fields"=\>{"keyword"=\>{"ignore\_above"=\>256, "type"=\>"keyword"}}}, "BUSICMM"=\>{"type"=\>"text", "analyzer"=\>"ik\_max\_word"}, "BUSITECHCMM"=\>{"type"=\>"text", "analyzer"=\>"ik\_max\_word"}}}}}} > [2018-08-18T19:42:13,427][INFO][logstash.outputs.elasticsearch] Installing elasticsearch template to \_template/trx-template > [2018-08-18T19:42:13,524][INFO][logstash.outputs.elasticsearch] New Elasticsearch output {:class=\>"LogStash::Outputs::Elasticsearch", :hosts=\>["[//192.168.137.1:9200](https://192.168.137.1:9200)"]} > [2018-08-18T19:42:13,575][INFO][logstash.licensechecker.licensereader] Elasticsearch pool URLs updated {:changes=\>{:removed=\>, :added=\>[[http://elastic:xxxxxx@192.168.137.1:9200/](http://elastic:xxxxxx@192.168.137.1:9200/)]}} > [2018-08-18T19:42:13,579][INFO][logstash.licensechecker.licensereader] Running health check to see if an Elasticsearch connection is working {:healthcheck\_url=\>[http://elastic:xxxxxx@192.168.137.1:9200/](http://elastic:xxxxxx@192.168.137.1:9200/), :path=\>"/"} > [2018-08-18T19:42:13,599][WARN][logstash.licensechecker.licensereader] Restored connection to ES instance {:url=\>"[http://elastic:xxxxxx@192.168.137.1:9200/](http://elastic:xxxxxx@192.168.137.1:9200/)"} > [2018-08-18T19:42:13,627][INFO][logstash.licensechecker.licensereader] ES Output version determined {:es\_version=\>6} > [2018-08-18T19:42:13,630][WARN][logstash.licensechecker.licensereader] Detected a 6.x and above cluster: the `type` event field won't be used to determine the document \_type {:es\_version=\>6} > [2018-08-18T19:42:13,893][INFO][logstash.pipeline] Pipeline started successfully {:pipeline\_id=\>".monitoring-logstash", :thread=\>"#\"} > [2018-08-18T19:42:14,565][INFO][logstash.pipeline] Pipeline started successfully {:pipeline\_id=\>"main", :thread=\>"#\"} > [2018-08-18T19:42:14,702][INFO][logstash.agent] Pipelines running {:count=\>2, :running\_pipelines=\>[:main, :".monitoring-logstash"], :non\_running\_pipelines=\>} > [2018-08-18T19:42:14,736][INFO][logstash.inputs.metrics] Monitoring License OK > [2018-08-18T19:42:16,347][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=\>9600} and my configuration is > input { > file { > path =\> "C:\Application\logstash\script\data\zibotrxnew.csv" > #path =\> "C:\Application\logstash\script\data\zibotrxnewtest.csv" > start\_position =\> "beginning" > #sincedb\_path =\> "C:\Application\logstash\zibotrx.read" > sincedb\_path =\> "NUL" > } > } > > filter { > csv { > separator =\> "," > skip\_header =\> true > columns =\> ["ID","CUSNO","CUSACC","CUSNAME","OPPCUSNO","OPPACC","OPPNAME","OPPACCFLAG","CDFLAG","AMT","TRXDATE","TRXTIME","TRXFLOW","TRXFLOWNO","ACCCODE","ACCNAME","BANKNO","BANKNAME","BRANCHNO","BRANCHNAME","TELLER","TERMINAL","CUSWILL","BUSICODE","BUSINAME","BUSICMMCODE","BUSICMM","BUSITECHCMM"] > #autodetect\_column\_names =\> true > #remove\_field =\> ["host","path"] > } > > #date{ > > # match =\> ["TRXDATE", "yyyyMMdd"] > > #} > > #date{ > > # match =\> ["TRXTIME", "HHmmss"] > > #} > > #dissect { > > # mapping =\> { "message" =\> "%{TRXDATE}-%{TRXFLOW}-%{TRXFLOWNO}" } > > #} > > mutate > { > remove\_field =\> ["message","path","@version","@timestamp"] > } > } > > output { > > elasticsearch { > hosts =\> ["192.168.137.1:9200"] > user =\> "XXXXXX" > password =\> "XXXXXXXX" > > ``` > index => "trxdetail-zibo" > document_type=>"trx" > #document_id => "%{TRXDATE}-%{TRXFLOW}-%{TRXFLOWNO}" > > template => "C:\Application\logstash\script\template\trxdetail-template.json" > template_name => "trx-template" > template_overwrite => true > } > > ``` > > } ---
**Author:** ![kennymarx0](https://avatars.discourse-cdn.com/v4/letter/k/8797f3/32.png) [@kennymarx0](https://discuss.elastic.co/u/kennymarx0)\ **Post date:** [August 18, 2018, 12:06pm UTC](https://discuss.elastic.co/t/there-are-no-data-output-to-es-with-no-error/145004/2 "2018-08-18T12:06:06Z")
sorry, it's a mistake. the data have been imported into es, i could find them in es-head later. ---
**Author:** ![pavan\_padaki](https://avatars.discourse-cdn.com/v4/letter/p/8edcca/32.png) [@pavan\_padaki](https://discuss.elastic.co/u/pavan_padaki)\ **Post date:** [August 20, 2018, 7:11am UTC](https://discuss.elastic.co/t/there-are-no-data-output-to-es-with-no-error/145004/3 "2018-08-20T07:11:31Z")
I am also facing the same issue while parsing xml and output is not getting displayed anywhere ---
**Author:** ![kennymarx0](https://avatars.discourse-cdn.com/v4/letter/k/8797f3/32.png) [@kennymarx0](https://discuss.elastic.co/u/kennymarx0)\ **Post date:** [August 30, 2018, 3:46am UTC](https://discuss.elastic.co/t/there-are-no-data-output-to-es-with-no-error/145004/4 "2018-08-30T03:46:30Z")
u should delete the output file which record the information about what logstash have readed before. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [September 27, 2018, 3:46am UTC](https://discuss.elastic.co/t/there-are-no-data-output-to-es-with-no-error/145004/5 "2018-09-27T03:46:31Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.