# Logstash-InfluxDB plugin doesnot send complete data to InfluxDB **URL:** https://discuss.elastic.co/t/logstash-influxdb-plugin-doesnot-send-complete-data-to-influxdb/182729 **Category:** Logstash **Created:** [May 24, 2019, 10:39pm UTC](https://discuss.elastic.co/t/logstash-influxdb-plugin-doesnot-send-complete-data-to-influxdb/182729 "2019-05-24T22:39:43Z") **Posts on this page:** 6 **Page:** 1
### Author: ![naveenrt23](https://avatars.discourse-cdn.com/v4/letter/n/47e85d/32.png) [@naveenrt23](https://discuss.elastic.co/u/naveenrt23) #### Post date: [May 24, 2019, 10:39pm UTC](https://discuss.elastic.co/t/logstash-influxdb-plugin-doesnot-send-complete-data-to-influxdb/182729/1 "2019-05-24T22:39:44Z")
Hello, I am trying to send data from Logstash(6.2.3) to influxDB(1.7.5) using Logstash-influxDB plugin. I tried to send 10 lines of logs where 7 lines went through and 3 lines didn’t get into InfluxDB. I tried to figure out whats the odd part but couldn’t figure out the issue. **LOGS sent:** ```auto 20190524193000|18|REQUEST|10.194.20.31|cctg-npm-deployer|GET|/api/npm/cctg-npm-npm/iconv-lite|HTTP/1.1|304|0 20190524193000|26|REQUEST|10.194.20.31|cctg-npm-deployer|GET|/api/npm/cctg-npm-npm/grunt-legacy-util|HTTP/1.1|200|0 20190524193000|3|REQUEST|10.194.20.31|cctg-npm-deployer|GET|/api/npm/cctg-npm-npm/colors/-/colors-0.6.2.tgz|HTTP/1.1|200|6289 20190524193000|30|REQUEST|10.194.20.31|cctg-npm-deployer|GET|/api/npm/cctg-npm-npm/js-yaml|HTTP/1.1|304|0 20190524193000|7|REQUEST|10.194.20.31|cctg-npm-deployer|GET|/api/npm/cctg-npm-npm/iconv-lite/-/iconv-lite-0.2.11.tgz|HTTP/1.1|200|235160 20190524193000|0|REQUEST|10.25.79.236|non_authenticated_user|GET|/api/docker/docker-login/v2/|HTTP/1.1|401|0 20190524193000|5|REQUEST|10.25.79.236|anonymous|GET|/api/docker/docker-login/v2/token|HTTP/1.1|200|0 20190524193000|5|REQUEST|173.39.45.237|content-security-builds-deployer|GET|/api/storage/content-security-builds-snapshot/ESA/phoebe-12-1-br/|HTTP/1.1|200|0 20190524193000|4|REQUEST|10.194.20.31|cctg-npm-deployer|GET|/api/npm/cctg-npm-npm/which/-/which-1.0.9.tgz|HTTP/1.1|200|2285 ``` **Logs didnot go through** (3 logs didnot go through) ```auto 20190524193000|4|REQUEST|10.194.20.31|cctg-npm-deployer|GET|/api/npm/cctg-npm-npm/nopt/-/nopt-1.0.10.tgz|HTTP/1.1|200|10240 20190524193000|26|REQUEST|10.194.20.31|cctg-npm-deployer|GET|/api/npm/cctg-npm-npm/grunt-legacy-util|HTTP/1.1|200|0 20190524193000|7|REQUEST|10.194.20.31|cctg-npm-deployer|GET|/api/npm/cctg-npm-npm/iconv-lite/-/iconv-lite-0.2.11.tgz|HTTP/1.1|200|235160 ``` **Logstash filter** ```auto grok { # Enable multiple matchers break_on_match => false match => { "message" => "%{DATA:timestamp_local}\|%{NUMBER:duration}\|%{WORD:requesttype}\|%{IP:ip}\|%{DATA:username}\|%{WORD:method}\|%{DATA:resource}\|%{DATA:protocol}\|%{NUMBER:statuscode}\|%{NUMBER:bytes}" } # Extract repo and path match => { "resource" => "/%{DATA:repo}/%{GREEDYDATA:resource_path}"} # Extract resource name match => { "resource_path" => "(?[^/]+$)" } # Extract file extension match => { "resource_path" => "(?[^.]+$)" } } ``` **Logstash outputs** ```auto influxdb { host => "***.*.*.*" db => "testing" port => 8086 codec => "json" measurement => "requests" send_as_tags => ["ip","repo","site"] use_event_fields_for_data_points => true exclude_fields => ["@timestamp","timestamp","timestamp_object","timestamp_local","protocol","message","@version"] coerce_values => { 'bytes' => 'integer' 'duration' => 'integer'} } ``` **when i tried to query influxdb** ```auto select bytes,ip,resource_path,username from requests name: requests time bytes ip resource_path username ---- ----- -------- ------------- -------- 1558726546126000000 0 10.194.20.31 npm/cctg-npm-npm/iconv-lite cctg-npm-deployer 1558726546153000000 0 10.194.20.31 npm/cctg-npm-npm/js-yaml cctg-npm-deployer 1558726546160000000 0 10.25.79.236 docker/docker-login/v2/ non_authenticated_user 1558726546160000000 6289 10.194.20.31 npm/cctg-npm-npm/colors/-/colors-0.6.2.tgz cctg-npm-deployer 1558726546161000000 0 10.25.79.236 docker/docker-login/v2/token anonymous 1558726546161000000 0 173.39.45.237 storage/content-security-builds-snapshot/ESA/phoebe-12-1-br/ content-security-builds-deployer 1558726551069000000 2285 10.194.20.31 npm/cctg-npm-npm/which/-/which-1.0.9.tgz cctg-npm-deployer ``` I tried enabling debug logs in logstash but that didnot help and neither does influxdb throw any errors. **UPDATE 1:** I cleaned out influxDB and tested using the same logs again but this time different set of logs went through Can anyone see whats missing ? Thanks ---
### Author: ![naveenrt23](https://avatars.discourse-cdn.com/v4/letter/n/47e85d/32.png) [@naveenrt23](https://discuss.elastic.co/u/naveenrt23) #### Post date: [May 29, 2019, 12:14pm UTC](https://discuss.elastic.co/t/logstash-influxdb-plugin-doesnot-send-complete-data-to-influxdb/182729/2 "2019-05-29T12:14:11Z")
Bump ! can anyone take a look at this please? ---
### Author: ![naveenrt23](https://avatars.discourse-cdn.com/v4/letter/n/47e85d/32.png) [@naveenrt23](https://discuss.elastic.co/u/naveenrt23) #### Post date: [May 30, 2019, 2:53pm UTC](https://discuss.elastic.co/t/logstash-influxdb-plugin-doesnot-send-complete-data-to-influxdb/182729/3 "2019-05-30T14:53:33Z")
Bump ---
### Author: ![naveenrt23](https://avatars.discourse-cdn.com/v4/letter/n/47e85d/32.png) [@naveenrt23](https://discuss.elastic.co/u/naveenrt23) #### Post date: [May 31, 2019, 3:48am UTC](https://discuss.elastic.co/t/logstash-influxdb-plugin-doesnot-send-complete-data-to-influxdb/182729/4 "2019-05-31T03:48:50Z")
Bump ---
### Author: ![naveenrt23](https://avatars.discourse-cdn.com/v4/letter/n/47e85d/32.png) [@naveenrt23](https://discuss.elastic.co/u/naveenrt23) #### Post date: [June 4, 2019, 6:03pm UTC](https://discuss.elastic.co/t/logstash-influxdb-plugin-doesnot-send-complete-data-to-influxdb/182729/5 "2019-06-04T18:03:55Z")
Bump ---
### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system) #### Post date: [July 2, 2019, 6:04pm UTC](https://discuss.elastic.co/t/logstash-influxdb-plugin-doesnot-send-complete-data-to-influxdb/182729/6 "2019-07-02T18:04:03Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.