# Logstash Error parsing csv java.lang.ArrayIndexOutOfBoundsException

**URL:** <https://discuss.elastic.co/t/logstash-error-parsing-csv-java-lang-arrayindexoutofboundsexception/144900>\
**Category:** Logstash\
**Created:** [August 17, 2018, 12:38pm UTC](https://discuss.elastic.co/t/logstash-error-parsing-csv-java-lang-arrayindexoutofboundsexception/144900 "2018-08-17T12:38:56Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![kennymarx0](https://avatars.discourse-cdn.com/v4/letter/k/8797f3/32.png) [@kennymarx0](https://discuss.elastic.co/u/kennymarx0)\
**Post date:** [August 17, 2018, 12:38pm UTC](https://discuss.elastic.co/t/logstash-error-parsing-csv-java-lang-arrayindexoutofboundsexception/144900/1 "2018-08-17T12:38:56Z")

</div>

when i use logstash to import data from csv file to elasticsearch, it has error like below and there are no data imported to es.

how to fix it?

```auto
 [2018-08-15T23:23:07,540][WARN][logstash.filters.csv] Error parsing csv {:field=>"message", :source=>"\"XXXXXXXXXXXXX\",\"XXXXXXXXXXXXX\",\"XXXXXXXXXXXXX\",\"XXXXXXXXXXXXX\",(null),\"XXXXXXXXXXXXX\",\"XXXXXXXXXXXXX\",\"XXXXXXXXXXXXX\",\"X\",100.00,20220602,\"XXXX\",\"XXXXXXXXXXXXX\",1,\"XXXXXXXXXXXXX\",\"XXXXXXXXXXXXX\",\"XXXXXXXXXXXXX\",\"XXXXXXXXXXXXX\",\"XXXXXXXXXXXXX\",\"XXXXXXXXXXXXX\",\"XXXXXXXXXXXXX\",(null),(null),\"XXXXXXXXXXXXX\",\"XXXXXXXXXXXXX\",\"XXXXXXXXXXXXX\",\"\",\"XXXXXXXXXXXXX\"\r", :exception=>java.lang.ArrayIndexOutOfBoundsException}

```

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [August 17, 2018, 1:08pm UTC](https://discuss.elastic.co/t/logstash-error-parsing-csv-java-lang-arrayindexoutofboundsexception/144900/2 "2018-08-17T13:08:06Z")

</div>

If you show us your Logstash configuration and an example line of input we might be able to help out.

---

<div class="post-metadata">

**Author:** ![kennymarx0](https://avatars.discourse-cdn.com/v4/letter/k/8797f3/32.png) [@kennymarx0](https://discuss.elastic.co/u/kennymarx0)\
**Post date:** [August 17, 2018, 1:35pm UTC](https://discuss.elastic.co/t/logstash-error-parsing-csv-java-lang-arrayindexoutofboundsexception/144900/3 "2018-08-17T13:35:31Z")

</div>

thanks for reply.

my configuration is like below

> input {  
> file {  
> path =\> "C:\Application\logstash\script\data\trx.csv"  
> start\_position =\> "beginning"  
> sincedb\_path =\> "C:\Application\logstash\trx.read"  
> }  
> }
> 
> filter {  
> csv {  
> separator =\> ","  
> autodetect\_column\_names =\> true  
> #remove\_field =\> ["host","path"]  
> }
> 
> date{  
> match =\> ["TRXDATE", "yyyyMMdd"]  
> }
> 
> date{  
> match =\> ["TRXTIME", "HHmmss"]  
> }
> 
> mutate  
> {  
> remove\_field =\> ["message","path","@version","@timestamp"]  
> }  
> }
> 
> output {
> 
> elasticsearch {  
> template =\> "C:\Application\logstash\script\template\trxdetail-template.json"  
> template\_name =\> "trx-template"  
> template\_overwrite =\> true
> 
> ```
> hosts => ["XXX.XXX.XXX:9200"]
> user => "XXXXX"
> password => "XXXXX"
>   	
> index => "trxdetail"
> document_type=>"trx"
> document_id => "%{TRXDATE}-%{TRXFLOW}-%{TRXFLOWNO}"
>   	
> }
> 
> ```
> 
> }

and example line is

> ID,CUSNO,CUSACC,CUSNAME,OPPCUSNO,OPPACC,OPPNAME,OPPACCFLAG,CDFLAG,AMT,TRXDATE,TRXTIME,TRXFLOW,TRXFLOWNO,ACCCODE,ACCNAME,BANKNO,BANKNAME,BRANCHNO,BRANCHNAME,TELLER,TERMINAL,CUSWILL,BUSICODE,BUSINAME,BUSICMMCODE,BUSICMM,BUSITECHCMM  
> "2017XXXXXXXXXXXXXXXXXXXXX","0115XXXXXXXXXXX","62XXXXXXXXXXXXXXXXXX","userXXXX",(null),"X7380XXXXXXXXXXXXXX","XXXXXXXXXXXXXXXX","inner acct","credit",619.00,20100902,"092900","EXXXXXXXXXXXX",1,"2XXXXXXXXX","TEST ACCOUNT","0XXXXXXXXXXXX","XXXXXXXXXXXX","0XXXXXXXXXXXXXX","XXXXXXXXXXXXXXXXXX","ECXXXXXX",(null),(null),"2TTTTTTTT","POSTRX","AXXXX","","PDXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 1"

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [August 17, 2018, 2:10pm UTC](https://discuss.elastic.co/t/logstash-error-parsing-csv-java-lang-arrayindexoutofboundsexception/144900/4 "2018-08-17T14:10:23Z")

</div>

Works with an older Logstash and `autodetect_column_names` disabled. Have you tried disabling column autodetection? If that works I'm guessing it's either

- a mismatch in the column count (more declared columns that actual columns, or vice versa) or
- a csv filter bug.

---

<div class="post-metadata">

**Author:** ![kennymarx0](https://avatars.discourse-cdn.com/v4/letter/k/8797f3/32.png) [@kennymarx0](https://discuss.elastic.co/u/kennymarx0)\
**Post date:** [August 17, 2018, 2:16pm UTC](https://discuss.elastic.co/t/logstash-error-parsing-csv-java-lang-arrayindexoutofboundsexception/144900/5 "2018-08-17T14:16:38Z")

</div>

thanks a lot, i try it. my es is version 6.3.0 and logstash is also 6.3.0

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 14, 2018, 2:16pm UTC](https://discuss.elastic.co/t/logstash-error-parsing-csv-java-lang-arrayindexoutofboundsexception/144900/6 "2018-09-14T14:16:49Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
