# Missing index issue

**URL:** <https://discuss.elastic.co/t/missing-index-issue/199060>\
**Category:** Logstash\
**Created:** [September 11, 2019, 10:32am UTC](https://discuss.elastic.co/t/missing-index-issue/199060 "2019-09-11T10:32:33Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![msk\_76](https://avatars.discourse-cdn.com/v4/letter/m/dbc845/32.png) [@msk\_76](https://discuss.elastic.co/u/msk_76)\
**Post date:** [September 11, 2019, 10:32am UTC](https://discuss.elastic.co/t/missing-index-issue/199060/1 "2019-09-11T10:32:33Z")

</div>

I have a java based application which reads an index sys\_username\_mapping. This index gets update once every day. My steps are :

1. initially load the index sys\_username\_mapping using filebeat+logstash for first time with a csv file.
2. Start my java application that reads sys\_username\_mapping index and it works well reading the index sys\_username\_mapping.
3. On 2nd day of data load into same index sys\_username\_mapping, the java application start giving me this error in the log file :

"ESWriter.initDependentData(ESWriter.java:258) Dependent index [sys\_username\_mapping] is  
missing."

This java application has to read data from sys\_username\_mapping index and write to another index. However it starts giving this error only after 2nd load of sys\_username\_mapping index.

Here is my logstash.conf file :  
input {  
beats {  
port =\> 5043  
client\_inactivity\_timeout =\> 432000  
}  
}

filter {

dissect {  
mapping =\> { "message" =\> "%{user\_name}:%{email}/%{site}/%{group}/%{division}/%{cad\_cc}/%{ldap\_cc}/%{acc\_type}" }  
}

grok {

```
    match => ["@timestamp", "%{YEAR:al_year}-%{MONTHNUM:al_month}-%{MONTHDAY:al_day}T%{HOUR:al_hr}:%{MINUTE:al_mn}:%{SECOND:al_ss}"]
    add_field => ["last_modified_utctimestamp", "%{al_year}-%{al_month}-%{al_day} %{al_hr}:%{al_mn}:%{al_ss}"]
    remove_field => "al_year"
    remove_field => "al_month"
    remove_field => "al_day"
    remove_field => "al_hr"
    remove_field => "al_mn"
    remove_field => "al_ss"
    }

```

mutate {  
convert =\> {  
"user\_name" =\> "string"  
"email" =\> "string"  
"site" =\> "string"  
"group" =\> "string"  
"division" =\> "string"  
"cad\_cc" =\> "string"  
"ldap\_cc" =\> "string"  
"acc\_type" =\> "string"  
}  
gsub =\> ["last\_modified\_utctimestamp", ":\d\d.\d\d\d$", ":00"]  
}  
date {  
match =\> ["last\_modified\_utctimestamp", "yyyy-MM-dd HH:mm:ss"]  
timezone =\> "Europe/Paris"  
target =\> "last\_modified\_time\_stamp"

}

ruby {  
code =\> "try = DateTime.parse(event.get('last\_modified\_utctimestamp'))  
event.set('last\_modified\_utc',try.strftime('%Q')) "  
}  
}

output {  
elasticsearch {  
hosts =\> ["[http://xxxx.xxxx.xxxx.xxxx:9200](http://xxxx.xxxx.xxxx.xxxx:9200)"]  
index =\> "sys\_username\_mapping"  
document\_id =\> "%{user\_name}"  
}  
}

I am able to list sys\_username\_mapping index and see it's contents using curl but the java application is not able to see it. I suspect that java application is not able to reload the state with new data? Should I use action =\> "update" ? It's really difficult to debug

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 9, 2019, 10:32am UTC](https://discuss.elastic.co/t/missing-index-issue/199060/2 "2019-10-09T10:32:36Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.