I'm new in the ELK system building and configuration and have a few challenges.
I am unable to add index for parsed data from elastic search index management. I however can see the the parsed data from Kibana index pattern but when l try create the index it takes forever to create the index. Please assist.
I am pulling data from a SQL database using the below string in logstash
input {
jdbc {
jdbc_connection_string => //HostName\instanceName;database=DBName;user=UserName;password=Password"
jdbc_user => User
jdbc_driver_library => "C:\Program Files\Microsoft JDBC Driver 6.2 for SQL Server\sqljdbc_6.2\enu\sqljdbc4-2.0.jar"
jdbc_driver_class => "com.microsoft.sqlserver.jdbc.SQLServerDriver"
statement => "SELECT TOP 100 * FROM Example_table"
}
}
output {
#stdout { codec => json_lines }
elasticsearch {
hosts => ["localhost:9200"]
}
}
Below is the response from elastic search indices in the index management stats and health state is continuously yellow.
{
"_shards": {
"total": 2,
"successful": 1,
"failed": 0
},
"stats": {
"uuid": "swDiyIk-TyWagC_vrSOOgg",
"primaries": {
"docs": {
"count": 35320,
"deleted": 0
},
"store": {
"size_in_bytes": 10176016
},
"indexing": {
"index_total": 35320,
"index_time_in_millis": 15253,
"index_current": 0,
"index_failed": 0,
"delete_total": 0,
"delete_time_in_millis": 0,
"delete_current": 0,
"noop_update_total": 0,
"is_throttled": false,
"throttle_time_in_millis": 0
},
In Kibana index pattern l can see the indices but when l try create the index it takes forever to create. Kindly assist not sure what could be the issue.
See below for kibana screenshots
System keeps on saying creating index forever
