Elasticsearch index issues

Elastic Stack Elasticsearch
1

i have an Ubuntu 16.04 VM running ELK stack.

installed an older versions of elastic, kibana, lostash and wrote an index to pull data from a MySQL database. it worked.

updated kibana and elastic to 5.1.2 and logstash to 5. something

added xpack to kibana and elastic

disabled security (this is only a proof of concept)

updated the xpack license

now the graph plugin doesnt work; its not present in Kibana UI.
logstash logs show no errors and that data is being pulled from the database.

i have the free BASIC license: no sure if this is a problem:
ubuntu@ubuntu-VirtualBox:~$ curl -XGET localhost:9200/.monitoring-es-2-2017.01.17?pretty
{
"error" : {
"root_cause" : [
{
"type" : "index_not_found_exception",
"reason" : "no such index",
"resource.type" : "index_or_alias",
"resource.id" : ".monitoring-es-2-2017.01.17",
"index_uuid" : "na",
"index" : ".monitoring-es-2-2017.01.17"
}
],
"type" : "index_not_found_exception",
"reason" : "no such index",
"resource.type" : "index_or_alias",
"resource.id" : ".monitoring-es-2-2017.01.17",
"index_uuid" : "na",
"index" : ".monitoring-es-2-2017.01.17"
},
"status" : 404
}

from the elasticsearch log:
[2017-02-03T09:56:20,470][ERROR][o.e.x.m.AgentService ] [v2HOWFX] exception when exporting documents
org.elasticsearch.xpack.monitoring.exporter.ExportException: failed to flush export bulks
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$Compound.doFlush(ExportBulk.java:148) ~[x-pack-5.1.2.jar:5.1.2]
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk.close(ExportBulk.java:77) ~[x-pack-5.1.2.jar:5.1.2]
at org.elasticsearch.xpack.monitoring.exporter.Exporters.export(Exporters.java:183) ~[x-pack-5.1.2.jar:5.1.2]
at org.elasticsearch.xpack.monitoring.AgentService$ExportingWorker.run(AgentService.java:208) [x-pack-5.1.2.jar:5.1.2]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_121]
Caused by: org.elasticsearch.xpack.monitoring.exporter.ExportException: failed to flush export bulk [default_local]
at org.elasticsearch.xpack.monitoring.exporter.local.LocalBulk.doFlush(LocalBulk.java:114) ~[?:?]
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk.flush(ExportBulk.java:62) ~[?:?]
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$Compound.doFlush(ExportBulk.java:145) ~[?:?]
... 4 more
Caused by: org.elasticsearch.xpack.monitoring.exporter.ExportException: bulk [default_local] reports failures when exporting documents
at org.elasticsearch.xpack.monitoring.exporter.local.LocalBulk.throwExportException(LocalBulk.java:121) ~[?:?]
at org.elasticsearch.xpack.monitoring.exporter.local.LocalBulk.doFlush(LocalBulk.java:111) ~[?:?]
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk.flush(ExportBulk.java:62) ~[?:?]
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$Compound.doFlush(ExportBulk.java:145) ~[?:?]
... 4 more

2

logstash-plain.log:
[2017-02-03T10:23:00,159][INFO ][logstash.inputs.jdbc ] (0.111000s) SELECT * from testtable
[2017-02-03T10:23:03,526][INFO ][logstash.outputs.elasticsearch] Elasticsearch pool URLs updated {:changes=>{:removed=>["http://localhost:9200"], :added=>[]}}
[2017-02-03T10:23:08,544][WARN ][logstash.outputs.elasticsearch] UNEXPECTED POOL ERROR {:e=>#<LogStash::Outputs::ElasticSearch::HttpClient::Pool::NoConnectionAvailableError: No Available connections>}
[2017-02-03T10:23:08,545][WARN ][logstash.outputs.elasticsearch] Elasticsearch output attempted to sniff for new connections but cannot. No living connections are detected. Pool contains the following current URLs {:url_info=>{}}

3

and heres my configuration:

input {
jdbc {
jdbc_driver_library => "/usr/share/java/mysql-connector-java-5.1.38.jar"
jdbc_driver_class => "com.mysql.jdbc.Driver"
jdbc_connection_string => "jdbc:mysql://localhost:3306/testdb"
jdbc_validate_connection => true
jdbc_user =>
jdbc_password =>
schedule => "* * * * *"
statement => "SELECT * from testtable"
}
}
output {
elasticsearch{
index => "test-migrate"
document_type => "table"
document_id => "PersonID"
hosts => "localhost:9200"
sniffing => false
}
stdout{
codec => json_lines
}

4

Basic licenses do not have access to Graph.

5

i eventually figured out the BASIC license restriction.

what about the "type" : "index_not_found_exception"?

6

Doe the index exist?

7

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.