Get only the last record

Elastic Stack Logstash
1

Hello ,

Im using logstash and jdbc driver to import my data to ES.

but when i look for data using ,i only find the last record?

my conf:

input {
jdbc {
jdbc_connection_string => "jdbc:sqlserver:myconnexion;databaseName=mydb"
jdbc_user => "myusername"
jdbc_password => "mypass"
jdbc_driver_library => "D:\ES\sqljdbc42.jar"
jdbc_driver_class => "com.microsoft.sqlserver.jdbc.SQLServerDriver"
statement => "sql statement"

}
}
filter {

}
output {
stdout { codec => rubydebug }
elasticsearch {
#protocol => http
index => "myindex"
document_type => "mytype"
document_id => "%{myid}"
hosts => "localhost"

    }

}

2

Does the SQL query return a column named myid or are you creating that field elsewhere? It probably doesn't so all documents get the same document id, overwriting each other all the time.

3

Thank you for your answer!

yes my sql query return the named column

4

Please show an example document from Elasticsearch or your stdout { codec => rubydebug } output.

5

ccc1.PNG1173×435 35 KB

assuming that myid is :BusinessEntityID

6

Field names are case-sensitive (BusinessEntityID vs. businessentityid).

7

Thank you so much ,for your help !

8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.