Number of lines+ real-time data from SQL Server

Hi,
I retrieved from the database SQL SERVER 300 million lines with logstash and elasticsearch, now I want to visualize this data with kibana. So how to know the number of rows recorvred by kibana and how can i activate the real-time addition of the new data inserted in the database .

Best regards

The fastest way to get the total number of rows in a kibana index, you can use a small query in dev tools:

GET metricbeat-*/_search
{
  "query": {
    "match_all": {}
  },
  "size": 0
}

Since size is 0, it won't return the actual data. If you want the actual data you can expand your time range in discover, but the search may take more time to return.

See the total hit count in the response:

See "hits" in the upper left corner. The number is larger in this screenshot because my data is continually being indexed.

To visualize this data, you should explore the Visualize tab where you can create different types of charts, depending on your needs/data format.

As far as auto indexing data from SQL Server into Elasticsearch, you may need to find an external plugin to do so:
https://github.com/logstash-plugins/logstash-input-jdbc may do the trick. Looks like this link may have some useful information as well.

Thanks for your replay
In sql server I created this request (SELECT * FROM TRENDTABLE1 WHERE name LIKE '%AEP%' ) and I get 8000 lines but when i insert this request in file.conf and search in kibana i got this result


This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.