Ingesting daily health data into Logstash pipeline for time-series monitoring

Elastic Stack Elasticsearch
1

Hello everyone,

I am working on a Logstash pipeline to ingest and process daily health monitoring data from a home BP device.

The context of this data is post-operative recovery after a medical procedure (DIEP flap breast reconstruction surgery), and I need to track daily blood pressure readings for trend analysis.

My setup involves:

  1. Input: JSON/CSV BP readings from a home monitor
  2. Processing: Logstash filters for formatting timestamps and values
  3. Output: Elasticsearch index for visualization in Kibana

I would like guidance on:

  1. Best practice for structuring time-series health data in Logstash
  2. Recommended indexing strategy for daily BP readings
  3. Any tips for handling small but sensitive datasets efficiently
2

Hi @jesscia Welcome to the community.

There are a number of ways to ingest data into Elasticsearch of which logstash is just one. Is there a particular reason you want to use logstash – to learn or just because it seemed like a good fit?

How much data comes in each day?
Is this for like one person or is this a IoT and you expect to do this for thousands of users?

How does the data get from the device to the CSV or json?

Tell us a little bit more and perhaps we can help.

And of course if you give some sample date of people can definitely help.