Ingest fixed length data from internet

I have internet based web site, fixed length data, that I need to ingest. Question:

  1. Can beats be used - assuming have to use Logtash
  2. The input has about 100 fixed length. Is there a 'easy' way to define the fields - referring to How to parse data with fixed length but no separators - Elastic Stack / Logstash - Discuss the Elastic Stack
  3. The input file will need be unencrypted. Any help would be really appreciated

You can use just logstash to do this.
Logstash has an http_poller input that you can use.

If you post an example of the data then I can help you further.

Many thanks AquaX

Here is an extract of input file specification - the 1st column is a header. :
|Label|Width|
|Label1 |5|
|Label2|10|
|Label3|5|
|Label4|1|
|Label5|50|
|Label6|50|
|Label7|12|
|Label8|12|
|Label9|12|
|Label10|5|
|Label11|5|
|Label12|50|
|Label13|9|
|Label14|10|
|Label15|5|
|Label16|10|
|Label17|12|
|Label18|12|
|Label19|5|
etc...total 100 labels

Hoping this helps :slight_smile:

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.