How to load json file into ES using logstash

Elastic Stack Logstash
10

Ok so, thank you for following my directions and formatting your input json. Now it's much easier to read.

Now, what you would like to achieve - if I got it right - is to split your events and from a source input like

{
  "0": {
    "foo":"bar0"
  },
  "1": {
    "foo":"bar1"
  },
  "2": {
    "foo":"bar2"
  }
}

obtain 3 separate Elastic documents like:

{
  "foo":"bar0"
}

{
  "foo":"bar1"
}

{
  "foo":"bar2"
}

rather than have one single document similar to the input event. Is that right?

If so, in order to avoid a heavy ruby filter, would it be possible for you to edit the sample.json file in input and make it something like this?

{
  "events": [
    {
      "foo": "bar0"
    },
    {
      "foo": "bar1"
    },
    {
      "foo": "bar2"
    }
  ]
}

which in your case would mean something like:

{
  "events": [
    {
      "text_clean": "to add an attachment to a thread do the follow 1 once you have create a thread you will see add attachment option on the left hand side 2 click on browse select a file and click do 3 you can add files up to 5 mb of size 4 read through the privacy policy and submit how to add attachment to a thread",
      "title": "How to add an Attachment to a thread",
      "ner": {},
      "text_clean_stem": [
        "option",
        "creat"
      ],
      "ner_hierarchy_display_content": {
        "neraction": [
          "create",
          "read"
        ],
        "nercategory": [
          "",
          "files"
        ]
      },
      "ner_hierarchy_display": {},
      "html_content": "<p>To add an Attachment to a thread, do the following:</p>\n1.\tOnce you have created a thread, you will see 'Add Attachment' option on the left hand side.\n2.\tClick on Browse, select a file and click done.\n3.\tYou can add files up to 5 MB of size.\n4.\tRead through the privacy policy and submit.",
      "std_title": "how to add attachment to a thread"
    },
    {
      "text_clean": "to add an attachment to a query do the follow 1 once you have create a query you will see add attachment option on the left hand side 2 click on browse select a file and click do 3 you can add files up to 5 mb of size 4 read through the privacy policy and submit steps to add attachments to a query",
      "title": "How to add an Attachment to a thread",
      "ner": {},
      "text_clean_stem": [
        "add",
        "attach"
      ],
      "ner_hierarchy_display_content": {
        "neraction": [
          "create",
          "read"
        ],
        "nercategory": [
          "",
          "files"
        ]
      },
      "ner_hierarchy_display": {},
      "html_content": "<p>To add an Attachment to a query, do the following:</p>\n1.\tOnce you have created a query, you will see 'Add Attachment' option on the left hand side.\n2.\tClick on Browse, select a file and click done.\n3.\tYou can add files up to 5 MB of size.\n4.\tRead through the privacy policy and submit.",
      "std_title": "steps to add attachments to a query"
    }
  ]
}