Adding 5000 JSON documents in elastic search

Elastic Stack Elasticsearch
1

Hello,

I am new to elastic search.

My use case is following, I had thousands of pdf and supporting xml files. I have converted the files into JSON and the JSON file has the following structure :

{
'' contentattributes'' : {
'' attribute'' : [
{
''@name'' : ''object_name'',
''@value'' : ''892378923_HP.PDF''
}
]
}
''content'' : '''Some content(multiple pages) in english\n''
}

Like above I have 5000 documents, I wish to put this into elastic search, and build a search engine to find which documents are relevant according to passed query.

As a first step, how can I put multiple documents. I could not find any solution on internet.

Thanks,
Ritesh

2

The bulk API is what you are looking for.

3

Thankyou @dadoonet!

I have seen examples of bulk API on web, however in those examples bulk API seems to use only one big json file to put into elastic search, but not multiple.

Is it like that, elastic search accepts one big JSON ?

4

You mean that you have 5000 json files on your hard disk and you want to send them to elasticsearch?
I thought you were speaking of JSON documents, not JSON files.

Well. Lot of options there.

  1. Build a shell script which creates the bulk
  2. Logstash file input might help (unsure though)
  3. FSCrawler has a json option which you can use as well

Probably others...

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.