I'm trying to import a directory of .json files into elasticsearch. The files are not prettified and have no newline characters. They are valid JSON according to jsonlint but I cannot import them into elasticsearch.
Here is an example of the data:
[{"Author":"Adam Watts \u003cadamwatts@hooey.com\u003e","Content-Length":"634","Content-Type":"message/rfc822","Creation-Date":"2018-07-31T15:35:47Z","Message-From":"Adam Watts \u003cadamwatts@hooey.com\u003e","Message:From-Email":"adamwatts@hooey.com","Message:From-Name":"Adam Watts","Message:Raw-Header:MIME-Version":"1.0","Message:Raw-Header:Message-ID":"\u003cCANy\u003d\u003dEdFpmKewnGbz94WQGDQe12uEgToiqPjLdYFtScWGPqEUg@mail.hooey.com\u003e","Message:Raw-Header:Received":"by 2002:a9d:7547:0:0:0:0:0 with HTTP; Tue, 31 Jul 2018 08:35:47 -0700 (PDT)","Multipart-Boundary":"000000000000ffba2e05724d5480","Multipart-Subtype":"alternative","X-Parsed-By":["org.apache.tika.parser.DefaultParser","org.apache.tika.parser.mail.RFC822Parser"],"X-TIKA:content":"\u003chtml xmlns\u003d"http://www.w3.org/1999/xhtml"\u003e\n\u003chead\u003e\n\u003cmeta name\u003d"X-Parsed-By" content\u003d"org.apache.tika.parser.DefaultParser" /\u003e\n\u003cmeta name\u003d"X-Parsed-By" content\u003d"org.apache.tika.parser.mail.RFC822Parser" /\u003e\n\u003cmeta name\u003d"creator" content\u003d"Adam Watts \u0026lt;adamwatts@hooey.com\u0026gt;" /\u003e\n\u003cmeta name\u003d"meta:author" content\u003d"Adam Watts \u0026lt;adamwatts@hooey.com\u0026gt;" /\u003e\n\u003cmeta name\u003d"meta:creation-date" content\u003d"2018-07-31T15:35:47Z" /\u003e\n\u003cmeta name\u003d"subject" content\u003d" " /\u003e\n\u003cmeta name\u003d"dc:creator" content\u003d"Adam Watts \u0026lt;adamwatts@hooey.com\u0026gt;" /\u003e\n\u003cmeta name\u003d"tika_batch_fs:relative_path" content\u003d"20180731-no_subject-21868.eml" /\u003e\n\u003cmeta name\u003d"Creation-Date" content\u003d"2018-07-31T15:35:47Z" /\u003e\n\u003cmeta name\u003d"resourceName" content\u003d"20180731-no_subject-21868.eml" /\u003e\n\u003cmeta name\u003d"dcterms:created" content\u003d"2018-07-31T15:35:47Z" /\u003e\n\u003cmeta name\u003d"Message:From-Email" content\u003d"adamwatts@hooey.com" /\u003e\n\u003cmeta name\u003d"Message:Raw-Header:MIME-Version" content\u003d"1.0" /\u003e\n\u003cmeta name\u003d"Multipart-Boundary" content\u003d"000000000000ffba2e05724d5480" /\u003e\n\u003cmeta name\u003d"Message:Raw-Header:Message-ID" content\u003d"\u0026lt;CANy\u003d\u003dEdFpmKewnGbz94WQGDQe12uEgToiqPjLdYFtScWGPqEUg@mail.hooey.com\u0026gt;" /\u003e\n\u003cmeta name\u003d"dc:title" content\u003d" " /\u003e\n\u003cmeta name\u003d"tika:file_ext" content\u003d"eml" /\u003e\n\u003cmeta name\u003d"Message:From-Name" content\u003d"Adam Watts" /\u003e\n\u003cmeta name\u003d"Author" content\u003d"Adam Watts \u0026lt;adamwatts@hooey.com\u0026gt;" /\u003e\n\u003cmeta name\u003d"Multipart-Subtype" content\u003d"alternative" /\u003e\n\u003cmeta name\u003d"Message:Raw-Header:Received" content\u003d"by 2002:a9d:7547:0:0:0:0:0 with HTTP; Tue, 31 Jul 2018 08:35:47 -0700 (PDT)" /\u003e\n\u003cmeta name\u003d"Content-Length" content\u003d"634" /\u003e\n\u003cmeta name\u003d"X-TIKA:digest:MD5" content\u003d"3999400e0c25c6c14d591d030cd947df" /\u003e\n\u003cmeta name\u003d"Message-From" content\u003d"Adam Watts \u0026lt;adamwatts@hooey.com\u0026gt;" /\u003e\n\u003cmeta name\u003d"Content-Type" content\u003d"message/rfc822" /\u003e\n\u003ctitle\u003e \u003c/title\u003e\n\u003c/head\u003e\n\u003cbody\u003einsurance health center. - \n\n\n\u003c/body\u003e\u003c/html\u003e","X-TIKA:digest:MD5":"3999400e0c25c6c14d591d030cd947df","X-TIKA:parse_time_millis":"10","creator":"Adam Watts \u003cadamwatts@hooey.com\u003e","dc:creator":"Adam Watts \u003cadamwatts@hooey.com\u003e","dc:title":" ","dcterms:created":"2018-07-31T15:35:47Z","meta:author":"Adam Watts \u003cadamwatts@hooey.com\u003e","meta:creation-date":"2018-07-31T15:35:47Z","resourceName":"20180731-no_subject-21868.eml","subject":" ","tika:file_ext":"eml","tika_batch_fs:relative_path":"20180731-no_subject-21868.eml"}]
- What's the right way to insert this file into elasticsearch?
- What's the right way to import a directory full of these files into elasticsearch?