I am trying to find a clever approach to screen / index / search / connect all kinds of data that go throug my company's Enterprise Service Bus (WSO2). The files are mostly HL7, XML and JSON. Sometimes there are Scans (PDF) or Images (BMP) but these files are not the focus. We kept all the files passing our ESB in the past two years.
Now we feel it is time to use this data meaning make it searchable, connect and analyze it.
My main question is: Is the current Version of Elasticsearch able to work as a file dump / file store, analytics engine and presentation layer? Is there a way to deal with formats like HL7 effectively? Would it be smarter to use another product like MongoDB and search it with Elasticsearch? Or use a completely different product?
Another question is: Does anybody know of a published project that did something similar?
I would be highly interested in best practices.