I am strongly investigating the potential of ES for a use case we have but I am not really sure if I cannot make it do what I want it to do or if it is actually not designed for this. Any advice appreciadted
Say I am processing business objects (millions) are in particular states in one of several different systems.
Every time an object changes state, I receive a JSON document from that system describing the new state.
Each systems have different JSON mappings, but all contains the object ids. An object can only be inn one state and one system at once, and follows a flow: system 1 -> n.
Is ES able to answer these two questions:
- for all object ids, can I have the last state (or "last document ingested") by any of the systems at time T? ie. canI get the list of all last document by business object id at defined time T?
- Is it possible to aggregate on a state contained in the documents and have a dashboard in kibana based on this?
I tried to achieve on a local instance, but can't me head around the search feature for this use case .
Any idea ?