I am looking for a solution to get all the records from the elasticsearch for visualization.
It seems only 10000 documents can be visualized at a time.
I went through elasticsearch documentation and found out that "scroll" would be an option. I could use this approach in python to loop through all the documents no matter how many documents exists in elasticsearch.
But i want to get all the documents for visualization in a scatter plot and i am trying to find a way to include the main search query (which would get me default 10000 docs) together with the scroll query (which would get me the all or remaining documents). In dev tools (console) of kibana, i have to use two separate queries but not sure about the way to use these queries in scatter plot or in any other visualization tools. It seems combining these two queries together wont work.
Any suggestions would be really appreciated..