hi, i'm throwing a huge amount of log data into ES each month. i'm trying to create a python script to build a report at the end of the month. my first query i need to make is to query the index and get all the unique IP addresses and the count of how many times those IP addresses hit our network.…

thank you that helped a lot, i think i got it.. just for future reference.. this seems to work.. its just test code, so its not pretty but you'll get the idea. def query_test(self,es_host, es_index, es_field, startDate, endDate): # Define a default Elasticsearch client client = connection…

Python3 query with large results, best approach

Elastic Stack Elasticsearch

Emanuil (Emanuil Tolev) December 3, 2020, 11:25pm 7

You might find this blog post on high cardinality terms aggregation optimisations useful. This forum topic may also help you, in particular the examples of aggregation partitioning being discussed.

Topic		Replies	Views
Python3 Elastic Query returns large amount of results.. am i doing this right? Elasticsearch	1	342	December 29, 2020
Python3 Large Query Cardinality & Query return different results Elasticsearch	5	329	December 15, 2020
Increase size limit - Python ElasticSearch Elasticsearch language-clients	8	986	March 22, 2021
Indexing Aggregate Results Logstash	1	231	November 4, 2019
Elasticsearch Result Size Elasticsearch	2	6031	July 5, 2017

Python3 query with large results, best approach

Related topics