Aggregation with java High Level Rest Client

Elastic Stack Elasticsearch
1

I manage to create a working query but I'm having hard time converting it to java.

Working query: GET edgedevicedata/_search { "size": 0, "aggs": { "by_days": { "date_histogram": { "field": "@timestamp", "fixed_interval": "3d" }, "aggs": { "totalValue": { "sum": { "field": "value" } },"minValue": { "min": { "field": "value" } },"maxValue": { "max": { "field": "value" } },"avgValue": { "avg": { "field": "value" } } } } } }

My java code; `RestHighLevelClient client = new RestHighLevelClient(builder);

    //range query for start and end date
    QueryBuilder rangeQuery = QueryBuilders
            .rangeQuery("time")
            .from("0")
            .to("999999999999999999")
            .includeLower(false)
            .includeUpper(false);

    //term query for sensorId (sensor type)
    QueryBuilder termsQuery = QueryBuilders.boolQuery()
            .must(QueryBuilders.termsQuery("sensorId","1"));

    //term query for deviceId
    QueryBuilder termsQuery2 = QueryBuilders.boolQuery()
            .must(QueryBuilders.termsQuery("deviceId","device1"));

    //combining 3 querries
    QueryBuilder qb = QueryBuilders
            .boolQuery()
            .must(rangeQuery)
            .must(termsQuery)
            .must(termsQuery2);


    //creating search request
    SearchRequest searchRequest = new SearchRequest();
    SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
    searchSourceBuilder.query(qb);
    searchSourceBuilder.from(0);
    searchSourceBuilder.size(1000);


    DateHistogramAggregationBuilder dateAggregation=
            AggregationBuilders.dateHistogram("date_aggregation")
                    .field("timestamp")
                    .fixedInterval(DateHistogramInterval.days(1))
            .subAggregation(AggregationBuilders.max("maxValue")
                .field("value"))
            .subAggregation(AggregationBuilders.min("minValue")
                    .field("value"))
            .subAggregation(AggregationBuilders.avg("avgValue")
                    .field("value"))
            .subAggregation(AggregationBuilders.sum("totalValue")
                    .field("value"));


    searchSourceBuilder.aggregation(dateAggregation);
    searchRequest.source(searchSourceBuilder);


    //setting up for response
    SearchResponse searchResponse = client.search(searchRequest, RequestOptions.DEFAULT);

    //getting gits
    SearchHits hits = searchResponse.getHits();`

Expected output example: "aggregations" : { "by_minute" : { "buckets" : [ { "key_as_string" : "2019-12-28T00:00:00.000Z", "key" : 1577491200000, "doc_count" : 6, "totalValue" : { "value" : 125.0 }, "avgValue" : { "value" : 20.833333333333332 }, "minValue" : { "value" : 15.0 }, "maxValue" : { "value" : 29.0 } }

Output im getting: { "_index" : "edgedevicedata", "_type" : "_doc", "_id" : "rDryZ28BtB64rZAMaqqO", "_score" : 3.0, "_source" : { "sensorId" : 1, "deviceId" : "device1", "time" : 1577996937761, "value" : 29.0, "@version" : "1", "@timestamp" : "2020-01-02T20:28:57.766Z" } }

I'm sorry about the format of queries but I don't know how to make them look good.

2

I decided to ditch high level client and used low level client.

It works even though it looks awful.

3

Welcome!

Here is how I'm writing that kind of thing in another project.
Hope this could help.

4

Thank you very much,

I just realized after reading your code that I'm actually printing hits, not aggregations. There wasn't any problem with my code :slight_smile:

I'm glad I found it before someone else so I can be less embarrassed.

To print the aggregations above you can use this Its raw but usable:

        Histogram agg = searchResponse.getAggregations().get("date_aggregation");

    // For each entry
    for (Histogram.Bucket entry : agg.getBuckets()) {
        Min min_agg = entry.getAggregations().get("minValue");
        Max max_agg = entry.getAggregations().get("maxValue");
        Avg avg_agg = entry.getAggregations().get("avgValue");
        Sum sum_agg = entry.getAggregations().get("totalValue");
        System.out.println("minValue: " +min_agg.getValue()+" maxValue: " +max_agg.getValue()+" avgValue: " +avg_agg.getValue()+" totalValue: " +sum_agg.getValue());
    }
1 Like
5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.