Problem with too long query time

Elastic Stack Elasticsearch
1

A ES newbie here.

I've got documents in the following format and basically try to loop through all users data to find 2000 users within 100Km from his location excluding any users associated with the blocked_ids.

{
    "name": "user1",
    "active": true,
    "location": { "lat": 21, "lon": 80 },
    "blocked_ids": [ "19", "83", "486", ... ]
},
{
    "name": "user2",
    "active": true,
    "location": { "lat": 22, "lon": 81 },
    "blocked_ids": [ "7", "8", "148", ... ]
},
:

So, first off, on my PHP application, I retrieve a chunk of every 200 users with scorll API. then, loop the chunk through with the following query:

    return [
        "index" => "users",
        "type" => "doc",
        "body" => [
            "size" => 2000,
            "query" => [
                "bool" => [
                    "must" => [
                        [ "match" => [ "active" => true ] ],
                    ],
                    "must_not" => [
                        "ids" => [
                            "values" => $excludedIds
                        ],
                    ],
                    "filter" => [
                        'geo_distance' => [
                            'distance' => "100km",
                            "distance_type" => "plane",
                            'location' => [
                                "lat" => $lat,
                                "lon" => $lng
                            ]
                        ]
                    ]
                ]
            ]
        ]
    ];

here, $excludedOds, $lat, and $lng are PHP variables extracted from the chunk. But, the execution time I measured was too long. I observed the size of query result, currently 2000, affect the execution time greatly. How can I achieve faster query result? Any tips or enlightments would greatly be appreciated.

Thanks!

Chuck

2

lemme ask some question?

  • do you need these results all at once?
  • is the query time acceptable if you set the size to 10?
  • what is the time you get and what is the time you are looking for?
3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.