Problem displaying points on maps

hi everyone, I would have a problem with the visualization of the points on the map, when I reduce the zoom you no longer see different points as if they were truncated as soon as I zoom back to see them. I use Kibana version 7.2 cloud

before:
before

after:
after

this is mapping of index:

    GET /tpl_fermate_gkqy/_mapping
    {
      "tpl_fermate_gkqy" : {
        "mappings" : {
          "properties" : {
            "@timestamp" : {
              "type" : "date"
            },
            "@version" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "acc motoria" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "acc uditiva" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "acc visiva" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "anno" : {
              "type" : "float"
            },
            "attiva a dicembre" : {
              "type" : "long"
            },
            "ck dati palina" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "comune" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "data fine" : {
              "type" : "date"
            },
            "data inizio" : {
              "type" : "date"
            },
            "fermata" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "geom" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "id" : {
              "type" : "long"
            },
            "info elettronica" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "linea" : {
              "type" : "long"
            },
            "linee" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "location" : {
              "type" : "geo_point"
            },
            "nome fermata" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "numero giorni" : {
              "type" : "long"
            },
            "numero verde" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "pensilina" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "tipo" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "ubicazione" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "visibile distanza" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            }
          }
        }
      }
    }

thanks.

The number of documents returned is limited by index.max_result_window, (although, in 7.2 the limit is hard coded to 10000). I suspect that at zoom levels showing larger regions of the world, you are seeing points disappear because of this search limit.

In 7.7, a blended layer was added to address this issue. With a blended layer: when results exceed index.max_result_window , the layer uses GeoTile grid aggregation to group your documents into clusters and displays metrics for each cluster. When results are less then index.max_result_window , the layer displays features from individual documents.

Also, in the upcoming 7.10 release, there is an option to display documents with vector tiles. Vector tiles partition your map into 6 to 8 tiles. Each tile request is limited to the index.max_result_window index setting. Tiles exceeding index.max_result_window have a visual indicator when there are too many features to display.

See scaling section in https://www.elastic.co/guide/en/kibana/7.10/vector-layer.html for more details about different ways to display larger data sets.

1 Like

Nathan_Reese thanks for the kind reply, i thought to import the points in geojson but i can't find the filter for logstash,
my configuration is:

input {
    jdbc{

        jdbc_driver_library =>"\logstash-7.5.1\logstash-core\lib\jars\postgresql-42.2.10.jre7.jar"
        jdbc_driver_class =>"org.postgresql.Driver"
        # Postgres jdbc connection string to our database, mydb
        jdbc_connection_string =>"jdbc:postgresql://192.1.1.120:5000/tpl"
        # The user we wish to execute our statement as
        jdbc_user =>"xxxxxxxx"
        jdbc_password =>"xxxxxxxx"
        jdbc_paging_enabled =>true
        jdbc_page_size =>50000
        statement_filepath =>"\logstash-7.5.1\bin\fermate_group.sql"
        use_column_value => true
        tracking_column => id
        last_run_metadata_path =>"logstash_noAuth_lastValue"
        }
}

filter {
  mutate {
      convert => { "x" => "float" }
      convert => { "y" => "float" }
  }
  mutate {
      rename => {
          "x" => "[location][lon]"
          "y" => "[location][lat]"
          "id_fermata" => "[fermata]"
          "descr_ubicazione" => "[ubicazione]" 
          "descr_ubicazione_long" => "[nome fermata]"
          "min_data" => "[data inizio]"
          "max_data" => "[data fine]"
          "n_giorni" => "[numero giorni]"
          "check_dati_palina" => "[ck dati palina]"
          "pensilina" => "[pensilina]" 
          "info_elettronica" => "[info elettronica]"
          "numero_verde" => "[numero verde]" 
          "visibile_distanza" => "[visibile distanza]" 
          "acc_motoria" => "[acc motoria]" 
          "acc_visiva" => "[acc visiva]" 
          "acc_uditiva" => "[acc uditiva]"
          "attiva_dicembre" => "[attiva a dicembre]"
      }
  }
}

output {
    elasticsearch {
        hosts =>"0c2cf08586af4fd5a03d129357e559a9.eu-central-1.aws.cloud.es.io:9243"
        index =>"tpl_fermate_gk"
        document_id =>"%{id}"
        user =>"xxxxxxxx"
        password =>"xxxxxxxx"
        ssl =>true
        ssl_certificate_verification =>true        
     }
}

For large GeoJSON datasets, I'd suggest to use the ogr2ogr tool, part of the GDAL library. Take a look to this blog post on the topic

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.