Cannot select index pattern having geo_point field when creating map layer

Hi there,

I'm having troubles adding a new level creating a map in Kibana 7.6.1.

I have two index patterns: index_pat-* and index_pat-x-*, both containing at least one field of type geo_point named geoSensor.geoPoint.
Furthermore I checked that every index wrapped by index_pat-* satisfies the same property.

Being this the only requirement an index pattern shoud meet when adding a vector layer (I'm using Documents - read the doc here), I expect both of them will be available in the drop down menu.

Nonetheless, when i click on it i get only one pattern, i.e. index_pat-x-*

I know the whole index_pat-* may bee too large (90M docs, 50 Gb) to plot non aggregated data on a map, but i expect in the worst case scenario kibana won't show me more than index.max_result_window results (doc); the problem persists even if i try adding a new level in a Grid aggregation, so i don't think mine it's an issue related to the size of the index.

Related posts that didn't solve my problem:
Index not listed only when trying to add a map
Index Pattern not available when creating a Map layer

The index pattern select list should include all index patterns with geo_point fields regardless of the number of documents.

Can you check a few things:

  1. From dev tools, what output do you get from running commands below (substitute "myGeoPointField" with the name of your geo_point field).
    GET index_pat-*/_field_caps?fields=myGeoPointField
    GET index_pat-x-*/_field_caps?fields=myGeoPointField
  2. From Stack management -> Kibana -> index patterns, What is the type assigned to your geo field? The output should look like the screen shot below.

1 Like

Hi Nathan, thanks for your quick reply!

GET index_pat-*/_field_caps?fields=geoSat.geoPoint

yields

{
  "indices" : [
    "index_pat-60-20200721",
    "index_pat-60-20200720",
    "index_pat-52-20200618",
    "index_pat-52-20200619",
    "index_pat-60-20200714",
    "index_pat-60-20200713",
    "index_pat-60-20200712",
    "index_pat-60-20200711",
    "index_pat-16-20200619",
    "index_pat-60-20200719",
    "index_pat-60-20200718",
    "index_pat-60-20200717",
    "index_pat-60-20200716",
    "index_pat-60-20200715",
    "index_pat-52-20200628",
    "index_pat-16-20200627",
    "index_pat-16-20200629",
    "index_pat-16-20200620",
    "index_pat-45-20200704",
    "index_pat-45-20200711",
    "index_pat-45-20200713",
    "index_pat-45-20200712",
    "index_pat-45-20200719",
    "index_pat-45-20200718",
    "index_pat-45-20200715",
    "index_pat-45-20200714",
    "index_pat-45-20200717",
    "index_pat-45-20200716",
    "index_pat-45-20200721",
    "index_pat-16-20200525",
    "index_pat-45-20200720",
    "index_pat-16-20200521",
    "index_pat-43-20200422",
    "index_pat-56-20200629",
    "index_pat-56-20200627",
    "index_pat-56-20200626",
    "index_pat-56-20200505",
    "index_pat-56-20200620",
    "index_pat-56-20200625",
    "index_pat-56-20200623",
    "index_pat-58-20200714",
    "index_pat-52-20200703",
    "index_pat-58-20200715",
    "index_pat-52-20200706",
    "index_pat-58-20200712",
    "index_pat-58-20200713",
    "index_pat-58-20200711",
    "index_pat-43-20200407",
    "index_pat-56-20200616",
    "index_pat-56-20200615",
    "index_pat-52-20200709",
    "index_pat-49-20200720",
    "index_pat-52-20200720",
    "index_pat-49-20200721",
    "index_pat-52-20200715",
    "index_pat-52-20200714",
    "index_pat-52-20200717",
    "index_pat-49-20200719",
    "index_pat-52-20200716",
    "index_pat-49-20200718",
    "index_pat-61-20200711",
    "index_pat-61-20200712",
    "index_pat-52-20200711",
    "index_pat-61-20200713",
    "index_pat-52-20200710",
    "index_pat-52-20200713",
    "index_pat-61-20200714",
    "index_pat-61-20200715",
    "index_pat-52-20200712",
    "index_pat-61-20200716",
    "index_pat-61-20200717",
    "index_pat-61-20200718",
    "index_pat-61-20200719",
    "index_pat-52-20200719",
    "index_pat-52-20200718",
    "index_pat-43-20200512",
    "index_pat-49-20200713",
    "index_pat-49-20200712",
    "index_pat-49-20200711",
    "index_pat-49-20200717",
    "index_pat-49-20200716",
    "index_pat-49-20200715",
    "index_pat-49-20200714",
    "index_pat-52-20200721",
    "index_pat-56-20200519",
    "index_pat-43-20200626",
    "index_pat-41-20200717",
    "index_pat-41-20200716",
    "index_pat-41-20200715",
    "index_pat-41-20200714",
    "index_pat-41-20200713",
    "index_pat-41-20200712",
    "index_pat-41-20200711",
    "index_pat-51-20200720",
    "index_pat-51-20200721",
    "index_pat-41-20200719",
    "index_pat-41-20200718",
    "index_pat-41-20200720",
    "index_pat-61-20200720",
    "index_pat-61-20200721",
    "index_pat-21-20200711",
    "index_pat-64-20200719",
    "index_pat-64-20200716",
    "index_pat-64-20200715",
    "index_pat-64-20200718",
    "index_pat-64-20200717",
    "index_pat-64-20200712",
    "index_pat-64-20200711",
    "index_pat-64-20200714",
    "index_pat-64-20200713",
    "index_pat-64-20200721",
    "index_pat-64-20200720",
    "index_pat-39-20200316",
    "index_pat-54-20200711",
    "index_pat-21-20200721",
    "index_pat-21-20200720",
    "index_pat-51-20200717",
    "index_pat-51-20200718",
    "index_pat-51-20200719",
    "index_pat-51-20200713",
    "index_pat-51-20200714",
    "index_pat-51-20200715",
    "index_pat-51-20200716",
    "index_pat-51-20200711",
    "index_pat-51-20200712",
    "index_pat-21-20200718",
    "index_pat-21-20200719",
    "index_pat-21-20200716",
    "index_pat-21-20200717",
    "index_pat-21-20200714",
    "index_pat-21-20200715",
    "index_pat-21-20200712",
    "index_pat-21-20200713",
    "index_pat-44-20200716",
    "index_pat-44-20200715",
    "index_pat-44-20200714",
    "index_pat-44-20200713",
    "index_pat-44-20200719",
    "index_pat-44-20200718",
    "index_pat-44-20200717",
    "index_pat-16-20200709",
    "index_pat-16-20200710",
    "index_pat-16-20200711",
    "index_pat-16-20200712",
    "index_pat-16-20200713",
    "index_pat-16-20200714",
    "index_pat-72-20200719",
    "index_pat-16-20200715",
    "index_pat-72-20200718",
    "index_pat-16-20200716",
    "index_pat-72-20200717",
    "index_pat-16-20200717",
    "index_pat-44-20200721",
    "index_pat-44-20200720",
    "index_pat-54-20200712",
    "index_pat-54-20200713",
    "index_pat-54-20200714",
    "index_pat-54-20200715",
    "index_pat-54-20200716",
    "index_pat-54-20200717",
    "index_pat-54-20200718",
    "index_pat-54-20200719",
    "index_pat-16-20200703",
    "index_pat-54-20200720",
    "index_pat-54-20200721",
    "index_pat-16-20200706",
    "index_pat-72-20200721",
    "index_pat-72-20200720",
    "index_pat-67-20200518",
    "index_pat-16-20200611",
    "index_pat-16-20200612",
    "index_pat-16-20200617",
    "index_pat-57-20200711",
    "index_pat-57-20200712",
    "index_pat-39-20200630",
    "index_pat-57-20200713",
    "index_pat-57-20200714",
    "index_pat-47-20200701",
    "index_pat-57-20200719",
    "index_pat-57-20200715",
    "index_pat-57-20200716",
    "index_pat-57-20200717",
    "index_pat-57-20200718",
    "index_pat-41-20200721",
    "index_pat-16-20200718",
    "index_pat-16-20200719",
    "index_pat-16-20200721",
    "index_pat-19-20200701",
    "index_pat-16-20200605",
    "index_pat-39-20200524",
    "index_pat-39-20200522",
    "index_pat-19-20200706",
    "index_pat-19-20200707",
    "index_pat-39-20200523",
    "index_pat-19-20200708",
    "index_pat-19-20200709",
    "index_pat-39-20200521",
    "index_pat-44-20200712",
    "index_pat-19-20200702",
    "index_pat-44-20200711",
    "index_pat-19-20200703",
    "index_pat-19-20200704",
    "index_pat-57-20200720",
    "index_pat-57-20200721",
    "index_pat-19-20200705",
    "index_pat-16-20200720",
    "index_pat-47-20200716",
    "index_pat-50-20200711",
    "index_pat-47-20200717",
    "index_pat-47-20200718",
    "index_pat-47-20200719",
    "index_pat-50-20200714",
    "index_pat-50-20200715",
    "index_pat-50-20200712",
    "index_pat-50-20200713",
    "index_pat-50-20200718",
    "index_pat-50-20200719",
    "index_pat-50-20200716",
    "index_pat-50-20200717",
    "index_pat-39-20200609",
    "index_pat-39-20200618",
    "index_pat-39-20200619",
    "index_pat-19-20200710",
    "index_pat-39-20200616",
    "index_pat-19-20200711",
    "index_pat-19-20200712",
    "index_pat-39-20200617",
    "index_pat-39-20200614",
    "index_pat-39-20200615",
    "index_pat-39-20200612",
    "index_pat-39-20200613",
    "index_pat-19-20200717",
    "index_pat-39-20200610",
    "index_pat-39-20200611",
    "index_pat-47-20200720",
    "index_pat-19-20200718",
    "index_pat-19-20200719",
    "index_pat-47-20200721",
    "index_pat-19-20200713",
    "index_pat-19-20200714",
    "index_pat-19-20200715",
    "index_pat-19-20200716",
    "index_pat-50-20200721",
    "index_pat-50-20200720",
    "index_pat-18-20200524",
    "index_pat-42-20200720",
    "index_pat-42-20200721",
    "index_pat-19-20200720",
    "index_pat-39-20200629",
    "index_pat-42-20200711",
    "index_pat-19-20200721",
    "index_pat-42-20200712",
    "index_pat-39-20200627",
    "index_pat-42-20200713",
    "index_pat-42-20200714",
    "index_pat-39-20200628",
    "index_pat-19-20200602",
    "index_pat-39-20200625",
    "index_pat-42-20200715",
    "index_pat-39-20200626",
    "index_pat-42-20200716",
    "index_pat-39-20200623",
    "index_pat-42-20200717",
    "index_pat-39-20200624",
    "index_pat-42-20200718",
    "index_pat-39-20200621",
    "index_pat-42-20200719",
    "index_pat-19-20200608",
    "index_pat-39-20200622",
    "index_pat-39-20200620",
    "index_pat-47-20200711",
    "index_pat-47-20200712",
    "index_pat-47-20200713",
    "index_pat-47-20200714",
    "index_pat-19-20200605",
    "index_pat-47-20200715",
...
    "index_pat-56-20200720",
    "index_pat-43-20200711",
    "index_pat-56-20200721",
    "index_pat-7-20200712",
    "index_pat-7-20200713",
    "index_pat-7-20200714",
    "index_pat-7-20200715",
    "index_pat-7-20200711",
    "index_pat-7-20200716",
    "index_pat-7-20200717",
    "index_pat-7-20200718",
    "index_pat-7-20200719",
    "index_pat-56-20200717",
    "index_pat-56-20200716",
    "index_pat-56-20200715",
    "index_pat-56-20200714",
    "index_pat-43-20200702",
    "index_pat-43-20200707",
    "index_pat-43-20200708",
    "index_pat-56-20200719",
    "index_pat-56-20200718",
    "index_pat-63-20200721",
    "index_pat-60-20200515",
    "index_pat-4-20200711",
    "index_pat-4-20200712",
    "index_pat-4-20200713",
    "index_pat-4-20200714",
    "index_pat-4-20200715",
    "index_pat-4-20200716",
    "index_pat-4-20200717",
    "index_pat-4-20200718",
    "index_pat-18-20320121",
    "index_pat-18-20320122",
    "index_pat-4-20200719",
    "index_pat-63-20200713",
    "index_pat-63-20200712",
    "index_pat-63-20200711",
    "index_pat-63-20200717",
    "index_pat-63-20200716",
    "index_pat-50-20200701",
    "index_pat-63-20200715",
    "index_pat-63-20200714",
    "index_pat-63-20200719",
    "index_pat-63-20200718",
    "index_pat-63-20200720"
  ],
  "fields" : {
    "geoSat" : {
      "object" : {
        "type" : "object",
        "searchable" : false,
        "aggregatable" : false
      }
    },
    "geoSat.geoPoint" : {
      "geo_point" : {
        "type" : "geo_point",
        "searchable" : true,
        "aggregatable" : true
      }
    }
  }
}

while (x in my case was 16... :slightly_smiling_face:)

GET index_pat-16-*/_field_caps?fields=geoSat.geoPoint

yields

{
  "indices" : [
    "index_pat-16-20200709",
    "index_pat-16-20200611",
    "index_pat-16-20200710",
    "index_pat-16-20200612",
    "index_pat-16-20200711",
    "index_pat-16-20200712",
    "index_pat-16-20200713",
    "index_pat-16-20200714",
    "index_pat-16-20200715",
    "index_pat-16-20200716",
    "index_pat-16-20200617",
    "index_pat-16-20200717",
    "index_pat-16-20200131",
    "index_pat-16-20200619",
    "index_pat-16-20200718",
    "index_pat-16-20200719",
    "index_pat-16-20200721",
    "index_pat-16-20200525",
    "index_pat-16-20200703",
    "index_pat-16-20200627",
    "index_pat-16-20200605",
    "index_pat-16-20200629",
    "index_pat-16-20200706",
    "index_pat-16-20200521",
    "index_pat-16-20200620",
    "index_pat-16-20200720"
  ],
  "fields" : {
    "geoSat" : {
      "object" : {
        "type" : "object",
        "searchable" : false,
        "aggregatable" : false
      }
    },
    "geoSat.geoPoint" : {
      "geo_point" : {
        "type" : "geo_point",
        "searchable" : true,
        "aggregatable" : true
      }
    }
  }
}
  1. The type (for geoSat.geoPoint) is geo_point for both index_pat-* and index_pat-16-*

:thinking:

It looks like your index patterns are correctly configured.

Can you try 1 more thing, from Stack management -> Kibana -> index patterns, can you refresh the field list for each kibana index pattern by clicking refresh button in the upper right. Does this resolve the problem?

Unfortunately, it doesn't :frowning:

How many Kibana index pattern's do you have?

Currently, there are 13 index patterns.

By the way, I noticed Kibana shows me this error.

Here the plain text with the error

_construct@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/commons.bundle.js:3:2995780
Wrapper@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/commons.bundle.js:3:2994879
HttpFetchError@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/commons.bundle.js:3:2996661
fetchResponse$@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/commons.bundle.js:3:2992334
s@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js:338:774550
l/i._invoke</<@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js:338:774304
v/</e[t]@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js:338:774907
s@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js:338:774550
t@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js:338:775046
t/<@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js:338:775196

May this be related to our drop down menù issue?

Thanks for the error message. That indeed may be the problem. How many fields are in the index pattern? Is the index pattern selectable in Kibana visualization application?

There are 7600 fields.
We solved setting in the kibana.yml

server.maxPayloadBytes: 5242880

The default 1 Mb was not sufficient, so we increased to 5 Mb.

Thank you very much for the support, by the way!
:slight_smile:

1 Like

That is great you figured out the problem.

I am going to add this to the trouble shooting guide, https://github.com/elastic/kibana/pull/73066. Please add any feedback if you think anything is missing

3 Likes

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.