Cannot select index pattern having geo_point field when creating map layer

mattiapdo · July 20, 2020, 3:00pm

Hi there,

I'm having troubles adding a new level creating a map in Kibana 7.6.1.

I have two index patterns: index_pat-* and index_pat-x-*, both containing at least one field of type geo_point named geoSensor.geoPoint.
Furthermore I checked that every index wrapped by index_pat-* satisfies the same property.

Being this the only requirement an index pattern shoud meet when adding a vector layer (I'm using Documents - read the doc here), I expect both of them will be available in the drop down menu.

Nonetheless, when i click on it i get only one pattern, i.e. index_pat-x-*

I know the whole index_pat-* may bee too large (90M docs, 50 Gb) to plot non aggregated data on a map, but i expect in the worst case scenario kibana won't show me more than index.max_result_window results (doc); the problem persists even if i try adding a new level in a Grid aggregation, so i don't think mine it's an issue related to the size of the index.

Related posts that didn't solve my problem:
Index not listed only when trying to add a map
Index Pattern not available when creating a Map layer

Nathan_Reese · July 20, 2020, 9:23pm

The index pattern select list should include all index patterns with geo_point fields regardless of the number of documents.

Can you check a few things:

From dev tools, what output do you get from running commands below (substitute "myGeoPointField" with the name of your geo_point field).
GET index_pat-*/_field_caps?fields=myGeoPointField
GET index_pat-x-*/_field_caps?fields=myGeoPointField
From Stack management -> Kibana -> index patterns, What is the type assigned to your geo field? The output should look like the screen shot below.

mattiapdo · July 21, 2020, 7:41am

Hi Nathan, thanks for your quick reply!

GET index_pat-*/_field_caps?fields=geoSat.geoPoint

yields

{
  "indices" : [
    "index_pat-60-20200721",
    "index_pat-60-20200720",
    "index_pat-52-20200618",
    "index_pat-52-20200619",
    "index_pat-60-20200714",
    "index_pat-60-20200713",
    "index_pat-60-20200712",
    "index_pat-60-20200711",
    "index_pat-16-20200619",
    "index_pat-60-20200719",
    "index_pat-60-20200718",
    "index_pat-60-20200717",
    "index_pat-60-20200716",
    "index_pat-60-20200715",
    "index_pat-52-20200628",
    "index_pat-16-20200627",
    "index_pat-16-20200629",
    "index_pat-16-20200620",
    "index_pat-45-20200704",
    "index_pat-45-20200711",
    "index_pat-45-20200713",
    "index_pat-45-20200712",
    "index_pat-45-20200719",
    "index_pat-45-20200718",
    "index_pat-45-20200715",
    "index_pat-45-20200714",
    "index_pat-45-20200717",
    "index_pat-45-20200716",
    "index_pat-45-20200721",
    "index_pat-16-20200525",
    "index_pat-45-20200720",
    "index_pat-16-20200521",
    "index_pat-43-20200422",
    "index_pat-56-20200629",
    "index_pat-56-20200627",
    "index_pat-56-20200626",
    "index_pat-56-20200505",
    "index_pat-56-20200620",
    "index_pat-56-20200625",
    "index_pat-56-20200623",
    "index_pat-58-20200714",
    "index_pat-52-20200703",
    "index_pat-58-20200715",
    "index_pat-52-20200706",
    "index_pat-58-20200712",
    "index_pat-58-20200713",
    "index_pat-58-20200711",
    "index_pat-43-20200407",
    "index_pat-56-20200616",
    "index_pat-56-20200615",
    "index_pat-52-20200709",
    "index_pat-49-20200720",
    "index_pat-52-20200720",
    "index_pat-49-20200721",
    "index_pat-52-20200715",
    "index_pat-52-20200714",
    "index_pat-52-20200717",
    "index_pat-49-20200719",
    "index_pat-52-20200716",
    "index_pat-49-20200718",
    "index_pat-61-20200711",
    "index_pat-61-20200712",
    "index_pat-52-20200711",
    "index_pat-61-20200713",
    "index_pat-52-20200710",
    "index_pat-52-20200713",
    "index_pat-61-20200714",
    "index_pat-61-20200715",
    "index_pat-52-20200712",
    "index_pat-61-20200716",
    "index_pat-61-20200717",
    "index_pat-61-20200718",
    "index_pat-61-20200719",
    "index_pat-52-20200719",
    "index_pat-52-20200718",
    "index_pat-43-20200512",
    "index_pat-49-20200713",
    "index_pat-49-20200712",
    "index_pat-49-20200711",
    "index_pat-49-20200717",
    "index_pat-49-20200716",
    "index_pat-49-20200715",
    "index_pat-49-20200714",
    "index_pat-52-20200721",
    "index_pat-56-20200519",
    "index_pat-43-20200626",
    "index_pat-41-20200717",
    "index_pat-41-20200716",
    "index_pat-41-20200715",
    "index_pat-41-20200714",
    "index_pat-41-20200713",
    "index_pat-41-20200712",
    "index_pat-41-20200711",
    "index_pat-51-20200720",
    "index_pat-51-20200721",
    "index_pat-41-20200719",
    "index_pat-41-20200718",
    "index_pat-41-20200720",
    "index_pat-61-20200720",
    "index_pat-61-20200721",
    "index_pat-21-20200711",
    "index_pat-64-20200719",
    "index_pat-64-20200716",
    "index_pat-64-20200715",
    "index_pat-64-20200718",
    "index_pat-64-20200717",
    "index_pat-64-20200712",
    "index_pat-64-20200711",
    "index_pat-64-20200714",
    "index_pat-64-20200713",
    "index_pat-64-20200721",
    "index_pat-64-20200720",
    "index_pat-39-20200316",
    "index_pat-54-20200711",
    "index_pat-21-20200721",
    "index_pat-21-20200720",
    "index_pat-51-20200717",
    "index_pat-51-20200718",
    "index_pat-51-20200719",
    "index_pat-51-20200713",
    "index_pat-51-20200714",
    "index_pat-51-20200715",
    "index_pat-51-20200716",
    "index_pat-51-20200711",
    "index_pat-51-20200712",
    "index_pat-21-20200718",
    "index_pat-21-20200719",
    "index_pat-21-20200716",
    "index_pat-21-20200717",
    "index_pat-21-20200714",
    "index_pat-21-20200715",
    "index_pat-21-20200712",
    "index_pat-21-20200713",
    "index_pat-44-20200716",
    "index_pat-44-20200715",
    "index_pat-44-20200714",
    "index_pat-44-20200713",
    "index_pat-44-20200719",
    "index_pat-44-20200718",
    "index_pat-44-20200717",
    "index_pat-16-20200709",
    "index_pat-16-20200710",
    "index_pat-16-20200711",
    "index_pat-16-20200712",
    "index_pat-16-20200713",
    "index_pat-16-20200714",
    "index_pat-72-20200719",
    "index_pat-16-20200715",
    "index_pat-72-20200718",
    "index_pat-16-20200716",
    "index_pat-72-20200717",
    "index_pat-16-20200717",
    "index_pat-44-20200721",
    "index_pat-44-20200720",
    "index_pat-54-20200712",
    "index_pat-54-20200713",
    "index_pat-54-20200714",
    "index_pat-54-20200715",
    "index_pat-54-20200716",
    "index_pat-54-20200717",
    "index_pat-54-20200718",
    "index_pat-54-20200719",
    "index_pat-16-20200703",
    "index_pat-54-20200720",
    "index_pat-54-20200721",
    "index_pat-16-20200706",
    "index_pat-72-20200721",
    "index_pat-72-20200720",
    "index_pat-67-20200518",
    "index_pat-16-20200611",
    "index_pat-16-20200612",
    "index_pat-16-20200617",
    "index_pat-57-20200711",
    "index_pat-57-20200712",
    "index_pat-39-20200630",
    "index_pat-57-20200713",
    "index_pat-57-20200714",
    "index_pat-47-20200701",
    "index_pat-57-20200719",
    "index_pat-57-20200715",
    "index_pat-57-20200716",
    "index_pat-57-20200717",
    "index_pat-57-20200718",
    "index_pat-41-20200721",
    "index_pat-16-20200718",
    "index_pat-16-20200719",
    "index_pat-16-20200721",
    "index_pat-19-20200701",
    "index_pat-16-20200605",
    "index_pat-39-20200524",
    "index_pat-39-20200522",
    "index_pat-19-20200706",
    "index_pat-19-20200707",
    "index_pat-39-20200523",
    "index_pat-19-20200708",
    "index_pat-19-20200709",
    "index_pat-39-20200521",
    "index_pat-44-20200712",
    "index_pat-19-20200702",
    "index_pat-44-20200711",
    "index_pat-19-20200703",
    "index_pat-19-20200704",
    "index_pat-57-20200720",
    "index_pat-57-20200721",
    "index_pat-19-20200705",
    "index_pat-16-20200720",
    "index_pat-47-20200716",
    "index_pat-50-20200711",
    "index_pat-47-20200717",
    "index_pat-47-20200718",
    "index_pat-47-20200719",
    "index_pat-50-20200714",
    "index_pat-50-20200715",
    "index_pat-50-20200712",
    "index_pat-50-20200713",
    "index_pat-50-20200718",
    "index_pat-50-20200719",
    "index_pat-50-20200716",
    "index_pat-50-20200717",
    "index_pat-39-20200609",
    "index_pat-39-20200618",
    "index_pat-39-20200619",
    "index_pat-19-20200710",
    "index_pat-39-20200616",
    "index_pat-19-20200711",
    "index_pat-19-20200712",
    "index_pat-39-20200617",
    "index_pat-39-20200614",
    "index_pat-39-20200615",
    "index_pat-39-20200612",
    "index_pat-39-20200613",
    "index_pat-19-20200717",
    "index_pat-39-20200610",
    "index_pat-39-20200611",
    "index_pat-47-20200720",
    "index_pat-19-20200718",
    "index_pat-19-20200719",
    "index_pat-47-20200721",
    "index_pat-19-20200713",
    "index_pat-19-20200714",
    "index_pat-19-20200715",
    "index_pat-19-20200716",
    "index_pat-50-20200721",
    "index_pat-50-20200720",
    "index_pat-18-20200524",
    "index_pat-42-20200720",
    "index_pat-42-20200721",
    "index_pat-19-20200720",
    "index_pat-39-20200629",
    "index_pat-42-20200711",
    "index_pat-19-20200721",
    "index_pat-42-20200712",
    "index_pat-39-20200627",
    "index_pat-42-20200713",
    "index_pat-42-20200714",
    "index_pat-39-20200628",
    "index_pat-19-20200602",
    "index_pat-39-20200625",
    "index_pat-42-20200715",
    "index_pat-39-20200626",
    "index_pat-42-20200716",
    "index_pat-39-20200623",
    "index_pat-42-20200717",
    "index_pat-39-20200624",
    "index_pat-42-20200718",
    "index_pat-39-20200621",
    "index_pat-42-20200719",
    "index_pat-19-20200608",
    "index_pat-39-20200622",
    "index_pat-39-20200620",
    "index_pat-47-20200711",
    "index_pat-47-20200712",
    "index_pat-47-20200713",
    "index_pat-47-20200714",
    "index_pat-19-20200605",
    "index_pat-47-20200715",
...
    "index_pat-56-20200720",
    "index_pat-43-20200711",
    "index_pat-56-20200721",
    "index_pat-7-20200712",
    "index_pat-7-20200713",
    "index_pat-7-20200714",
    "index_pat-7-20200715",
    "index_pat-7-20200711",
    "index_pat-7-20200716",
    "index_pat-7-20200717",
    "index_pat-7-20200718",
    "index_pat-7-20200719",
    "index_pat-56-20200717",
    "index_pat-56-20200716",
    "index_pat-56-20200715",
    "index_pat-56-20200714",
    "index_pat-43-20200702",
    "index_pat-43-20200707",
    "index_pat-43-20200708",
    "index_pat-56-20200719",
    "index_pat-56-20200718",
    "index_pat-63-20200721",
    "index_pat-60-20200515",
    "index_pat-4-20200711",
    "index_pat-4-20200712",
    "index_pat-4-20200713",
    "index_pat-4-20200714",
    "index_pat-4-20200715",
    "index_pat-4-20200716",
    "index_pat-4-20200717",
    "index_pat-4-20200718",
    "index_pat-18-20320121",
    "index_pat-18-20320122",
    "index_pat-4-20200719",
    "index_pat-63-20200713",
    "index_pat-63-20200712",
    "index_pat-63-20200711",
    "index_pat-63-20200717",
    "index_pat-63-20200716",
    "index_pat-50-20200701",
    "index_pat-63-20200715",
    "index_pat-63-20200714",
    "index_pat-63-20200719",
    "index_pat-63-20200718",
    "index_pat-63-20200720"
  ],
  "fields" : {
    "geoSat" : {
      "object" : {
        "type" : "object",
        "searchable" : false,
        "aggregatable" : false
      }
    },
    "geoSat.geoPoint" : {
      "geo_point" : {
        "type" : "geo_point",
        "searchable" : true,
        "aggregatable" : true
      }
    }
  }
}

while (x in my case was 16... )

GET index_pat-16-*/_field_caps?fields=geoSat.geoPoint

yields

{
  "indices" : [
    "index_pat-16-20200709",
    "index_pat-16-20200611",
    "index_pat-16-20200710",
    "index_pat-16-20200612",
    "index_pat-16-20200711",
    "index_pat-16-20200712",
    "index_pat-16-20200713",
    "index_pat-16-20200714",
    "index_pat-16-20200715",
    "index_pat-16-20200716",
    "index_pat-16-20200617",
    "index_pat-16-20200717",
    "index_pat-16-20200131",
    "index_pat-16-20200619",
    "index_pat-16-20200718",
    "index_pat-16-20200719",
    "index_pat-16-20200721",
    "index_pat-16-20200525",
    "index_pat-16-20200703",
    "index_pat-16-20200627",
    "index_pat-16-20200605",
    "index_pat-16-20200629",
    "index_pat-16-20200706",
    "index_pat-16-20200521",
    "index_pat-16-20200620",
    "index_pat-16-20200720"
  ],
  "fields" : {
    "geoSat" : {
      "object" : {
        "type" : "object",
        "searchable" : false,
        "aggregatable" : false
      }
    },
    "geoSat.geoPoint" : {
      "geo_point" : {
        "type" : "geo_point",
        "searchable" : true,
        "aggregatable" : true
      }
    }
  }
}

The type (for geoSat.geoPoint) is geo_point for both index_pat-* and index_pat-16-*

Nathan_Reese · July 21, 2020, 1:40pm

It looks like your index patterns are correctly configured.

Can you try 1 more thing, from Stack management -> Kibana -> index patterns, can you refresh the field list for each kibana index pattern by clicking refresh button in the upper right. Does this resolve the problem?

mattiapdo · July 22, 2020, 4:52pm

Unfortunately, it doesn't

Nathan_Reese · July 22, 2020, 5:33pm

How many Kibana index pattern's do you have?

mattiapdo · July 23, 2020, 7:17am

Currently, there are 13 index patterns.

By the way, I noticed Kibana shows me this error.

Here the plain text with the error

_construct@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/commons.bundle.js:3:2995780
Wrapper@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/commons.bundle.js:3:2994879
HttpFetchError@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/commons.bundle.js:3:2996661
fetchResponse$@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/commons.bundle.js:3:2992334
s@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js:338:774550
l/i._invoke</<@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js:338:774304
v/</e[t]@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js:338:774907
s@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js:338:774550
t@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js:338:775046
t/<@https://dev-kibana.xxxxxxxxxxxxxxx.com/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js:338:775196

May this be related to our drop down menù issue?

Nathan_Reese · July 23, 2020, 11:47am

Thanks for the error message. That indeed may be the problem. How many fields are in the index pattern? Is the index pattern selectable in Kibana visualization application?

mattiapdo · July 23, 2020, 12:35pm

There are 7600 fields.
We solved setting in the kibana.yml

server.maxPayloadBytes: 5242880

The default 1 Mb was not sufficient, so we increased to 5 Mb.

Thank you very much for the support, by the way!

Nathan_Reese · July 23, 2020, 3:08pm

That is great you figured out the problem.

I am going to add this to the trouble shooting guide, https://github.com/elastic/kibana/pull/73066. Please add any feedback if you think anything is missing

system · August 20, 2020, 3:08pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
[Kibana 7.0.1] Missing Index Patterns as Datasouce options in Maps Kibana	4	1162	June 14, 2019
MAPS in kibana Kibana	9	450	March 17, 2020
Index Pattern not available when creating a Map layer Kibana maps	3	2719	February 27, 2020
Kibana maps does not show index pattern Kibana maps	4	862	May 7, 2021
The index pattern does not contain any of the following compatible field types: geo_point Kibana	3	603	August 18, 2019

Cannot select index pattern having geo_point field when creating map layer

Related topics