Geo-point field not getting picked up during Visualization

Elastic Stack Kibana
1

Hello folks,

New to to ELK stack. I am using latest ELK version on windows 8 with chrome browser.

I have ingested UFO sightings documents into Elastic search. First I created the structure in ES and then using logstash I was able to index the data successfully. Both screen shots are shown below.

I picked Visualization Type as "Coordinated Map" and I selected "Aggregation" as GeoHash. I immediately get "No compatiblity fields" . I thought I should be able to the "location" field which has been created as as "Geopoint" data type

2018-03-13_12-27-09
2018-03-13_12-27-09.jpg702×502 65.1 KB

2018-03-13_12-34-52
2018-03-13_12-34-52.jpg1791×669 160 KB

1
1.jpg751×214 11.5 KB
2
2.jpg847×666 80.9 KB

2

You might need to refresh your index pattern fields in Management > Index Patterns, then select your index pattern from the left and click the "refresh field list" button on the top right of the page. image

Does that make the field available?

If not, can you provide the mappings for your ufo index by running GET /ufo/_mapping in Dev Tools > Console and pasting the response here?

3

I will try and let you know you Spencer.
Thank you so much for the reply.

4

Spencer,

I tried refreshing as you said. It didn't help.

There is a limit of 7000 charecters to post a reply. Is there any way I can send the file to you?

Thank You very much for responding.

5

something is not right. I have two mappings sections.

  "mappings": {
                "properties": {
                  "ufo": {
                    "properties": {
                      "properties": {
                        "properties": {
                          "city": {
                            "properties": {
                              "type": {
                                "type": "text",
                                "fields": {
                                  "keyword": {
                                    "type": "keyword",
                                    "ignore_above": 256
                                  }
                                }
                              }
                            }
                          },
                          "comments": {
                            "properties": {
                              "type": {
                                "type": "text",
                                "fields": {
                                  "keyword": {
                                    "type": "keyword",
                                    "ignore_above": 256
                                  }
                                }
                              }
                            }
                          },
                          "country": {
                            "properties": {
                              "type": {
                                "type": "text",
                                "fields": {
                                  "keyword": {
                                    "type": "keyword",
                                    "ignore_above": 256
                                  }
                                }
                              }
                            }
                          },
                          "date posted": {
                            "properties": {
                              "type": {
                                "type": "text",
                                "fields": {
                                  "keyword": {
                                    "type": "keyword",
                                    "ignore_above": 256
                                  }
                                }
                              }
                            }
                          },
                          "datetime": {
                            "properties": {
                              "type": {
                                "type": "text",
                                "fields": {
                                  "keyword": {
                                    "type": "keyword",
                                    "ignore_above": 256
                                  }
                                }
                              }
                            }
                          },
                          "duration (hours/min)": {
                            "properties": {
                              "type": {
                                "type": "text",
                                "fields": {
                                  "keyword": {
                                    "type": "keyword",
                                    "ignore_above": 256
                                  }
                                }
                              }
                            }
                          },
                          "duration (seconds)": {
                            "properties": {
                              "type": {
                                "type": "text",
                                "fields": {
                                  "keyword": {
                                    "type": "keyword",
                                    "ignore_above": 256
                                  }
                                }
                              }
                            }
                          },
                          "location": {
                            "properties": {
                              "type": {
                                "type": "text",
                                "fields": {
                                  "keyword": {
                                    "type": "keyword",
                                    "ignore_above": 256
                                  }
                                }
                              }
                            }
                          },
                          "shape": {
                            "properties": {
                              "type": {
                                "type": "text",
                                "fields": {
                                  "keyword": {
                                    "type": "keyword",
                                    "ignore_above": 256
                                  }
                                }
                              }
                            }
                          },
                          "state": {
                            "properties": {
                              "type": {
                                "type": "text",
                                "fields": {
                                  "keyword": {
                                    "type": "keyword",
                                    "ignore_above": 256
                                  }
                                }
                              }
                            }
                          }
                        }
                      }
                    }
                  }
                }
              },
              "message": {
                "type": "text",
                "fields": {
                  "keyword": {
                    "type": "keyword",
                    "ignore_above": 256
                  }
                }
              },
              "path": {
                "type": "text",
                "fields": {
                  "keyword": {
                    "type": "keyword",
                    "ignore_above": 256
                  }
                }
              },
              "settings": {
                "properties": {
                  "number_of_shards": {
                    "type": "long"
                  }
                }
              },
              "shape": {
                "type": "text",
                "fields": {
                  "keyword": {
                    "type": "keyword",
                    "ignore_above": 256
                  }
                }
              },
              "state": {
                "type": "text",
                "fields": {
                  "keyword": {
                    "type": "keyword",
                    "ignore_above": 256
                  }
                }
              }
            }
          }
        }
      }
    }
6 
   {
  "ufo": {
"mappings": {
  "_doc": {
    "properties": {
      "@timestamp": {
        "type": "date"
      },
      "@version": {
        "type": "text",
        "fields": {
          "keyword": {
            "type": "keyword",
            "ignore_above": 256
          }
        }
      },
      "city": {
        "type": "text",
        "fields": {
          "keyword": {
            "type": "keyword",
            "ignore_above": 256
          }
        }
      },
      "column12": {
        "type": "text",
        "fields": {
          "keyword": {
            "type": "keyword",
            "ignore_above": 256
          }
        }
      },
      "comments": {
        "type": "text",
        "fields": {
          "keyword": {
            "type": "keyword",
            "ignore_above": 256
          }
        }
      },
      "country": {
        "type": "text",
        "fields": {
          "keyword": {
            "type": "keyword",
            "ignore_above": 256
          }
        }
      },
      "date posted": {
        "type": "text",
        "fields": {
          "keyword": {
            "type": "keyword",
            "ignore_above": 256
          }
        }
      },
      "datetime": {
        "type": "text",
        "fields": {
          "keyword": {
            "type": "keyword",
            "ignore_above": 256
          }
        }
      },
      "duration (hours/min)": {
        "type": "text",
        "fields": {
          "keyword": {
            "type": "keyword",
            "ignore_above": 256
          }
        }
      },
      "duration (seconds)": {
        "type": "long"
      },
      "host": {
        "type": "text",
        "fields": {
          "keyword": {
            "type": "keyword",
            "ignore_above": 256
          }
        }
      },
      "location": {
        "properties": {
          "lat": {
            "type": "float"
          },
          "lon": {
            "type": "float"
          }
        }
      },
7

Yeah, looks like something is misconfigured. You might want to wipeout the elasticsearch indexes and try reindexing your data a couple times to see if you can find the issue in the configuration.

curl -XDELETE localhost:9200/ufo

will delete your ufo index and let you start over

8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.