# Some Fields of index not listed in kibana - discover- under avilable fields , , eventhough shown in in index using GET command

**URL:** https://discuss.elastic.co/t/some-fields-of-index-not-listed-in-kibana-discover-under-avilable-fields-eventhough-shown-in-in-index-using-get-command/286545
**Category:** Elasticsearch
**Created:** [October 12, 2021, 8:11pm UTC](https://discuss.elastic.co/t/some-fields-of-index-not-listed-in-kibana-discover-under-avilable-fields-eventhough-shown-in-in-index-using-get-command/286545 "2021-10-12T20:11:13Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![shi](https://avatars.discourse-cdn.com/v4/letter/s/f14d63/32.png) [@shi](https://discuss.elastic.co/u/shi)
#### Post date: [October 12, 2021, 8:11pm UTC](https://discuss.elastic.co/t/some-fields-of-index-not-listed-in-kibana-discover-under-avilable-fields-eventhough-shown-in-in-index-using-get-command/286545/1 "2021-10-12T20:11:13Z")

</div>

Following log entries are put in index  
2021-09-27T03:35:53.263029+05:30 \_gateway devname="PPFW01"  
2021-09-27T03:42:22.549689+05:30 \_gateway devname="PPFW02"  
2021-09-27T04:02:36.089881+05:30 \_gateway devname="PPFW03"  
2021-09-27T04:05:06.749370+05:30 \_gateway devname="PPFW04"  
2021-09-27T04:10:04.904638+05:30 \_gateway devname="PPFW05"  
2021-09-27T04:03:18.223319+05:30 \_gateway devname="PPFW06" [from="aditya@gmail.com](mailto:from=%22aditya@gmail.com)" attachment="yes"  
2021-09-27T04:10:26.326831+05:30 \_gateway devname="PPFW02" [from="contact@online.com](mailto:from=%22contact@online.com)" attachment="no"

But the fields from ([from="aditya@gmail.com](mailto:from=%22aditya@gmail.com)")and attachment (attachment="no")are not listed under available fields in when the index is viewed using kibana-\> discover. but all fields are shown under the document

While using GET lp\_indexttt/\_search/?pretty  
all fileds are shown , 2 sample entries shown below

{  
"took" : 2,  
"timed\_out" : false,  
"\_shards" : {  
"total" : 1,  
"successful" : 1,  
"skipped" : 0,  
"failed" : 0  
},  
"hits" : {  
"total" : {  
"value" : 7,  
"relation" : "eq"  
},  
"max\_score" : 1.0,  
"hits" : [

{  
"\_index" : "lp\_indexttt",  
"\_type" : "\_doc",  
"\_id" : "g8foa3wBjuQOzRLqEY0I",  
"\_score" : 1.0,  
"\_source" : {  
"agent" : {  
"hostname" : "shi-Latitude-3510",  
"name" : "shi-Latitude-3510",  
"id" : "058ff2af-04fe-470d-bbe9-9a87caad3718",  
"ephemeral\_id" : "adcc3879-a556-4585-818d-295e0c2ecbf1",  
"type" : "filebeat",  
"version" : "7.15.0"  
},  
"log" : {  
"file" : {  
"path" : "/home/shi/logfortipartsnew/utm-emailfilshortest.log"  
},  
"offset" : 296  
},  
"message" : """2021-09-27T04:10:04.904638+05:30 \_gateway devname="PPFW05" """,  
"kvmsg" : """devname="PPFW05" """,  
"tags" : [  
"lp\_tag2"  
],  
"input" : {  
"type" : "filestream"  
},  
"@timestamp" : "2021-09-26T22:40:04.904638000Z",  
"ecs" : {  
"version" : "1.11.0"  
},  
"host" : {  
"hostname" : "shi-Latitude-3510",  
"os" : {  
"kernel" : "5.11.0-37-generic",  
"codename" : "focal",  
"name" : "Ubuntu",  
"family" : "debian",  
"type" : "linux",  
"version" : "20.04.3 LTS (Focal Fossa)",  
"platform" : "ubuntu"  
},  
"containerized" : false,  
"ip" : [  
"192.168.1.6",  
"fe80::cd8f:a19c:a6b2:2627"  
],  
"name" : "shi-Latitude-3510",  
"id" : "3104765478f478eadec013d7ghf2c1c",  
"mac" : [  
"7c:76:a5:54:06:76",  
"90:b6:44:76:e9:b2"  
],  
"architecture" : "x86\_64"  
},  
"devname" : ""PPFW05"",  
"fields" : {  
"type" : "ttt"  
}  
}  
},  
{  
"\_index" : "lp\_indexttt",  
"\_type" : "\_doc",  
"\_id" : "hMfoa3wBjuQOzRLqEY0I",  
"\_score" : 1.0,  
"\_source" : {  
"agent" : {  
"hostname" : "shi-Latitude-3510",  
"name" : "shi-Latitude-3510",  
"id" : "058ff2af-04fe-470d-bbe9-9a87caad3718",  
"ephemeral\_id" : "adcc3879-a556-4585-818d-295e0c2ecbf1",  
"type" : "filebeat",  
"version" : "7.15.0"  
},  
"log" : {  
"file" : {  
"path" : "/home/shi/logfortipartsnew/utm-emailfilshortest.log"  
},  
"offset" : 396  
},  
"message" : "2021-09-27T04:03:18.223319+05:30 \_gateway devname="PPFW06" [from="aditya@gmail.com](mailto:from=%22aditya@gmail.com)" attachment="yes"",  
"kvmsg" : "devname="PPFW06" [from="aditya@gmail.com](mailto:from=%22aditya@gmail.com)" attachment="yes"",  
"tags" : [  
"lp\_tag2"  
],  
"input" : {  
"type" : "filestream"  
},  
"@timestamp" : "2021-09-26T22:33:18.223319000Z",  
"ecs" : {  
"version" : "1.11.0"  
},  
"attachment" : ""yes"",  
"host" : {  
"hostname" : "shi-Latitude-3510",  
"os" : {  
"kernel" : "5.11.0-37-generic",  
"codename" : "focal",  
"name" : "Ubuntu",  
"type" : "linux",  
"family" : "debian",  
"version" : "20.04.3 LTS (Focal Fossa)",  
"platform" : "ubuntu"  
},  
"containerized" : false,  
"ip" : [  
"192.168.1.6",  
"fe80::cd8f:a19c:a6b2:2627"  
],  
"name" : "shi-Latitude-3510",  
"id" : "3104765478f478eadec013d7ghf2c1c",  
"mac" : [  
"7c:76:a5:54:06:76",  
"90:b6:44:76:e9:b2"  
],  
"architecture" : "x86\_64"  
},  
"devname" : ""PPFW06"",  
"from" : ""[aditya@gmail.com](mailto:aditya@gmail.com)"",  
"fields" : {  
"type" : "ttt"  
}  
}  
},

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [October 12, 2021, 10:52pm UTC](https://discuss.elastic.co/t/some-fields-of-index-not-listed-in-kibana-discover-under-avilable-fields-eventhough-shown-in-in-index-using-get-command/286545/2 "2021-10-12T22:52:50Z")

</div>

Can you please format your code/logs/config using the `</>` button, or markdown style back ticks. It helps to make things easy to read which helps us help you 🙂

---

<div class="post-metadata">

### Author: ![shi](https://avatars.discourse-cdn.com/v4/letter/s/f14d63/32.png) [@shi](https://discuss.elastic.co/u/shi)
#### Post date: [October 13, 2021, 6:43pm UTC](https://discuss.elastic.co/t/some-fields-of-index-not-listed-in-kibana-discover-under-avilable-fields-eventhough-shown-in-in-index-using-get-command/286545/3 "2021-10-13T18:43:07Z")

</div>

Sir,  
Actually all fields were viewable, only when i changed the options in the following way

Under Kibana- Discover- after selecting the index pattern, for the field names - Filter by type - The options " **Aggregatable = yes" and "Searchable = yes"** was selected .  
Then the fields from ([from="[aditya@gmail.com](mailto:aditya@gmail.com)")and attachment (attachment="no")were **NOT** listed

Only when the options **" Aggregatable = any" and Searchable = any**" was selected ,  
Then the fields from ([from="[aditya@gmail.com](mailto:aditya@gmail.com))and attachment (attachment="no") got listed

Now the issue is HOW to make these fields come under **Aggregatable = yes" and "Searchable = yes"**?

Following are the 2 sample entries from the output of GET lp\_indexttt/\_search/?prettyProcessing: indexoutputtt...

```auto
{
  "took" : 2,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 7,
      "relation" : "eq"
    },
    "max_score" : 1.0,
    "hits" : [

```

```
  {
    "_index" : "lp_indexttt",
    "_type" : "_doc",
    "_id" : "g8foa3wBjuQOzRLqEY0I",
    "_score" : 1.0,
    "_source" : {
      "agent" : {
        "hostname" : "shi-Latitude-3510",
        "name" : "shi-Latitude-3510",
        "id" : "058ff2af-04fe-470d-bbe9-9a87caad3718",
        "ephemeral_id" : "adcc3879-a556-4585-818d-295e0c2ecbf1",
        "type" : "filebeat",
        "version" : "7.15.0"
      },
      "log" : {
        "file" : {
          "path" : "/home/shi/logfortipartsnew/utm-emailfilshortest.log"
        },
        "offset" : 296
      },
      "message" : """2021-09-27T04:10:04.904638+05:30 _gateway devname="PPFW05" """,
      "kvmsg" : """devname="PPFW05" """,
      "tags" : [
        "lp_tag2"
      ],
      "input" : {
        "type" : "filestream"
      },
      "@timestamp" : "2021-09-26T22:40:04.904638000Z",
      "ecs" : {
        "version" : "1.11.0"
      },
      "host" : {
        "hostname" : "shi-Latitude-3510",
        "os" : {
          "kernel" : "5.11.0-37-generic",
          "codename" : "focal",
          "name" : "Ubuntu",
          "family" : "debian",
          "type" : "linux",
          "version" : "20.04.3 LTS (Focal Fossa)",
          "platform" : "ubuntu"
        },
        "containerized" : false,
        "ip" : [
          "192.168.1.6",
          "fe80::cd8f:a19c:a6b2:2627"
        ],
        "name" : "shi-Latitude-3510",
        "id" : "3104765478f478eadec013d7ghf2c1c",
        "mac" : [
          "7c:76:a5:54:06:76",
          "90:b6:44:76:e9:b2"
        ],
        "architecture" : "x86_64"
      },
      "devname" : "\"PPFW05\"",
      "fields" : {
        "type" : "ttt"
      }
    }
  },

```

```auto

```

```
  {
    "_index" : "lp_indexttt",
    "_type" : "_doc",
    "_id" : "hMfoa3wBjuQOzRLqEY0I",
    "_score" : 1.0,
    "_source" : {
      "agent" : {
        "hostname" : "shi-Latitude-3510",
        "name" : "shi-Latitude-3510",
        "id" : "058ff2af-04fe-470d-bbe9-9a87caad3718",
        "ephemeral_id" : "adcc3879-a556-4585-818d-295e0c2ecbf1",
        "type" : "filebeat",
        "version" : "7.15.0"
      },
      "log" : {
        "file" : {
          "path" : "/home/shi/logfortipartsnew/utm-emailfilshortest.log"
        },
        "offset" : 396
      },
      "message" : "2021-09-27T04:03:18.223319+05:30 _gateway devname=\"PPFW06\" from=\"aditya@gmail.com\" attachment=\"yes\"",
      "kvmsg" : "devname=\"PPFW06\" from=\"aditya@gmail.com\" attachment=\"yes\"",
      "tags" : [
        "lp_tag2"
      ],
      "input" : {
        "type" : "filestream"
      },
      "@timestamp" : "2021-09-26T22:33:18.223319000Z",
      "ecs" : {
        "version" : "1.11.0"
      },
      "attachment" : "\"yes\"",
      "host" : {
        "hostname" : "shi-Latitude-3510",
        "os" : {
          "kernel" : "5.11.0-37-generic",
          "codename" : "focal",
          "name" : "Ubuntu",
          "type" : "linux",
          "family" : "debian",
          "version" : "20.04.3 LTS (Focal Fossa)",
          "platform" : "ubuntu"
        },
        "containerized" : false,
        "ip" : [
          "192.168.1.6",
          "fe80::cd8f:a19c:a6b2:2627"
        ],
        "name" : "shi-Latitude-3510",
        "id" : "3104765478f478eadec013d7ghf2c1c",
        "mac" : [
          "7c:76:a5:54:06:76",
          "90:b6:44:76:e9:b2"
        ],
        "architecture" : "x86_64"
      },
      "devname" : "\"PPFW06\"",
      "from" : "\"aditya@gmail.com\"",
      "fields" : {
        "type" : "ttt"
      }
    }
  },

```

```auto
thanks and regards
shini
```

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [November 10, 2021, 6:43pm UTC](https://discuss.elastic.co/t/some-fields-of-index-not-listed-in-kibana-discover-under-avilable-fields-eventhough-shown-in-in-index-using-get-command/286545/4 "2021-11-10T18:43:28Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
