# Random fields in "Available fields" in Kibana discover

**URL:** https://discuss.elastic.co/t/random-fields-in-available-fields-in-kibana-discover/330498
**Category:** Kibana
**Tags:** docker
**Created:** [April 21, 2023, 6:31am UTC](https://discuss.elastic.co/t/random-fields-in-available-fields-in-kibana-discover/330498 "2023-04-21T06:31:37Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![rkelastic](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rkelastic/32/119663_2.png) [@rkelastic](https://discuss.elastic.co/u/rkelastic)
#### Post date: [April 21, 2023, 6:31am UTC](https://discuss.elastic.co/t/random-fields-in-available-fields-in-kibana-discover/330498/1 "2023-04-21T06:31:37Z")

</div>

I am using a filebeat instance to read data from azure blob storage and see the visualisation in kibana.

In Discover tab in kibana, under the "Available fields" section, it is showing list of fields which are not there in the data present in blob storage.

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/1/2/1216c69726f0f46ac8142684cfaf5c60109cfa10.png)

I only have 6 fields in the data i am sending.

Can anyone help me with it

---

<div class="post-metadata">

### Author: ![Tre\_Seymour](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tre_seymour/32/46507_2.png) [@Tre\_Seymour](https://discuss.elastic.co/u/Tre_Seymour)
#### Post date: [April 21, 2023, 1:46pm UTC](https://discuss.elastic.co/t/random-fields-in-available-fields-in-kibana-discover/330498/2 "2023-04-21T13:46:38Z")

</div>

Hello there @rkelastic  
Before we get started, may I ask which version you are using?

---

<div class="post-metadata">

### Author: ![rkelastic](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rkelastic/32/119663_2.png) [@rkelastic](https://discuss.elastic.co/u/rkelastic)
#### Post date: [April 23, 2023, 12:16pm UTC](https://discuss.elastic.co/t/random-fields-in-available-fields-in-kibana-discover/330498/3 "2023-04-23T12:16:40Z")

</div>

the versions are 8.7.0 (same for kibana, elasticsearch and filebeat)

i have to files for config:  
filebeat.yml  
ingestion\_pipeline in Elasticsearch

Here is the filebeat yml file that i am using

```auto
filebeat.inputs:
- type: azure-blob-storage
  id: my-azureblobstorage-id
  enabled: true
  account_name: <acc_name>
  auth.connection_string.uri: <conn_String>
  max_workers: 10
  poll: true
  poll_interval: 15s
  containers:
  - name: testlogstash
    max_workers: 3
    poll: true
    poll_interval: 2s

processors:
- drop_fields:
    fields: ["@timestamp", "input", "prospector", "host", "agent", "event", "ecs", "log"]
    ignore_missing: true
- decode_json_fields:
    fields: ["message"]
    target: ""
    overwrite_keys: true

output.elasticsearch:
  hosts: '${ELASTICSEARCH_HOSTS:<ip>:9200}'
  index: 'processed1-1'
  pipeline: 'epoch-time-converter'

setup.template.name: "processed1"
setup.template.pattern: "processed1-1"

```

ingestion pipeline

```auto
{
  "epoch-time-converter": {
    "description": "test pipeline to parse timestamp field",
    "processors": [
      {
        "date": {
          "field": "timestamp",
          "formats": [
            "UNIX_MS"
          ],
          "if": "ctx.timestamp != null && (ctx.timestamp instanceof String || ctx.timestamp instanceof Number)"
        }
      }
    ]
  }
}

```

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [May 21, 2023, 12:16pm UTC](https://discuss.elastic.co/t/random-fields-in-available-fields-in-kibana-discover/330498/4 "2023-05-21T12:16:55Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.