# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1479

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1480

---

## [QueryShardException No mapping found for \[failed\]](https://discuss.elastic.co/t/queryshardexception-no-mapping-found-for-failed/269111)

<div class="topic-metadata">

**Author:** [@MdRashid](https://discuss.elastic.co/u/MdRashid)\
**Replies:** 1\
**Last updated:** [April 2, 2021, 8:47pm UTC](https://discuss.elastic.co/t/queryshardexception-no-mapping-found-for-failed/269111 "2021-04-02T20:47:56Z")

</div>

Hi All, I have deploy my ES on Azure Kubernetes Services AKS after deploying i got error all shards failed Caused by: org.elasticsearch.index.query.QueryShardException: No mapping found for \[failed\] in order to sort o…

---

## [How to know Elasticsearch daily log intake?](https://discuss.elastic.co/t/how-to-know-elasticsearch-daily-log-intake/269104)

<div class="topic-metadata">

**Author:** [@mahesh.yerawar](https://discuss.elastic.co/u/mahesh.yerawar)\
**Replies:** 3\
**Last updated:** [April 2, 2021, 8:47pm UTC](https://discuss.elastic.co/t/how-to-know-elasticsearch-daily-log-intake/269104 "2021-04-02T20:47:01Z")

</div>

Hi, I'm looking to understand how much data is getting ingested to our ELK cluster on a daily basis. anyone has any idea how to get these details? Thank you.

---

## [Enhanced Table computed column issue](https://discuss.elastic.co/t/enhanced-table-computed-column-issue/269000)

<div class="topic-metadata">

**Author:** [@bab](https://discuss.elastic.co/u/bab)\
**Replies:** 3\
**Last updated:** [April 2, 2021, 6:27pm UTC](https://discuss.elastic.co/t/enhanced-table-computed-column-issue/269000 "2021-04-02T18:27:36Z")

</div>

i'm trying to get the duration in s using the formula but is not working, can someone help pls, thank you.

---

## [FATAL Error: Unable to complete saved object migrations for the \[.kibana\] index. TypeError: Cannot read property 'error' of undefined](https://discuss.elastic.co/t/fatal-error-unable-to-complete-saved-object-migrations-for-the-kibana-index-typeerror-cannot-read-property-error-of-undefined/269066)

<div class="topic-metadata">

**Author:** [@elk\_usr](https://discuss.elastic.co/u/elk_usr)\
**Replies:** 2\
**Last updated:** [April 2, 2021, 6:07pm UTC](https://discuss.elastic.co/t/fatal-error-unable-to-complete-saved-object-migrations-for-the-kibana-index-typeerror-cannot-read-property-error-of-undefined/269066 "2021-04-02T18:07:47Z")

</div>

Hello, I am trying to install Kibana7.12.0 on a new Win10 laptop that has elasticsearch7.12.0 already installed and running. However, Kibana install fails about halfway giving below fatal error Any help on this is g…

---

## [Need help to aggregate a text field into a visualization](https://discuss.elastic.co/t/need-help-to-aggregate-a-text-field-into-a-visualization/269034)

<div class="topic-metadata">

**Author:** [@trubisky](https://discuss.elastic.co/u/trubisky)\
**Replies:** 5\
**Last updated:** [April 2, 2021, 5:14pm UTC](https://discuss.elastic.co/t/need-help-to-aggregate-a-text-field-into-a-visualization/269034 "2021-04-02T17:14:22Z")

</div>

Hi All, I've spent a ton of time on this and I feel like it should be relatively simple but for some reason I'm not able to find the solution. I'll also add that I am fairly novice at visualizations. The docs looks sim…

---

## [FreeBSD 12 + Filebeat + netflow](https://discuss.elastic.co/t/freebsd-12-filebeat-netflow/269123)

<div class="topic-metadata">

**Author:** [@Yustas](https://discuss.elastic.co/u/Yustas)\
**Replies:** 0\
**Last updated:** [April 2, 2021, 5:03pm UTC](https://discuss.elastic.co/t/freebsd-12-filebeat-netflow/269123 "2021-04-02T17:03:30Z")

</div>

Hello I am installed beats7 by pkg on FreeBSD 12.1 But in installation missing module netflow for filebeat Anybody know how install filebeat with netflow support on freebsd? /usr/ports/sysutils/beats7/pkg-plist %%ME…

---

## [Help me writing grok filter for the pattern](https://discuss.elastic.co/t/help-me-writing-grok-filter-for-the-pattern/268794)

<div class="topic-metadata">

**Author:** [@abhishek\_s1](https://discuss.elastic.co/u/abhishek_s1)\
**Replies:** 8\
**Last updated:** [April 2, 2021, 3:39pm UTC](https://discuss.elastic.co/t/help-me-writing-grok-filter-for-the-pattern/268794 "2021-04-02T15:39:21Z")

</div>

I've http log of the form 10.255.255.255 - jira \[11/Mar/2021:10:00:03 -0800\] "GET /svn/repos/branches/feature-IPv6-TWLP-3.2/ZProxyHealthManager.cpp HTTP/1.1" 200 29110 & my pattern is: %{IPORHOST:client\_ip} %{HTTPDUS…

---

## [Filter one value with other value](https://discuss.elastic.co/t/filter-one-value-with-other-value/269103)

<div class="topic-metadata">

**Author:** [@domra](https://discuss.elastic.co/u/domra)\
**Replies:** 1\
**Last updated:** [April 2, 2021, 2:42pm UTC](https://discuss.elastic.co/t/filter-one-value-with-other-value/269103 "2021-04-02T14:42:38Z")

</div>

Hi! I want to apply a filter to an TSVB metric visualization where I filter all documents, where one value is between a offset of another value. something like this: valueA: \[valueB-1 TO valueB+1\] Is something like th…

---

## [Unable to create scripted filed](https://discuss.elastic.co/t/unable-to-create-scripted-filed/269101)

<div class="topic-metadata">

**Author:** [@Dinesh\_Sharma](https://discuss.elastic.co/u/Dinesh_Sharma)\
**Replies:** 7\
**Last updated:** [April 2, 2021, 2:12pm UTC](https://discuss.elastic.co/t/unable-to-create-scripted-filed/269101 "2021-04-02T14:12:46Z")

</div>

Hi, I was trying to create an scripted field. Where I was implementing the following logic which is return true if IP is equal to Pi\_IP. ''' if (doc\['IP.kayword'\].value == doc\['Pi\_IP.keyword'\].value) { retrun "true"; …

---

## [Pipeline has lesser fields than Filebeat directly to Elasticsearch](https://discuss.elastic.co/t/pipeline-has-lesser-fields-than-filebeat-directly-to-elasticsearch/269054)

<div class="topic-metadata">

**Author:** [@Automation\_Scripts](https://discuss.elastic.co/u/Automation_Scripts)\
**Replies:** 0\
**Last updated:** [April 1, 2021, 4:04pm UTC](https://discuss.elastic.co/t/pipeline-has-lesser-fields-than-filebeat-directly-to-elasticsearch/269054 "2021-04-01T16:04:17Z")

</div>

Hi team, I have a pipeline like this: filebeat =\>kafka =\>logstask=\>elasticsearch (ELK7.12) Why I have a smaller amounts of fileds than filebeat directly =\>elasticsearch (ELK7.11.1) Whenever I check the fields from ECS…

---

## [Ngram vs wildcard (Using ngrams instead of wildcards)](https://discuss.elastic.co/t/ngram-vs-wildcard-using-ngrams-instead-of-wildcards/260809)

<div class="topic-metadata">

**Author:** [@mohsin](https://discuss.elastic.co/u/mohsin)\
**Replies:** 1\
**Last updated:** [April 2, 2021, 1:56pm UTC](https://discuss.elastic.co/t/ngram-vs-wildcard-using-ngrams-instead-of-wildcards/260809 "2021-04-02T13:56:06Z")

</div>

We are using spring-data-elasticsearch in our Project we have the autocomplete function for the search textbox. When we type into the search text field, we will fetch suggestions by performing a wild card search with t…

---

## [Is there any option to define multiple key value pairs based on delimeter while ingesting files through FSCrawler in Elasticsearch?](https://discuss.elastic.co/t/is-there-any-option-to-define-multiple-key-value-pairs-based-on-delimeter-while-ingesting-files-through-fscrawler-in-elasticsearch/261383)

<div class="topic-metadata">

**Author:** [@Nirmal\_Raj](https://discuss.elastic.co/u/Nirmal_Raj)\
**Replies:** 3\
**Last updated:** [April 2, 2021, 1:49pm UTC](https://discuss.elastic.co/t/is-there-any-option-to-define-multiple-key-value-pairs-based-on-delimeter-while-ingesting-files-through-fscrawler-in-elasticsearch/261383 "2021-04-02T13:49:14Z")

</div>

I'm trying to ingest multiple extension files like (.pdf, .doc, .docx, .csv) using FSCrawler in Elasticsearch . After ingesting, all the details inside the files mapped under one key value pair called content. Is there …

---

## [Elasticsearch thread\_pool is growing over and over](https://discuss.elastic.co/t/elasticsearch-thread-pool-is-growing-over-and-over/266078)

<div class="topic-metadata">

**Author:** [@nuzolx](https://discuss.elastic.co/u/nuzolx)\
**Replies:** 3\
**Last updated:** [April 2, 2021, 1:39pm UTC](https://discuss.elastic.co/t/elasticsearch-thread-pool-is-growing-over-and-over/266078 "2021-04-02T13:39:17Z")

</div>

Hi all, I am a newbie with Elastic. I cannot find all my documents in my research. If I repeat the same search, after a while, it's okay. I understood that it could come from the 'refresh'. But sometimes the waiting tim…

---

## [Best way to maintain total count for rollup documents?](https://discuss.elastic.co/t/best-way-to-maintain-total-count-for-rollup-documents/269109)

<div class="topic-metadata">

**Author:** [@hsalim](https://discuss.elastic.co/u/hsalim)\
**Replies:** 0\
**Last updated:** [April 2, 2021, 1:37pm UTC](https://discuss.elastic.co/t/best-way-to-maintain-total-count-for-rollup-documents/269109 "2021-04-02T13:37:54Z")

</div>

Hello, I am performing Elastic rollups on an index with the following streaming documents and fields. Rollup is on Field 1: Field1 Field2 doc1 1200 a doc2 1200 b doc3 1200 c doc4 …

---

## [Sending data from logstash to ElasticSearch (ECK): Certificate issue](https://discuss.elastic.co/t/sending-data-from-logstash-to-elasticsearch-eck-certificate-issue/269106)

<div class="topic-metadata">

**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\
**Replies:** 0\
**Last updated:** [April 2, 2021, 1:25pm UTC](https://discuss.elastic.co/t/sending-data-from-logstash-to-elasticsearch-eck-certificate-issue/269106 "2021-04-02T13:25:11Z")

</div>

have setup operator based elasticsearch & kibana.. but since logstash is not within ECK, running logstash as standalone. Unfortunately, i'm trying it hard to find to connect to Elasticsearch due to certificate issue. ou…

---

## [Change ILM policy](https://discuss.elastic.co/t/change-ilm-policy/269105)

<div class="topic-metadata">

**Author:** [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\
**Replies:** 0\
**Last updated:** [April 2, 2021, 12:49pm UTC](https://discuss.elastic.co/t/change-ilm-policy/269105 "2021-04-02T12:49:17Z")

</div>

Hello, I have a cluster of 2 nodes HOT and 1 DATA warm, and my ILM configuration is set to 1 shard and 1 replica I checked today my indexes and I found out that My HOT data node is going to hit 90% of DISK, and after …

---

## [Unable to start Kibana](https://discuss.elastic.co/t/unable-to-start-kibana/268950)

<div class="topic-metadata">

**Author:** [@maruthi\_Donthi](https://discuss.elastic.co/u/maruthi_Donthi)\
**Replies:** 5\
**Last updated:** [April 2, 2021, 11:33am UTC](https://discuss.elastic.co/t/unable-to-start-kibana/268950 "2021-04-02T11:33:52Z")

</div>

I am trying to start Kibana using a docker. I have already installed elastic search and it is working fine: I can see the elastic search status here: http://localhost:9200/\_cluster/health?pretty But when I run kibana do…

---

## [Set timestamp from message](https://discuss.elastic.co/t/set-timestamp-from-message/269073)

<div class="topic-metadata">

**Author:** [@Andrey\_RF](https://discuss.elastic.co/u/Andrey_RF)\
**Replies:** 4\
**Last updated:** [April 2, 2021, 11:12am UTC](https://discuss.elastic.co/t/set-timestamp-from-message/269073 "2021-04-02T11:12:38Z")

</div>

I have a pipeline to receive logs from different programs with different timestamp formats. input { beats { port =\> 5000 } } filter { date { match =\> \["message", "yyyy-MM-d…

---

## [Elasticsearch crashing with 'no space available', while disk still has 75% free storage](https://discuss.elastic.co/t/elasticsearch-crashing-with-no-space-available-while-disk-still-has-75-free-storage/269094)

<div class="topic-metadata">

**Author:** [@Kristijan](https://discuss.elastic.co/u/Kristijan)\
**Replies:** 1\
**Last updated:** [April 2, 2021, 11:10am UTC](https://discuss.elastic.co/t/elasticsearch-crashing-with-no-space-available-while-disk-still-has-75-free-storage/269094 "2021-04-02T11:10:08Z")

</div>

The elasticsearch(v5.6.12) is deployed as a single pod in a Kubernetes cluster with attached storage through a PVC. Once every couple of months it will go into a crash loop state and complain that there is no storage le…

---

## [How to create mulitple indices](https://discuss.elastic.co/t/how-to-create-mulitple-indices/268920)

<div class="topic-metadata">

**Author:** [@Shushil\_Shankar](https://discuss.elastic.co/u/Shushil_Shankar)\
**Replies:** 5\
**Last updated:** [April 2, 2021, 10:40am UTC](https://discuss.elastic.co/t/how-to-create-mulitple-indices/268920 "2021-04-02T10:40:48Z")

</div>

Good morning eveyyone! I have a question about the creation of a multiple indices. Currenlty in my project i have one index mutileple types. Now i need to migrate new version 7.12. How to do i create multiple indicies …

---

## [Filebeat to parse mixed data (strings and json)](https://discuss.elastic.co/t/filebeat-to-parse-mixed-data-strings-and-json/267629)

<div class="topic-metadata">

**Author:** [@Olivier\_Gerault](https://discuss.elastic.co/u/Olivier_Gerault)\
**Replies:** 3\
**Last updated:** [April 2, 2021, 10:34am UTC](https://discuss.elastic.co/t/filebeat-to-parse-mixed-data-strings-and-json/267629 "2021-04-02T10:34:54Z")

</div>

Hello, First of all, I'm a new to filebeat, so I may say stupids things. Forgive me in advance. I have to parse a log file that looks like : 2021-03-18 09:33:37,131 -- TYPE -- {"json1": "data", "json2": "data", "json3…

---

## [Where condition](https://discuss.elastic.co/t/where-condition/269072)

<div class="topic-metadata">

**Author:** [@Wolfram\_P](https://discuss.elastic.co/u/Wolfram_P)\
**Replies:** 13\
**Last updated:** [April 2, 2021, 10:22am UTC](https://discuss.elastic.co/t/where-condition/269072 "2021-04-02T10:22:59Z")

</div>

Hi, as a beginner on Kibana this question might be silly, but I cannot get across it: I would like to add a stacked bar graph to my dashboard. Two Y-axis: sum of index abc field1, where field2="1" sum of index abc f…

---

## [Failed to get report](https://discuss.elastic.co/t/failed-to-get-report/269040)

<div class="topic-metadata">

**Author:** [@111456](https://discuss.elastic.co/u/111456)\
**Replies:** 1\
**Last updated:** [April 2, 2021, 9:52am UTC](https://discuss.elastic.co/t/failed-to-get-report/269040 "2021-04-02T09:52:08Z")

</div>

my problem： my yml: server.port: 5601 server.name: "kibana" server.host: "0.0.0.0" elasticsearch.hosts: \["http://192.168.8.142:9200", "http://192.168.8.143:9200", "http://192.168.8.144:9200"\] k…

---

## [Slower Query Response Times - Intermittent](https://discuss.elastic.co/t/slower-query-response-times-intermittent/266634)

<div class="topic-metadata">

**Author:** [@israni.amit](https://discuss.elastic.co/u/israni.amit)\
**Replies:** 6\
**Last updated:** [April 2, 2021, 9:41am UTC](https://discuss.elastic.co/t/slower-query-response-times-intermittent/266634 "2021-04-02T09:41:46Z")

</div>

Hi there, We recently noticed that some of the queries were having high response times like 12-15 seconds compared to others which were in miliseconds. We have a query layer (Spring Boot App) which uses RestHighLevelCl…

---

## [ElasticSearch WARN after installing kibana](https://discuss.elastic.co/t/elasticsearch-warn-after-installing-kibana/268428)

<div class="topic-metadata">

**Author:** [@kylesu](https://discuss.elastic.co/u/kylesu)\
**Replies:** 10\
**Last updated:** [April 2, 2021, 9:07am UTC](https://discuss.elastic.co/t/elasticsearch-warn-after-installing-kibana/268428 "2021-04-02T09:07:47Z")

</div>

After installing kibana,when i operate(GET/POST/DELETE and so on) Elastic Search with High Level Rest Clinet comes up this warning: Each request comes up with one warning,i have 500 millions documents to process every …

---

## [Logstash pipeline order](https://discuss.elastic.co/t/logstash-pipeline-order/269057)

<div class="topic-metadata">

**Author:** [@Narayan\_Banik](https://discuss.elastic.co/u/Narayan_Banik)\
**Replies:** 3\
**Last updated:** [April 2, 2021, 8:34am UTC](https://discuss.elastic.co/t/logstash-pipeline-order/269057 "2021-04-02T08:34:54Z")

</div>

Hello All, Is there any order of logstash pipelines config: I've below pipelines: \[root@gzp-p-qv-logst-3 pipeline\]# ls -larth total 60K drwxr-xr-x. 3 logstash logstash 42 Oct 11 2019 .. -rw-r--r--. 1 root root …

---

## [Ingest-attachment sometimes recognizes files as empty](https://discuss.elastic.co/t/ingest-attachment-sometimes-recognizes-files-as-empty/268238)

<div class="topic-metadata">

**Author:** [@dimaPust](https://discuss.elastic.co/u/dimaPust)\
**Replies:** 1\
**Last updated:** [April 2, 2021, 8:32am UTC](https://discuss.elastic.co/t/ingest-attachment-sometimes-recognizes-files-as-empty/268238 "2021-04-02T08:32:10Z")

</div>

Hello, I am using elasticsearch:7.9.0 with the ingest-attachment plugin for indexing docx files, created in an external editor. However, sometimes files are indexed as 'empty', for example next file: { \_index: 'loc…

---

## [Adding objects to an Array filed in Elastic Search index using Java High level Rest Client](https://discuss.elastic.co/t/adding-objects-to-an-array-filed-in-elastic-search-index-using-java-high-level-rest-client/268418)

<div class="topic-metadata">

**Author:** [@dekay14](https://discuss.elastic.co/u/dekay14)\
**Replies:** 7\
**Last updated:** [April 2, 2021, 8:14am UTC](https://discuss.elastic.co/t/adding-objects-to-an-array-filed-in-elastic-search-index-using-java-high-level-rest-client/268418 "2021-04-02T08:14:27Z")

</div>

I am trying to add a list or a single object to a Array field on a Elastic Search Index, the index is as shown below: "\_index" : "class\_index", "\_id" : "1234", "\_source" : { "externalId" : …

---

## [Question about threadpools](https://discuss.elastic.co/t/question-about-threadpools/268888)

<div class="topic-metadata">

**Author:** [@nyquillus](https://discuss.elastic.co/u/nyquillus)\
**Replies:** 13\
**Last updated:** [April 2, 2021, 8:08am UTC](https://discuss.elastic.co/t/question-about-threadpools/268888 "2021-04-02T08:08:31Z")

</div>

Hi, It's a simple question but I couldn't be sure and couldn't find anything that specifies this. When using Kibana on discover page what operation is used on elasticsearch to show logs? Is it Get or Search?

---

## [How to add podip on add\_kubernetes\_metadata processor?](https://discuss.elastic.co/t/how-to-add-podip-on-add-kubernetes-metadata-processor/269006)

<div class="topic-metadata">

**Author:** [@dadayoo](https://discuss.elastic.co/u/dadayoo)\
**Replies:** 6\
**Last updated:** [April 2, 2021, 7:45am UTC](https://discuss.elastic.co/t/how-to-add-podip-on-add-kubernetes-metadata-processor/269006 "2021-04-02T07:45:05Z")

</div>

Hi I'm running filebeat daemonset on my k8s cluster have try different config scenario but do not get the pod ip data here is my config processors: - add\_kubernetes\_metadata: default\_indexers.enabled: tr…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1478)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1480)
