# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1436

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1437

---

## [Run custom tracks get type error](https://discuss.elastic.co/t/run-custom-tracks-get-type-error/271520)

<div class="topic-metadata">

**Author:** [@GITnewfish](https://discuss.elastic.co/u/GITnewfish)\
**Replies:** 3\
**Last updated:** [April 30, 2021, 9:21am UTC](https://discuss.elastic.co/t/run-custom-tracks-get-type-error/271520 "2021-04-30T09:21:05Z")

</div>

When I run custom tracks ,I got type error. I can't figure out, need help! Thanks! esrally version: esrally 1.4.1 es version: 6.4.0 my custom track: {% import "rally.helpers" as rally with context %} { "version": 2…

---

## [Exception in indexing function: ElasticsearchException got in indexing function: TransportError](https://discuss.elastic.co/t/exception-in-indexing-function-elasticsearchexception-got-in-indexing-function-transporterror/271220)

<div class="topic-metadata">

**Author:** [@sanjaysh](https://discuss.elastic.co/u/sanjaysh)\
**Replies:** 19\
**Last updated:** [April 30, 2021, 9:11am UTC](https://discuss.elastic.co/t/exception-in-indexing-function-elasticsearchexception-got-in-indexing-function-transporterror/271220 "2021-04-30T09:11:30Z")

</div>

Hello All, I was ingesting the data into the ElasticCloud and suddenly I got this error before the competition of the data I was having the data of 14BG and at 13.5 GB data are being completed but this error has come an…

---

## [Custom \_id for new user profile documents](https://discuss.elastic.co/t/custom-id-for-new-user-profile-documents/271745)

<div class="topic-metadata">

**Author:** [@Lukas\_Smilek](https://discuss.elastic.co/u/Lukas_Smilek)\
**Replies:** 2\
**Last updated:** [April 30, 2021, 8:56am UTC](https://discuss.elastic.co/t/custom-id-for-new-user-profile-documents/271745 "2021-04-30T08:56:35Z")

</div>

Hello, I went through the topics here and did some research and I am aware of the fact that specifying an custom \_id when indexing new document can slow down the performance. But I could not find how drastically it woul…

---

## [Error when running 7.12.1 on centos 7 in docker](https://discuss.elastic.co/t/error-when-running-7-12-1-on-centos-7-in-docker/271508)

<div class="topic-metadata">

**Author:** [@WiseOwl](https://discuss.elastic.co/u/WiseOwl)\
**Replies:** 3\
**Last updated:** [April 30, 2021, 8:40am UTC](https://discuss.elastic.co/t/error-when-running-7-12-1-on-centos-7-in-docker/271508 "2021-04-30T08:40:28Z")

</div>

Hi, Since the 7.12.1 update ES does not want to start in a docker container, running Centos 7. The systemd output is as such: systemd-entrypoint\[16341\]: \[0.001s\]\[warning\]\[os,container\] Duplicate cpuset controllers dete…

---

## [Kibana - can visualize a field that we multiply by a fixed value?](https://discuss.elastic.co/t/kibana-can-visualize-a-field-that-we-multiply-by-a-fixed-value/271742)

<div class="topic-metadata">

**Author:** [@felix180](https://discuss.elastic.co/u/felix180)\
**Replies:** 3\
**Last updated:** [April 30, 2021, 8:27am UTC](https://discuss.elastic.co/t/kibana-can-visualize-a-field-that-we-multiply-by-a-fixed-value/271742 "2021-04-30T08:27:05Z")

</div>

I did a visualization with a field but I would like to visualize it multiplied (or divised) by a fixed value. Is it possible ? Thanks for your help

---

## [Fatal alert: bad\_certificate](https://discuss.elastic.co/t/fatal-alert-bad-certificate/271277)

<div class="topic-metadata">

**Author:** [@mirko.spezie](https://discuss.elastic.co/u/mirko.spezie)\
**Replies:** 5\
**Last updated:** [April 30, 2021, 8:17am UTC](https://discuss.elastic.co/t/fatal-alert-bad-certificate/271277 "2021-04-30T08:17:06Z")

</div>

Hi all, I've enabled 1 year ago a cluster with X-Pack security enabled. Everything was fine and the cluster went in production. From a couple of days I'm receiving an error regarding a bad\_certificate only for the secon…

---

## [How to completely reset forced shard allocation awareness?](https://discuss.elastic.co/t/how-to-completely-reset-forced-shard-allocation-awareness/271710)

<div class="topic-metadata">

**Author:** [@dschneiter](https://discuss.elastic.co/u/dschneiter)\
**Replies:** 3\
**Last updated:** [April 29, 2021, 9:21pm UTC](https://discuss.elastic.co/t/how-to-completely-reset-forced-shard-allocation-awareness/271710 "2021-04-29T21:21:27Z")

</div>

While teaching about shard allocation awareness and forced shard allocation awareness (Elasticsearch Engineer II course), one of the students made a typo in his request to configure forced shard allocation awareness whic…

---

## [ECS for syslog: why Filebeat does not follow ECS naming convention](https://discuss.elastic.co/t/ecs-for-syslog-why-filebeat-does-not-follow-ecs-naming-convention/271744)

<div class="topic-metadata">

**Author:** [@jetnet](https://discuss.elastic.co/u/jetnet)\
**Replies:** 0\
**Last updated:** [April 30, 2021, 7:19am UTC](https://discuss.elastic.co/t/ecs-for-syslog-why-filebeat-does-not-follow-ecs-naming-convention/271744 "2021-04-30T07:19:30Z")

</div>

we're indexing syslogs data via Logstash (without Filebeat). Since it's not that clear, how Logstash manages ECS schema, I checked the Filebeat mapping and realized, that it uses different naming for Syslog: system.sysl…

---

## [How to remove a field from elastic search mapping?](https://discuss.elastic.co/t/how-to-remove-a-field-from-elastic-search-mapping/271691)

<div class="topic-metadata">

**Author:** [@vk98](https://discuss.elastic.co/u/vk98)\
**Replies:** 3\
**Last updated:** [April 30, 2021, 7:24am UTC](https://discuss.elastic.co/t/how-to-remove-a-field-from-elastic-search-mapping/271691 "2021-04-30T07:24:51Z")

</div>

I have added a field which is not actually required in elastic search. Now I want to get rid of it. Changing mapping or making a new one will reindex my whole data. Which is very huge and cant afford to do such thing. Ca…

---

## [Elasticseach failed shard allocation](https://discuss.elastic.co/t/elasticseach-failed-shard-allocation/271739)

<div class="topic-metadata">

**Author:** [@TheVintik](https://discuss.elastic.co/u/TheVintik)\
**Replies:** 7\
**Last updated:** [April 30, 2021, 7:23am UTC](https://discuss.elastic.co/t/elasticseach-failed-shard-allocation/271739 "2021-04-30T07:23:44Z")

</div>

My ES is in yellow state after another one node adding and restarting cluster. I have 4 unassigned shards (from 33), and here is response for one of unassigned shards: { "index" : "MY INDEX NAME", "shard" : 0, "pr…

---

## [Elasticsearch 7.12 High CPU usage](https://discuss.elastic.co/t/elasticsearch-7-12-high-cpu-usage/270757)

<div class="topic-metadata">

**Author:** [@Anabella\_Cristaldi](https://discuss.elastic.co/u/Anabella_Cristaldi)\
**Replies:** 7\
**Last updated:** [April 30, 2021, 6:51am UTC](https://discuss.elastic.co/t/elasticsearch-7-12-high-cpu-usage/270757 "2021-04-30T06:51:04Z")

</div>

Hi all, Last week in need to install a new cluster and I decided to use the 7.12 version. Initially I've configure a three node cluster (two data+master nodes, one master node). In this version elasticsearch automatic…

---

## [Drill down with Kibana 7.11.0](https://discuss.elastic.co/t/drill-down-with-kibana-7-11-0/271354)

<div class="topic-metadata">

**Author:** [@Manjula\_Piyumal](https://discuss.elastic.co/u/Manjula_Piyumal)\
**Replies:** 4\
**Last updated:** [April 30, 2021, 5:49am UTC](https://discuss.elastic.co/t/drill-down-with-kibana-7-11-0/271354 "2021-04-30T05:49:36Z")

</div>

Hi, I'm trying to implement a drill down from one visualization to another dashboard. I have create a TSVB Metric visualization and added another dashboard as a drill down dashboard. I can see that my parent visualizat…

---

## [Logstash If statement and grok not working](https://discuss.elastic.co/t/logstash-if-statement-and-grok-not-working/271717)

<div class="topic-metadata">

**Author:** [@ankitdevnalkar](https://discuss.elastic.co/u/ankitdevnalkar)\
**Replies:** 3\
**Last updated:** [April 30, 2021, 4:52am UTC](https://discuss.elastic.co/t/logstash-if-statement-and-grok-not-working/271717 "2021-04-30T04:52:30Z")

</div>

I am using following if statement, not sure what is wrong here, it is giving me \_mutate\_error. Does the / cause this error? if \[operationName\] == "MICROSOFT.RESOURCES/SUBSCRIPTIONS/RESOURCEGROUPS/DELETE" { …

---

## [Need help calculating weekly averages using either TSVB tables or Scripted fields](https://discuss.elastic.co/t/need-help-calculating-weekly-averages-using-either-tsvb-tables-or-scripted-fields/271472)

<div class="topic-metadata">

**Author:** [@fidsamurai](https://discuss.elastic.co/u/fidsamurai)\
**Replies:** 9\
**Last updated:** [April 30, 2021, 4:29am UTC](https://discuss.elastic.co/t/need-help-calculating-weekly-averages-using-either-tsvb-tables-or-scripted-fields/271472 "2021-04-30T04:29:35Z")

</div>

I have an index with the following structure - @timestamp the format is Apr 25, 2021 @ 05:30:00.000, all of the documents have this same time however the dates vary eg. Apr 26, 2021 @ 05:30:00.000 The next field is a …

---

## [Issue](https://discuss.elastic.co/t/issue/271690)

<div class="topic-metadata">

**Author:** [@sakshi13](https://discuss.elastic.co/u/sakshi13)\
**Replies:** 1\
**Last updated:** [April 30, 2021, 4:21am UTC](https://discuss.elastic.co/t/issue/271690 "2021-04-30T04:21:52Z")

</div>

I opened Kibana support for help but, I'm not able to send it because there aren't any option available in Deployment you need help block kindly solve my issue. Thank you

---

## [Metrics dashboards not working as it should](https://discuss.elastic.co/t/metrics-dashboards-not-working-as-it-should/271555)

<div class="topic-metadata">

**Author:** [@Francisco\_Gomez1](https://discuss.elastic.co/u/Francisco_Gomez1)\
**Replies:** 7\
**Last updated:** [April 30, 2021, 4:21am UTC](https://discuss.elastic.co/t/metrics-dashboards-not-working-as-it-should/271555 "2021-04-30T04:21:26Z")

</div>

Hi there. Im using elastic agent to load all my system metrics in the dashboards given by kibana, the problem is that when i use the default metrics recollection time (10 seconds) it works well, giving me a perfect view…

---

## [Schedule job for creating new indexes](https://discuss.elastic.co/t/schedule-job-for-creating-new-indexes/271728)

<div class="topic-metadata">

**Author:** [@arctica82](https://discuss.elastic.co/u/arctica82)\
**Replies:** 1\
**Last updated:** [April 30, 2021, 3:38am UTC](https://discuss.elastic.co/t/schedule-job-for-creating-new-indexes/271728 "2021-04-30T03:38:30Z")

</div>

Hi Everyone, I am new in Elastic search and I would appreciate if someone help me on below issue.We are trying to create new indexes on quarterly bases(Example :Data\_Q12021,Data\_Q22021,Data\_Q32021,...) and this way part…

---

## [File output extension](https://discuss.elastic.co/t/file-output-extension/270940)

<div class="topic-metadata">

**Author:** [@hilt86](https://discuss.elastic.co/u/hilt86)\
**Replies:** 1\
**Last updated:** [April 30, 2021, 2:43am UTC](https://discuss.elastic.co/t/file-output-extension/270940 "2021-04-30T02:43:04Z")

</div>

Is there a way to control the extension of the files created in the file output? I want to be able to name the files packetbeat.1.json for example rather than the default packetbeat.1 etc Also is it possible to use the…

---

## [Not to able to create new node](https://discuss.elastic.co/t/not-to-able-to-create-new-node/271537)

<div class="topic-metadata">

**Author:** [@hussshe](https://discuss.elastic.co/u/hussshe)\
**Replies:** 5\
**Last updated:** [April 30, 2021, 2:38am UTC](https://discuss.elastic.co/t/not-to-able-to-create-new-node/271537 "2021-04-30T02:38:13Z")

</div>

Hello Elastic Members, ES Version: 7.12.0 OS: Windows 10 I am following an udemy course on ES. The trainer has given a task to add an additional node to the cluster(contains only 1 node) that runs on a same machine. S…

---

## [FSCrawler2.6 : failed to create elasticsearch client, disabling crawler](https://discuss.elastic.co/t/fscrawler2-6-failed-to-create-elasticsearch-client-disabling-crawler/271701)

<div class="topic-metadata">

**Author:** [@joseph-l.amalraj](https://discuss.elastic.co/u/joseph-l.amalraj)\
**Replies:** 6\
**Last updated:** [April 30, 2021, 2:16am UTC](https://discuss.elastic.co/t/fscrawler2-6-failed-to-create-elasticsearch-client-disabling-crawler/271701 "2021-04-30T02:16:06Z")

</div>

Hi, Can you please share your suggestions for this issue.. I am using FSCrawler v2.6 and my ELK v6.8.14.. when i tried to ingest pdf files, getting below errors.. FYI.. with the same settings.json and data, i was able…

---

## [Promoting ML jobs from Pre-Prod to Prod (Different Environments)](https://discuss.elastic.co/t/promoting-ml-jobs-from-pre-prod-to-prod-different-environments/270412)

<div class="topic-metadata">

**Author:** [@Rohan-boogeyman](https://discuss.elastic.co/u/Rohan-boogeyman)\
**Replies:** 2\
**Last updated:** [April 30, 2021, 2:12am UTC](https://discuss.elastic.co/t/promoting-ml-jobs-from-pre-prod-to-prod-different-environments/270412 "2021-04-30T02:12:24Z")

</div>

Hello, I've come accross a situation where i am trying to promote our ML models from one environment to another - was curious if there's any way of doing it thru some CI/CD Pipeline or if anyone has implemented somethin…

---

## [Parsing multiple files with Filebeat](https://discuss.elastic.co/t/parsing-multiple-files-with-filebeat/271591)

<div class="topic-metadata">

**Author:** [@tkkchan](https://discuss.elastic.co/u/tkkchan)\
**Replies:** 8\
**Last updated:** [April 30, 2021, 1:20am UTC](https://discuss.elastic.co/t/parsing-multiple-files-with-filebeat/271591 "2021-04-30T01:20:29Z")

</div>

Dear all, I have several JSON files that I wish to parse with Filebeat; and I read the following: https://stackoverflow.com/questions/39983918/can-filebeat-use-multiple-config-files I used the code in the above soluti…

---

## [How to search over all fields and return every document containing that search in elasticsearch?](https://discuss.elastic.co/t/how-to-search-over-all-fields-and-return-every-document-containing-that-search-in-elasticsearch/271533)

<div class="topic-metadata">

**Author:** [@Sander\_Marx](https://discuss.elastic.co/u/Sander_Marx)\
**Replies:** 2\
**Last updated:** [April 30, 2021, 1:01am UTC](https://discuss.elastic.co/t/how-to-search-over-all-fields-and-return-every-document-containing-that-search-in-elasticsearch/271533 "2021-04-30T01:01:55Z")

</div>

I have a problem regarding searching in elasticsearch. I have a index with multiple documents with several fields. I want to be able to search over all the fields running a query and want it to return all the documents …

---

## [Setting up ElasticCloud to handle large data - does adding new nodes just replicate or share data?](https://discuss.elastic.co/t/setting-up-elasticcloud-to-handle-large-data-does-adding-new-nodes-just-replicate-or-share-data/271725)

<div class="topic-metadata">

**Author:** [@M\_Gibbs](https://discuss.elastic.co/u/M_Gibbs)\
**Replies:** 4\
**Last updated:** [April 30, 2021, 12:27am UTC](https://discuss.elastic.co/t/setting-up-elasticcloud-to-handle-large-data-does-adding-new-nodes-just-replicate-or-share-data/271725 "2021-04-30T00:27:49Z")

</div>

Hi all, So we have a single node currently in ElasticCloud and I've been advised we need multiple nodes as we have a number of shards that are unable to be assigned due to the single node. So, we have one node with 928…

---

## [Error loading visualizations in kibana timelion](https://discuss.elastic.co/t/error-loading-visualizations-in-kibana-timelion/271525)

<div class="topic-metadata">

**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\
**Replies:** 5\
**Last updated:** [April 30, 2021, 12:11am UTC](https://discuss.elastic.co/t/error-loading-visualizations-in-kibana-timelion/271525 "2021-04-30T00:11:10Z")

</div>

I have an error that appears when entering a dashboard in kibana, no data in the visualizations, everything comes out blank; these visualizations are of filebeat that the service works correctly, but this error comes out…

---

## [Filebeat Cisco logs in files](https://discuss.elastic.co/t/filebeat-cisco-logs-in-files/271687)

<div class="topic-metadata">

**Author:** [@Boardsec](https://discuss.elastic.co/u/Boardsec)\
**Replies:** 1\
**Last updated:** [April 29, 2021, 11:55pm UTC](https://discuss.elastic.co/t/filebeat-cisco-logs-in-files/271687 "2021-04-29T23:55:56Z")

</div>

Hi! I’m new to Filebeat, and I’d like to process some already generated ASA logs. How do I set up cisco.yml to ingest from /var/log/cisco/ instead of listening on a socket? Thanks!

---

## [Filebeat with Logstash failed to create Index](https://discuss.elastic.co/t/filebeat-with-logstash-failed-to-create-index/271561)

<div class="topic-metadata">

**Author:** [@madhug](https://discuss.elastic.co/u/madhug)\
**Replies:** 8\
**Last updated:** [April 29, 2021, 11:10pm UTC](https://discuss.elastic.co/t/filebeat-with-logstash-failed-to-create-index/271561 "2021-04-29T23:10:32Z")

</div>

Hi , I am new to ELK stack started exploring the tool. First I had setup ELK stack without filebeat everything is working fine. Wanted to explore the Filebeat after installing and configuring I do not see index create…

---

## [Export CSV data from Elasticsearch using Logstash](https://discuss.elastic.co/t/export-csv-data-from-elasticsearch-using-logstash/271702)

<div class="topic-metadata">

**Author:** [@ice2021](https://discuss.elastic.co/u/ice2021)\
**Replies:** 2\
**Last updated:** [April 29, 2021, 9:47pm UTC](https://discuss.elastic.co/t/export-csv-data-from-elasticsearch-using-logstash/271702 "2021-04-29T21:47:55Z")

</div>

Hi, I am trying to extract pivoted data from ES using Logstash. It works on Kibana but not on Logstash. \`Error: \[400\] {"error":{"root\_cause":\[{"type":"parsing\_exception","reason":"Unknown key for a VALUE\_STRING in \[qu…

---

## [Metricbeat kubernetes volumes type](https://discuss.elastic.co/t/metricbeat-kubernetes-volumes-type/271720)

<div class="topic-metadata">

**Author:** [@andrask](https://discuss.elastic.co/u/andrask)\
**Replies:** 0\
**Last updated:** [April 29, 2021, 9:23pm UTC](https://discuss.elastic.co/t/metricbeat-kubernetes-volumes-type/271720 "2021-04-29T21:23:23Z")

</div>

Metricbeat is providing numbers for volumes in my cluster. However, I find it hard to determine what type a volume is as this data is missing from the fields. Would it be possible to add the type field too? E.g. PV, Conf…

---

## [Heartbeat showing 1/2 of my nodes down](https://discuss.elastic.co/t/heartbeat-showing-1-2-of-my-nodes-down/271680)

<div class="topic-metadata">

**Author:** [@marone](https://discuss.elastic.co/u/marone)\
**Replies:** 2\
**Last updated:** [April 29, 2021, 9:20pm UTC](https://discuss.elastic.co/t/heartbeat-showing-1-2-of-my-nodes-down/271680 "2021-04-29T21:20:20Z")

</div>

Hey I have two nodes of elasticsearch running in two separate VMs in azure, I set up SSL + https for my cluster and secured kibana too running in VM1. I used self signed certificates following this doc. I used the file e…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1435)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1437)
