# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1129 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1130 --- ## [Heartbeat.yml nano error](https://discuss.elastic.co/t/heartbeat-yml-nano-error/291680)
**Author:** [@Brendanluvsdata](https://discuss.elastic.co/u/Brendanluvsdata)\ **Replies:** 3\ **Last updated:** [December 13, 2021, 6:25pm UTC](https://discuss.elastic.co/t/heartbeat-yml-nano-error/291680 "2021-12-13T18:25:17Z")
The lab says to type "nano heartbeat". When I do that all I get is gibberish (see attached). I figured out that if you type instead "nano heartbeat.yml" that it opens properly. --- ## [Can't get nodes communicate to each other via TLS-secured transport](https://discuss.elastic.co/t/cant-get-nodes-communicate-to-each-other-via-tls-secured-transport/291676)
**Author:** [@v\_melnyk](https://discuss.elastic.co/u/v_melnyk)\ **Replies:** 1\ **Last updated:** [December 13, 2021, 6:00pm UTC](https://discuss.elastic.co/t/cant-get-nodes-communicate-to-each-other-via-tls-secured-transport/291676 "2021-12-13T18:00:18Z")
Hello, I have a question regarding deploying of a cluster of nodes and stuck with an inter-node communications issue. It seems that my mistake and the solution are pretty obvious, but somewhy I can't grasp what exactly … --- ## [How to re-name multiple field names at once in logstash](https://discuss.elastic.co/t/how-to-re-name-multiple-field-names-at-once-in-logstash/291599)
**Author:** [@Anusha\_Kusanghi](https://discuss.elastic.co/u/Anusha_Kusanghi)\ **Replies:** 1\ **Last updated:** [December 13, 2021, 5:45pm UTC](https://discuss.elastic.co/t/how-to-re-name-multiple-field-names-at-once-in-logstash/291599 "2021-12-13T17:45:14Z")
Hie All, I want to rename fields names from this : "\[url\]\[path\]" =\> to "url path" and "\[server\]\[domain\]" =\> "Server domain" We can use mutate filter plugin (as mutate uses lot of cpu) ,but I have nearly 50 fields name… --- ## [CSV MalformedCSVError: Illegal quoting in line](https://discuss.elastic.co/t/csv-malformedcsverror-illegal-quoting-in-line/291639)
**Author:** [@mangeshs](https://discuss.elastic.co/u/mangeshs)\ **Replies:** 1\ **Last updated:** [December 13, 2021, 4:59pm UTC](https://discuss.elastic.co/t/csv-malformedcsverror-illegal-quoting-in-line/291639 "2021-12-13T16:59:45Z")
I have used CSV filter to log the events my sample data is 2021-12-09 12:12:09,155 INFO com.tdg.box.incrindex.service.PastEventProcessor \[Thread-14\] Captured Event false dbf5b71c-faa1-4e73-b8db-bf057002e3f5 UPLOAD 1747… --- ## [Mapping Strategies For Survey Data](https://discuss.elastic.co/t/mapping-strategies-for-survey-data/291481)
**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\ **Replies:** 2\ **Last updated:** [December 13, 2021, 4:58pm UTC](https://discuss.elastic.co/t/mapping-strategies-for-survey-data/291481 "2021-12-13T16:58:55Z")
I am ingesting data and looking for opinions on better ways of indexing the data for later aggregation analytics. The data is currently pulled and stored in Elasticsearch as numbered q&a fields. { "question1": { … --- ## [Docker images for elasticsearch compatibility with Amazon ARM based EC2 machines?](https://discuss.elastic.co/t/docker-images-for-elasticsearch-compatibility-with-amazon-arm-based-ec2-machines/291693)
**Author:** [@Ritesh\_Uniyal](https://discuss.elastic.co/u/Ritesh_Uniyal)\ **Replies:** 0\ **Last updated:** [December 13, 2021, 4:58pm UTC](https://discuss.elastic.co/t/docker-images-for-elasticsearch-compatibility-with-amazon-arm-based-ec2-machines/291693 "2021-12-13T16:58:10Z")
Are docker images for Elasticsearch provided at location (elasticsearch | Docker @ Elastic) compatible with Amazon ARM based EC2 machines? --- ## [Error running Logstash 7.16.1 OSS](https://discuss.elastic.co/t/error-running-logstash-7-16-1-oss/291677)
**Author:** [@BenSeb](https://discuss.elastic.co/u/BenSeb)\ **Replies:** 2\ **Last updated:** [December 13, 2021, 4:54pm UTC](https://discuss.elastic.co/t/error-running-logstash-7-16-1-oss/291677 "2021-12-13T16:54:53Z")
We're getting the following errors when trying to run 7.16.1 OSS \[2021-12-13T14:53:22,775\]\[INFO \]\[logstash.runner \] Log4j configuration path used is: /etc/logstash/log4j2.properties \[2021-12-13T14:53:22,790\]\[I… --- ## [Fscrawler refuses connection over https](https://discuss.elastic.co/t/fscrawler-refuses-connection-over-https/291689)
**Author:** [@ehsan\_kabiri\_33](https://discuss.elastic.co/u/ehsan_kabiri_33)\ **Replies:** 0\ **Last updated:** [December 13, 2021, 4:18pm UTC](https://discuss.elastic.co/t/fscrawler-refuses-connection-over-https/291689 "2021-12-13T16:18:50Z")
I've studied this page and really do not not how to make and use .cer certificate, so can't launch fscrawler over secured connection. I created a certificate like this: sudo ./elasticsearch-certutil ca -out /etc/elasti… --- ## [exception=\>#\](https://discuss.elastic.co/t/exception-csv-illegal-quoting-in-line-1/291437)
**Author:** [@stillfreem](https://discuss.elastic.co/u/stillfreem)\ **Replies:** 2\ **Last updated:** [December 13, 2021, 4:06pm UTC](https://discuss.elastic.co/t/exception-csv-illegal-quoting-in-line-1/291437 "2021-12-13T16:06:49Z")
My config file is: { stdin{} } filter { if "box\_Firewall" not in \[program\] { if \[message\] =~ /{".\*":\\s".\*",/ { json { source =\> "message" } … --- ## [Logstash.conf not building pipeline.yml file](https://discuss.elastic.co/t/logstash-conf-not-building-pipeline-yml-file/291259)
**Author:** [@MKirby](https://discuss.elastic.co/u/MKirby)\ **Replies:** 12\ **Last updated:** [December 13, 2021, 3:36pm UTC](https://discuss.elastic.co/t/logstash-conf-not-building-pipeline-yml-file/291259 "2021-12-13T15:36:58Z")
Good Afternoon Elastic Peeps; I am in the process of creating a second logstash.conf file on my server. It is intended to pull data from a microsoft database. To that end I downloaded and extracted the sqljdbc9.4.jar … --- ## [ES-hadoop serialize org.apache.hadoop.io.ShortWritable failed](https://discuss.elastic.co/t/es-hadoop-serialize-org-apache-hadoop-io-shortwritable-failed/276894)
**Author:** [@zjd-melo](https://discuss.elastic.co/u/zjd-melo)\ **Replies:** 3\ **Last updated:** [December 13, 2021, 2:50pm UTC](https://discuss.elastic.co/t/es-hadoop-serialize-org-apache-hadoop-io-shortwritable-failed/276894 "2021-12-13T14:50:32Z")
Hi I am using pyspark with es-hadoop process es data ES 7.4.0 spark 2.3.1 PUT test { "mappings": { "properties": { "price": { "type": "short" } } } } P… --- ## [Convert IP string to Integer](https://discuss.elastic.co/t/convert-ip-string-to-integer/290351)
**Author:** [@rojin](https://discuss.elastic.co/u/rojin)\ **Replies:** 3\ **Last updated:** [December 13, 2021, 2:48pm UTC](https://discuss.elastic.co/t/convert-ip-string-to-integer/290351 "2021-12-13T14:48:18Z")
Hi!, Is there a way to convert an IP address to an integer in logstash filters? Suppose I have the grok pattern: %{IPv4: clientip} - %{DATA:name}.... I want to have the equivalent byte-like integer of the IP address t… --- ## [Parsing a date and timestamp to default Elasticsearch](https://discuss.elastic.co/t/parsing-a-date-and-timestamp-to-default-elasticsearch/291667)
**Author:** [@mangesh\_shinde](https://discuss.elastic.co/u/mangesh_shinde)\ **Replies:** 2\ **Last updated:** [December 13, 2021, 2:43pm UTC](https://discuss.elastic.co/t/parsing-a-date-and-timestamp-to-default-elasticsearch/291667 "2021-12-13T14:43:44Z")
I have a field called event\_timestamp with format Thu Dec 09 15:02:66 IST 2021 I want to parse this format to default elastic acceptable format I use date filter as below date{ match =\> \["event\_timestamp","EEE MMM dd… --- ## [Duplicates were found \[.kibana (alias of \[.kibana\_2/gSBnpInZS6KXHw6xXlP7AA\])\]"](https://discuss.elastic.co/t/duplicates-were-found-kibana-alias-of-kibana-2-gsbnpinzs6kxhw6xxlp7aa/291671)
**Author:** [@siva1233](https://discuss.elastic.co/u/siva1233)\ **Replies:** 0\ **Last updated:** [December 13, 2021, 2:26pm UTC](https://discuss.elastic.co/t/duplicates-were-found-kibana-alias-of-kibana-2-gsbnpinzs6kxhw6xxlp7aa/291671 "2021-12-13T14:26:27Z")
Hi All, i'm using Elasticsearch 7.3.0 in kubernetes and Openshift with client,data and master pods, whenever data pod is deleted and after recreated pod i'm getting below error. {"type": "server", "timestamp": "2021-12-… --- ## [Filebeat decode\_cef messes up fields, when not all header fields are given](https://discuss.elastic.co/t/filebeat-decode-cef-messes-up-fields-when-not-all-header-fields-are-given/291664)
**Author:** [@buzzdeee](https://discuss.elastic.co/u/buzzdeee)\ **Replies:** 0\ **Last updated:** [December 13, 2021, 1:53pm UTC](https://discuss.elastic.co/t/filebeat-decode-cef-messes-up-fields-when-not-all-header-fields-are-given/291664 "2021-12-13T13:53:21Z")
Hi, the CEF spec found here: https://community.microfocus.com/cfs-file/\_\_key/communityserver-wikis-components-files/00-00-00-00-23/3731.CommonEventFormatV25.pdf it says: CEF uses syslog as a transport mechanism. It us… --- ## [Logstash concatenar dos campos strig](https://discuss.elastic.co/t/logstash-concatenar-dos-campos-strig/291657)
**Author:** [@Javier\_Garcia\_Alvare](https://discuss.elastic.co/u/Javier_Garcia_Alvare)\ **Replies:** 2\ **Last updated:** [December 13, 2021, 1:52pm UTC](https://discuss.elastic.co/t/logstash-concatenar-dos-campos-strig/291657 "2021-12-13T13:52:28Z")
Hola, Necesito concatenar dos campos tipo string en el fichero de logtash ¿alguien me puede ayudar? es decir, los campos ya exiten del csv. filter.. mutate { add\_field =\> {"CANALITSOFT" =\> ""} } ruby{ code =\> " … --- ## [Is it possible to change the color of a submetric inside a metric?](https://discuss.elastic.co/t/is-it-possible-to-change-the-color-of-a-submetric-inside-a-metric/291404)
**Author:** [@Gonzalo\_Cabanillas\_P](https://discuss.elastic.co/u/Gonzalo_Cabanillas_P)\ **Replies:** 2\ **Last updated:** [December 13, 2021, 1:49pm UTC](https://discuss.elastic.co/t/is-it-possible-to-change-the-color-of-a-submetric-inside-a-metric/291404 "2021-12-13T13:49:39Z")
How can i change the color of the 1.52% to red? It is a metric in TSVB And this is the metric part: Thanks. --- ## [Logstash input Kafka error](https://discuss.elastic.co/t/logstash-input-kafka-error/291345)
**Author:** [@Khaled\_Saidi](https://discuss.elastic.co/u/Khaled_Saidi)\ **Replies:** 1\ **Last updated:** [December 13, 2021, 1:27pm UTC](https://discuss.elastic.co/t/logstash-input-kafka-error/291345 "2021-12-13T13:27:04Z")
Hi evrery one, i'm facing an issue while using kafka as my logstash input. when i started logstash i have this error : Unable to poll Kafka consumer {:kafka\_error\_message=\>org.apache.kafka.common.KafkaException: Recei… --- ## [How to configure GCS as filebeat input](https://discuss.elastic.co/t/how-to-configure-gcs-as-filebeat-input/291453)
**Author:** [@arvin495](https://discuss.elastic.co/u/arvin495)\ **Replies:** 7\ **Last updated:** [December 13, 2021, 1:13pm UTC](https://discuss.elastic.co/t/how-to-configure-gcs-as-filebeat-input/291453 "2021-12-13T13:13:01Z")
Hello Team, We are storing our audit logs in GCS bucket. we would like to ingest them to Elasticsearch when required - not regularly - using filebeat. I have checked S3 option where it let us use s3 like storages as inp… --- ## [Move to ultrawarm aws managed elasticsearch](https://discuss.elastic.co/t/move-to-ultrawarm-aws-managed-elasticsearch/291319)
**Author:** [@rizvaughan](https://discuss.elastic.co/u/rizvaughan)\ **Replies:** 4\ **Last updated:** [December 13, 2021, 1:07pm UTC](https://discuss.elastic.co/t/move-to-ultrawarm-aws-managed-elasticsearch/291319 "2021-12-13T13:07:18Z")
Hello all, We have aws managed Elasticsearch(now opensearch) with weekly indices. We use curator for index retention. Here is what were are doing now --- actions: 1: action: delete\_indices description: \>- … --- ## [Where to find a list of newly added integrations for per release?](https://discuss.elastic.co/t/where-to-find-a-list-of-newly-added-integrations-for-per-release/291363)
**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\ **Replies:** 4\ **Last updated:** [December 13, 2021, 1:06pm UTC](https://discuss.elastic.co/t/where-to-find-a-list-of-newly-added-integrations-for-per-release/291363 "2021-12-13T13:06:52Z")
Hi, With every new release of Elastic since Integrations/Fleet were added, there have been new integrations added (from what I can tell). Is there a place I can find a list of integrations and in what release they were … --- ## [Combining date and time fields in csv](https://discuss.elastic.co/t/combining-date-and-time-fields-in-csv/290624)
**Author:** [@Pba\_In](https://discuss.elastic.co/u/Pba_In)\ **Replies:** 5\ **Last updated:** [December 13, 2021, 12:15pm UTC](https://discuss.elastic.co/t/combining-date-and-time-fields-in-csv/290624 "2021-12-13T12:15:08Z")
I have a csv file that I'm looking to import into Kibana. There is a date field and a time field. I would like to combine them to be used as a timestamp, so that I can then search for specific time ranges. However, the… --- ## [Add comment in kibana elasticsearch](https://discuss.elastic.co/t/add-comment-in-kibana-elasticsearch/291624)
**Author:** [@Aitor\_MtzAm](https://discuss.elastic.co/u/Aitor_MtzAm)\ **Replies:** 2\ **Last updated:** [December 13, 2021, 12:01pm UTC](https://discuss.elastic.co/t/add-comment-in-kibana-elasticsearch/291624 "2021-12-13T12:01:09Z")
Hi! is there any chance to comment in elastic? like you can comment in sql or java with /\* \*/ or -- --- ## [Kibana migrates index every time it starts](https://discuss.elastic.co/t/kibana-migrates-index-every-time-it-starts/291402)
**Author:** [@driveirk](https://discuss.elastic.co/u/driveirk)\ **Replies:** 2\ **Last updated:** [December 13, 2021, 11:23am UTC](https://discuss.elastic.co/t/kibana-migrates-index-every-time-it-starts/291402 "2021-12-13T11:23:44Z")
Hey! We have a cluster of 4 servers with Elasticsearch and kibans 7.15.1. Every time we restart kibana, reindex is started: { "tasks": { "GrebRFKTSyqTXAWk3FwIUg:6687096": { "node": "GrebRFKTSyqTXAWk3FwIUg"… --- ## [Unable to access 'path.repo'](https://discuss.elastic.co/t/unable-to-access-path-repo/291633)
**Author:** [@WTrois](https://discuss.elastic.co/u/WTrois)\ **Replies:** 0\ **Last updated:** [December 13, 2021, 11:12am UTC](https://discuss.elastic.co/t/unable-to-access-path-repo/291633 "2021-12-13T11:12:55Z")
Hi, I'm having problems uploading indices from a snapshot. I'm running Elasticsearch version 7.16.0 I have: path.repo: \["/home/user/Downloads/snapshot1"\] in my yml file. The Elasticsearch cluster fails to start. The … --- ## [Elasticksearch query in stack alerts not exist](https://discuss.elastic.co/t/elasticksearch-query-in-stack-alerts-not-exist/291625)
**Author:** [@Mohamed\_Emad](https://discuss.elastic.co/u/Mohamed_Emad)\ **Replies:** 0\ **Last updated:** [December 13, 2021, 10:39am UTC](https://discuss.elastic.co/t/elasticksearch-query-in-stack-alerts-not-exist/291625 "2021-12-13T10:39:47Z")
Hi, I want to monitor a list of keywords in a certain index and write these events in a new index after a little search, I found the way for that using Elasticsearch query in stack alerts but I can't find it I found t… --- ## [Use of caps in query with field names while perform search](https://discuss.elastic.co/t/use-of-caps-in-query-with-field-names-while-perform-search/291598)
**Author:** [@BIRENDRA](https://discuss.elastic.co/u/BIRENDRA)\ **Replies:** 2\ **Last updated:** [December 13, 2021, 10:39am UTC](https://discuss.elastic.co/t/use-of-caps-in-query-with-field-names-while-perform-search/291598 "2021-12-13T10:39:25Z")
Hi Team, I have seen caps in field names while doing a search. Specially inside should block which contributes to score. I tried doing similar thing to see the effect but score remained same whatever number I gave after… --- ## [Get the entire sub-tree / tree structure for a document based on a field](https://discuss.elastic.co/t/get-the-entire-sub-tree-tree-structure-for-a-document-based-on-a-field/291614)
**Author:** [@olivebranch](https://discuss.elastic.co/u/olivebranch)\ **Replies:** 2\ **Last updated:** [December 13, 2021, 10:30am UTC](https://discuss.elastic.co/t/get-the-entire-sub-tree-tree-structure-for-a-document-based-on-a-field/291614 "2021-12-13T10:30:06Z")
I have a hierarchical structure (much like categories contained within categories) in my document like following: 1(parent for root category is: -1) / \\ 2 3 … --- ## [The grok works very strangely in logstash](https://discuss.elastic.co/t/the-grok-works-very-strangely-in-logstash/291427)
**Author:** [@San9](https://discuss.elastic.co/u/San9)\ **Replies:** 5\ **Last updated:** [December 13, 2021, 10:13am UTC](https://discuss.elastic.co/t/the-grok-works-very-strangely-in-logstash/291427 "2021-12-13T10:13:42Z")
To all lovers of this hello! In some excellent one noticed that my messages in logstash stopped parsing, an error appeared - \_grokparsefailure. but no configuration changes were made. Original messages 1.2.3.4 0 - Tes… --- ## [Why do non ASCII characters cause problems in elastic search?](https://discuss.elastic.co/t/why-do-non-ascii-characters-cause-problems-in-elastic-search/291617)
**Author:** [@Pineirin](https://discuss.elastic.co/u/Pineirin)\ **Replies:** 0\ **Last updated:** [December 13, 2021, 9:56am UTC](https://discuss.elastic.co/t/why-do-non-ascii-characters-cause-problems-in-elastic-search/291617 "2021-12-13T09:56:52Z")
Greetings. I have found a problem in the search bar of my application (that uses Elasticsearch for the search bar). If I do a fuzzy search of a text (in this case the title of a book) that is quite long (more than 96 c… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1128) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1130)