# Latest **URL:** https://discuss.elastic.co/latest.md?page=1865 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1866 --- ## [Node crash is happening ES 6.8](https://discuss.elastic.co/t/node-crash-is-happening-es-6-8/262791)
**Author:** [@nk1506](https://discuss.elastic.co/u/nk1506)\ **Replies:** 2\ **Last updated:** [February 1, 2021, 9:51am UTC](https://discuss.elastic.co/t/node-crash-is-happening-es-6-8/262791 "2021-02-01T09:51:41Z")
Because of some bad query GC clean up is happening more frequently and node is getting crashed after sometime. Is there any way to know which query is causing the issues? Or how to prevent node is going down? I read ab… --- ## [Install elasticsearch-analysis-ik not working](https://discuss.elastic.co/t/install-elasticsearch-analysis-ik-not-working/262800)
**Author:** [@George\_Lee](https://discuss.elastic.co/u/George_Lee)\ **Replies:** 2\ **Last updated:** [February 1, 2021, 9:40am UTC](https://discuss.elastic.co/t/install-elasticsearch-analysis-ik-not-working/262800 "2021-02-01T09:40:01Z")
hello I use the initialization container to install the plugin. ECK version: ECK version 1.3.1 kubernetes version Client Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.8", GitCommit:"9f2892aab98fe339… --- ## [Logstash file output plugin writing to the same file from multiple Logstash processes?!](https://discuss.elastic.co/t/logstash-file-output-plugin-writing-to-the-same-file-from-multiple-logstash-processes/261750)
**Author:** [@bjosve](https://discuss.elastic.co/u/bjosve)\ **Replies:** 2\ **Last updated:** [February 1, 2021, 9:18am UTC](https://discuss.elastic.co/t/logstash-file-output-plugin-writing-to-the-same-file-from-multiple-logstash-processes/261750 "2021-02-01T09:18:27Z")
Hi, In the following post, https://discuss.elastic.co/t/multiple-logstash-nodes-use-file-output-plugin-to-output-messages-to-one-file-in-a-shared-file-system/94275/9 @magnusbaeck writes, If Logstash is opening the o… --- ## [Recover shards from different version](https://discuss.elastic.co/t/recover-shards-from-different-version/262766)
**Author:** [@carmine.fabrizio](https://discuss.elastic.co/u/carmine.fabrizio)\ **Replies:** 2\ **Last updated:** [February 1, 2021, 9:16am UTC](https://discuss.elastic.co/t/recover-shards-from-different-version/262766 "2021-02-01T09:16:55Z")
Hi there, I have a cluster of 25 nodes with HOT/WARM/COLD phases in place, the cluster is running on version 7.5.1 and by mistake one of the hot nodes was running on a different version 7.8.1, and ingesting data, I not… --- ## [Why to empDir in elasticsearch and kibana](https://discuss.elastic.co/t/why-to-empdir-in-elasticsearch-and-kibana/262473)
**Author:** [@knagasri](https://discuss.elastic.co/u/knagasri)\ **Replies:** 1\ **Last updated:** [February 1, 2021, 9:03am UTC](https://discuss.elastic.co/t/why-to-empdir-in-elasticsearch-and-kibana/262473 "2021-02-01T09:03:20Z")
I am using ECK 1.1.0 , I am not defining anywhere in elasticsearch or kibana yaml files for empDir. But after deploying in kubernetes , when I describe pod I can see the below: - emptyDir: {} name: elastic-internal-e… --- ## [Best infrastructure for elasticsearch](https://discuss.elastic.co/t/best-infrastructure-for-elasticsearch/262737)
**Author:** [@iammanmale](https://discuss.elastic.co/u/iammanmale)\ **Replies:** 3\ **Last updated:** [February 1, 2021, 9:01am UTC](https://discuss.elastic.co/t/best-infrastructure-for-elasticsearch/262737 "2021-02-01T09:01:11Z")
We have 7 ES node + 2 logstash server to collect log from AWS machines around the world by filebeat. Those ES and logstash nodes are just desktop PC at the moment. We want to put them into a more reliable infrastructure. … --- ## [Java Scroll Api with aggregation](https://discuss.elastic.co/t/java-scroll-api-with-aggregation/262798)
**Author:** [@vands](https://discuss.elastic.co/u/vands)\ **Replies:** 0\ **Last updated:** [February 1, 2021, 8:27am UTC](https://discuss.elastic.co/t/java-scroll-api-with-aggregation/262798 "2021-02-01T08:27:46Z")
Hi All , I am using Java scroll API to fetch data from an index . Is it possible to use CompositeAggregationBuilder along with scroll api and get aggregation resultset in batches of 10000 from elastic . If so , please h… --- ## [Mapping fields as date when index already exists](https://discuss.elastic.co/t/mapping-fields-as-date-when-index-already-exists/262745)
**Author:** [@Giovanni\_Di\_Lembo](https://discuss.elastic.co/u/Giovanni_Di_Lembo)\ **Replies:** 2\ **Last updated:** [February 1, 2021, 8:19am UTC](https://discuss.elastic.co/t/mapping-fields-as-date-when-index-already-exists/262745 "2021-02-01T08:19:02Z")
Hi all and sorry for my poor english. I've successfully mapped a field as date (for kibana purpose) before ingestioning one document ,using this: PUT my-index { "mappings": { "properties": { "currentDate": { "t… --- ## [Elasticsearch master and client service/pod not coming up](https://discuss.elastic.co/t/elasticsearch-master-and-client-service-pod-not-coming-up/262788)
**Author:** [@Munieswaran](https://discuss.elastic.co/u/Munieswaran)\ **Replies:** 1\ **Last updated:** [February 1, 2021, 8:07am UTC](https://discuss.elastic.co/t/elasticsearch-master-and-client-service-pod-not-coming-up/262788 "2021-02-01T08:07:00Z")
I'm running Elasticsearch cluster in openshift environment, where i recently patched and rebooted the underlaying nodes, after reboot master and client pods are not coming up and error seems to be related to mount, but d… --- ## [Calculating Average Daily Count over 30 Days](https://discuss.elastic.co/t/calculating-average-daily-count-over-30-days/262758)
**Author:** [@Clay\_Curtis](https://discuss.elastic.co/u/Clay_Curtis)\ **Replies:** 1\ **Last updated:** [February 1, 2021, 7:42am UTC](https://discuss.elastic.co/t/calculating-average-daily-count-over-30-days/262758 "2021-02-01T07:42:38Z")
I am trying to make a table visualization that shows the 30-day averages of the daily averages of log volume (count) per per log source split by type. For example, If I have 10 log sources, half are firewalls, and hal… --- ## [Ingest node cloning](https://discuss.elastic.co/t/ingest-node-cloning/262485)
**Author:** [@NickGearls](https://discuss.elastic.co/u/NickGearls)\ **Replies:** 3\ **Last updated:** [February 1, 2021, 7:35am UTC](https://discuss.elastic.co/t/ingest-node-cloning/262485 "2021-02-01T07:35:33Z")
There is no "clone" feature in ingest nodes as in LogStash. Is it possible to implement this feature with a plugin? I want to use the cloud version, so I don't want to install my own LogStash server for this cloning (a… --- ## [Column span in Kibana canvas data table](https://discuss.elastic.co/t/column-span-in-kibana-canvas-data-table/262654)
**Author:** [@BitBucketUser\_user](https://discuss.elastic.co/u/BitBucketUser_user)\ **Replies:** 2\ **Last updated:** [February 1, 2021, 7:27am UTC](https://discuss.elastic.co/t/column-span-in-kibana-canvas-data-table/262654 "2021-02-01T07:27:29Z")
Hello, Is it possible to perform row-span or column-span operations on Kibana Canvas Data table? Something similar to this? --- ## [Misalignment in TSVB data table](https://discuss.elastic.co/t/misalignment-in-tsvb-data-table/261896)
**Author:** [@Bhavya\_Bansal](https://discuss.elastic.co/u/Bhavya_Bansal)\ **Replies:** 1\ **Last updated:** [February 1, 2021, 7:20am UTC](https://discuss.elastic.co/t/misalignment-in-tsvb-data-table/261896 "2021-02-01T07:20:35Z")
Hi, I'm using Kibana 7.9 and the alignment of records and the headers is not editable and the default looks off. Is there a way to align these? Maybe align everything to the left. Here it seems, the header is left align… --- ## [Alerts & Actions Server Log](https://discuss.elastic.co/t/alerts-actions-server-log/262358)
**Author:** [@Angelos](https://discuss.elastic.co/u/Angelos)\ **Replies:** 1\ **Last updated:** [February 1, 2021, 7:13am UTC](https://discuss.elastic.co/t/alerts-actions-server-log/262358 "2021-02-01T07:13:19Z")
Hi, I started using Alerts and Actions in Kibana and I have a question about Server Log action. How can get the results there? Where can I see the messages when action is triggered? Thank you in advance! /Angelos --- ## [Write Operations in Kibana](https://discuss.elastic.co/t/write-operations-in-kibana/262574)
**Author:** [@ITchandj](https://discuss.elastic.co/u/ITchandj)\ **Replies:** 1\ **Last updated:** [February 1, 2021, 7:05am UTC](https://discuss.elastic.co/t/write-operations-in-kibana/262574 "2021-02-01T07:05:12Z")
Hello people!!! please how could i write this Splunk function in kibana sum(NetTargetConnectCount) as SumNetTargetConnectCount sum(NetTargetReconnectCount) as SumNetTargetReconnectCount sum(NetTargetRetransmitCount) … --- ## [Logstash ‘77⚠constant::Fixnum is deprecated’ and not work](https://discuss.elastic.co/t/logstash-77constant-fixnum-is-deprecated-and-not-work/262792)
**Author:** [@plumy0902](https://discuss.elastic.co/u/plumy0902)\ **Replies:** 0\ **Last updated:** [February 1, 2021, 6:49am UTC](https://discuss.elastic.co/t/logstash-77constant-fixnum-is-deprecated-and-not-work/262792 "2021-02-01T06:49:15Z")
Hi I was trying to send data to elasticsearch using scheduler. I want it to run once a day and update new records. But it gets stuck after these outputs. Please suggest any solution, thanks. (ps : logstash version is 7.… --- ## [Elasticsearch의 필드 관련 질문](https://discuss.elastic.co/t/elasticsearch/260779)
**Author:** [@teichae](https://discuss.elastic.co/u/teichae)\ **Replies:** 1\ **Last updated:** [February 1, 2021, 6:04am UTC](https://discuss.elastic.co/t/elasticsearch/260779 "2021-02-01T06:04:27Z")
안녕하세요. Elasticsearch 관련 궁금한 점이 있어서 문의드립니다. 현재 저희 회사에서 로그 관리 시스템을 운영하려고 준비중인데요. Elasticsearch 에다가 특정 툴을 이용해서 적재 테스트 중입니다. 특정 한개 필드에서 포맷이 두개가 있는 경우가 있는데, 한쪽이 계속 누락되고 있습니다. 예를 들어... "color": { "key": "오크색", "label"… --- ## [Index Roller Policy not working](https://discuss.elastic.co/t/index-roller-policy-not-working/262553)
**Author:** [@sureshdpawar](https://discuss.elastic.co/u/sureshdpawar)\ **Replies:** 2\ **Last updated:** [February 1, 2021, 4:39am UTC](https://discuss.elastic.co/t/index-roller-policy-not-working/262553 "2021-02-01T04:39:57Z")
I am referring to above document to automate rollover with ILM. I am doing it without data streams and by using an ILM index alias, I created a lifecycle policy as named as timeseires\_policy with below setting { … --- ## [Custom Query for Range / Bucket Aggregation](https://discuss.elastic.co/t/custom-query-for-range-bucket-aggregation/262635)
**Author:** [@bhavin.shah](https://discuss.elastic.co/u/bhavin.shah)\ **Replies:** 2\ **Last updated:** [February 1, 2021, 4:08am UTC](https://discuss.elastic.co/t/custom-query-for-range-bucket-aggregation/262635 "2021-02-01T04:08:02Z")
Hi, ELK setup - 3 nodes/ 7.10.0 version Query :- I am trying to create one query for business where below is raw data and expected output as well. Left side - is raw data and final data is dealer ID wise brk\_amt wise… --- ## [How i can get timestamp?](https://discuss.elastic.co/t/how-i-can-get-timestamp/262777)
**Author:** [@Ricky\_Alamsyah](https://discuss.elastic.co/u/Ricky_Alamsyah)\ **Replies:** 1\ **Last updated:** [February 1, 2021, 3:27am UTC](https://discuss.elastic.co/t/how-i-can-get-timestamp/262777 "2021-02-01T03:27:05Z")
how i can get range timestamp with format epoch\_millis ? "mappings": { "properties": { "@timestamp": { "type": "date" }, i try this but not working { "query":{ "bool": { "must": \[{ "match\_all": {} }\], "filter… --- ## [Dynamically assign filter, char\_filter, analyzer?](https://discuss.elastic.co/t/dynamically-assign-filter-char-filter-analyzer/262774)
**Author:** [@adude946](https://discuss.elastic.co/u/adude946)\ **Replies:** 4\ **Last updated:** [February 1, 2021, 2:30am UTC](https://discuss.elastic.co/t/dynamically-assign-filter-char-filter-analyzer/262774 "2021-02-01T02:30:48Z")
Wanted to know if it's possible to dynamically assign filter, char\_filter & analyzer? We have multilanguage data in ES. The search is language specific which the application detects at request time. So if request is in … --- ## [Include specific fields from document using Ingest pipeline](https://discuss.elastic.co/t/include-specific-fields-from-document-using-ingest-pipeline/262734)
**Author:** [@mussa572](https://discuss.elastic.co/u/mussa572)\ **Replies:** 1\ **Last updated:** [February 1, 2021, 1:02am UTC](https://discuss.elastic.co/t/include-specific-fields-from-document-using-ingest-pipeline/262734 "2021-02-01T01:02:00Z")
Hi I am ingesting following document to elasticsearch directly . First I am only interested in wprss\_ftp\_feed\_source and its values and exclude all other fields before they are ingested into index . second after select… --- ## [Unable to listen on port 5044 for logstash on unbuntu 20.04](https://discuss.elastic.co/t/unable-to-listen-on-port-5044-for-logstash-on-unbuntu-20-04/262664)
**Author:** [@Paul\_Fleming](https://discuss.elastic.co/u/Paul_Fleming)\ **Replies:** 1\ **Last updated:** [February 1, 2021, 12:48am UTC](https://discuss.elastic.co/t/unable-to-listen-on-port-5044-for-logstash-on-unbuntu-20-04/262664 "2021-02-01T00:48:18Z")
Using Ubuntu 20.04 I have confirmed OpenSSL is running and then I have installed logstash by running the following commands. \` openssl version -a apt install logstash -y Edit the etc/hosts file and add the following … --- ## [Unregistered Authentication Agent for unix-process](https://discuss.elastic.co/t/unregistered-authentication-agent-for-unix-process/262716)
**Author:** [@Taufik\_Maulana](https://discuss.elastic.co/u/Taufik_Maulana)\ **Replies:** 1\ **Last updated:** [February 1, 2021, 12:45am UTC](https://discuss.elastic.co/t/unregistered-authentication-agent-for-unix-process/262716 "2021-02-01T00:45:39Z")
Hello everyone, I'm having trouble starting my elasticsearch . This is what journal -xe command's output. -- Subject: Unit elasticsearch.service has begun start-up -- Defined-By: systemd -- Support: http://lists.freed… --- ## [Can I connect MySQL database to elastic search?](https://discuss.elastic.co/t/can-i-connect-mysql-database-to-elastic-search/262743)
**Author:** [@Arun\_Sharma](https://discuss.elastic.co/u/Arun_Sharma)\ **Replies:** 3\ **Last updated:** [February 1, 2021, 12:43am UTC](https://discuss.elastic.co/t/can-i-connect-mysql-database-to-elastic-search/262743 "2021-02-01T00:43:42Z")
Can I connect a MySQL database with elasticsearch and will I able to make a search engine for organization after learning elasticsearch? For example : if I type on the search bar "how many employees joined today from Mu… --- ## [Conflicting Use Cases? Perf concerns?](https://discuss.elastic.co/t/conflicting-use-cases-perf-concerns/262733)
**Author:** [@brpinard](https://discuss.elastic.co/u/brpinard)\ **Replies:** 2\ **Last updated:** [January 31, 2021, 4:33pm UTC](https://discuss.elastic.co/t/conflicting-use-cases-perf-concerns/262733 "2021-01-31T16:33:06Z")
I’m looking to deliver an Elasticsearch based search experience off our event driven architecture. We have a stream of events on Kalfka. Each event represents a state change for a thing that we can call a case. There a… --- ## [Metricbeat for m3db](https://discuss.elastic.co/t/metricbeat-for-m3db/262605)
**Author:** [@Mohith\_Vegi](https://discuss.elastic.co/u/Mohith_Vegi)\ **Replies:** 1\ **Last updated:** [February 1, 2021, 12:27am UTC](https://discuss.elastic.co/t/metricbeat-for-m3db/262605 "2021-02-01T00:27:32Z")
how can i monitor m3db using metricbeats, since metricbeat doesn't support m3db module.. plz help --- ## [Clarification on setting up TLS in an elastic cluster](https://discuss.elastic.co/t/clarification-on-setting-up-tls-in-an-elastic-cluster/262613)
**Author:** [@first100](https://discuss.elastic.co/u/first100)\ **Replies:** 0\ **Last updated:** [January 29, 2021, 8:19am UTC](https://discuss.elastic.co/t/clarification-on-setting-up-tls-in-an-elastic-cluster/262613 "2021-01-29T08:19:36Z")
Hello, im trying to set up TLS in elastic cluster, the cluster works normally without tls, communicating in http, im received from company some certificates for all node of my cluster, ca\_cert.crt, subca\_cert.crt, machi… --- ## [Slack-Alerting | JSON Body](https://discuss.elastic.co/t/slack-alerting-json-body/262677)
**Author:** [@manjesh23](https://discuss.elastic.co/u/manjesh23)\ **Replies:** 0\ **Last updated:** [January 29, 2021, 6:15pm UTC](https://discuss.elastic.co/t/slack-alerting-json-body/262677 "2021-01-29T18:15:28Z")
Hello All, I am testing Kibana to Slack feature. Where, I am receiving a alert message on Slack but no data is present in there. "actions": { "incoming-webhook": { "throttle\_period\_in\_millis": 10000, … --- ## [Reindexing doesnt work](https://discuss.elastic.co/t/reindexing-doesnt-work/262693)
**Author:** [@Deny7](https://discuss.elastic.co/u/Deny7)\ **Replies:** 1\ **Last updated:** [February 1, 2021, 12:24am UTC](https://discuss.elastic.co/t/reindexing-doesnt-work/262693 "2021-02-01T00:24:36Z")
Hi, I changed mapping to index so I wanted reindex. I have about 200 daily indicies that I want reindex. I used bellow command. When I ran it gave me 504 timeout error. When I checked GET /\_cat/indices?v there is creat… [Previous page](https://discuss.elastic.co/latest.md?page=1864) [Next page](https://discuss.elastic.co/latest.md?page=1866)