# Latest **URL:** https://discuss.elastic.co/latest.md?page=1587 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1588 --- ## [Ingest data via Modbus and BACnet communication protocols to Elastic](https://discuss.elastic.co/t/ingest-data-via-modbus-and-bacnet-communication-protocols-to-elastic/277598)
**Author:** [@Valdos116](https://discuss.elastic.co/u/Valdos116)\ **Replies:** 0\ **Last updated:** [July 1, 2021, 8:56pm UTC](https://discuss.elastic.co/t/ingest-data-via-modbus-and-bacnet-communication-protocols-to-elastic/277598 "2021-07-01T20:56:08Z")
Hi Team, I'm trying to ingest data from field devices that talk Modbus TCP and BACnet IP to Elastic Logstash. Any help would be appreciated. Thanks --- ## [Disk usage threshold](https://discuss.elastic.co/t/disk-usage-threshold/277328)
**Author:** [@Abhishek\_Shinde](https://discuss.elastic.co/u/Abhishek_Shinde)\ **Replies:** 5\ **Last updated:** [July 6, 2021, 1:35am UTC](https://discuss.elastic.co/t/disk-usage-threshold/277328 "2021-07-06T01:35:29Z")
I'm planning integrate Elasticsearch as a single node cluster per application server. Application server is getting hosted in customer environment. For disk threshold, I'm planning to use only disk flood\_stage configura… --- ## [반복문을 사용한 csv 데이터 insert 방법](https://discuss.elastic.co/t/csv-insert/277883)
**Author:** [@111488](https://discuss.elastic.co/u/111488)\ **Replies:** 1\ **Last updated:** [July 6, 2021, 1:09am UTC](https://discuss.elastic.co/t/csv-insert/277883 "2021-07-06T01:09:40Z")
안녕하세요 엘라스틱 서치를 사용해서 대용량 csv 파일을 실시간 데이터인 것처럼 활용하려고 합니다. datetime 형식의 타임 인덱스를 기반으로 100개 미만의 컬럼을 갖은 데이터 셋을 1초(또는 1분)마다 한줄씩 append를 하려고 합니다. 대량의 데이터를 한번에 삽입하는 것이 아닌, 인덱스를 기준으로 특정 주기마다 한 줄씩 삽입하는 방법을 알고 싶습니다. --- ## [Problems getting filebeat to connect to logstash container running in kubernetes](https://discuss.elastic.co/t/problems-getting-filebeat-to-connect-to-logstash-container-running-in-kubernetes/277754)
**Author:** [@RyanCherry](https://discuss.elastic.co/u/RyanCherry)\ **Replies:** 3\ **Last updated:** [July 6, 2021, 12:48am UTC](https://discuss.elastic.co/t/problems-getting-filebeat-to-connect-to-logstash-container-running-in-kubernetes/277754 "2021-07-06T00:48:30Z")
Hi there, I have used the helm chart to install logstash onto my kubernetes cluster, however I am having problems getting filebeat to send logs to logstash. Filebeat is running on a windows server as a service on that s… --- ## [Lifecycle policies don't work](https://discuss.elastic.co/t/lifecycle-policies-dont-work/276218)
**Author:** [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\ **Replies:** 13\ **Last updated:** [July 5, 2021, 11:40pm UTC](https://discuss.elastic.co/t/lifecycle-policies-dont-work/276218 "2021-07-05T23:40:49Z")
As per the title, ILM simply does not work, or at least it doesn't work according to what Kibana or the docs make you believe should work. I can create a lifecycle policy and attach a index but it will never roll over. … --- ## [Elasticsearch index size less then dataset disk space](https://discuss.elastic.co/t/elasticsearch-index-size-less-then-dataset-disk-space/277872)
**Author:** [@Fradi](https://discuss.elastic.co/u/Fradi)\ **Replies:** 1\ **Last updated:** [July 5, 2021, 11:28pm UTC](https://discuss.elastic.co/t/elasticsearch-index-size-less-then-dataset-disk-space/277872 "2021-07-05T23:28:29Z")
Hello there, I have elasticsearch version 7.10.1, I work on the file from MeDAL Dataset | Kaggle full\_data.csv 14.12 GB I divided it into 179 csv files containing 300,000 lines each and loaded them into elasticsearch. H… --- ## [Update template and force rollover](https://discuss.elastic.co/t/update-template-and-force-rollover/277886)
**Author:** [@dimitris\_sb](https://discuss.elastic.co/u/dimitris_sb)\ **Replies:** 0\ **Last updated:** [July 5, 2021, 11:11pm UTC](https://discuss.elastic.co/t/update-template-and-force-rollover/277886 "2021-07-05T23:11:06Z")
Hi All, Is it possible after applying a new template to ILM (with rollover every x GB or y days) managed indices, to force rollover? Could I use the rollover API in order to create new indices which will follow the cha… --- ## [ILM and custom index names](https://discuss.elastic.co/t/ilm-and-custom-index-names/277563)
**Author:** [@muhdiekuh](https://discuss.elastic.co/u/muhdiekuh)\ **Replies:** 3\ **Last updated:** [July 5, 2021, 11:25pm UTC](https://discuss.elastic.co/t/ilm-and-custom-index-names/277563 "2021-07-05T23:25:03Z")
Hi, I'm using ILM with filebeat. Right now I'm using the default configuration. I'd like to adjust it a little bit now, but I'm not sure if what I want to do is actually possible. I'd like to have a separate index for … --- ## [Install Elasticsearch on Ubuntu Core](https://discuss.elastic.co/t/install-elasticsearch-on-ubuntu-core/277559)
**Author:** [@vadd98](https://discuss.elastic.co/u/vadd98)\ **Replies:** 3\ **Last updated:** [July 5, 2021, 11:23pm UTC](https://discuss.elastic.co/t/install-elasticsearch-on-ubuntu-core/277559 "2021-07-05T23:23:42Z")
Hi there, I'm working on a project using a Raspberry Pi 4 and Ubuntu Core. I need to use Elasticsearch for my project, but I'm being blocked by the need to install Elasticsearch using Snap. I can't find any Elasticsear… --- ## [Elastic.console unable to connect](https://discuss.elastic.co/t/elastic-console-unable-to-connect/277865)
**Author:** [@Sahithi\_V](https://discuss.elastic.co/u/Sahithi_V)\ **Replies:** 0\ **Last updated:** [July 5, 2021, 4:22pm UTC](https://discuss.elastic.co/t/elastic-console-unable-to-connect/277865 "2021-07-05T16:22:34Z")
Continuing the discussion from ElasticSearch Query with Powershell Invoke-RestMethod: hi @forloop/ Paul, I tried the same module ie elastic.console to invoke web request using PS \> es http://172.44.222.44:5601/\_cat/in… --- ## [Kibana Discover view is very slow after upgrade - not compressing HTTP responses](https://discuss.elastic.co/t/kibana-discover-view-is-very-slow-after-upgrade-not-compressing-http-responses/276991)
**Author:** [@salvoj](https://discuss.elastic.co/u/salvoj)\ **Replies:** 9\ **Last updated:** [July 5, 2021, 8:28pm UTC](https://discuss.elastic.co/t/kibana-discover-view-is-very-slow-after-upgrade-not-compressing-http-responses/276991 "2021-07-05T20:28:34Z")
We have updated from 7.4.0 to 7.13.2 a few days ago. Performance in Discover view has greatly deteriorated. Query times are still good. Problem seems to be the long time it takes to render page: Query time: 1.3 sec T… --- ## [Winlogbeat Sysmon Configuration Registry fields seems to map the wrong value of the registry](https://discuss.elastic.co/t/winlogbeat-sysmon-configuration-registry-fields-seems-to-map-the-wrong-value-of-the-registry/277879)
**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\ **Replies:** 0\ **Last updated:** [July 5, 2021, 7:45pm UTC](https://discuss.elastic.co/t/winlogbeat-sysmon-configuration-registry-fields-seems-to-map-the-wrong-value-of-the-registry/277879 "2021-07-05T19:45:55Z")
Hello, Second try.. (Winlogbeat Sysmon Configuration Registry fields seems to map the wrong value of the registry) Just noticed something weird with Sysmon configuration in 7.11 (registry events) As you can see, th… --- ## [Gzip compression results to uncompressable package](https://discuss.elastic.co/t/gzip-compression-results-to-uncompressable-package/277867)
**Author:** [@yodog](https://discuss.elastic.co/u/yodog)\ **Replies:** 1\ **Last updated:** [July 5, 2021, 6:49pm UTC](https://discuss.elastic.co/t/gzip-compression-results-to-uncompressable-package/277867 "2021-07-05T18:49:41Z")
so, after a few years, any way to work around this problem? same problem on logstash 7.13.1 zgrep '2021' zimbra.log.2021-01-30-1613154813.gz gzip: zimbra.log.2021-01-30-1613154813.gz: invalid compressed data--forma… --- ## [Linking separate log records](https://discuss.elastic.co/t/linking-separate-log-records/276680)
**Author:** [@kibanaquery](https://discuss.elastic.co/u/kibanaquery)\ **Replies:** 2\ **Last updated:** [July 5, 2021, 6:16pm UTC](https://discuss.elastic.co/t/linking-separate-log-records/276680 "2021-07-05T18:16:21Z")
Hi, I was wondering if is possible to perform a basic link function (either in Discover or Visualise)? All my records have a common identifier, say "LinkID", but only some records have "Type" and only some have "Colour… --- ## [Deleting Index and Reclaiming Space](https://discuss.elastic.co/t/deleting-index-and-reclaiming-space/277858)
**Author:** [@cis4life](https://discuss.elastic.co/u/cis4life)\ **Replies:** 2\ **Last updated:** [July 5, 2021, 5:03pm UTC](https://discuss.elastic.co/t/deleting-index-and-reclaiming-space/277858 "2021-07-05T17:03:53Z")
Good Day, I have an a couple pretty big indexes that I need to delete. I know I can delete an index by using DELETE myindex the question is by simplying using the DELETE myindex command, will that be enough to delete t… --- ## [Elasticsearch 7.13 - monitoring execution failed](https://discuss.elastic.co/t/elasticsearch-7-13-monitoring-execution-failed/277334)
**Author:** [@Xor44](https://discuss.elastic.co/u/Xor44)\ **Replies:** 5\ **Last updated:** [July 5, 2021, 4:38pm UTC](https://discuss.elastic.co/t/elasticsearch-7-13-monitoring-execution-failed/277334 "2021-07-05T16:38:13Z")
Hi Folks , I have lot of issue with my ELK Stack . This stack is composed of 3 nodes ( Master , Data , Data ) . Logs are populated with the following errors . When I'm trying to make a transform on an index it's failed … --- ## [Http poller plugin automatically splits json response](https://discuss.elastic.co/t/http-poller-plugin-automatically-splits-json-response/277859)
**Author:** [@pjohnson](https://discuss.elastic.co/u/pjohnson)\ **Replies:** 0\ **Last updated:** [July 5, 2021, 3:54pm UTC](https://discuss.elastic.co/t/http-poller-plugin-automatically-splits-json-response/277859 "2021-07-05T15:54:01Z")
I'm using the http\_poller plugin with an endpoint that returns a json array and then I'm processing the response in a ruby script. It seems like http\_poller is automatically splitting the body into separate events for ea… --- ## [HTML in Kibana email action](https://discuss.elastic.co/t/html-in-kibana-email-action/277093)
**Author:** [@sireesha\_m](https://discuss.elastic.co/u/sireesha_m)\ **Replies:** 1\ **Last updated:** [July 5, 2021, 3:18pm UTC](https://discuss.elastic.co/t/html-in-kibana-email-action/277093 "2021-07-05T15:18:08Z")
I have Kibana email action being triggered as a web hook from my Elastic watcher. The doc says markdown is supported. I have added the following for email payload: \`\`"message": "New alert created for asset motor\_pump\_… --- ## [Main problem with garbage collector](https://discuss.elastic.co/t/main-problem-with-garbage-collector/277656)
**Author:** [@angelogabeira](https://discuss.elastic.co/u/angelogabeira)\ **Replies:** 8\ **Last updated:** [July 5, 2021, 3:17pm UTC](https://discuss.elastic.co/t/main-problem-with-garbage-collector/277656 "2021-07-05T15:17:02Z")
guys, I really need help. I've researched a lot on the internet but I couldn't help myself. I have an ELK stack with an elasticsearch 6.5 server, running for 3 years. lately i have had a lot of problem with ingesting da… --- ## [Why python agent is not capturing handled exception error events](https://discuss.elastic.co/t/why-python-agent-is-not-capturing-handled-exception-error-events/277727)
**Author:** [@bimanarajesh](https://discuss.elastic.co/u/bimanarajesh)\ **Replies:** 3\ **Last updated:** [July 5, 2021, 2:37pm UTC](https://discuss.elastic.co/t/why-python-agent-is-not-capturing-handled-exception-error-events/277727 "2021-07-05T14:37:37Z")
Elasticsearch version : 6.8.4 APM Server version : 7.6.0 APM Agent language and version : Java - 1.16.0 Original install method (e.g. download page, yum, deb, from source, etc.) and version : Download page python… --- ## [HTTP Filter - Unnest Array](https://discuss.elastic.co/t/http-filter-unnest-array/277778)
**Author:** [@RoteEdition](https://discuss.elastic.co/u/RoteEdition)\ **Replies:** 2\ **Last updated:** [July 5, 2021, 2:22pm UTC](https://discuss.elastic.co/t/http-filter-unnest-array/277778 "2021-07-05T14:22:17Z")
Hi there, I need to unnest an array (based on the workaround mentioned in this previous thread) into seperate documents. I am calling an API and getting in return an array of results. Each of these results should prefe… --- ## [Gauge element issue with SQL query data](https://discuss.elastic.co/t/gauge-element-issue-with-sql-query-data/275884)
**Author:** [@qlikq](https://discuss.elastic.co/u/qlikq)\ **Replies:** 3\ **Last updated:** [July 5, 2021, 2:21pm UTC](https://discuss.elastic.co/t/gauge-element-issue-with-sql-query-data/275884 "2021-07-05T14:21:47Z")
Hello all, i am just starting with ELK, and i am struggling with understanding this part. Could someone point to some documentation, or explain what i am doing wrong ? I have create a gauge element, in the Data portion … --- ## [Delete Documents Index](https://discuss.elastic.co/t/delete-documents-index/277777)
**Author:** [@Kirtash](https://discuss.elastic.co/u/Kirtash)\ **Replies:** 1\ **Last updated:** [July 5, 2021, 2:13pm UTC](https://discuss.elastic.co/t/delete-documents-index/277777 "2021-07-05T14:13:14Z")
Hi all!! I have read the documentation about the lifecicle but I have a simple question about it. Is possible delete the documents after X days? I don't want to keep the docs because they are only to debug. Thanks for… --- ## [Kibana running slowly](https://discuss.elastic.co/t/kibana-running-slowly/277796)
**Author:** [@Andrea\_Bozzano](https://discuss.elastic.co/u/Andrea_Bozzano)\ **Replies:** 1\ **Last updated:** [July 5, 2021, 1:02pm UTC](https://discuss.elastic.co/t/kibana-running-slowly/277796 "2021-07-05T13:02:20Z")
Hi everyone, I'm experiencing something in my test environment (1 master and 2 data nodes Elasticsearch, and 1machine with Logstash and Kibana, with enough resources for each node, v7.12 of the stack). When I login int… --- ## [Logstash buff/cache high utilization linux](https://discuss.elastic.co/t/logstash-buff-cache-high-utilization-linux/277836)
**Author:** [@Adixon\_Diaz](https://discuss.elastic.co/u/Adixon_Diaz)\ **Replies:** 0\ **Last updated:** [July 5, 2021, 12:57pm UTC](https://discuss.elastic.co/t/logstash-buff-cache-high-utilization-linux/277836 "2021-07-05T12:57:17Z")
Hi comunity, I'm seeing the utilization resources on my S.O Linux that I only use for Logstash. I could see that the buff/cache is very high. In another hand i would like to know if i configured correctly the utiliz… --- ## [Rerun transforms](https://discuss.elastic.co/t/rerun-transforms/277801)
**Author:** [@alexs1](https://discuss.elastic.co/u/alexs1)\ **Replies:** 1\ **Last updated:** [July 5, 2021, 12:56pm UTC](https://discuss.elastic.co/t/rerun-transforms/277801 "2021-07-05T12:56:47Z")
Hello, Is there any way to run the transform again? for example for the last 24 hours. the naive aproch will be to stop the transform, delete the data from the dest index(is that required), and recreate it with a rang… --- ## [Systemctl failing to start elasticsearch](https://discuss.elastic.co/t/systemctl-failing-to-start-elasticsearch/277220)
**Author:** [@bnason](https://discuss.elastic.co/u/bnason)\ **Replies:** 4\ **Last updated:** [July 5, 2021, 12:18pm UTC](https://discuss.elastic.co/t/systemctl-failing-to-start-elasticsearch/277220 "2021-07-05T12:18:25Z")
After upgrading to 7.13.2 from 7.12.1, using systemctl to start elasticsearch fails. \[root@elastic elasticsearch\]# systemctl status elasticsearch -l ● elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/sy… --- ## [Metricbeat: "More than one write index" errors in version 7.13.x](https://discuss.elastic.co/t/metricbeat-more-than-one-write-index-errors-in-version-7-13-x/275355)
**Author:** [@bwright1558](https://discuss.elastic.co/u/bwright1558)\ **Replies:** 6\ **Last updated:** [July 5, 2021, 12:03pm UTC](https://discuss.elastic.co/t/metricbeat-more-than-one-write-index-errors-in-version-7-13-x/275355 "2021-07-05T12:03:47Z")
Ever since upgrading the elastic stack from 7.12.1 to 7.13.x, we've been getting frequent hang ups with running metricbeat (or any other beat) due to the following error: 2021-06-08T22:01:05.930Z ERROR \[index-management… --- ## [Metricbeat - collects the dockers memory size which is different from “docker stats”](https://discuss.elastic.co/t/metricbeat-collects-the-dockers-memory-size-which-is-different-from-docker-stats/277830)
**Author:** [@SperChung-11](https://discuss.elastic.co/u/SperChung-11)\ **Replies:** 0\ **Last updated:** [July 5, 2021, 12:01pm UTC](https://discuss.elastic.co/t/metricbeat-collects-the-dockers-memory-size-which-is-different-from-docker-stats/277830 "2021-07-05T12:01:35Z")
Hi，I have met a problem as follows： i have use metricbeat to collect docker memory, but found that the data of memory (suce as memory usage) was different from the "docker stats", is it right ? metricbeat: 7.6.0 --- ## [APM dashboard "Thoughput" viz serrated instead of continue](https://discuss.elastic.co/t/apm-dashboard-thoughput-viz-serrated-instead-of-continue/276831)
**Author:** [@ebuildy](https://discuss.elastic.co/u/ebuildy)\ **Replies:** 2\ **Last updated:** [July 5, 2021, 11:53am UTC](https://discuss.elastic.co/t/apm-dashboard-thoughput-viz-serrated-instead-of-continue/276831 "2021-07-05T11:53:49Z")
Kibana version: 7.13.2 Elasticsearch version: 7.13.2 APM Server version: 7.13.2 "throughput" viz: why the line is not continue ? we run a quite busy web site but data is totally discontinue [Previous page](https://discuss.elastic.co/latest.md?page=1586) [Next page](https://discuss.elastic.co/latest.md?page=1588)