# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=929 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 930 --- ## [Recover connection vs logstash further processing](https://discuss.elastic.co/t/recover-connection-vs-logstash-further-processing/305429)
**Author:** [@INS](https://discuss.elastic.co/u/INS)\ **Replies:** 0\ **Last updated:** [May 23, 2022, 7:36pm UTC](https://discuss.elastic.co/t/recover-connection-vs-logstash-further-processing/305429 "2022-05-23T19:36:12Z")
Hi I observe in my production environment such suspicious behavior. Under in spike period of shooting data to ELK cluster a few of master nodes are occupying and in that time I got it that connection is Unreachable. T… --- ## [Error on import with Python and Eland](https://discuss.elastic.co/t/error-on-import-with-python-and-eland/304713)
**Author:** [@greengeek](https://discuss.elastic.co/u/greengeek)\ **Replies:** 1\ **Last updated:** [May 23, 2022, 6:20pm UTC](https://discuss.elastic.co/t/error-on-import-with-python-and-eland/304713 "2022-05-23T18:20:53Z")
I am using Python and Eland to loop through 2757 json files that I have created and import them into Elasticsearch. With my code I am able to import the majority of them, only 5 of them do not import and throw the same … --- ## [Environment name instead of hostname](https://discuss.elastic.co/t/environment-name-instead-of-hostname/305359)
**Author:** [@Anagha\_nambiar](https://discuss.elastic.co/u/Anagha_nambiar)\ **Replies:** 4\ **Last updated:** [May 23, 2022, 4:29pm UTC](https://discuss.elastic.co/t/environment-name-instead-of-hostname/305359 "2022-05-23T16:29:15Z")
Hi All, Suppose I have installed metricbeat in 3 servers and their machine names are IIS1, IIS2 and IIS3. If I have to filter metric data for dashboard creation in Kibana, then I used the query "agent.hostname"or "host… --- ## [Kibana Canvas: createTable creates duplicate rows](https://discuss.elastic.co/t/kibana-canvas-createtable-creates-duplicate-rows/301210)
**Author:** [@JeroenK](https://discuss.elastic.co/u/JeroenK)\ **Replies:** 7\ **Last updated:** [May 23, 2022, 3:52pm UTC](https://discuss.elastic.co/t/kibana-canvas-createtable-creates-duplicate-rows/301210 "2022-05-23T15:52:42Z")
Hi, I want to create a bar chart in canvas with a consistent 10 bars even if there is no data for 10 bars. It is for a competition and, for example, at the beginning of the week there might not be enough data to have 10 … --- ## [MetricBeat no longer creating new indexes](https://discuss.elastic.co/t/metricbeat-no-longer-creating-new-indexes/305400)
**Author:** [@ozonshak](https://discuss.elastic.co/u/ozonshak)\ **Replies:** 2\ **Last updated:** [May 23, 2022, 3:39pm UTC](https://discuss.elastic.co/t/metricbeat-no-longer-creating-new-indexes/305400 "2022-05-23T15:39:48Z")
Hello. I've been using MetricBeat for a while now and it was working just fine. All of a sudden, about mid April, I noticed that it stopped logging to the index. Upon closer inspection, all of the metricbeat agents ar… --- ## [About Ingest Processor patterns](https://discuss.elastic.co/t/about-ingest-processor-patterns/305353)
**Author:** [@katakam\_chaitanya](https://discuss.elastic.co/u/katakam_chaitanya)\ **Replies:** 3\ **Last updated:** [May 23, 2022, 3:20pm UTC](https://discuss.elastic.co/t/about-ingest-processor-patterns/305353 "2022-05-23T15:20:53Z")
My custom log lines look something like this level=WARNING;user=john;location=xxx; Its like "LHS=RHS;" A processor I have to write for this is:- "processors": \[ { "grok": { "field": "message",… --- ## [Data Node disconnects randomly from cluster](https://discuss.elastic.co/t/data-node-disconnects-randomly-from-cluster/305396)
**Author:** [@Siva\_Karan](https://discuss.elastic.co/u/Siva_Karan)\ **Replies:** 2\ **Last updated:** [May 23, 2022, 3:12pm UTC](https://discuss.elastic.co/t/data-node-disconnects-randomly-from-cluster/305396 "2022-05-23T15:12:05Z")
Hi Team, Data node from the cluster some times automatically removed without any high heap usage. with in sometime it joins automatically. Please help me to sort it out. Elasticsearch version :7.3.2 OS:ubunutu 2022… --- ## [Latest timestamp in lens table?](https://discuss.elastic.co/t/latest-timestamp-in-lens-table/305333)
**Author:** [@David\_Hodgson](https://discuss.elastic.co/u/David_Hodgson)\ **Replies:** 5\ **Last updated:** [May 23, 2022, 3:11pm UTC](https://discuss.elastic.co/t/latest-timestamp-in-lens-table/305333 "2022-05-23T15:11:44Z")
I'm trying to create a Lens table in a Dashboard summarising heartbeats, with columns: monitor.name, monitor.status, last\_value(@timestamp, kql='monitor.status:"up"'), last\_value(@timestamp, kql='monitor.status:"down"'… --- ## [Increased Search Latency After Closing Index, Adding Analyzer, and Then Reopening Index](https://discuss.elastic.co/t/increased-search-latency-after-closing-index-adding-analyzer-and-then-reopening-index/305352)
**Author:** [@Christopher\_Levy](https://discuss.elastic.co/u/Christopher_Levy)\ **Replies:** 3\ **Last updated:** [May 23, 2022, 2:42pm UTC](https://discuss.elastic.co/t/increased-search-latency-after-closing-index-adding-analyzer-and-then-reopening-index/305352 "2022-05-23T14:42:06Z")
Hey, we have a production AWS opensearch cluster running Elasticsearch 7.10. We needed to add a new custom analyzer to a running cluster. We closed the index, added the analyzer, and then reopened the index. No search… --- ## [Indexing data from Azure into MongoDB and Elastic search](https://discuss.elastic.co/t/indexing-data-from-azure-into-mongodb-and-elastic-search/305222)
**Author:** [@ManojKumarM](https://discuss.elastic.co/u/ManojKumarM)\ **Replies:** 1\ **Last updated:** [May 23, 2022, 2:23pm UTC](https://discuss.elastic.co/t/indexing-data-from-azure-into-mongodb-and-elastic-search/305222 "2022-05-23T14:23:15Z")
Cureently data is available in Azure, Kindly help me to understand how to index the data from Azure to MongoDB and Elasticsearch --- ## [Elastic agent not shipping syslog](https://discuss.elastic.co/t/elastic-agent-not-shipping-syslog/305286)
**Author:** [@Thomas\_Thorburn](https://discuss.elastic.co/u/Thomas_Thorburn)\ **Replies:** 1\ **Last updated:** [May 23, 2022, 2:17pm UTC](https://discuss.elastic.co/t/elastic-agent-not-shipping-syslog/305286 "2022-05-23T14:17:00Z")
Hi all, I'm using elastic agent v8.2.0 being sent to an Elasticsearch service cluster on v8.2.0 using the recommended tar install method. The agents are healthy with the system integration enabled and ship logs from /va… --- ## [Hide rows in kibana table](https://discuss.elastic.co/t/hide-rows-in-kibana-table/305407)
**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\ **Replies:** 1\ **Last updated:** [May 23, 2022, 2:09pm UTC](https://discuss.elastic.co/t/hide-rows-in-kibana-table/305407 "2022-05-23T14:09:50Z")
Hi all, I have a complex aggregation , but I need to show only total without showing Row as below.. I cannot aggregate using metric as it is a complex aggregation. I only want to show total. Any way to hide the row… --- ## [Does Java API support \_mvt endpoint?](https://discuss.elastic.co/t/does-java-api-support-mvt-endpoint/305319)
**Author:** [@csirwin](https://discuss.elastic.co/u/csirwin)\ **Replies:** 1\ **Last updated:** [May 23, 2022, 1:24pm UTC](https://discuss.elastic.co/t/does-java-api-support-mvt-endpoint/305319 "2022-05-23T13:24:13Z")
I am using the Elasticsearch-java-api-8.2.0 API and am trying to execute a search against the \_mvt to get tiles back but do not see a way to hit that endpoint? --- ## [Using variables/constants in input](https://discuss.elastic.co/t/using-variables-constants-in-input/305402)
**Author:** [@msl09](https://discuss.elastic.co/u/msl09)\ **Replies:** 0\ **Last updated:** [May 23, 2022, 12:54pm UTC](https://discuss.elastic.co/t/using-variables-constants-in-input/305402 "2022-05-23T12:54:10Z")
Consider the following code: input { http\_poller { urls =\> { myurl1 =\> { ... password =\> 123456 } myurl2 =\> { ... password =\> 123456 } ... } ..… --- ## [Reindex "host" to "host.ip"](https://discuss.elastic.co/t/reindex-host-to-host-ip/305102)
**Author:** [@teamomni](https://discuss.elastic.co/u/teamomni)\ **Replies:** 6\ **Last updated:** [May 23, 2022, 12:52pm UTC](https://discuss.elastic.co/t/reindex-host-to-host-ip/305102 "2022-05-23T12:52:56Z")
Hello, we recently moved our Logstash that was receiving SNMP to the data stream. All of the current data has worked fine, but when I went to reindex the past several months it failed due to the old files had placed the… --- ## [Parameter indexing\_pressure.memory.limit](https://discuss.elastic.co/t/parameter-indexing-pressure-memory-limit/304823)
**Author:** [@masyutka](https://discuss.elastic.co/u/masyutka)\ **Replies:** 4\ **Last updated:** [May 23, 2022, 12:48pm UTC](https://discuss.elastic.co/t/parameter-indexing-pressure-memory-limit/304823 "2022-05-23T12:48:51Z")
Hi ! We are trying to understand if parameter indexing\_pressure.memory.limit can be adjusted and how. We cannot find any info on how to change it, we found only this help link Indexing pressure | Elasticsearch Guide \[8… --- ## [Sharing scripted fields across indexes](https://discuss.elastic.co/t/sharing-scripted-fields-across-indexes/305401)
**Author:** [@behappy\_alwayz0401](https://discuss.elastic.co/u/behappy_alwayz0401)\ **Replies:** 1\ **Last updated:** [May 23, 2022, 12:48pm UTC](https://discuss.elastic.co/t/sharing-scripted-fields-across-indexes/305401 "2022-05-23T12:48:03Z")
Hi, Is it possible that a scripted field created in one index be used in another index or does it need to be recreated? Thanks --- ## [How to store unstructured data](https://discuss.elastic.co/t/how-to-store-unstructured-data/305373)
**Author:** [@Naga\_Prudhvi](https://discuss.elastic.co/u/Naga_Prudhvi)\ **Replies:** 1\ **Last updated:** [May 23, 2022, 12:45pm UTC](https://discuss.elastic.co/t/how-to-store-unstructured-data/305373 "2022-05-23T12:45:53Z")
how to store a novel book (text) data into Elasticsearch --- ## [Custom elastic query with Enhanced Table](https://discuss.elastic.co/t/custom-elastic-query-with-enhanced-table/305384)
**Author:** [@nomi-gee](https://discuss.elastic.co/u/nomi-gee)\ **Replies:** 12\ **Last updated:** [May 23, 2022, 12:19pm UTC](https://discuss.elastic.co/t/custom-elastic-query-with-enhanced-table/305384 "2022-05-23T12:19:46Z")
Continuing the discussion from Enhanced Table: Kibana Datatable has some limitations. I am using aggregations with a custom elastic query for generating results and sorting on the basis of buckets can Enhanced table giv… --- ## [Getting "Kibana server is not ready yet" when running from docker](https://discuss.elastic.co/t/getting-kibana-server-is-not-ready-yet-when-running-from-docker/305345)
**Author:** [@asil](https://discuss.elastic.co/u/asil)\ **Replies:** 8\ **Last updated:** [May 23, 2022, 12:08pm UTC](https://discuss.elastic.co/t/getting-kibana-server-is-not-ready-yet-when-running-from-docker/305345 "2022-05-23T12:08:17Z")
I'm trying to run elasticsearch and kibana via dockers, and I'm getting errors with kibana . I'm using elasticsearch and kibana version 7.6.2 and Ubuntu 18.04.6 LTS I run elasticsearch with the following command: dock… --- ## [Creating a watcher to check for no data in all the indices](https://discuss.elastic.co/t/creating-a-watcher-to-check-for-no-data-in-all-the-indices/305232)
**Author:** [@venkatkumar229](https://discuss.elastic.co/u/venkatkumar229)\ **Replies:** 5\ **Last updated:** [May 23, 2022, 12:08pm UTC](https://discuss.elastic.co/t/creating-a-watcher-to-check-for-no-data-in-all-the-indices/305232 "2022-05-23T12:08:12Z")
Hi Team, I am trying to create a watcher in our elastic cloud 7.17.3 env to get an alert when there is no data in the indices. The problem here is i have more than 50 indices in the cluster and it will be difficult to c… --- ## [How to change Fleet Output Host](https://discuss.elastic.co/t/how-to-change-fleet-output-host/305245)
**Author:** [@Ataye](https://discuss.elastic.co/u/Ataye)\ **Replies:** 6\ **Last updated:** [May 23, 2022, 11:51am UTC](https://discuss.elastic.co/t/how-to-change-fleet-output-host/305245 "2022-05-23T11:51:04Z")
Hello, I am adding fleet managed agents, but they are not sending data due to incorrect Elastic Output Host. I cannot change this setting since "This output is managed outside of Fleet". I tried changing it outside of… --- ## [Delete data from source index of a transform that created the documents in destination index](https://discuss.elastic.co/t/delete-data-from-source-index-of-a-transform-that-created-the-documents-in-destination-index/304937)
**Author:** [@Tzvika\_Cohen](https://discuss.elastic.co/u/Tzvika_Cohen)\ **Replies:** 5\ **Last updated:** [May 23, 2022, 11:50am UTC](https://discuss.elastic.co/t/delete-data-from-source-index-of-a-transform-that-created-the-documents-in-destination-index/304937 "2022-05-23T11:50:02Z")
I have two indexes, that the transform aggregates multiple documents into 1, that works fine: transformation is done from index 1 to index 2: itermediate\_index - source total\_index - destination There are 2 fields tha… --- ## [Minimum 2 field should have search term?](https://discuss.elastic.co/t/minimum-2-field-should-have-search-term/305382)
**Author:** [@div927](https://discuss.elastic.co/u/div927)\ **Replies:** 2\ **Last updated:** [May 23, 2022, 11:17am UTC](https://discuss.elastic.co/t/minimum-2-field-should-have-search-term/305382 "2022-05-23T11:17:52Z")
How create search query to search the searched word in atleast 2 field? --- ## [Logstash how to parse and split nested json file](https://discuss.elastic.co/t/logstash-how-to-parse-and-split-nested-json-file/305308)
**Author:** [@Iss](https://discuss.elastic.co/u/Iss)\ **Replies:** 9\ **Last updated:** [May 23, 2022, 10:52am UTC](https://discuss.elastic.co/t/logstash-how-to-parse-and-split-nested-json-file/305308 "2022-05-23T10:52:32Z")
Hi! I have a nested json file in a list read as single event in Elasticsearch like this : \[{"header": {"id": "idvalue", "datestamp": "YYYY-MM-DD" }, "metas": {"dc:title": "text...", "dc:id": "idvalue… --- ## [ELK with Caprover?](https://discuss.elastic.co/t/elk-with-caprover/305381)
**Author:** [@Kazwell](https://discuss.elastic.co/u/Kazwell)\ **Replies:** 0\ **Last updated:** [May 23, 2022, 9:15am UTC](https://discuss.elastic.co/t/elk-with-caprover/305381 "2022-05-23T09:15:14Z")
Hello, intern here, sorry in advance if this was asked before but I couldn't find my case. I successfully deployed ELK with jenkins logs like what was tasked, the only thing bothering me is I failed to enable the xpack … --- ## [Can't parse Laravel log with json content](https://discuss.elastic.co/t/cant-parse-laravel-log-with-json-content/305174)
**Author:** [@Robert\_Garcia\_Torren](https://discuss.elastic.co/u/Robert_Garcia_Torren)\ **Replies:** 3\ **Last updated:** [May 23, 2022, 8:31am UTC](https://discuss.elastic.co/t/cant-parse-laravel-log-with-json-content/305174 "2022-05-23T08:31:50Z")
Hello! I'm trying to send this Laravel Log to Elasticksearch using filebeat and logstash visualizing it with Kibana: \[2022-05-16 12:03:50\] dev.INFO: Update successful for user {"idmember":"37774", "idcard":"0000000H","… --- ## [How to parse log file with different log types with json](https://discuss.elastic.co/t/how-to-parse-log-file-with-different-log-types-with-json/305269)
**Author:** [@Robert\_Garcia\_Torren](https://discuss.elastic.co/u/Robert_Garcia_Torren)\ **Replies:** 3\ **Last updated:** [May 23, 2022, 8:29am UTC](https://discuss.elastic.co/t/how-to-parse-log-file-with-different-log-types-with-json/305269 "2022-05-23T08:29:15Z")
Hello I'm trying to parse a log file where different log types coexist. Hope someone can help :slight\_smile: This are all log types: \[2022-05-18 11:09:41\] dev.INFO: Inserting new User... \[2022-05-18 11:09:41\] dev.INFO:… --- ## [Process log for logstash pipelines](https://discuss.elastic.co/t/process-log-for-logstash-pipelines/305376)
**Author:** [@karlk](https://discuss.elastic.co/u/karlk)\ **Replies:** 0\ **Last updated:** [May 23, 2022, 8:05am UTC](https://discuss.elastic.co/t/process-log-for-logstash-pipelines/305376 "2022-05-23T08:05:50Z")
My goal is to make process log for any running process in ELK stack. Initially processes can be logged from Logstash pipelines and different Java processes. Sample index in elastic for process logs could be something li… --- ## [Beats in docker after 7.17](https://discuss.elastic.co/t/beats-in-docker-after-7-17/302429)
**Author:** [@Yustas](https://discuss.elastic.co/u/Yustas)\ **Replies:** 6\ **Last updated:** [May 23, 2022, 8:03am UTC](https://discuss.elastic.co/t/beats-in-docker-after-7-17/302429 "2022-05-23T08:03:18Z")
Hello Found problem with dockers image of beats from version 7.17 and higher. Early images was near 600 Mb size After 7.17 image baset on lightweight image near 300 Mb But in new images: no tzdate, so cant use -e T… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=928) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=930)