# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1693 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1694 --- ## [Downgrade from 7.9 to 7.8](https://discuss.elastic.co/t/downgrade-from-7-9-to-7-8/255672)
**Author:** [@amralieg](https://discuss.elastic.co/u/amralieg)\ **Replies:** 2\ **Last updated:** [November 17, 2020, 1:55pm UTC](https://discuss.elastic.co/t/downgrade-from-7-9-to-7-8/255672 "2020-11-17T13:55:57Z")
Hi All, need some thoughts on this. for some reasons I need to move from v7.9.3 to v7.8. I know I can not do a snapshot and restore. but what are my other options here? I thought for reindex from the old cluster to the … --- ## [Elasticsearch stopped allocating shards due to missing kuromoji\_part\_of\_speech filter](https://discuss.elastic.co/t/elasticsearch-stopped-allocating-shards-due-to-missing-kuromoji-part-of-speech-filter/254871)
**Author:** [@phoerious](https://discuss.elastic.co/u/phoerious)\ **Replies:** 2\ **Last updated:** [November 17, 2020, 1:49pm UTC](https://discuss.elastic.co/t/elasticsearch-stopped-allocating-shards-due-to-missing-kuromoji-part-of-speech-filter/254871 "2020-11-17T13:49:28Z")
Hi, We have a web index containing Japanese documents, which are using analyzers from the analysis-icu and analysis-kuromoji plugins. Our Elasticsearch cluster is deployed via ECK and pulls the plugins inside the init c… --- ## [Logstash shut down after pipeline terminated](https://discuss.elastic.co/t/logstash-shut-down-after-pipeline-terminated/255478)
**Author:** [@Amir\_Almian](https://discuss.elastic.co/u/Amir_Almian)\ **Replies:** 2\ **Last updated:** [November 17, 2020, 1:24pm UTC](https://discuss.elastic.co/t/logstash-shut-down-after-pipeline-terminated/255478 "2020-11-17T13:24:27Z")
i,m running elastic stack on docker and with ssl security enable. this is my logstash.yml file http.host: "0.0.0.0" xpack.monitoring.elasticsearch.hosts: \[ "https://elasticsearch:9200" \] xpack.monitoring.enabled: true … --- ## [Elasticsearch-certutil: generate both pem certificates and PKCS#12 keystores](https://discuss.elastic.co/t/elasticsearch-certutil-generate-both-pem-certificates-and-pkcs-12-keystores/255486)
**Author:** [@flavienbwk](https://discuss.elastic.co/u/flavienbwk)\ **Replies:** 4\ **Last updated:** [November 17, 2020, 1:00pm UTC](https://discuss.elastic.co/t/elasticsearch-certutil-generate-both-pem-certificates-and-pkcs-12-keystores/255486 "2020-11-17T13:00:38Z")
Hi, I am currently using elasticsearch-certutil to generate my PEM certificates (.crt and .key) for Elasticsearch and Kibana through a certutil .yml file. However I want to setup SSL for my Enterprise Search instance b… --- ## [Ingest node pipeline error](https://discuss.elastic.co/t/ingest-node-pipeline-error/255694)
**Author:** [@Adriann](https://discuss.elastic.co/u/Adriann)\ **Replies:** 1\ **Last updated:** [November 17, 2020, 12:42pm UTC](https://discuss.elastic.co/t/ingest-node-pipeline-error/255694 "2020-11-17T12:42:46Z")
I want to set up an ingest node pipeline that will add new field based on host.hostname that is all lower cased. I made something like this But I got this error that I don't understand. 2020-11-17T13:31:41.473+0100 … --- ## [Logstash config to ingest data by filtering the data that is already present in another index in ES](https://discuss.elastic.co/t/logstash-config-to-ingest-data-by-filtering-the-data-that-is-already-present-in-another-index-in-es/255692)
**Author:** [@Sivajanani](https://discuss.elastic.co/u/Sivajanani)\ **Replies:** 0\ **Last updated:** [November 17, 2020, 12:29pm UTC](https://discuss.elastic.co/t/logstash-config-to-ingest-data-by-filtering-the-data-that-is-already-present-in-another-index-in-es/255692 "2020-11-17T12:29:46Z")
Hello All, I have a requirement to ingest only the data which already exists in another index. For example I have a index in ES like index1 =\[source=a,time=b,value=c,id=d\] and data set to be ingested like sample=\[value=… --- ## [Logstash pipeline terminates immediately after logstash container starts up](https://discuss.elastic.co/t/logstash-pipeline-terminates-immediately-after-logstash-container-starts-up/255208)
**Author:** [@Sam\_Mellors](https://discuss.elastic.co/u/Sam_Mellors)\ **Replies:** 1\ **Last updated:** [November 17, 2020, 12:18pm UTC](https://discuss.elastic.co/t/logstash-pipeline-terminates-immediately-after-logstash-container-starts-up/255208 "2020-11-17T12:18:32Z")
Hi everyone I'm trying to set up logstash in a kubernetes cluster, but whenever the container starts the logs say it terminates the pipeline I have: \[\[.monitoring-logstash\]-pipeline-manager\] javapipeline - Pipeline term… --- ## [Failed to install S3 repository](https://discuss.elastic.co/t/failed-to-install-s3-repository/255566)
**Author:** [@jovan](https://discuss.elastic.co/u/jovan)\ **Replies:** 9\ **Last updated:** [November 17, 2020, 12:08pm UTC](https://discuss.elastic.co/t/failed-to-install-s3-repository/255566 "2020-11-17T12:08:33Z")
Hi team, recently we upgraded our cluster to be close to latest release. We are using OSS version of stack, with current version 7.9.1: rpm -qa | grep elasticsearch-oss elasticsearch-oss-7.9.1-1.x86\_64 However, we … --- ## [Logstash docker error -\> exception=\>"LogStash::ConfigurationError", :message=\>"Expected one of \[ \\\\t\\\\r\\\\n\], \\"#\\", \\"input\\", \\"filter\\", \\"output\\" at line 1, column 1 (byte 1)"](https://discuss.elastic.co/t/logstash-docker-error-exception-logstash-configurationerror-message-expected-one-of-t-r-n-input-filter-output-at-line-1-column-1-byte-1/255210)
**Author:** [@s0umen](https://discuss.elastic.co/u/s0umen)\ **Replies:** 2\ **Last updated:** [November 17, 2020, 11:55am UTC](https://discuss.elastic.co/t/logstash-docker-error-exception-logstash-configurationerror-message-expected-one-of-t-r-n-input-filter-output-at-line-1-column-1-byte-1/255210 "2020-11-17T11:55:59Z")
Hi, I am facing a peculiar issue. I have seen the error faced by many before me, but the solution (only a few of them said resolved by fresh creation by typing the logstash.conf file) is not working for me. Please help… --- ## [Filebeat i/o timeout on output to Redis](https://discuss.elastic.co/t/filebeat-i-o-timeout-on-output-to-redis/255677)
**Author:** [@ushaopusnet](https://discuss.elastic.co/u/ushaopusnet)\ **Replies:** 0\ **Last updated:** [November 17, 2020, 11:32am UTC](https://discuss.elastic.co/t/filebeat-i-o-timeout-on-output-to-redis/255677 "2020-11-17T11:32:55Z")
Hi, I've a simple setup using filebeat (v7.8.0) pushing logs to redis v4.0.9 and seeing the following error in logs. Please help troubleshoot. redis/client.go:239 Failed to RPUSH to redis list with: write… --- ## [Per user data retention](https://discuss.elastic.co/t/per-user-data-retention/255552)
**Author:** [@10aRK](https://discuss.elastic.co/u/10aRK)\ **Replies:** 4\ **Last updated:** [November 17, 2020, 11:25am UTC](https://discuss.elastic.co/t/per-user-data-retention/255552 "2020-11-17T11:25:45Z")
Hi I've been looking into how best to model data whilst accounting for customisable data retention periods at a user / document level vs the whole index. ILM seems perfect when reasoning about the whole index, old vers… --- ## [TimeSeries Graph with a factor to multiple for Count Value](https://discuss.elastic.co/t/timeseries-graph-with-a-factor-to-multiple-for-count-value/255645)
**Author:** [@ginu](https://discuss.elastic.co/u/ginu)\ **Replies:** 1\ **Last updated:** [November 17, 2020, 11:09am UTC](https://discuss.elastic.co/t/timeseries-graph-with-a-factor-to-multiple-for-count-value/255645 "2020-11-17T11:09:39Z")
Hi I have a requirement where I need to multiple a time-series count value with a factor n any idea how to achieve this? --- ## [Kibana anomaly explorer](https://discuss.elastic.co/t/kibana-anomaly-explorer/254887)
**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\ **Replies:** 2\ **Last updated:** [November 17, 2020, 10:56am UTC](https://discuss.elastic.co/t/kibana-anomaly-explorer/254887 "2020-11-17T10:56:16Z")
Hello, It seems that there is a bug in the ml display in Kibana ( Categorization\> rare occurrences job) you can see below red squares, but actually there aren't any major anomalies --- ## [Elastic ILM is not rolling](https://discuss.elastic.co/t/elastic-ilm-is-not-rolling/254527)
**Author:** [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\ **Replies:** 2\ **Last updated:** [November 17, 2020, 10:39am UTC](https://discuss.elastic.co/t/elastic-ilm-is-not-rolling/254527 "2020-11-17T10:39:02Z")
Hello, I have configured my ILM to rollover when the indice size be 20GB or after passing 30 days in the hot node as it's mentioned in this pic : but my indice passed 20GB and still didn't pass to the cold node: a… --- ## [We can't find products matching the selection](https://discuss.elastic.co/t/we-cant-find-products-matching-the-selection/255653)
**Author:** [@AndrewsG](https://discuss.elastic.co/u/AndrewsG)\ **Replies:** 3\ **Last updated:** [November 17, 2020, 10:34am UTC](https://discuss.elastic.co/t/we-cant-find-products-matching-the-selection/255653 "2020-11-17T10:34:34Z")
Hi, I have installed Elasticsearch onto a Magento 2.4 site. I keep receiving the error "We can't find products matching the selection" after a period of time of the Elasticsearch working. Please can anyone advise? --- ## [How to filter a list of word with kibana](https://discuss.elastic.co/t/how-to-filter-a-list-of-word-with-kibana/255515)
**Author:** [@slim-hmidi](https://discuss.elastic.co/u/slim-hmidi)\ **Replies:** 9\ **Last updated:** [November 17, 2020, 10:32am UTC](https://discuss.elastic.co/t/how-to-filter-a-list-of-word-with-kibana/255515 "2020-11-17T10:32:23Z")
I tried to fetch some word using regexp in the filter but does not work: { "query": { "regexp": { "message": { "value": "\*.word1.word2.word3.\*" } } } } I want to fetch messages that contai… --- ## [Converting value in field](https://discuss.elastic.co/t/converting-value-in-field/255527)
**Author:** [@Lokesh\_Mayan](https://discuss.elastic.co/u/Lokesh_Mayan)\ **Replies:** 2\ **Last updated:** [November 17, 2020, 9:57am UTC](https://discuss.elastic.co/t/converting-value-in-field/255527 "2020-11-17T09:57:17Z")
Hi i am having a log list like this \<#\> 20200924 15:14:44.552 000000997 FD.WRN \[ MVINB-LSL2.T1G1\_ATMTH\_SL main.main ConfigService.ConfigService \] Unable to get CommonParamConfig of \[DAC\_TEST\_WHILE\_IDLE… --- ## [Elasticsearch cannot find a non-existing file](https://discuss.elastic.co/t/elasticsearch-cannot-find-a-non-existing-file/255636)
**Author:** [@vaclav1](https://discuss.elastic.co/u/vaclav1)\ **Replies:** 5\ **Last updated:** [November 17, 2020, 9:54am UTC](https://discuss.elastic.co/t/elasticsearch-cannot-find-a-non-existing-file/255636 "2020-11-17T09:54:43Z")
Hello, after enabling and configuring ES to use s3 repository plugin when we restart each node we got a following error right after restarting nodes and only. When I enter the directory the file is missing. Els process … --- ## [How to stop Ml Daily Maintenance Service in elasticsearch (SLM retention snapshot cleanup task)](https://discuss.elastic.co/t/how-to-stop-ml-daily-maintenance-service-in-elasticsearch-slm-retention-snapshot-cleanup-task/255623)
**Author:** [@sakthiskv](https://discuss.elastic.co/u/sakthiskv)\ **Replies:** 8\ **Last updated:** [November 17, 2020, 9:47am UTC](https://discuss.elastic.co/t/how-to-stop-ml-daily-maintenance-service-in-elasticsearch-slm-retention-snapshot-cleanup-task/255623 "2020-11-17T09:47:26Z")
Hai , How to turn off or disable automatic deletion (ML daily maintenance task) in ES ?. everyday its happening , anyone plz help on this. \[2020-08-19T01:30:00,036\]\[INFO \]\[o.e.x.s.SnapshotRetentionTask\] \[\] starting … --- ## [Does logstash continue getting log from Kafka if it cannot send log to ELS?](https://discuss.elastic.co/t/does-logstash-continue-getting-log-from-kafka-if-it-cannot-send-log-to-els/255648)
**Author:** [@AkatsukiPain](https://discuss.elastic.co/u/AkatsukiPain)\ **Replies:** 1\ **Last updated:** [November 17, 2020, 9:40am UTC](https://discuss.elastic.co/t/does-logstash-continue-getting-log-from-kafka-if-it-cannot-send-log-to-els/255648 "2020-11-17T09:40:43Z")
I want to build a topology like this, but I don't know the behavior of logstash when elasticsearch dies ( Logstash cannot send the log to Elasticsearch). There are 2 situations that I'm thinking Logstash will stop get… --- ## [Kibana Map "No results found"](https://discuss.elastic.co/t/kibana-map-no-results-found/255528)
**Author:** [@ahmet\_erkol](https://discuss.elastic.co/u/ahmet_erkol)\ **Replies:** 3\ **Last updated:** [November 17, 2020, 9:28am UTC](https://discuss.elastic.co/t/kibana-map-no-results-found/255528 "2020-11-17T09:28:26Z")
Hello, I uploaded the csv file which includes lat and long columns. The in the advanced tab I choose the lat nad long fields and create a new geo\_point. The data is like "geo": "37.8357,26.7728", . When I want to add t… --- ## [Elasticsearch and dynamic mappings](https://discuss.elastic.co/t/elasticsearch-and-dynamic-mappings/255643)
**Author:** [@BBQigniter](https://discuss.elastic.co/u/BBQigniter)\ **Replies:** 0\ **Last updated:** [November 17, 2020, 9:04am UTC](https://discuss.elastic.co/t/elasticsearch-and-dynamic-mappings/255643 "2020-11-17T09:04:30Z")
I have two questions about dynamic mappings. I have set up a component template which looks like this: PUT \_component\_template/syslog-mappings-dynamic { "version": 1, "template": { "mappings": { "\_source"… --- ## [Parse the json \[{},{},{}\]\[{},{},{}\] with logstash](https://discuss.elastic.co/t/parse-the-json-with-logstash/255642)
**Author:** [@thibd](https://discuss.elastic.co/u/thibd)\ **Replies:** 0\ **Last updated:** [November 17, 2020, 8:48am UTC](https://discuss.elastic.co/t/parse-the-json-with-logstash/255642 "2020-11-17T08:48:48Z")
Hello, I have a json from scrapy with this format: \[{"website1":"myurl1","importdate":"X"},{"website2":"myurl2","importdate":"X"}\] \[{"website1":"myurl1","importdate":"Y"},{"website3":"myurl3","importdate":"Y"}\] So a n… --- ## [Logstash - Json appearing in Message field](https://discuss.elastic.co/t/logstash-json-appearing-in-message-field/255641)
**Author:** [@weiyentan](https://discuss.elastic.co/u/weiyentan)\ **Replies:** 0\ **Last updated:** [November 17, 2020, 8:46am UTC](https://discuss.elastic.co/t/logstash-json-appearing-in-message-field/255641 "2020-11-17T08:46:21Z")
Hi, I am kind of new to the elasticsearch family so thought I would try to create some use cases. One of those is to upload system information into logstash from json documents gathered by ansible . Ansible then reads … --- ## [Elasticsearch cluster across different Geo Datacenters](https://discuss.elastic.co/t/elasticsearch-cluster-across-different-geo-datacenters/255639)
**Author:** [@pavank](https://discuss.elastic.co/u/pavank)\ **Replies:** 1\ **Last updated:** [November 17, 2020, 8:44am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-across-different-geo-datacenters/255639 "2020-11-17T08:44:40Z")
We are in the process of setting up Elasticsearch as a Search Engine to consume customer data. The Elasticsearch nodes are across 5 VMs in 2 different Datacenters (3:2), and all of them are Master-Data and active nodes. … --- ## [Detecting deletes](https://discuss.elastic.co/t/detecting-deletes/255570)
**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\ **Replies:** 3\ **Last updated:** [November 17, 2020, 7:29am UTC](https://discuss.elastic.co/t/detecting-deletes/255570 "2020-11-17T07:29:21Z")
Hello, I was hoping to find a way to detect deletion of documents in our Elasticsearch audit logs. But I cannot find any reference or event related to me testing deletion of docs with for example: DELETE av-002-2020.10… --- ## [Averaging dense\_vectors within ES](https://discuss.elastic.co/t/averaging-dense-vectors-within-es/255637)
**Author:** [@fpug](https://discuss.elastic.co/u/fpug)\ **Replies:** 0\ **Last updated:** [November 17, 2020, 8:27am UTC](https://discuss.elastic.co/t/averaging-dense-vectors-within-es/255637 "2020-11-17T08:27:20Z")
Hi! I'm designing a clustering algorithm, which leverages ES as a backend to retrieve close matches, using the recently introduced dense\_vector type and the cosineSimilarity function. So far so good, aside from the fac… --- ## [Aggregation not working in visualization](https://discuss.elastic.co/t/aggregation-not-working-in-visualization/254250)
**Author:** [@gokulnath112](https://discuss.elastic.co/u/gokulnath112)\ **Replies:** 5\ **Last updated:** [November 17, 2020, 8:25am UTC](https://discuss.elastic.co/t/aggregation-not-working-in-visualization/254250 "2020-11-17T08:25:18Z")
Hi Team, Greetings..! Hope you are doing good. In dev tools tab, when I execute the terms aggs query for a certain field I can retrieve the result based on the values in that field, but when I do the same terms aggrega… --- ## [How to reindex data from cluster to another](https://discuss.elastic.co/t/how-to-reindex-data-from-cluster-to-another/255634)
**Author:** [@gokulnath112](https://discuss.elastic.co/u/gokulnath112)\ **Replies:** 0\ **Last updated:** [November 17, 2020, 8:07am UTC](https://discuss.elastic.co/t/how-to-reindex-data-from-cluster-to-another/255634 "2020-11-17T08:07:12Z")
Hi Team, Greetings..! Hope you are safe and good in health. I want to reindex data of index 'A', from cluster 'X' to cluster 'Y'. I have whitelisted the 'X' cluster host in cluster 'Y' using reindex.remote.whitelist: i… --- ## [Terms aggregation doesn't return all hits](https://discuss.elastic.co/t/terms-aggregation-doesnt-return-all-hits/255353)
**Author:** [@Zining](https://discuss.elastic.co/u/Zining)\ **Replies:** 9\ **Last updated:** [November 17, 2020, 8:04am UTC](https://discuss.elastic.co/t/terms-aggregation-doesnt-return-all-hits/255353 "2020-11-17T08:04:39Z")
Hi, We are using Elasticsearch 5.6 to store track events. Recently we run Terms aggregation on one index to find out duplicated events which have same event type, device id, and event time. Then we remove the duplicated… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1692) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1694)