# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=814 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 815 --- ## [Grok Ingest Pipeline and the Elastic Common Schema](https://discuss.elastic.co/t/grok-ingest-pipeline-and-the-elastic-common-schema/247917)
**Author:** [@roshanp](https://discuss.elastic.co/u/roshanp)\ **Replies:** 3\ **Last updated:** [September 9, 2020, 2:11pm UTC](https://discuss.elastic.co/t/grok-ingest-pipeline-and-the-elastic-common-schema/247917 "2020-09-09T14:11:42Z")
Hi there, I want to use the Grok patterns already available in the Elastic Ingest pipeline; however, I don't see how I can map the default field names provided to the Elastic common schema? Is there any work towards tha… --- ## [Generate daily report](https://discuss.elastic.co/t/generate-daily-report/247993)
**Author:** [@headtea](https://discuss.elastic.co/u/headtea)\ **Replies:** 6\ **Last updated:** [September 9, 2020, 1:57pm UTC](https://discuss.elastic.co/t/generate-daily-report/247993 "2020-09-09T13:57:34Z")
I have a dashboard in kibana (version 7.9.0). I need the dashboard to be exported to a PDF or an excel spreadsheet daily and emailed to someone. The time for the results should be in the last 24 hours. This doc page sug… --- ## [Es-Sql-Query - http client did not trust this server's certificate](https://discuss.elastic.co/t/es-sql-query-http-client-did-not-trust-this-servers-certificate/248019)
**Author:** [@Jose\_H](https://discuss.elastic.co/u/Jose_H)\ **Replies:** 0\ **Last updated:** [September 9, 2020, 1:46pm UTC](https://discuss.elastic.co/t/es-sql-query-http-client-did-not-trust-this-servers-certificate/248019 "2020-09-09T13:46:41Z")
Hi all, Im having issues with getting data from my index, using elasticsearch-sql-cli: /usr/share/elasticsearch/bin/elasticsearch-sql-cli https://elastic:my-password@elastic.local:9200 ERROR: Cannot communicate with t… --- ## [How to increase the performance of logging in elasticsearch](https://discuss.elastic.co/t/how-to-increase-the-performance-of-logging-in-elasticsearch/248018)
**Author:** [@galet](https://discuss.elastic.co/u/galet)\ **Replies:** 0\ **Last updated:** [September 9, 2020, 1:41pm UTC](https://discuss.elastic.co/t/how-to-increase-the-performance-of-logging-in-elasticsearch/248018 "2020-09-09T13:41:18Z")
I have multiple logs in my elasticsearch plugin app which will be logged during ingest and search. I want to reduce the time taken to log the events in all log files when multiple ingest or bulk ingest happens. Same for… --- ## [Elastic stuck and flooded with "monitoring execution failed"](https://discuss.elastic.co/t/elastic-stuck-and-flooded-with-monitoring-execution-failed/247881)
**Author:** [@ludaca](https://discuss.elastic.co/u/ludaca)\ **Replies:** 9\ **Last updated:** [September 9, 2020, 1:14pm UTC](https://discuss.elastic.co/t/elastic-stuck-and-flooded-with-monitoring-execution-failed/247881 "2020-09-09T13:14:20Z")
Hello, ES 5.6.10 under k8s cluster v1.9 xpack.security disabled 16 data nodes Large number of unassigned shards that do not go down at all. \[2020-09-08T11:15:40,655\]\[WARN \]\[o.e.x.m.MonitoringService\] \[es-data05-0\] … --- ## [Xpack computation](https://discuss.elastic.co/t/xpack-computation/248000)
**Author:** [@whiletruelearn](https://discuss.elastic.co/u/whiletruelearn)\ **Replies:** 1\ **Last updated:** [September 9, 2020, 1:03pm UTC](https://discuss.elastic.co/t/xpack-computation/248000 "2020-09-09T13:03:03Z")
Hi, I read about the concept of ml nodes for xpack. But since xpack itself is a form of a plugin , i was curious to know where the actual compute is happening? Is it internally some form of a rest service where data is… --- ## [Bulk index if not exists](https://discuss.elastic.co/t/bulk-index-if-not-exists/247912)
**Author:** [@noorul.m](https://discuss.elastic.co/u/noorul.m)\ **Replies:** 4\ **Last updated:** [September 9, 2020, 9:45am UTC](https://discuss.elastic.co/t/bulk-index-if-not-exists/247912 "2020-09-09T09:45:52Z")
I have the following document structure { "id": "977373", "name": "Air Odisha" } I want to create documents in bulk only if id and name are not present already. --- ## [Http request response to elastic search](https://discuss.elastic.co/t/http-request-response-to-elastic-search/247959)
**Author:** [@Nupur](https://discuss.elastic.co/u/Nupur)\ **Replies:** 8\ **Last updated:** [September 9, 2020, 9:11am UTC](https://discuss.elastic.co/t/http-request-response-to-elastic-search/247959 "2020-09-09T09:11:32Z")
when sending 100 parallel http request the http response time is very high .. whereas the took time in for each query response is very low. How can i improve the http response time to ealstic search. --- ## [Elastic search stops at no plugin loaded](https://discuss.elastic.co/t/elastic-search-stops-at-no-plugin-loaded/247555)
**Author:** [@Sourabh](https://discuss.elastic.co/u/Sourabh)\ **Replies:** 3\ **Last updated:** [September 7, 2020, 8:54pm UTC](https://discuss.elastic.co/t/elastic-search-stops-at-no-plugin-loaded/247555 "2020-09-07T20:54:14Z")
When i started my node on the server it was successfully started.But when due to some reason the node goes down may be due to extensive load or if i down it intentionally and i try to restart it then the log stops at … --- ## [What are typical memory or cpu intensive workloads?](https://discuss.elastic.co/t/what-are-typical-memory-or-cpu-intensive-workloads/247978)
**Author:** [@vchalmel](https://discuss.elastic.co/u/vchalmel)\ **Replies:** 0\ **Last updated:** [September 9, 2020, 8:37am UTC](https://discuss.elastic.co/t/what-are-typical-memory-or-cpu-intensive-workloads/247978 "2020-09-09T08:37:47Z")
I would like to get a better understanding of the alternative proposed for elastic-cloud new deployements between "I/O" "CPU" or "memory" optimizations. What they are, and how the selected hardware is balanced is pretty… --- ## [How to give json.gz to Elasticsearch docker](https://discuss.elastic.co/t/how-to-give-json-gz-to-elasticsearch-docker/247973)
**Author:** [@Cyril\_Guiet](https://discuss.elastic.co/u/Cyril_Guiet)\ **Replies:** 0\ **Last updated:** [September 9, 2020, 7:55am UTC](https://discuss.elastic.co/t/how-to-give-json-gz-to-elasticsearch-docker/247973 "2020-09-09T07:55:50Z")
Hello ! I would like to know the "sexiest" way to give my json to ElasticSearch container :slight\_smile: my start command is actually docker run -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" docker.elastic… --- ## [How to leave the indices in mode read write in phase warm after to pass shrink process](https://discuss.elastic.co/t/how-to-leave-the-indices-in-mode-read-write-in-phase-warm-after-to-pass-shrink-process/247879)
**Author:** [@David\_Moya](https://discuss.elastic.co/u/David_Moya)\ **Replies:** 2\ **Last updated:** [September 9, 2020, 7:51am UTC](https://discuss.elastic.co/t/how-to-leave-the-indices-in-mode-read-write-in-phase-warm-after-to-pass-shrink-process/247879 "2020-09-09T07:51:07Z")
I need to have the indices with permissions of read and write in the phase warm because I still receive old indices that they can't write over indices in phase warm. NOTE: in the phase warm the shrink process is selecte… --- ## [Cluster Filtering is not showing any results](https://discuss.elastic.co/t/cluster-filtering-is-not-showing-any-results/247919)
**Author:** [@Shubhangi](https://discuss.elastic.co/u/Shubhangi)\ **Replies:** 2\ **Last updated:** [September 9, 2020, 7:47am UTC](https://discuss.elastic.co/t/cluster-filtering-is-not-showing-any-results/247919 "2020-09-09T07:47:25Z")
Hi, I'm using Elastic Stack 7.8. I wanted to decommission a node, in order to do that i used the following command: PUT \_cluster/settings { "transient" : { "cluster.routing.allocation.exclude.\_ip" : "1.2.3.4" }… --- ## [Help with complex query](https://discuss.elastic.co/t/help-with-complex-query/247887)
**Author:** [@Andreas\_C](https://discuss.elastic.co/u/Andreas_C)\ **Replies:** 1\ **Last updated:** [September 9, 2020, 6:18am UTC](https://discuss.elastic.co/t/help-with-complex-query/247887 "2020-09-09T06:18:55Z")
Hello, I've just started using Elastic and my use case involves retrieving relevant documents using a natural query string and the following query: { "size": "5", "query": { "bool": { "should": \[ … --- ## [Elastic Cloud Private Link connectivity for clients with CloudID](https://discuss.elastic.co/t/elastic-cloud-private-link-connectivity-for-clients-with-cloudid/247933)
**Author:** [@kiwibel](https://discuss.elastic.co/u/kiwibel)\ **Replies:** 4\ **Last updated:** [September 9, 2020, 5:46am UTC](https://discuss.elastic.co/t/elastic-cloud-private-link-connectivity-for-clients-with-cloudid/247933 "2020-09-09T05:46:29Z")
Hi, We are using Elastic Cloud (AWS) and the ES client on the app side is configured with CloudID. We have added Private Link to access our deployment as described here: https://www.elastic.co/guide/en/cloud/current/e… --- ## [Implementing Rollover+ILM with Logstash and time based index name](https://discuss.elastic.co/t/implementing-rollover-ilm-with-logstash-and-time-based-index-name/247883)
**Author:** [@xenoid](https://discuss.elastic.co/u/xenoid)\ **Replies:** 2\ **Last updated:** [September 9, 2020, 4:46am UTC](https://discuss.elastic.co/t/implementing-rollover-ilm-with-logstash-and-time-based-index-name/247883 "2020-09-09T04:46:50Z")
Hi there, I used to index logs with Logstash into time-based indices (logstash-YYYY.MM.DD). Time-based index names make administration easier on us. We already use lifecycle management to pull the indices to slower nod… --- ## [Capitalization of words in nori user dictionary](https://discuss.elastic.co/t/capitalization-of-words-in-nori-user-dictionary/247950)
**Author:** [@Ubeta](https://discuss.elastic.co/u/Ubeta)\ **Replies:** 0\ **Last updated:** [September 9, 2020, 4:46am UTC](https://discuss.elastic.co/t/capitalization-of-words-in-nori-user-dictionary/247950 "2020-09-09T04:46:29Z")
Hi! My custom nori analyzer uses a nori user dictionary that contains Korean, English, and a mix of Korean-English words. These words are very technical so there was a need to put them in my user dictionary. However, wi… --- ## [Mapping explosion, how to refactor?](https://discuss.elastic.co/t/mapping-explosion-how-to-refactor/247473)
**Author:** [@DumpCat](https://discuss.elastic.co/u/DumpCat)\ **Replies:** 5\ **Last updated:** [September 9, 2020, 4:27am UTC](https://discuss.elastic.co/t/mapping-explosion-how-to-refactor/247473 "2020-09-09T04:27:55Z")
We have hbase with thousands of colume and sync colume data to elasticsearch periodically, but it is causing mapping explosion. Every field in elasticsearch maybe be searched by user, how do I to refactor? Thanks in adva… --- ## [Synced flush failed problem](https://discuss.elastic.co/t/synced-flush-failed-problem/247937)
**Author:** [@vincentduan](https://discuss.elastic.co/u/vincentduan)\ **Replies:** 1\ **Last updated:** [September 9, 2020, 4:00am UTC](https://discuss.elastic.co/t/synced-flush-failed-problem/247937 "2020-09-09T04:00:27Z")
Elasticsearch 6.2.3 The index has five primary shards and replicas is set to 1. Each shard is about 30GB. The cluster health is Green. And no data is being wrtten to the index. When I execute POST myindex/\_flush/synced,… --- ## [Blockchain and time series data](https://discuss.elastic.co/t/blockchain-and-time-series-data/247839)
**Author:** [@hejmaniok](https://discuss.elastic.co/u/hejmaniok)\ **Replies:** 1\ **Last updated:** [September 9, 2020, 1:42am UTC](https://discuss.elastic.co/t/blockchain-and-time-series-data/247839 "2020-09-09T01:42:20Z")
Hi everyone, We are considering using ES to index blockchain data, but before we make a move I would like to find out if with time series data it is possible to have let's say an hourly bucket and get the average of all… --- ## [Kibana : Unable to connect to Elasticsearch](https://discuss.elastic.co/t/kibana-unable-to-connect-to-elasticsearch/247687)
**Author:** [@infected](https://discuss.elastic.co/u/infected)\ **Replies:** 8\ **Last updated:** [September 9, 2020, 12:43am UTC](https://discuss.elastic.co/t/kibana-unable-to-connect-to-elasticsearch/247687 "2020-09-09T00:43:38Z")
Kibana cant connect Elasticsearch Kibana's error log log \[23:55:34.484\] \[info\]\[plugins-service\] Plugin "case" is disabled. log \[23:55:46.109\] \[info\]\[plugins-system\] Setting up \[37\] plugins: \[siem,taskManager,li… --- ## [Changed JVM heap usage pattern on 7.8.1](https://discuss.elastic.co/t/changed-jvm-heap-usage-pattern-on-7-8-1/247877)
**Author:** [@Kim-Kruse-Hansen](https://discuss.elastic.co/u/Kim-Kruse-Hansen)\ **Replies:** 1\ **Last updated:** [September 9, 2020, 12:08am UTC](https://discuss.elastic.co/t/changed-jvm-heap-usage-pattern-on-7-8-1/247877 "2020-09-09T00:08:56Z")
Hi Having recently upgraded to 7.8.1 on all our clusters , we are seeing changed JVM heap usage. Our max heap usage seems to never go above around 19 GB , no matter what happens in the cluster. Same pattern on all no… --- ## [Intermittent errors connecting to ES cluster when using High Level Rest client](https://discuss.elastic.co/t/intermittent-errors-connecting-to-es-cluster-when-using-high-level-rest-client/247929)
**Author:** [@jdevilla20](https://discuss.elastic.co/u/jdevilla20)\ **Replies:** 0\ **Last updated:** [September 8, 2020, 10:15pm UTC](https://discuss.elastic.co/t/intermittent-errors-connecting-to-es-cluster-when-using-high-level-rest-client/247929 "2020-09-08T22:15:30Z")
Elasticsearch version ( bin/elasticsearch --version ): 7.6.2 Plugins installed : JVM version ( java -version ): sh-4.2# /usr/share/elasticsearch/jdk/bin/java -version openjdk version "13.0.2" 2020-01-14 OpenJDK … --- ## [CPU high on Elastic cloud, instance almost stuck](https://discuss.elastic.co/t/cpu-high-on-elastic-cloud-instance-almost-stuck/247188)
**Author:** [@Daniele\_Renda](https://discuss.elastic.co/u/Daniele_Renda)\ **Replies:** 7\ **Last updated:** [September 8, 2020, 9:23pm UTC](https://discuss.elastic.co/t/cpu-high-on-elastic-cloud-instance-almost-stuck/247188 "2020-09-08T21:23:38Z")
Hi guys, I'm looking for some hint. Starting from this morning my ES instance (aws.data.highio.i3 2GB ram on Elastic cloud) is almost stuck with high load on cpu as you can see from screenshots. It seems there is no loa… --- ## [Renaming properties during reindex](https://discuss.elastic.co/t/renaming-properties-during-reindex/247926)
**Author:** [@dpr](https://discuss.elastic.co/u/dpr)\ **Replies:** 0\ **Last updated:** [September 8, 2020, 8:26pm UTC](https://discuss.elastic.co/t/renaming-properties-during-reindex/247926 "2020-09-08T20:26:30Z")
Hi! I've been successful at renaming fields during a reindex using a painless script, but I cannot figure out how to rename a (nested) property. I am trying to rename myObject.oldProperty to myObject.newProperty Here'… --- ## [Ideal Uses cases for elasticsearch Join](https://discuss.elastic.co/t/ideal-uses-cases-for-elasticsearch-join/247568)
**Author:** [@MickeyT](https://discuss.elastic.co/u/MickeyT)\ **Replies:** 6\ **Last updated:** [September 8, 2020, 7:53pm UTC](https://discuss.elastic.co/t/ideal-uses-cases-for-elasticsearch-join/247568 "2020-09-08T19:53:05Z")
If you are building a system say twitter where you anticipate replies to user tweets will be quite a lot. In addition the system will have huge user base. Is using the Join in elasticsearch ideal since you have to ensur… --- ## [Elasticsearch querying time](https://discuss.elastic.co/t/elasticsearch-querying-time/247589)
**Author:** [@AditiKhalatkar](https://discuss.elastic.co/u/AditiKhalatkar)\ **Replies:** 4\ **Last updated:** [September 8, 2020, 6:02pm UTC](https://discuss.elastic.co/t/elasticsearch-querying-time/247589 "2020-09-08T18:02:26Z")
Hi all, There is a use case, where I need some help from you guys. I wonder how should I do aggregation and which method would be the best. Let's take an example. May be a school register. Having 3 fields, student\_na… --- ## [Bin/elasticsearch-setup-passwords: No such file or directory](https://discuss.elastic.co/t/bin-elasticsearch-setup-passwords-no-such-file-or-directory/247725)
**Author:** [@Bigranawab](https://discuss.elastic.co/u/Bigranawab)\ **Replies:** 3\ **Last updated:** [September 8, 2020, 5:40pm UTC](https://discuss.elastic.co/t/bin-elasticsearch-setup-passwords-no-such-file-or-directory/247725 "2020-09-08T17:40:59Z")
Hi, I am using elasticsearch 8.0 and I want to setup passwords for built-in users, so I enabled xpack.security.enabled: true and after restarting elasticsearch service I ran following command: "bin/elasticsearch-setup-p… --- ## [ELASTICSEARCH - Sort agg values only in most recent document](https://discuss.elastic.co/t/elasticsearch-sort-agg-values-only-in-most-recent-document/247398)
**Author:** [@Miguel\_BA](https://discuss.elastic.co/u/Miguel_BA)\ **Replies:** 2\ **Last updated:** [September 8, 2020, 5:20pm UTC](https://discuss.elastic.co/t/elasticsearch-sort-agg-values-only-in-most-recent-document/247398 "2020-09-08T17:20:09Z")
I want to return the most recent document of all results of the aggregations, but it is returning all the documents How can I solve that? { "aggs": { "nested": { "nested": { "path": "data.add" … --- ## [Elastalert plugin in ELK 7.9.0](https://discuss.elastic.co/t/elastalert-plugin-in-elk-7-9-0/247778)
**Author:** [@robertitox](https://discuss.elastic.co/u/robertitox)\ **Replies:** 2\ **Last updated:** [September 8, 2020, 2:14pm UTC](https://discuss.elastic.co/t/elastalert-plugin-in-elk-7-9-0/247778 "2020-09-08T14:14:22Z")
Hi people, I have an ELK 7.9.0 / Debian 10 cluster running OK. I wanna test Elastalert plugin in order to set alert rules and get feedback by email. Is it possible to put to work Elastalert for this ELK 7.9.0 version? … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=813) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=815)