# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=872 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 873 --- ## [Schema-less records support](https://discuss.elastic.co/t/schema-less-records-support/239714)
**Author:** [@dobes\_gf](https://discuss.elastic.co/u/dobes_gf)\ **Replies:** 5\ **Last updated:** [July 3, 2020, 6:17pm UTC](https://discuss.elastic.co/t/schema-less-records-support/239714 "2020-07-03T18:17:58Z")
Hi, I use elasticsearch to store logs collected by fluentd within Kubernetes. One of the pain points I keep hitting time and time again is elasticsearch rejecting logs because the field types change between log message… --- ## [MetricBeat Unknown or unexpected state \ for process with pid 25](https://discuss.elastic.co/t/metricbeat-unknown-or-unexpected-state-p-for-process-with-pid-25/239512)
**Author:** [@vamshisiddarth](https://discuss.elastic.co/u/vamshisiddarth)\ **Replies:** 3\ **Last updated:** [July 3, 2020, 6:06pm UTC](https://discuss.elastic.co/t/metricbeat-unknown-or-unexpected-state-p-for-process-with-pid-25/239512 "2020-07-03T18:06:13Z")
We have deployed metricbeat on our kubernetes cluster and everything is working as expected. But, noticing the pods continuously log the below error for the metricbeat pods. 2020-07-01T14:46:07.826Z ERROR process\_… --- ## [Slow transform performance](https://discuss.elastic.co/t/slow-transform-performance/239785)
**Author:** [@magnalite](https://discuss.elastic.co/u/magnalite)\ **Replies:** 6\ **Last updated:** [July 3, 2020, 3:01pm UTC](https://discuss.elastic.co/t/slow-transform-performance/239785 "2020-07-03T15:01:27Z")
I'm currently running a simple transform across ~500M docs but it is doing so super slowly, seemingly searching at \<1000 docs/s, slower than we ingest them live. The nodes are barely getting their CPU or network used and… --- ## [Disable inner\_hit fields from search api response](https://discuss.elastic.co/t/disable-inner-hit-fields-from-search-api-response/239814)
**Author:** [@shusson](https://discuss.elastic.co/u/shusson)\ **Replies:** 2\ **Last updated:** [July 3, 2020, 2:29pm UTC](https://discuss.elastic.co/t/disable-inner-hit-fields-from-search-api-response/239814 "2020-07-03T14:29:29Z")
Is it possible to disable certain inner\_hit fields in the response from the Search API. We have many hits and it is taking up unnecessary memory. e.g we would like to ES to remove the commented out fields from the respo… --- ## [Not able to search index](https://discuss.elastic.co/t/not-able-to-search-index/239808)
**Author:** [@nvnitt](https://discuss.elastic.co/u/nvnitt)\ **Replies:** 1\ **Last updated:** [July 3, 2020, 2:09pm UTC](https://discuss.elastic.co/t/not-able-to-search-index/239808 "2020-07-03T14:09:18Z")
Hello, I restored some indexes from snapshot.The restore status was success.But,when I search for it,I am not able to find any data.I am a beginner to ELK stack.Please help. --- ## [Anomaly Result Interpretation for Seasonal Data](https://discuss.elastic.co/t/anomaly-result-interpretation-for-seasonal-data/239216)
**Author:** [@saraKM](https://discuss.elastic.co/u/saraKM)\ **Replies:** 3\ **Last updated:** [July 3, 2020, 1:08pm UTC](https://discuss.elastic.co/t/anomaly-result-interpretation-for-seasonal-data/239216 "2020-07-03T13:08:34Z")
Hi, I have one job running in elastic ML with following config: "bucket\_span": "10m", "detectors": \[ { "detector\_description": "high\_non\_zero\_count by \\"client.user\_name\\" partitionfield=\\"client.ip\\"… --- ## [Unable to use rest-high-level client with GraalVM and Quarkus](https://discuss.elastic.co/t/unable-to-use-rest-high-level-client-with-graalvm-and-quarkus/239805)
**Author:** [@clementlesne](https://discuss.elastic.co/u/clementlesne)\ **Replies:** 0\ **Last updated:** [July 3, 2020, 12:34pm UTC](https://discuss.elastic.co/t/unable-to-use-rest-high-level-client-with-graalvm-and-quarkus/239805 "2020-07-03T12:34:14Z")
Hi, I am unable to use the REST High Level Elasticsearch client on Quarkus with native image. The issue has been referenced into the GraalVM project. How to reproduce: Instantiate a Quarkus project Add the rest-high-… --- ## [Are these values right for Query delay, Frequency and Bucket Span?](https://discuss.elastic.co/t/are-these-values-right-for-query-delay-frequency-and-bucket-span/239498)
**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\ **Replies:** 3\ **Last updated:** [July 3, 2020, 12:39pm UTC](https://discuss.elastic.co/t/are-these-values-right-for-query-delay-frequency-and-bucket-span/239498 "2020-07-03T12:39:12Z")
I am trying out the anomaly detection job. The data is coming from logstash at interval of 5 mins. But sometimes there will be no data in those 5 mins. The data itself will be randomly distrubuted in the 5 min slot. Som… --- ## [Search query Timeout using RestHighLevelClient ES 7.6v](https://discuss.elastic.co/t/search-query-timeout-using-resthighlevelclient-es-7-6v/239784)
**Author:** [@Sriram8894](https://discuss.elastic.co/u/Sriram8894)\ **Replies:** 3\ **Last updated:** [July 3, 2020, 11:49am UTC](https://discuss.elastic.co/t/search-query-timeout-using-resthighlevelclient-es-7-6v/239784 "2020-07-03T11:49:04Z")
Hi, We have recently migrated from ES 5.6v to 7.6v. In ES 5.6 we have been using the below statement to throw an exception and return the default response if the query execution is taking more than the given TimeValue. … --- ## [Elasticsearch Service: Email whitelisting alternative](https://discuss.elastic.co/t/elasticsearch-service-email-whitelisting-alternative/239789)
**Author:** [@Max96](https://discuss.elastic.co/u/Max96)\ **Replies:** 0\ **Last updated:** [July 3, 2020, 11:42am UTC](https://discuss.elastic.co/t/elasticsearch-service-email-whitelisting-alternative/239789 "2020-07-03T11:42:03Z")
Hello, I am new to the ELK-Stack and we are using the Elasticsearch Service. Is it possible to send emails without whitelisting them first? Thanks Max --- ## [Detach node from a cluster in docker](https://discuss.elastic.co/t/detach-node-from-a-cluster-in-docker/239777)
**Author:** [@peterol](https://discuss.elastic.co/u/peterol)\ **Replies:** 0\ **Last updated:** [July 3, 2020, 10:39am UTC](https://discuss.elastic.co/t/detach-node-from-a-cluster-in-docker/239777 "2020-07-03T10:39:33Z")
Hello everyone! I have a little question about the elasticsearch-node tool: Is it possible to use it in any way to detach a node from a cluster that exists in a docker container? So far the tool throws an exception tha… --- ## [Creating Snapshot repository, Linux and windows paths get mixed. Why?](https://discuss.elastic.co/t/creating-snapshot-repository-linux-and-windows-paths-get-mixed-why/239767)
**Author:** [@defalt](https://discuss.elastic.co/u/defalt)\ **Replies:** 4\ **Last updated:** [July 3, 2020, 10:04am UTC](https://discuss.elastic.co/t/creating-snapshot-repository-linux-and-windows-paths-get-mixed-why/239767 "2020-07-03T10:04:47Z")
Hi I have 3 Nodes. 2 on Windows and 1 on linux. I want to try the snapshoting feature. As far as I know I have to set the path.repoon every node. So I created the network drive e which is on the PC Scot YML: Windows1… --- ## [I have to combine certain aggregation and query to extract data from elastic search . Can someone help with this following query](https://discuss.elastic.co/t/i-have-to-combine-certain-aggregation-and-query-to-extract-data-from-elastic-search-can-someone-help-with-this-following-query/239746)
**Author:** [@charvi23](https://discuss.elastic.co/u/charvi23)\ **Replies:** 7\ **Last updated:** [July 3, 2020, 10:01am UTC](https://discuss.elastic.co/t/i-have-to-combine-certain-aggregation-and-query-to-extract-data-from-elastic-search-can-someone-help-with-this-following-query/239746 "2020-07-03T10:01:38Z")
From a set of documents do the following: Extract documents which match the following criteria: a. date\_field \> given certain date and b. second\_date\_field \< given certain date From the above extracted documents,… --- ## [Continuous tranforms stop indexing after initial indexing](https://discuss.elastic.co/t/continuous-tranforms-stop-indexing-after-initial-indexing/238473)
**Author:** [@Germain\_Pavot](https://discuss.elastic.co/u/Germain_Pavot)\ **Replies:** 3\ **Last updated:** [July 3, 2020, 9:39am UTC](https://discuss.elastic.co/t/continuous-tranforms-stop-indexing-after-initial-indexing/238473 "2020-07-03T09:39:29Z")
Hy guys, I try to setup a continuous transforms strategy on a new cluster for optimize queries and index size with an 1h aggregation. The stack is setup like that : 1 index input-\[0\_9\]{6} with a write alias "input".… --- ## [Store dense vectors of size more than 2048](https://discuss.elastic.co/t/store-dense-vectors-of-size-more-than-2048/239438)
**Author:** [@techytushar](https://discuss.elastic.co/u/techytushar)\ **Replies:** 4\ **Last updated:** [July 3, 2020, 9:26am UTC](https://discuss.elastic.co/t/store-dense-vectors-of-size-more-than-2048/239438 "2020-07-03T09:26:55Z")
I am trying to build a semantic text search using ElasticSearch. For this I have decided to use the cosine similarity between the embeddings of the query paragraph and the embeddings of the search paragraphs. The proble… --- ## [Cluster.routing.allocation.awareness.attributes doesn't seem to work](https://discuss.elastic.co/t/cluster-routing-allocation-awareness-attributes-doesnt-seem-to-work/238548)
**Author:** [@mannoj87](https://discuss.elastic.co/u/mannoj87)\ **Replies:** 9\ **Last updated:** [July 3, 2020, 8:20am UTC](https://discuss.elastic.co/t/cluster-routing-allocation-awareness-attributes-doesnt-seem-to-work/238548 "2020-07-03T08:20:23Z")
Hi Team, cluster.routing.allocation.awareness.attributes: 34 And I have 2 VMs with this same value. prd-es107.com and prd-es108.com. Both has 34. I have almost 86 nodes in my cluster. Below is the shard allocation … --- ## [Design indexes with big data](https://discuss.elastic.co/t/design-indexes-with-big-data/239235)
**Author:** [@Ankur\_Mahajan](https://discuss.elastic.co/u/Ankur_Mahajan)\ **Replies:** 15\ **Last updated:** [July 3, 2020, 7:23am UTC](https://discuss.elastic.co/t/design-indexes-with-big-data/239235 "2020-07-03T07:23:15Z")
I am creating an elastic cluster with 2.5TB dataset. Questions: What is the best way to design shards for best performance? The only limit is 2.1Billion documents per shard (it's Lucene core limitation), 20 - 40GB… --- ## [How to reduce collection time](https://discuss.elastic.co/t/how-to-reduce-collection-time/239730)
**Author:** [@jang](https://discuss.elastic.co/u/jang)\ **Replies:** 3\ **Last updated:** [July 3, 2020, 6:32am UTC](https://discuss.elastic.co/t/how-to-reduce-collection-time/239730 "2020-07-03T06:32:48Z")
hello, I'm using elk. After a day of testing, there was a problem. The difference between collection time and log generation time is widening. For example, the collection time and log generation time were exactly th… --- ## [Should I be worried for this warn message when installing Elastic?](https://discuss.elastic.co/t/should-i-be-worried-for-this-warn-message-when-installing-elastic/239734)
**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\ **Replies:** 0\ **Last updated:** [July 3, 2020, 6:15am UTC](https://discuss.elastic.co/t/should-i-be-worried-for-this-warn-message-when-installing-elastic/239734 "2020-07-03T06:15:39Z")
after a successful instalation, I get this line warning: elasticsearch-7.8.0-x86\_64.rpm: Header V4 RSA/SHA512 Signature, key ID XXXXXX: NOKEY\` I have instaled elastic downloading the file from elastic website, and then… --- ## [JVM error in elasticsearch](https://discuss.elastic.co/t/jvm-error-in-elasticsearch/239701)
**Author:** [@Ganesh2303](https://discuss.elastic.co/u/Ganesh2303)\ **Replies:** 6\ **Last updated:** [July 3, 2020, 5:27am UTC](https://discuss.elastic.co/t/jvm-error-in-elasticsearch/239701 "2020-07-03T05:27:37Z")
HI Team, when i try to star the elasticsearch service it throwing below error \> Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit\_memory(0x00002b76c9990000, 33661845504, 0) failed; error='Cannot allocate … --- ## [Upgrading to Elastic Search 7.1.x not able to get the cluster up](https://discuss.elastic.co/t/upgrading-to-elastic-search-7-1-x-not-able-to-get-the-cluster-up/239726)
**Author:** [@Ranjit\_Singh](https://discuss.elastic.co/u/Ranjit_Singh)\ **Replies:** 1\ **Last updated:** [July 3, 2020, 4:41am UTC](https://discuss.elastic.co/t/upgrading-to-elastic-search-7-1-x-not-able-to-get-the-cluster-up/239726 "2020-07-03T04:41:05Z")
I have an existing Elastic 5.5.2 cluster that I am trying to upgrade to 7.1.x. The ssl was not enabled on the old cluster as it was in a non-prod environment I have changed elasticsearch.yaml to the following configurat… --- ## [Is there up-to-date documentation for implementing a custom Elasticsearch realm?](https://discuss.elastic.co/t/is-there-up-to-date-documentation-for-implementing-a-custom-elasticsearch-realm/239367)
**Author:** [@TimothyMDean](https://discuss.elastic.co/u/TimothyMDean)\ **Replies:** 4\ **Last updated:** [July 3, 2020, 1:09am UTC](https://discuss.elastic.co/t/is-there-up-to-date-documentation-for-implementing-a-custom-elasticsearch-realm/239367 "2020-07-03T01:09:03Z")
Hello, I am trying to implement a custom authentication realm for Elasticsearch, as documented at https://www.elastic.co/guide/en/elasticsearch/reference/current/custom-realms.html. I think I understand the basics, but … --- ## [Node/Admin Certificates no longer work after upgrade to ES 7.7.0 from 7.3.2](https://discuss.elastic.co/t/node-admin-certificates-no-longer-work-after-upgrade-to-es-7-7-0-from-7-3-2/239713)
**Author:** [@tmiller1142](https://discuss.elastic.co/u/tmiller1142)\ **Replies:** 1\ **Last updated:** [July 2, 2020, 11:38pm UTC](https://discuss.elastic.co/t/node-admin-certificates-no-longer-work-after-upgrade-to-es-7-7-0-from-7-3-2/239713 "2020-07-02T23:38:12Z")
We recently upgraded our Elasticsearch Stack to use OpenDistro 1.8.0 with Elasticsearch 7.7.0 from OpenDistro 1.3.0 with Elasticsearch 7.3.2. Before the upgrade, we used version 3 node and admin certs with Subject Altern… --- ## [Raw Query in Nest C#](https://discuss.elastic.co/t/raw-query-in-nest-c/239383)
**Author:** [@Ramesh\_balasubramani](https://discuss.elastic.co/u/Ramesh_balasubramani)\ **Replies:** 1\ **Last updated:** [July 2, 2020, 8:44pm UTC](https://discuss.elastic.co/t/raw-query-in-nest-c/239383 "2020-07-02T20:44:20Z")
string query = @" { ""size"" : 0, ""aggs"" : { ""words"" : { ""terms"" : { ""field"" : ""bodyContent"" , ""size"" : 80, ""exclude"" : \[""is"",""an"" \] } } } }"; client.LowLevel.Se… --- ## [How to deal with bigger loops in ElasticSearch?](https://discuss.elastic.co/t/how-to-deal-with-bigger-loops-in-elasticsearch/239705)
**Author:** [@jsonpaul](https://discuss.elastic.co/u/jsonpaul)\ **Replies:** 0\ **Last updated:** [July 2, 2020, 8:35pm UTC](https://discuss.elastic.co/t/how-to-deal-with-bigger-loops-in-elasticsearch/239705 "2020-07-02T20:35:19Z")
Hello everyone, I have a painless script that calculates user sessions. The script works fine but when I have more than 10k entry in the painless script loop throws this error: "caused\_by": { "type": "p… --- ## [Pinned query limit of 100 configurable?](https://discuss.elastic.co/t/pinned-query-limit-of-100-configurable/239667)
**Author:** [@Karl\_Kevilus](https://discuss.elastic.co/u/Karl_Kevilus)\ **Replies:** 12\ **Last updated:** [July 2, 2020, 8:11pm UTC](https://discuss.elastic.co/t/pinned-query-limit-of-100-configurable/239667 "2020-07-02T20:11:23Z")
How can I configure the maximum # of items returned in a 'pinned query'? I'm getting the following error: "caused\_by": { "type": "x\_content\_parse\_exception", "reason": "Failed to build \[pinned\] after l… --- ## [Elastic Search fails to restart because of high CPU usage and error failed to recover from translog](https://discuss.elastic.co/t/elastic-search-fails-to-restart-because-of-high-cpu-usage-and-error-failed-to-recover-from-translog/239696)
**Author:** [@adiwakar](https://discuss.elastic.co/u/adiwakar)\ **Replies:** 0\ **Last updated:** [July 2, 2020, 6:23pm UTC](https://discuss.elastic.co/t/elastic-search-fails-to-restart-because-of-high-cpu-usage-and-error-failed-to-recover-from-translog/239696 "2020-07-02T18:23:16Z")
Hi All, I shall be grateful if you could help me. I am using ES version 6.4 and have 2 node cluster setup (I know its bad, we have plans to change it). One node is in Washington and another Virginia. Everything… --- ## [Centos 8 install Java before installing the elasticstack?](https://discuss.elastic.co/t/centos-8-install-java-before-installing-the-elasticstack/239546)
**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\ **Replies:** 1\ **Last updated:** [July 2, 2020, 5:13pm UTC](https://discuss.elastic.co/t/centos-8-install-java-before-installing-the-elasticstack/239546 "2020-07-02T17:13:08Z")
Hi, in the documentation says that elasticsearch includes a bundled version of OpenJDK Elasticsearch is built using Java, and includes a bundled version of OpenJDK from the JDK maintainers (GPLv2+CE) within each distrib… --- ## [Getting issues with Java heap on Elasticsearch](https://discuss.elastic.co/t/getting-issues-with-java-heap-on-elasticsearch/239649)
**Author:** [@AshokBachchan](https://discuss.elastic.co/u/AshokBachchan)\ **Replies:** 6\ **Last updated:** [July 2, 2020, 4:14pm UTC](https://discuss.elastic.co/t/getting-issues-with-java-heap-on-elasticsearch/239649 "2020-07-02T16:14:42Z")
Hello @matw We have facing issue with elasticsearch, suddenly master nodes getting down. Logs were showing Java OutOfMemoryError. Master nodes have r5.xlarge instance type (4 Core CPU, 32 GB RAM), I have configured 15… --- ## [Support of dot in field name](https://discuss.elastic.co/t/support-of-dot-in-field-name/239664)
**Author:** [@Sergey\_Taranenko](https://discuss.elastic.co/u/Sergey_Taranenko)\ **Replies:** 1\ **Last updated:** [July 2, 2020, 4:14pm UTC](https://discuss.elastic.co/t/support-of-dot-in-field-name/239664 "2020-07-02T16:14:23Z")
Does es support dot in field name? I have field with name like: "checkbox1.1" and after insert it transforms to object type field(splitted by "."). As i know dots were supported in 2.4 version(https://www.elastic.co/guid… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=871) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=873)