# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=503 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 504 --- ## [Questions about performance](https://discuss.elastic.co/t/questions-about-performance/295518)
**Author:** [@EnJay](https://discuss.elastic.co/u/EnJay)\ **Replies:** 5\ **Last updated:** [January 27, 2022, 11:26pm UTC](https://discuss.elastic.co/t/questions-about-performance/295518 "2022-01-27T23:26:04Z")
Hello dear community :hugs: Sorry for the possibly incorrect questions below. I'm just trying to learn the miracle of Elasticsearch :slight\_smile: I want to store ~10 billion records with data history of different cryp… --- ## [Not enough free space for cache file of size \[8757706752\] in path \[/usr/share/elasticsearch/data/nodes/0\]](https://discuss.elastic.co/t/not-enough-free-space-for-cache-file-of-size-8757706752-in-path-usr-share-elasticsearch-data-nodes-0/295612)
**Author:** [@chaishiqi](https://discuss.elastic.co/u/chaishiqi)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 10:24pm UTC](https://discuss.elastic.co/t/not-enough-free-space-for-cache-file-of-size-8757706752-in-path-usr-share-elasticsearch-data-nodes-0/295612 "2022-01-27T22:24:12Z")
I ran a container of frozen node with image tag 7.16.2,here is the Elasticsearch.yml cluster.name: "docker-cluster" network.host: 192.168.56.13 discovery.seed\_hosts: \["192.168.56.13", "192.168.56.12", "192.168.56.14"\] n… --- ## [Date range java api examples](https://discuss.elastic.co/t/date-range-java-api-examples/295505)
**Author:** [@nandan-g](https://discuss.elastic.co/u/nandan-g)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 8:02pm UTC](https://discuss.elastic.co/t/date-range-java-api-examples/295505 "2022-01-27T20:02:33Z")
Hi, I am trying to search the documents using a date range filter along with some keywords. I couldn't find any java api samples to do so. Could you please help me. Normal search works with the following code: But am af… --- ## [Configure highlighted part](https://discuss.elastic.co/t/configure-highlighted-part/295164)
**Author:** [@Pavel\_Maltsev](https://discuss.elastic.co/u/Pavel_Maltsev)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 10:14pm UTC](https://discuss.elastic.co/t/configure-highlighted-part/295164 "2022-01-27T22:14:01Z")
Main question The user is looking for a name and enters the part of it, let's say au, and the document with the text paul is found. I would like to have the doc highlighted like p\au\l. How can I achieve it if … --- ## [Sequence numbers & indexing bottleneck](https://discuss.elastic.co/t/sequence-numbers-indexing-bottleneck/295614)
**Author:** [@fhalde](https://discuss.elastic.co/u/fhalde)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 9:07pm UTC](https://discuss.elastic.co/t/sequence-numbers-indexing-bottleneck/295614 "2022-01-27T21:07:48Z")
Hello, We are trying to debug a problem where indexing a document halts the ingestion pipeline on that particular shard Taking into account the way sequence numbers are implemented, do documents get processed sequentia… --- ## [Elasticsearch-users tool with](https://discuss.elastic.co/t/elasticsearch-users-tool-with/295600)
**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\ **Replies:** 0\ **Last updated:** [January 27, 2022, 3:44pm UTC](https://discuss.elastic.co/t/elasticsearch-users-tool-with/295600 "2022-01-27T15:44:13Z")
Hey there, in order to create from scratch a cluster using also file realm, I would like to know if is it possible to integrate the elasticsearch-users tool usage with a pipeline executed via Jenkins/Ansible or Terrafor… --- ## [Forcing Specific Mapping](https://discuss.elastic.co/t/forcing-specific-mapping/295177)
**Author:** [@Morphus1](https://discuss.elastic.co/u/Morphus1)\ **Replies:** 2\ **Last updated:** [January 27, 2022, 9:48am UTC](https://discuss.elastic.co/t/forcing-specific-mapping/295177 "2022-01-27T09:48:29Z")
I'm trying to link my elastic index to a piece of text annotation software called INCEpTION. It asks for some specific mapping. In order to set up a connection to an Elasticsearch repository, the following informatio… --- ## [Plugin development: custom distribution for yamlRestTest ? (7.16)](https://discuss.elastic.co/t/plugin-development-custom-distribution-for-yamlresttest-7-16/295368)
**Author:** [@mhugo](https://discuss.elastic.co/u/mhugo)\ **Replies:** 3\ **Last updated:** [January 27, 2022, 9:43am UTC](https://discuss.elastic.co/t/plugin-development-custom-distribution-for-yamlresttest-7-16/295368 "2022-01-27T09:43:44Z")
Hi, I'm migrating a plugin to the last 7.16.3 version and have trouble figuring out how to make yaml REST tests pass. The ES distribution that is used to run these tests does not seem to include everything needed to run… --- ## [We are trying to move Elasticsearch Data from Docker Container to Kubernetes Pod , the default Data path for ES pod is /usr/share/elasticsearch/data/nodes/0/](https://discuss.elastic.co/t/we-are-trying-to-move-elasticsearch-data-from-docker-container-to-kubernetes-pod-the-default-data-path-for-es-pod-is-usr-share-elasticsearch-data-nodes-0/295553)
**Author:** [@AnushaK](https://discuss.elastic.co/u/AnushaK)\ **Replies:** 3\ **Last updated:** [January 27, 2022, 9:36am UTC](https://discuss.elastic.co/t/we-are-trying-to-move-elasticsearch-data-from-docker-container-to-kubernetes-pod-the-default-data-path-for-es-pod-is-usr-share-elasticsearch-data-nodes-0/295553 "2022-01-27T09:36:30Z")
Hi , I am trying to copy the indices from the source Elasticsearch to the target Elasticsearch under /usr/share/Elasticsearch/data/nodes/0/indices/. Source and target path is same /usr/share/Elasticsearch/data/nodes/0/i… --- ## [Shards failed on a specific index after reducing number of primary shards](https://discuss.elastic.co/t/shards-failed-on-a-specific-index-after-reducing-number-of-primary-shards/295207)
**Author:** [@Michou\_Robert](https://discuss.elastic.co/u/Michou_Robert)\ **Replies:** 6\ **Last updated:** [January 27, 2022, 9:23am UTC](https://discuss.elastic.co/t/shards-failed-on-a-specific-index-after-reducing-number-of-primary-shards/295207 "2022-01-27T09:23:59Z")
I have a 4 nodes ES cluster running on Elasticsearch 6.8.4. We recently had some issues with ELK restarting and having too many shards on them resulting in our nodes going crazy everytime it restarted. (Which happen pret… --- ## [Elastic search show more than one snippet of a document](https://discuss.elastic.co/t/elastic-search-show-more-than-one-snippet-of-a-document/295411)
**Author:** [@bountyhat](https://discuss.elastic.co/u/bountyhat)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 9:04am UTC](https://discuss.elastic.co/t/elastic-search-show-more-than-one-snippet-of-a-document/295411 "2022-01-27T09:04:39Z")
Hi, the default setting is one snippet per document. Can I show more than one snippets of a document? --- ## [Tracking searched JSON documents](https://discuss.elastic.co/t/tracking-searched-json-documents/295554)
**Author:** [@Mohan\_Radhakrishnan](https://discuss.elastic.co/u/Mohan_Radhakrishnan)\ **Replies:** 0\ **Last updated:** [January 27, 2022, 7:51am UTC](https://discuss.elastic.co/t/tracking-searched-json-documents/295554 "2022-01-27T07:51:20Z")
Hello, We are evaluating based on our requirements and not sure how to handle these. We have decided to sink our events as JSON using Kafka Elasticsearch Sink Connector. The source is the DB. Now our primary document s… --- ## [How to convert timestamp in milliseconds i,e long using elastic-sql](https://discuss.elastic.co/t/how-to-convert-timestamp-in-milliseconds-i-e-long-using-elastic-sql/295543)
**Author:** [@David\_Samm](https://discuss.elastic.co/u/David_Samm)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 7:39am UTC](https://discuss.elastic.co/t/how-to-convert-timestamp-in-milliseconds-i-e-long-using-elastic-sql/295543 "2022-01-27T07:39:33Z")
Hi, I have timestamp fields where I want to convert this timestamp to long i,e milliseconds GET /\_sql { "query":"select "2017-11-13T13:51:00.000Z" as date from employee " } here I want the timestamp "201… --- ## [Elasticsearch memory issue?](https://discuss.elastic.co/t/elasticsearch-memory-issue/295449)
**Author:** [@catadetest](https://discuss.elastic.co/u/catadetest)\ **Replies:** 2\ **Last updated:** [January 27, 2022, 7:13am UTC](https://discuss.elastic.co/t/elasticsearch-memory-issue/295449 "2022-01-27T07:13:41Z")
Hi everyone, As my manager told me we should expect more traffic in the following days, I would like to be prepared with the Elasticsearch servers performance. So I did the following investigation: Verified my load /… --- ## [Enquiry on performance issue using Virtual Data Optimizer (VDO) to save storage space](https://discuss.elastic.co/t/enquiry-on-performance-issue-using-virtual-data-optimizer-vdo-to-save-storage-space/295550)
**Author:** [@anon17386273](https://discuss.elastic.co/u/anon17386273)\ **Replies:** 0\ **Last updated:** [January 27, 2022, 7:06am UTC](https://discuss.elastic.co/t/enquiry-on-performance-issue-using-virtual-data-optimizer-vdo-to-save-storage-space/295550 "2022-01-27T07:06:02Z")
Hi I came across this RedHat Virtual Data Optimizer (VDO) storage software that can be used as an additional storage layer on top of my physical volume to perform compression & deduplication. This can significantly save… --- ## [How to convert timestamp in milliseconds i,e long using elastic-sql](https://discuss.elastic.co/t/how-to-convert-timestamp-in-milliseconds-i-e-long-using-elastic-sql/295347)
**Author:** [@David\_Samm](https://discuss.elastic.co/u/David_Samm)\ **Replies:** 2\ **Last updated:** [January 27, 2022, 5:50am UTC](https://discuss.elastic.co/t/how-to-convert-timestamp-in-milliseconds-i-e-long-using-elastic-sql/295347 "2022-01-27T05:50:30Z")
Hi, I have timestamp fields where I want to convert this timestamp to long i,e milliseconds GET /\_sql { "query":"select "2017-11-13T13:51:00.000Z" as date from employee " } here I want the timestamp "2017-… --- ## [Search in two indexes](https://discuss.elastic.co/t/search-in-two-indexes/295506)
**Author:** [@TomTom](https://discuss.elastic.co/u/TomTom)\ **Replies:** 2\ **Last updated:** [January 27, 2022, 4:50am UTC](https://discuss.elastic.co/t/search-in-two-indexes/295506 "2022-01-27T04:50:00Z")
I have two indices. Customer: List of all customers, their internal identifier (id) and their name (name); Order: List of all purchases made, with purchase date (order\_date), customer id (customer.id) and name (custo… --- ## [Brew services starts elasticsearch as root](https://discuss.elastic.co/t/brew-services-starts-elasticsearch-as-root/295409)
**Author:** [@Stephen\_Moore](https://discuss.elastic.co/u/Stephen_Moore)\ **Replies:** 0\ **Last updated:** [January 26, 2022, 12:51am UTC](https://discuss.elastic.co/t/brew-services-starts-elasticsearch-as-root/295409 "2022-01-26T00:51:48Z")
Hello, I've installed Elasticsearch with brew tap elastic/tap brew install elastic/tap/elasticsearch-full And it seems the brew service for it wants to run as root and so Elasticsearch fails to start ╰─ brew services… --- ## [Failed to run "elasticsearch-setup-passwords auto" on ES 7.16.2](https://discuss.elastic.co/t/failed-to-run-elasticsearch-setup-passwords-auto-on-es-7-16-2/295316)
**Author:** [@asagiv](https://discuss.elastic.co/u/asagiv)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 2:45am UTC](https://discuss.elastic.co/t/failed-to-run-elasticsearch-setup-passwords-auto-on-es-7-16-2/295316 "2022-01-27T02:45:40Z")
Hi I am trying to generate the users/password for the built-in users , and fail with the below errors. can someone help to understand the issue ? Regards Avi Failed to determine the health of the cluster running at h… --- ## [ES Best Practices for collecting public distributed logs](https://discuss.elastic.co/t/es-best-practices-for-collecting-public-distributed-logs/295336)
**Author:** [@Alberto\_Manzano](https://discuss.elastic.co/u/Alberto_Manzano)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 2:43am UTC](https://discuss.elastic.co/t/es-best-practices-for-collecting-public-distributed-logs/295336 "2022-01-27T02:43:43Z")
Hello everyone, I've been using ES Stack for quite a while but I'm still struggling to figure out what's the best architecture to ingest logs for a given use case. I've developed an application customers have to instal… --- ## [Why am I getting warning about "Number of open shards exceeds cluster soft limit"?](https://discuss.elastic.co/t/why-am-i-getting-warning-about-number-of-open-shards-exceeds-cluster-soft-limit/295356)
**Author:** [@willdennis](https://discuss.elastic.co/u/willdennis)\ **Replies:** 8\ **Last updated:** [January 27, 2022, 2:14am UTC](https://discuss.elastic.co/t/why-am-i-getting-warning-about-number-of-open-shards-exceeds-cluster-soft-limit/295356 "2022-01-27T02:14:53Z")
I have a single-node ES 6.8 cluster with ~5500 shards. I have set the cluster.max\_shards\_per\_node to '10000' in /etc/elasticsearch/elasticsearch.yml as per this article: But even after restarting ES, I get the "Number … --- ## [Reducing the number of replicas will release disk space an each node of the cluster?](https://discuss.elastic.co/t/reducing-the-number-of-replicas-will-release-disk-space-an-each-node-of-the-cluster/295526)
**Author:** [@Guillermo\_Garcia1](https://discuss.elastic.co/u/Guillermo_Garcia1)\ **Replies:** 2\ **Last updated:** [January 27, 2022, 12:01am UTC](https://discuss.elastic.co/t/reducing-the-number-of-replicas-will-release-disk-space-an-each-node-of-the-cluster/295526 "2022-01-27T00:01:11Z")
Hello there, We have a problem with shard allocation due to disk space usage in several indices (yellow status). We have 2 replicas for each primary shard. We want to update the index settings to 1 replica instead of 2… --- ## [Logstash not connecting to Elasticsearch - using Docker-Compose](https://discuss.elastic.co/t/logstash-not-connecting-to-elasticsearch-using-docker-compose/295512)
**Author:** [@userR](https://discuss.elastic.co/u/userR)\ **Replies:** 1\ **Last updated:** [January 26, 2022, 11:31pm UTC](https://discuss.elastic.co/t/logstash-not-connecting-to-elasticsearch-using-docker-compose/295512 "2022-01-26T23:31:42Z")
Both containers are running and are attempting to communicate with each other. I see Filebeat connecting to Logstash and send information, however I don't see any data being read into Elasticsearch. Here are the logs th… --- ## [After upgrading ES version, new node cannot join to the cluster](https://discuss.elastic.co/t/after-upgrading-es-version-new-node-cannot-join-to-the-cluster/295520)
**Author:** [@judy\_gao](https://discuss.elastic.co/u/judy_gao)\ **Replies:** 0\ **Last updated:** [January 26, 2022, 11:03pm UTC](https://discuss.elastic.co/t/after-upgrading-es-version-new-node-cannot-join-to-the-cluster/295520 "2022-01-26T23:03:45Z")
After upgrading one node to ES 7.16.3, the new node cannot join the cluster, error from log : \[2022-01-26T22:33:34,365\]\[DEBUG\]\[o.e.d.PeerFinder \] \[ip-10-68-41-201.ec2.internal\] address \[\[::1\]:9304\], node \[null\],… --- ## [Insure rebalance data between data node](https://discuss.elastic.co/t/insure-rebalance-data-between-data-node/295503)
**Author:** [@INS](https://discuss.elastic.co/u/INS)\ **Replies:** 2\ **Last updated:** [January 26, 2022, 10:05pm UTC](https://discuss.elastic.co/t/insure-rebalance-data-between-data-node/295503 "2022-01-26T22:05:11Z")
Hi I'm wondering why it was occurred, from the beginning I used the schema of rebalance date through shards (7shards per index). I have 7 data node and one of additional as coordinator. But one of them is going to reach… --- ## [Getting search\_phase\_execution\_exception when making a SearchRequest with sort options](https://discuss.elastic.co/t/getting-search-phase-execution-exception-when-making-a-searchrequest-with-sort-options/295402)
**Author:** [@ridhwaans](https://discuss.elastic.co/u/ridhwaans)\ **Replies:** 0\ **Last updated:** [January 25, 2022, 9:23pm UTC](https://discuss.elastic.co/t/getting-search-phase-execution-exception-when-making-a-searchrequest-with-sort-options/295402 "2022-01-25T21:23:28Z")
Used the Java RestHighLevelClient 7.4.2 to make an org.elasticsearch.action.search.SearchRequest in conjunction with org.elasticsearch.search.sort.FieldSortBuilder. It returned the following ElasticsearchStatusExceptio… --- ## [Replicate HOT node](https://discuss.elastic.co/t/replicate-hot-node/295493)
**Author:** [@ima](https://discuss.elastic.co/u/ima)\ **Replies:** 1\ **Last updated:** [January 26, 2022, 5:47pm UTC](https://discuss.elastic.co/t/replicate-hot-node/295493 "2022-01-26T17:47:56Z")
Hello everyone, Is there a way to replicate a data hot node to another node to maitain high availability (HA). Thank you --- ## [Specifics around local store recovery and out-of-sync shards](https://discuss.elastic.co/t/specifics-around-local-store-recovery-and-out-of-sync-shards/295401)
**Author:** [@Bryan\_Warner](https://discuss.elastic.co/u/Bryan_Warner)\ **Replies:** 4\ **Last updated:** [January 26, 2022, 5:42pm UTC](https://discuss.elastic.co/t/specifics-around-local-store-recovery-and-out-of-sync-shards/295401 "2022-01-26T17:42:51Z")
Hello, I'm trying to understand better how local shard data is recovered after a node comes back online (e.g. after a crash). I believe this recovery is called a "local store recovery" as stated in Index recovery API | … --- ## [Importing existing index from one server to other](https://discuss.elastic.co/t/importing-existing-index-from-one-server-to-other/295487)
**Author:** [@ac123](https://discuss.elastic.co/u/ac123)\ **Replies:** 1\ **Last updated:** [January 26, 2022, 4:38pm UTC](https://discuss.elastic.co/t/importing-existing-index-from-one-server-to-other/295487 "2022-01-26T16:38:47Z")
Hello all, I was wondering the method of importing a single index from one server to another. Currently using restore from backup but one of the indexes are not populating on the main server but is working fine on our d… --- ## [CentOS Yum Repo Issues](https://discuss.elastic.co/t/centos-yum-repo-issues/294619)
**Author:** [@dgoldsmith](https://discuss.elastic.co/u/dgoldsmith)\ **Replies:** 2\ **Last updated:** [January 26, 2022, 4:34pm UTC](https://discuss.elastic.co/t/centos-yum-repo-issues/294619 "2022-01-26T16:34:58Z")
If I simply point a server to the Elastic Yum repo at https://artifacts.elastic.co/packages/7.x/yum/ using a copy of the Yum repo config file provided from the elastic web site, it is able to reach out and retrieve the Y… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=502) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=504)