# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=941

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 942

---

## [Failed to obtain node locks](https://discuss.elastic.co/t/failed-to-obtain-node-locks/229902)

<div class="topic-metadata">

**Author:** [@Rajeev\_Bhat](https://discuss.elastic.co/u/Rajeev_Bhat)\
**Replies:** 7\
**Last updated:** [April 28, 2020, 5:06am UTC](https://discuss.elastic.co/t/failed-to-obtain-node-locks/229902 "2020-04-28T05:06:21Z")

</div>

I have a single node ElasticSearch Cluster in local. I am unable to start elasticsearch service getting this error: \[bhatr@BLRVCESVM27547\]~/elasticsearch-6.8.8/bin% elasticsearch …

---

## [Question about "forcemerge" policy](https://discuss.elastic.co/t/question-about-forcemerge-policy/230050)

<div class="topic-metadata">

**Author:** [@Hyunsoo\_Shim](https://discuss.elastic.co/u/Hyunsoo_Shim)\
**Replies:** 0\
**Last updated:** [April 28, 2020, 12:07am UTC](https://discuss.elastic.co/t/question-about-forcemerge-policy/230050 "2020-04-28T00:07:41Z")

</div>

Hello, I want to know the policy of "forcemerge". (I am using Elasticsearch 6.5.2 version) For all I know, the automatic merge is following with TieredMergePolicy of Lucene, And some conditions can trigger merge acti…

---

## [Number of scroll contexts created by reindex](https://discuss.elastic.co/t/number-of-scroll-contexts-created-by-reindex/230051)

<div class="topic-metadata">

**Author:** [@bobbyi](https://discuss.elastic.co/u/bobbyi)\
**Replies:** 0\
**Last updated:** [April 28, 2020, 12:20am UTC](https://discuss.elastic.co/t/number-of-scroll-contexts-created-by-reindex/230051 "2020-04-28T00:20:39Z")

</div>

I am performing a reindex operation from one index to another within the same cluster running ES 7.5.1. I am using slices=32 and I thought this meant that 32 scroll contexts would be created and used in parallel to pull …

---

## [Is it possible to schedule a reindex which only indexes certain messages?](https://discuss.elastic.co/t/is-it-possible-to-schedule-a-reindex-which-only-indexes-certain-messages/229966)

<div class="topic-metadata">

**Author:** [@Mugen](https://discuss.elastic.co/u/Mugen)\
**Replies:** 1\
**Last updated:** [April 27, 2020, 10:57pm UTC](https://discuss.elastic.co/t/is-it-possible-to-schedule-a-reindex-which-only-indexes-certain-messages/229966 "2020-04-27T22:57:46Z")

</div>

Hi Folks. I'm currently using a cron job to reindex certain log-messages of multiple daily indexes into a new one. Is this possible via elastic internal tools like rollups ? Im currently querying the logs if they contai…

---

## [For allocating unassigned replicas: Why does DiskThresholdDecider need free disk space \>= shard size when only a few MBs need to be recovered](https://discuss.elastic.co/t/for-allocating-unassigned-replicas-why-does-diskthresholddecider-need-free-disk-space-shard-size-when-only-a-few-mbs-need-to-be-recovered/230037)

<div class="topic-metadata">

**Author:** [@UDixit](https://discuss.elastic.co/u/UDixit)\
**Replies:** 0\
**Last updated:** [April 27, 2020, 9:43pm UTC](https://discuss.elastic.co/t/for-allocating-unassigned-replicas-why-does-diskthresholddecider-need-free-disk-space-shard-size-when-only-a-few-mbs-need-to-be-recovered/230037 "2020-04-27T21:43:52Z")

</div>

ES5; Index size ~500GB, ShardSize ~45GB each. I have a 120GB disk and only 2 of the shards of this index are allocated on this disk. Currently, these replica shards are unassigned, with reason NODE-LEFT, doing a PEER r…

---

## [Can I safely use Solr and Elasticsearch dependencies in the same Java project?](https://discuss.elastic.co/t/can-i-safely-use-solr-and-elasticsearch-dependencies-in-the-same-java-project/230029)

<div class="topic-metadata">

**Author:** [@rmavilia\_w](https://discuss.elastic.co/u/rmavilia_w)\
**Replies:** 0\
**Last updated:** [April 27, 2020, 8:54pm UTC](https://discuss.elastic.co/t/can-i-safely-use-solr-and-elasticsearch-dependencies-in-the-same-java-project/230029 "2020-04-27T20:54:44Z")

</div>

Intro Hi so I have a Java project which started as a way to get data from a database and transport it into Solr. This project uses Maven and relies on the solr-core and solr-solrj artifacts as dependencies. For the Solr…

---

## [Repository verification exception when trying to create snapshot](https://discuss.elastic.co/t/repository-verification-exception-when-trying-to-create-snapshot/225125)

<div class="topic-metadata">

**Author:** [@Rakesh\_B](https://discuss.elastic.co/u/Rakesh_B)\
**Replies:** 5\
**Last updated:** [April 27, 2020, 8:54pm UTC](https://discuss.elastic.co/t/repository-verification-exception-when-trying-to-create-snapshot/225125 "2020-04-27T20:54:30Z")

</div>

version: 7.6.1 We are using the latest version of elasticsearch in kubernetes and the cluster is not able to verify the snapshot repository. As you can see, I'm able to upload files to the bucket and I was also able to…

---

## [How to get distinct values from elastic search](https://discuss.elastic.co/t/how-to-get-distinct-values-from-elastic-search/230020)

<div class="topic-metadata">

**Author:** [@msaundi](https://discuss.elastic.co/u/msaundi)\
**Replies:** 0\
**Last updated:** [April 27, 2020, 7:53pm UTC](https://discuss.elastic.co/t/how-to-get-distinct-values-from-elastic-search/230020 "2020-04-27T19:53:15Z")

</div>

Hello, I am trying to get distinct count form the elastic search. for the grouping I am using cardinality aggregation along with query string. I am using elastic 6.x with php client. below is my query. Array …

---

## [ElasticSearch XPack - PKI Realm authentication defaults to native authentication](https://discuss.elastic.co/t/elasticsearch-xpack-pki-realm-authentication-defaults-to-native-authentication/228906)

<div class="topic-metadata">

**Author:** [@AbrahamPFdez](https://discuss.elastic.co/u/AbrahamPFdez)\
**Replies:** 3\
**Last updated:** [April 27, 2020, 7:20pm UTC](https://discuss.elastic.co/t/elasticsearch-xpack-pki-realm-authentication-defaults-to-native-authentication/228906 "2020-04-27T19:20:00Z")

</div>

Hi, I am using ES version 7.6.2. I'm trying to set up a PKI authentication in my ES cluster, my elasticsearch.yml looks like this. Although the transport security configuration is not relevant, I post it anyway: # Tran…

---

## [Is there any API directly tell how many shard on a node](https://discuss.elastic.co/t/is-there-any-api-directly-tell-how-many-shard-on-a-node/229736)

<div class="topic-metadata">

**Author:** [@Louis\_Zhang](https://discuss.elastic.co/u/Louis_Zhang)\
**Replies:** 4\
**Last updated:** [April 27, 2020, 6:14pm UTC](https://discuss.elastic.co/t/is-there-any-api-directly-tell-how-many-shard-on-a-node/229736 "2020-04-27T18:14:43Z")

</div>

is there any API like GET /\_cat/nodes to get the quatiity of the shard on a node \[ { "name" : "node-2", "cpu" : "1" }, { "name" : "node-1", "cpu" : "4" }, { "name" : "node-3", "cpu" :…

---

## [Query on Incremental backups using snapshots](https://discuss.elastic.co/t/query-on-incremental-backups-using-snapshots/229597)

<div class="topic-metadata">

**Author:** [@shivani\_aggarwal](https://discuss.elastic.co/u/shivani_aggarwal)\
**Replies:** 4\
**Last updated:** [April 27, 2020, 5:56pm UTC](https://discuss.elastic.co/t/query-on-incremental-backups-using-snapshots/229597 "2020-04-27T17:56:49Z")

</div>

Hi, We use elasticsearch snapshot API to take backup of ES data daily and also regularly copy the entire content from the snapshot repository to another remote system. Now that we have huge amount of data in ES (in TBs…

---

## [Elastic-search cluster load-balancing](https://discuss.elastic.co/t/elastic-search-cluster-load-balancing/230003)

<div class="topic-metadata">

**Author:** [@opensourcengineer](https://discuss.elastic.co/u/opensourcengineer)\
**Replies:** 0\
**Last updated:** [April 27, 2020, 5:55pm UTC](https://discuss.elastic.co/t/elastic-search-cluster-load-balancing/230003 "2020-04-27T17:55:13Z")

</div>

I am using Elastic-search version 7.5.2 . My cluster has 1 master node and 3 data nodes and 1 co-ordinating node which is essentially a kibana node. The workflow is beats-\>logstash-\>elasti-search-\>kibana. All my logs …

---

## [Geopoint common Schema suggestion](https://discuss.elastic.co/t/geopoint-common-schema-suggestion/229562)

<div class="topic-metadata">

**Author:** [@Patrick\_Harris](https://discuss.elastic.co/u/Patrick_Harris)\
**Replies:** 6\
**Last updated:** [April 27, 2020, 5:38pm UTC](https://discuss.elastic.co/t/geopoint-common-schema-suggestion/229562 "2020-04-27T17:38:05Z")

</div>

Geopoint needs altitude added: Use cases are: Things that move need lat, long and altitude Vehicles, humans and covid are all moving. Need to correlate on altitude. Thx for considering suggestion.

---

## [Could not index event to Elasticsearch Errror](https://discuss.elastic.co/t/could-not-index-event-to-elasticsearch-errror/229740)

<div class="topic-metadata">

**Author:** [@bruno\_aleixo](https://discuss.elastic.co/u/bruno_aleixo)\
**Replies:** 4\
**Last updated:** [April 27, 2020, 5:09pm UTC](https://discuss.elastic.co/t/could-not-index-event-to-elasticsearch-errror/229740 "2020-04-27T17:09:09Z")

</div>

Hi, Please, help me with error \[2020-04-25T01:23:57,058\]\[WARN \]\[logstash.outputs.elasticsearch\] Could not index event to Elasticsearch. {:status=\>400, :action=\>\["index", {:\_id=\>nil, :\_index=\>"wl\_audit-2020.04.25", :\_ty…

---

## [Elasticsearch Java API : token \['result'\] was expecting one of \[{\<EOF\>, ';'}\]](https://discuss.elastic.co/t/elasticsearch-java-api-token-result-was-expecting-one-of-eof/229995)

<div class="topic-metadata">

**Author:** [@shamim\_Khadivinia](https://discuss.elastic.co/u/shamim_Khadivinia)\
**Replies:** 0\
**Last updated:** [April 27, 2020, 5:06pm UTC](https://discuss.elastic.co/t/elasticsearch-java-api-token-result-was-expecting-one-of-eof/229995 "2020-04-27T17:06:54Z")

</div>

I wanna update one of the fields with new value In the document. The type of new value is JSON. I send a String parameter it works but when I send JSON it has an error. UpdateResponse response = dataTransport…

---

## [Deployment a cluster in Elastic Cloud](https://discuss.elastic.co/t/deployment-a-cluster-in-elastic-cloud/229959)

<div class="topic-metadata">

**Author:** [@alberto1](https://discuss.elastic.co/u/alberto1)\
**Replies:** 2\
**Last updated:** [April 27, 2020, 3:41pm UTC](https://discuss.elastic.co/t/deployment-a-cluster-in-elastic-cloud/229959 "2020-04-27T15:41:14Z")

</div>

Hi, I am new in Elastic and today i did create a trial account in Elastic Cloud till there everything was fine but the problem came when i´ve tried to create my first deployment. I left all the default settings for the…

---

## [Retrieving model parameters of Data Frame Analytics job](https://discuss.elastic.co/t/retrieving-model-parameters-of-data-frame-analytics-job/227608)

<div class="topic-metadata">

**Author:** [@cristianplaytreks](https://discuss.elastic.co/u/cristianplaytreks)\
**Replies:** 3\
**Last updated:** [April 27, 2020, 3:24pm UTC](https://discuss.elastic.co/t/retrieving-model-parameters-of-data-frame-analytics-job/227608 "2020-04-27T15:24:08Z")

</div>

Hi, New to ELK here, love it so far! I created a regression Data Frame Analytics job successfully. Is it possible to retrieve the parameters of the XGBoost model (i.e. the same parameters I would need in order to creat…

---

## [Adding data to existing Index (Merge/Join)](https://discuss.elastic.co/t/adding-data-to-existing-index-merge-join/229983)

<div class="topic-metadata">

**Author:** [@Majid\_k](https://discuss.elastic.co/u/Majid_k)\
**Replies:** 0\
**Last updated:** [April 27, 2020, 3:08pm UTC](https://discuss.elastic.co/t/adding-data-to-existing-index-merge-join/229983 "2020-04-27T15:08:52Z")

</div>

Hey there. I am working on a project on social media analysis, esp. Twitter. I have imported tweets into daily indices with logstash. Now I need to do some processing in this data, and attach the results to each tweet. …

---

## [Should I use \`keyword\` in \`term\` queries?](https://discuss.elastic.co/t/should-i-use-keyword-in-term-queries/229960)

<div class="topic-metadata">

**Author:** [@tterranigma](https://discuss.elastic.co/u/tterranigma)\
**Replies:** 4\
**Last updated:** [April 27, 2020, 3:02pm UTC](https://discuss.elastic.co/t/should-i-use-keyword-in-term-queries/229960 "2020-04-27T15:02:21Z")

</div>

I parse a file with filebeat and send it to elasticsearch where I parse it with an ingest node into fields. The problem I have is that I want to use term queries to match the text of one of those fields. Until 2 days ag…

---

## [Elasticsearch cluster error for ES 7.2.1 "master not discovered yet:"](https://discuss.elastic.co/t/elasticsearch-cluster-error-for-es-7-2-1-master-not-discovered-yet/229311)

<div class="topic-metadata">

**Author:** [@mkbmanas87](https://discuss.elastic.co/u/mkbmanas87)\
**Replies:** 1\
**Last updated:** [April 27, 2020, 2:42pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-error-for-es-7-2-1-master-not-discovered-yet/229311 "2020-04-27T14:42:22Z")

</div>

Hi Team, I am getting the below Warning in 1 of my data node. My configuration is 1 master and 1 data node but data node is not connecting with the master node. ES Version- 7.2.1 "Error:- \[o.e.c.c.ClusterFormatio…

---

## [Unable to fetch real time data from database](https://discuss.elastic.co/t/unable-to-fetch-real-time-data-from-database/229956)

<div class="topic-metadata">

**Author:** [@Vishnu\_mk](https://discuss.elastic.co/u/Vishnu_mk)\
**Replies:** 0\
**Last updated:** [April 27, 2020, 12:55pm UTC](https://discuss.elastic.co/t/unable-to-fetch-real-time-data-from-database/229956 "2020-04-27T12:55:55Z")

</div>

This is my logstash config input { jdbc { jdbc\_driver\_library =\> "/etc/ojdbc6.jar" jdbc\_driver\_class =\> "Java::oracle.jdbc.driver.OracleDriver" jdbc\_connection\_string =\> "jdbc:oracle:thin:@1.0.2.10:8888/a…

---

## [Elastic Search Benchmarks](https://discuss.elastic.co/t/elastic-search-benchmarks/229914)

<div class="topic-metadata">

**Author:** [@nages](https://discuss.elastic.co/u/nages)\
**Replies:** 3\
**Last updated:** [April 27, 2020, 12:33pm UTC](https://discuss.elastic.co/t/elastic-search-benchmarks/229914 "2020-04-27T12:33:11Z")

</div>

Is there a document about benchmarks from elastic search -as in these many nodes for these many queries ? optimal shard size ? optimal node allocation ? I know "it depends" kind of answer for these questions - but any…

---

## [How to get all records in bucket](https://discuss.elastic.co/t/how-to-get-all-records-in-bucket/229216)

<div class="topic-metadata">

**Author:** [@Ramesh\_Kumar](https://discuss.elastic.co/u/Ramesh_Kumar)\
**Replies:** 13\
**Last updated:** [April 27, 2020, 12:28pm UTC](https://discuss.elastic.co/t/how-to-get-all-records-in-bucket/229216 "2020-04-27T12:28:44Z")

</div>

{ "aggs":{ "country":{ "terms":{ "field":"country.keyword" }, "size":1000, "aggs":{ "videocount":{ "sum":{ "field":"video\_count" } }, "viewcount":{ "sum":{ "field":"view\_count" } },…

---

## [Global ordinals on high cardinality fields with large indices](https://discuss.elastic.co/t/global-ordinals-on-high-cardinality-fields-with-large-indices/229948)

<div class="topic-metadata">

**Author:** [@YvorL](https://discuss.elastic.co/u/YvorL)\
**Replies:** 7\
**Last updated:** [April 27, 2020, 12:14pm UTC](https://discuss.elastic.co/t/global-ordinals-on-high-cardinality-fields-with-large-indices/229948 "2020-04-27T12:14:33Z")

</div>

Hi, I've got a daily index with a couple of high cardinality fields. Even after reading some threads and the documentation available, I'm not sure how should I proceed. The index has ~600M docs in it every day and the m…

---

## [Platinum license expired](https://discuss.elastic.co/t/platinum-license-expired/229933)

<div class="topic-metadata">

**Author:** [@pantomin](https://discuss.elastic.co/u/pantomin)\
**Replies:** 5\
**Last updated:** [April 27, 2020, 11:45am UTC](https://discuss.elastic.co/t/platinum-license-expired/229933 "2020-04-27T11:45:01Z")

</div>

Hi everyone, I am quite new in ElasticSearch so any help would be highly appreciated. It happened that our ES platinum license expired, and now we can not run queries, which is understandable. My question: is there any …

---

## [Different scroll id for each subsequent scroll request?](https://discuss.elastic.co/t/different-scroll-id-for-each-subsequent-scroll-request/229580)

<div class="topic-metadata">

**Author:** [@A\_google\_user](https://discuss.elastic.co/u/A_google_user)\
**Replies:** 6\
**Last updated:** [April 27, 2020, 11:27am UTC](https://discuss.elastic.co/t/different-scroll-id-for-each-subsequent-scroll-request/229580 "2020-04-27T11:27:14Z")

</div>

I am using scroll to fetch docs from elasticsearch, modify them, and reindex them. I have read everywhere and it is mentioned here and here that each subsequent request sends different scroll\_id. But I don't see that hap…

---

## [Hive to Elastic Data Load](https://discuss.elastic.co/t/hive-to-elastic-data-load/228066)

<div class="topic-metadata">

**Author:** [@Sarath\_Pullabhotla](https://discuss.elastic.co/u/Sarath_Pullabhotla)\
**Replies:** 13\
**Last updated:** [April 27, 2020, 11:23am UTC](https://discuss.elastic.co/t/hive-to-elastic-data-load/228066 "2020-04-27T11:23:08Z")

</div>

Hi, I have loaded a data containing 536965213 rows from hive to elastic. But when I check the data loaded in elastic via Kibana it displays " 548,889,213 hits which is more than the number of records present in my hive…

---

## [Point in time values each minute. For visualisations](https://discuss.elastic.co/t/point-in-time-values-each-minute-for-visualisations/229943)

<div class="topic-metadata">

**Author:** [@nmesmeric](https://discuss.elastic.co/u/nmesmeric)\
**Replies:** 0\
**Last updated:** [April 27, 2020, 10:47am UTC](https://discuss.elastic.co/t/point-in-time-values-each-minute-for-visualisations/229943 "2020-04-27T10:47:21Z")

</div>

Hey Guys, I'm not sure exactly how to word this. However, i would like to have a timeseries chart that plots point in time values every minute. I collect login and logout events for users into a system. I have a transf…

---

## [Getting \[ERROR\] 'The \[dims\] property must be specified for field \[vector\].' despite being set in mapping](https://discuss.elastic.co/t/getting-error-the-dims-property-must-be-specified-for-field-vector-despite-being-set-in-mapping/229001)

<div class="topic-metadata">

**Author:** [@Vinay\_Sharma](https://discuss.elastic.co/u/Vinay_Sharma)\
**Replies:** 1\
**Last updated:** [April 27, 2020, 10:38am UTC](https://discuss.elastic.co/t/getting-error-the-dims-property-must-be-specified-for-field-vector-despite-being-set-in-mapping/229001 "2020-04-27T10:38:36Z")

</div>

I am trying to upload dense vectors to Elasticsearch endpoint. created index with mapping as below: mapping = { "mappings": { "properties" : { "vector": { "type"…

---

## [Difference in performance between using metric path parameter and filter\_path query parameter in note stats](https://discuss.elastic.co/t/difference-in-performance-between-using-metric-path-parameter-and-filter-path-query-parameter-in-note-stats/229941)

<div class="topic-metadata">

**Author:** [@harskum](https://discuss.elastic.co/u/harskum)\
**Replies:** 0\
**Last updated:** [April 27, 2020, 10:29am UTC](https://discuss.elastic.co/t/difference-in-performance-between-using-metric-path-parameter-and-filter-path-query-parameter-in-note-stats/229941 "2020-04-27T10:29:38Z")

</div>

How is the computation of a query done. So, for example if I specify a metric path parameter in GET \_nodes/stats/\<metric\> api, are the computations being done for metrics that I passed, or whether it's just another filte…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=940)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=942)
