# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=678 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 679 --- ## [Setting indices.id\_field\_data.enabled for index instead of cluster](https://discuss.elastic.co/t/setting-indices-id-field-data-enabled-for-index-instead-of-cluster/268003)
**Author:** [@seanziee](https://discuss.elastic.co/u/seanziee)\ **Replies:** 0\ **Last updated:** [March 22, 2021, 6:16pm UTC](https://discuss.elastic.co/t/setting-indices-id-field-data-enabled-for-index-instead-of-cluster/268003 "2021-03-22T18:16:27Z")
This setting has been great to be able to change because many problems can come up from aggregating on the \_id field. However, I want to be able to control this setting for a specific index, rather than the whole cluster… --- ## [Does remote cluster with proxy mode support high availability](https://discuss.elastic.co/t/does-remote-cluster-with-proxy-mode-support-high-availability/267994)
**Author:** [@kannan\_raj](https://discuss.elastic.co/u/kannan_raj)\ **Replies:** 1\ **Last updated:** [March 22, 2021, 6:11pm UTC](https://discuss.elastic.co/t/does-remote-cluster-with-proxy-mode-support-high-availability/267994 "2021-03-22T18:11:04Z")
Hello Team, we are implementing remote cluster with proxy mode. we have noticed that we could able to add only one node as proxy\_address and its opened 18 socket connection to the same node. we are not able to search t… --- ## [Problem configuring elastic search with downloaded with msi](https://discuss.elastic.co/t/problem-configuring-elastic-search-with-downloaded-with-msi/267973)
**Author:** [@Tino23](https://discuss.elastic.co/u/Tino23)\ **Replies:** 3\ **Last updated:** [March 22, 2021, 3:50pm UTC](https://discuss.elastic.co/t/problem-configuring-elastic-search-with-downloaded-with-msi/267973 "2021-03-22T15:50:02Z")
Unexpected response code \[405\] from calling GET http://127.0.0.1:9200/\_security/\_authenticate?pretty It doesn't look like the X-Pack security feature is enabled on this Elasticsearch node. Please check if you have enab… --- ## [Full match on analyzed text field](https://discuss.elastic.co/t/full-match-on-analyzed-text-field/267982)
**Author:** [@JBo\_Shim](https://discuss.elastic.co/u/JBo_Shim)\ **Replies:** 0\ **Last updated:** [March 22, 2021, 2:24pm UTC](https://discuss.elastic.co/t/full-match-on-analyzed-text-field/267982 "2021-03-22T14:24:26Z")
Hi guys. I'm looking for the way to query only fully matched string on analyzed text field. For example, when I set "tasty" as synonym of "delicious", the indexed data will be like this: 1. "delicious apple" term pos… --- ## [First Claster for log collection](https://discuss.elastic.co/t/first-claster-for-log-collection/267765)
**Author:** [@zenekas1978](https://discuss.elastic.co/u/zenekas1978)\ **Replies:** 4\ **Last updated:** [March 22, 2021, 12:02pm UTC](https://discuss.elastic.co/t/first-claster-for-log-collection/267765 "2021-03-22T12:02:48Z")
Hi All, I would like to build my first ELK cluster in Azure in order to collect and analyze logs from VM's and firewalls. I used ELK Azure template and I created 3 masters, 1 data, Kibana and Logstash nodes. I would li… --- ## [Bucket Aggregation with Distinct Source at multiple levels](https://discuss.elastic.co/t/bucket-aggregation-with-distinct-source-at-multiple-levels/267722)
**Author:** [@F\_Doe\_FW](https://discuss.elastic.co/u/F_Doe_FW)\ **Replies:** 0\ **Last updated:** [March 18, 2021, 9:27pm UTC](https://discuss.elastic.co/t/bucket-aggregation-with-distinct-source-at-multiple-levels/267722 "2021-03-18T21:27:17Z")
Trying to see if I can pull out distinct values (keyword,float) on a bucket level. Top Hits will give me a lot of values that I have to discard. { "size": 0, "query": { "bool": { "filter": { "bool… --- ## [Filebeat -\> Logstash -\> ElasticSearch with multiple outputs](https://discuss.elastic.co/t/filebeat-logstash-elasticsearch-with-multiple-outputs/267598)
**Author:** [@Satyat500](https://discuss.elastic.co/u/Satyat500)\ **Replies:** 6\ **Last updated:** [March 22, 2021, 11:39am UTC](https://discuss.elastic.co/t/filebeat-logstash-elasticsearch-with-multiple-outputs/267598 "2021-03-22T11:39:01Z")
Hi team, I am trying to send output to two different index by taking two different inputs in tcp and beats. I am able to send logs to elasticsearch which are coming from filebeat but I am not able to send the logs to lo… --- ## [Question regarding TF/IDF implementation](https://discuss.elastic.co/t/question-regarding-tf-idf-implementation/267933)
**Author:** [@Yaron\_Golan](https://discuss.elastic.co/u/Yaron_Golan)\ **Replies:** 1\ **Last updated:** [March 22, 2021, 11:25am UTC](https://discuss.elastic.co/t/question-regarding-tf-idf-implementation/267933 "2021-03-22T11:25:44Z")
We have been using an older Elastic version (1.4) for a while and have recently upgraded but wish to continue using the TF/IDF scoring algorithm. In https://www.elastic.co/guide/en/elasticsearch/reference/current/index-… --- ## [NullPointerException in LongComparator.setTopValue](https://discuss.elastic.co/t/nullpointerexception-in-longcomparator-settopvalue/267972)
**Author:** [@mgrafl](https://discuss.elastic.co/u/mgrafl)\ **Replies:** 1\ **Last updated:** [March 22, 2021, 11:17am UTC](https://discuss.elastic.co/t/nullpointerexception-in-longcomparator-settopvalue/267972 "2021-03-22T11:17:45Z")
Hi all, I get a NullPointerException using Elasticsearch 7.9.1 with Lucene Core 8.6.2 on CentOS 7: "stacktrace": \["org.elasticsearch.action.search.SearchPhaseExecutionException: all shards failed", "at org.… --- ## [Highlight query behaviour in elastic search](https://discuss.elastic.co/t/highlight-query-behaviour-in-elastic-search/267961)
**Author:** [@Pushpak](https://discuss.elastic.co/u/Pushpak)\ **Replies:** 3\ **Last updated:** [March 22, 2021, 11:08am UTC](https://discuss.elastic.co/t/highlight-query-behaviour-in-elastic-search/267961 "2021-03-22T11:08:57Z")
Hi , My data is stored in below kind of json in elastic search { "number" : "0", "journal" : \[ { "no" : "1", "createdby" : "sanction", "typeofcomment" : "Normal", "comment" : … --- ## [Get error 'no such index \[pdf\_test\]' after use fscrawer to create index](https://discuss.elastic.co/t/get-error-no-such-index-pdf-test-after-use-fscrawer-to-create-index/267791)
**Author:** [@lxia](https://discuss.elastic.co/u/lxia)\ **Replies:** 7\ **Last updated:** [March 22, 2021, 10:06am UTC](https://discuss.elastic.co/t/get-error-no-such-index-pdf-test-after-use-fscrawer-to-create-index/267791 "2021-03-22T10:06:35Z")
FSCrawler verssion: 2.7 when I first run the command: bin\\fscrawler --config\_dir ./DS pdf\_test, it showed info: job \[pdf\_test\] does not exist Do you want to create it (Y/N)? Y Settings have been created in \[.\\DS\\pdf\_… --- ## [Automatic deletion of indices older than 3 months in elastic search](https://discuss.elastic.co/t/automatic-deletion-of-indices-older-than-3-months-in-elastic-search/267957)
**Author:** [@Deepz](https://discuss.elastic.co/u/Deepz)\ **Replies:** 5\ **Last updated:** [March 22, 2021, 9:39am UTC](https://discuss.elastic.co/t/automatic-deletion-of-indices-older-than-3-months-in-elastic-search/267957 "2021-03-22T09:39:17Z")
Hi.. Could someone help me on how to automate the deletion the indices that are older than 3 months old. (Without curator) --- ## [Advice on self hosted elasticsearch architecture](https://discuss.elastic.co/t/advice-on-self-hosted-elasticsearch-architecture/267962)
**Author:** [@Norman\_Khine](https://discuss.elastic.co/u/Norman_Khine)\ **Replies:** 1\ **Last updated:** [March 22, 2021, 9:36am UTC](https://discuss.elastic.co/t/advice-on-self-hosted-elasticsearch-architecture/267962 "2021-03-22T09:36:35Z")
Hello, We are looking to build a self hosted elasticsearch cluster either on AWS. I have been looking at infrastructure designs for HA ES setup and was wondering at what stage is it worth in migrating to self hosted so… --- ## [Geo\_point property](https://discuss.elastic.co/t/geo-point-property/267960)
**Author:** [@fabrizio](https://discuss.elastic.co/u/fabrizio)\ **Replies:** 1\ **Last updated:** [March 22, 2021, 9:24am UTC](https://discuss.elastic.co/t/geo-point-property/267960 "2021-03-22T09:24:57Z")
Hi, I have an index like log-. The daily index is create by logstash every day. I want to include geo\_point attribute. It was quite easy to create a specific index (for example) log-2021-03-17 with location property se… --- ## [Snapshot\_missing\_exception when deleting multiple snapshots](https://discuss.elastic.co/t/snapshot-missing-exception-when-deleting-multiple-snapshots/266834)
**Author:** [@Norman\_Khine](https://discuss.elastic.co/u/Norman_Khine)\ **Replies:** 8\ **Last updated:** [March 22, 2021, 9:15am UTC](https://discuss.elastic.co/t/snapshot-missing-exception-when-deleting-multiple-snapshots/266834 "2021-03-22T09:15:40Z")
Hello, from the documentation, https://www.elastic.co/guide/en/elasticsearch/reference/current/delete-snapshots.html I am trying to delete multiple snapshots, but get an error: { "error" : { "root\_cause" : \[ … --- ## [Documents are not getting inserted in ES6.2](https://discuss.elastic.co/t/documents-are-not-getting-inserted-in-es6-2/267806)
**Author:** [@rajat\_singh1](https://discuss.elastic.co/u/rajat_singh1)\ **Replies:** 0\ **Last updated:** [March 19, 2021, 11:48am UTC](https://discuss.elastic.co/t/documents-are-not-getting-inserted-in-es6-2/267806 "2021-03-19T11:48:22Z")
Hi, I'mm trying to insert documents in ES 6.2. My concern is when I'm inserting data into ES by mapping one of index and mentioning "index": false, Data is not getting populating. And same code is inserting data when … --- ## [How to add custom index descriptor mapping to added fields (Nest .net)](https://discuss.elastic.co/t/how-to-add-custom-index-descriptor-mapping-to-added-fields-nest-net/267958)
**Author:** [@Nicolas\_Rey](https://discuss.elastic.co/u/Nicolas_Rey)\ **Replies:** 0\ **Last updated:** [March 22, 2021, 8:24am UTC](https://discuss.elastic.co/t/how-to-add-custom-index-descriptor-mapping-to-added-fields-nest-net/267958 "2021-03-22T08:24:20Z")
Hi, I use a repository to deal with Elasticsearch CRUD operations. It works but I face a problem : when I add fields to an existing index I don't know how to apply custom Index Descriptor. It works with an AutoMap but … --- ## [When will translog file be deleted from disk?](https://discuss.elastic.co/t/when-will-translog-file-be-deleted-from-disk/267944)
**Author:** [@CHU\_XU](https://discuss.elastic.co/u/CHU_XU)\ **Replies:** 3\ **Last updated:** [March 22, 2021, 8:02am UTC](https://discuss.elastic.co/t/when-will-translog-file-be-deleted-from-disk/267944 "2021-03-22T08:02:27Z")
Hi there, I found in the data directory, there many translog files like \*.tlog or \*.ckp have been existing for few days. According to the document, there's a retention setting with default 12 hours. But I'm using 7.5 v… --- ## [How to deploy alert on incoming events](https://discuss.elastic.co/t/how-to-deploy-alert-on-incoming-events/267920)
**Author:** [@\_omar](https://discuss.elastic.co/u/_omar)\ **Replies:** 1\ **Last updated:** [March 22, 2021, 5:44am UTC](https://discuss.elastic.co/t/how-to-deploy-alert-on-incoming-events/267920 "2021-03-22T05:44:20Z")
Hi I'm a new user of 'elastic', and need to deploy an alert that notify each event with 'geoip.country\_name' tag value distinct than 'peru'. The alert have to be in real time, like the mostly siem solutions do, so far i… --- ## [Is there any way to score nested documents as if they're native fields of the main document?](https://discuss.elastic.co/t/is-there-any-way-to-score-nested-documents-as-if-theyre-native-fields-of-the-main-document/267934)
**Author:** [@Yaron\_Golan](https://discuss.elastic.co/u/Yaron_Golan)\ **Replies:** 0\ **Last updated:** [March 22, 2021, 3:20am UTC](https://discuss.elastic.co/t/is-there-any-way-to-score-nested-documents-as-if-theyre-native-fields-of-the-main-document/267934 "2021-03-22T03:20:09Z")
Is it possible to get similar scoring methodologies for nested document fields normal fields? See searches for "awful" (nested) and "amazing" (direct) below. DELETE /testindex PUT /testindex { "mappings": { "pro… --- ## [100% cpu system time used on hdd data node](https://discuss.elastic.co/t/100-cpu-system-time-used-on-hdd-data-node/267532)
**Author:** [@wangxr1985](https://discuss.elastic.co/u/wangxr1985)\ **Replies:** 2\ **Last updated:** [March 22, 2021, 2:44am UTC](https://discuss.elastic.co/t/100-cpu-system-time-used-on-hdd-data-node/267532 "2021-03-22T02:44:38Z")
The ES version is 7.11.1 We use 16C64G vm which has 4 physical hdd disks(striped lvm volume) as warm data node. The issue is that the cpu system time of a random vm offen suddenly rises up to 100%, and then the vm keep… --- ## [STIG - The DBMS must isolate security functions from non-security functions](https://discuss.elastic.co/t/stig-the-dbms-must-isolate-security-functions-from-non-security-functions/267744)
**Author:** [@Dan\_Bitter](https://discuss.elastic.co/u/Dan_Bitter)\ **Replies:** 3\ **Last updated:** [March 22, 2021, 2:28am UTC](https://discuss.elastic.co/t/stig-the-dbms-must-isolate-security-functions-from-non-security-functions/267744 "2021-03-22T02:28:01Z")
I have a list of STIGs to implement for Elasticsearch, and I'm not sure how to verify the needs of this one. I read about the keystore, which I think helps, but I don't think it covers all the points. I found setup p… --- ## [Indices name Can't use IP?](https://discuss.elastic.co/t/indices-name-cant-use-ip/267439)
**Author:** [@jun\_li](https://discuss.elastic.co/u/jun_li)\ **Replies:** 1\ **Last updated:** [March 22, 2021, 2:02am UTC](https://discuss.elastic.co/t/indices-name-cant-use-ip/267439 "2021-03-22T02:02:22Z")
I did a test to create index: Add Index PUT /access.log.2020.04.07/\_doc/1 { "domain":"www.amazon.com", "status":200 } #There is no problem when I query this index, GET \_cat/indices yellow open access.log.2020.04.0… --- ## [How the real data is stored in data disk?](https://discuss.elastic.co/t/how-the-real-data-is-stored-in-data-disk/267476)
**Author:** [@Jax\_dev](https://discuss.elastic.co/u/Jax_dev)\ **Replies:** 1\ **Last updated:** [March 22, 2021, 1:58am UTC](https://discuss.elastic.co/t/how-the-real-data-is-stored-in-data-disk/267476 "2021-03-22T01:58:46Z")
I have executed below api GET "/\_cat/shards?v" it has shown all the indices in which one of the indices has taken 302 GB. When I have checked the mounted disk ( mentioned in path.data ) which elastic is being used, it s… --- ## [How much disk storage required to take backup of index which is having 300GB?](https://discuss.elastic.co/t/how-much-disk-storage-required-to-take-backup-of-index-which-is-having-300gb/267424)
**Author:** [@Jax\_dev](https://discuss.elastic.co/u/Jax_dev)\ **Replies:** 12\ **Last updated:** [March 22, 2021, 1:55am UTC](https://discuss.elastic.co/t/how-much-disk-storage-required-to-take-backup-of-index-which-is-having-300gb/267424 "2021-03-22T01:55:57Z")
If we want to take a back of one of the indices which is having 300GB, enabling compression - true. How much space snapshot will occupy? How do we take snapshot to azure blob storage? Elastic server cluster is on azure… --- ## [How to fix Unassigned state for my indexes?](https://discuss.elastic.co/t/how-to-fix-unassigned-state-for-my-indexes/267560)
**Author:** [@andy1122](https://discuss.elastic.co/u/andy1122)\ **Replies:** 1\ **Last updated:** [March 22, 2021, 1:54am UTC](https://discuss.elastic.co/t/how-to-fix-unassigned-state-for-my-indexes/267560 "2021-03-22T01:54:08Z")
I have ElasticSearch configured in Docker and loading data from Magento into ES via indexer. When quering ES indexes I can see all the data is there but when I try to access it from my localhost:8080 where my connection … --- ## [How to create a document using the .NET library?](https://discuss.elastic.co/t/how-to-create-a-document-using-the-net-library/267584)
**Author:** [@jay2021](https://discuss.elastic.co/u/jay2021)\ **Replies:** 0\ **Last updated:** [March 17, 2021, 11:20pm UTC](https://discuss.elastic.co/t/how-to-create-a-document-using-the-net-library/267584 "2021-03-17T23:20:33Z")
Hello, I am trying to create a document using the .NET library. Here is the code that I attempted var newLogResponse = await elasticClient.CreateAsync(new ElasticJobLog() { Create… --- ## [Indices don't have primary shards while taking snapshot](https://discuss.elastic.co/t/indices-dont-have-primary-shards-while-taking-snapshot/267619)
**Author:** [@Venkatesh\_Kumar](https://discuss.elastic.co/u/Venkatesh_Kumar)\ **Replies:** 1\ **Last updated:** [March 22, 2021, 1:44am UTC](https://discuss.elastic.co/t/indices-dont-have-primary-shards-while-taking-snapshot/267619 "2021-03-22T01:44:22Z")
Hi , I am trying to take snapshot using curl -X PUT "http://localhost:9200/\_snapshot/repo1/snap1?wait\_for\_completion=true&pretty" -H 'Content-Type: application/json' -d" { \\"indices\\": \[ \\"apm-7.10.1-transaction-00… --- ## [Elastic and kibana 7.12 (or higher) compatibility with logstash , beats etc older 7.x](https://discuss.elastic.co/t/elastic-and-kibana-7-12-or-higher-compatibility-with-logstash-beats-etc-older-7-x/267850)
**Author:** [@xyz2](https://discuss.elastic.co/u/xyz2)\ **Replies:** 1\ **Last updated:** [March 22, 2021, 12:47am UTC](https://discuss.elastic.co/t/elastic-and-kibana-7-12-or-higher-compatibility-with-logstash-beats-etc-older-7-x/267850 "2021-03-22T00:47:26Z")
HI, Is elasticsearch and kibana 7.12 or 7.13 compatible with logstash, metricbeat, filebeat, heartbeat 7.x older version ? I see the that it is compatible until 7.11 though. --- ## [Yum repos returning: Not Found](https://discuss.elastic.co/t/yum-repos-returning-not-found/267924)
**Author:** [@lachlan.simpson](https://discuss.elastic.co/u/lachlan.simpson)\ **Replies:** 3\ **Last updated:** [March 21, 2021, 11:50pm UTC](https://discuss.elastic.co/t/yum-repos-returning-not-found/267924 "2021-03-21T23:50:12Z")
Following the documentation for installation, I'm getting not found on the regular and oss repositories? I'm not the first to experience this in 2021. Has the OS installation method been deprecated but not removed from… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=677) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=679)