# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1344 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1345 --- ## [Preparing cluster for the non-document-type in Elasticsearch 7](https://discuss.elastic.co/t/preparing-cluster-for-the-non-document-type-in-elasticsearch-7/175215)
**Author:** [@roblopes](https://discuss.elastic.co/u/roblopes)\ **Replies:** 0\ **Last updated:** [April 3, 2019, 1:54pm UTC](https://discuss.elastic.co/t/preparing-cluster-for-the-non-document-type-in-elasticsearch-7/175215 "2019-04-03T13:54:11Z")
Hi, I am preparing my first elastic cluster for a pilot project. I was using the document-type attribute, but after the announcement that it will be gone, I am only using (explicitly) "\_doc". Since I am using templates… --- ## [ELK 6.7.0: Search query match on inexisting fields](https://discuss.elastic.co/t/elk-6-7-0-search-query-match-on-inexisting-fields/175231)
**Author:** [@obuez](https://discuss.elastic.co/u/obuez)\ **Replies:** 3\ **Last updated:** [April 3, 2019, 4:32pm UTC](https://discuss.elastic.co/t/elk-6-7-0-search-query-match-on-inexisting-fields/175231 "2019-04-03T16:32:51Z")
Hi all, I just upgrade elasticsearch and kibana from version 6.5.0 to version 6.7.0 There is an impact on my application as a specific query in kibana is not interpreted the same way as before. ex: field1: "test" AND… --- ## [Recommendation for multi index/node/cluster setup](https://discuss.elastic.co/t/recommendation-for-multi-index-node-cluster-setup/175241)
**Author:** [@elitzur\_e](https://discuss.elastic.co/u/elitzur_e)\ **Replies:** 1\ **Last updated:** [April 3, 2019, 4:27pm UTC](https://discuss.elastic.co/t/recommendation-for-multi-index-node-cluster-setup/175241 "2019-04-03T16:27:59Z")
Hi. Recommendation for multi index/node/cluster setup We are looking for the best way to approach this search scenario: 1 huge erp/crm with 100M~ documents. Each document (word/pdf/img) belongs to a different customer … --- ## [Refresh strategy for real-time](https://discuss.elastic.co/t/refresh-strategy-for-real-time/175219)
**Author:** [@bviz](https://discuss.elastic.co/u/bviz)\ **Replies:** 1\ **Last updated:** [April 3, 2019, 4:15pm UTC](https://discuss.elastic.co/t/refresh-strategy-for-real-time/175219 "2019-04-03T16:15:24Z")
Hello. We use Elastic to index about 260M documents, about 150GB in size. We need the indexed data to be available in real-time (we query the data right after we index it), so we call a refresh after indexing documents,… --- ## [Is there a way to push bulk data into elastic search using some script query?](https://discuss.elastic.co/t/is-there-a-way-to-push-bulk-data-into-elastic-search-using-some-script-query/174981)
**Author:** [@Shubhangi\_Priya](https://discuss.elastic.co/u/Shubhangi_Priya)\ **Replies:** 5\ **Last updated:** [April 3, 2019, 3:45pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-push-bulk-data-into-elastic-search-using-some-script-query/174981 "2019-04-03T15:45:40Z")
Using any for loop or so? --- ## [Paramétrage du nombre de replica dans FSCrawler](https://discuss.elastic.co/t/parametrage-du-nombre-de-replica-dans-fscrawler/175017)
**Author:** [@Jean-Marc](https://discuss.elastic.co/u/Jean-Marc)\ **Replies:** 4\ **Last updated:** [April 3, 2019, 3:41pm UTC](https://discuss.elastic.co/t/parametrage-du-nombre-de-replica-dans-fscrawler/175017 "2019-04-03T15:41:56Z")
Bonjour, J'aimerais savoir si avec FSCrawler, y'a un moment de paramétrer le nombre de réplica parce que j'ai constaté qu'on peut paramétrer le nombre de shard dans les settings. --- ## [Obtaining the Term Vector for an index, and total word count of the index](https://discuss.elastic.co/t/obtaining-the-term-vector-for-an-index-and-total-word-count-of-the-index/175230)
**Author:** [@arclinear](https://discuss.elastic.co/u/arclinear)\ **Replies:** 0\ **Last updated:** [April 3, 2019, 2:42pm UTC](https://discuss.elastic.co/t/obtaining-the-term-vector-for-an-index-and-total-word-count-of-the-index/175230 "2019-04-03T14:42:54Z")
Currently, my index has 62k records, and I would like to retrieve the count of every unique term in my index, however, the multi termvector API seems to explicitly require a document id, may I know if there is a way for … --- ## [Why is indexing throughput higher at jmx 4GB than with jmx 24GB?](https://discuss.elastic.co/t/why-is-indexing-throughput-higher-at-jmx-4gb-than-with-jmx-24gb/175205)
**Author:** [@asp](https://discuss.elastic.co/u/asp)\ **Replies:** 2\ **Last updated:** [April 3, 2019, 2:28pm UTC](https://discuss.elastic.co/t/why-is-indexing-throughput-higher-at-jmx-4gb-than-with-jmx-24gb/175205 "2019-04-03T14:28:03Z")
Hi, I am doing some comparison loadtests with esrally. I tested indexing 250 mio events with elasticlogs-1bn-load challenge of eventdata loadtest from github. The big (!) green areas are the index-append-1000\_elasticl… --- ## [Help with watcher alert configuration in Kibana](https://discuss.elastic.co/t/help-with-watcher-alert-configuration-in-kibana/174154)
**Author:** [@Josip\_Cagalj](https://discuss.elastic.co/u/Josip_Cagalj)\ **Replies:** 7\ **Last updated:** [April 3, 2019, 2:20pm UTC](https://discuss.elastic.co/t/help-with-watcher-alert-configuration-in-kibana/174154 "2019-04-03T14:20:42Z")
Hi, this is my first post so yes I'm a noob who just recently started with ELK. I'm trying to set up an advanced watcher in Kibana. Let's say I have one index 'store' which contains documents with fields e.g. 'amountSpe… --- ## [How to extract terms into a new field while indexing](https://discuss.elastic.co/t/how-to-extract-terms-into-a-new-field-while-indexing/174805)
**Author:** [@David9](https://discuss.elastic.co/u/David9)\ **Replies:** 5\ **Last updated:** [April 3, 2019, 2:09pm UTC](https://discuss.elastic.co/t/how-to-extract-terms-into-a-new-field-while-indexing/174805 "2019-04-03T14:09:00Z")
We often encounter a need to extract special terms from our documents, e.g. phone numbers, twitter handles, hashtags. Often this can be done with regular expressions, not fancy entity extraction tools. We realize that … --- ## [SAML error with ELK Stack](https://discuss.elastic.co/t/saml-error-with-elk-stack/164673)
**Author:** [@vapetri](https://discuss.elastic.co/u/vapetri)\ **Replies:** 50\ **Last updated:** [April 3, 2019, 1:45pm UTC](https://discuss.elastic.co/t/saml-error-with-elk-stack/164673 "2019-04-03T13:45:48Z")
Hi guys, i am trying to configure Kibana authentication via SAML with oracle IAM stack as an Identity provider. In elasticsearch log we have: org.elasticsearch.ElasticsearchSecurityException: Cannot find any matching… --- ## [Can I use rsync tool to migrate closed index on a running elasticsearch cluster?](https://discuss.elastic.co/t/can-i-use-rsync-tool-to-migrate-closed-index-on-a-running-elasticsearch-cluster/175194)
**Author:** [@Adminstrator](https://discuss.elastic.co/u/Adminstrator)\ **Replies:** 2\ **Last updated:** [April 3, 2019, 1:27pm UTC](https://discuss.elastic.co/t/can-i-use-rsync-tool-to-migrate-closed-index-on-a-running-elasticsearch-cluster/175194 "2019-04-03T13:27:03Z")
I have many closed indices to migrate.But I do not want to open them,then use node tag attribute to migrate them dynamicly. \[root@test ~\]# curl -s 'localhost:9200/my\_index/\_settings?pretty' { "my\_index" : { "setti… --- ## [Nodes Constantly Disconencted from Cluster](https://discuss.elastic.co/t/nodes-constantly-disconencted-from-cluster/174702)
**Author:** [@Arief](https://discuss.elastic.co/u/Arief)\ **Replies:** 5\ **Last updated:** [April 3, 2019, 12:39pm UTC](https://discuss.elastic.co/t/nodes-constantly-disconencted-from-cluster/174702 "2019-04-03T12:39:42Z")
I have 3 Master as Hot Nodes and 3 Data Warm Nodes all with 16GB of RAM and 73 Index (3 Shards, 1 replica). However all 3 of the Warm nodes always and randomly disconnected and I can't figure out why. Ping to all those 3… --- ## [Autogenerate id of IndexRequest before sending it](https://discuss.elastic.co/t/autogenerate-id-of-indexrequest-before-sending-it/175177)
**Author:** [@rk201](https://discuss.elastic.co/u/rk201)\ **Replies:** 1\ **Last updated:** [April 3, 2019, 12:03pm UTC](https://discuss.elastic.co/t/autogenerate-id-of-indexrequest-before-sending-it/175177 "2019-04-03T12:03:42Z")
Hi, I would like to have ids of indexed documents auto-generated, but also, I want to know the id before I'll send the request. The id is generated in IndexRequest.process(...) method, so it doesn't work for me. Can I s… --- ## [Questions about shadow replica](https://discuss.elastic.co/t/questions-about-shadow-replica/175146)
**Author:** [@zhichen1](https://discuss.elastic.co/u/zhichen1)\ **Replies:** 2\ **Last updated:** [April 3, 2019, 12:01pm UTC](https://discuss.elastic.co/t/questions-about-shadow-replica/175146 "2019-04-03T12:01:09Z")
We are researching elasticsearch computing storage separation, and very interested in shadow replica, I would like to ask a few questions Under the premise of using shared storage NFS, when the primary shard loses comm… --- ## [I have a question about "Write Thread Pool."](https://discuss.elastic.co/t/i-have-a-question-about-write-thread-pool/175121)
**Author:** [@EddyKim](https://discuss.elastic.co/u/EddyKim)\ **Replies:** 2\ **Last updated:** [April 3, 2019, 11:30am UTC](https://discuss.elastic.co/t/i-have-a-question-about-write-thread-pool/175121 "2019-04-03T11:30:27Z")
Hello. I'm not good at English. I'm sorry, but please understand. We've installed our own custom plug-in in ElasticSearch. We implemented the AbstractTokenFilterFactory. the "incrementToken" method calls external API… --- ## [Query autocomplete options](https://discuss.elastic.co/t/query-autocomplete-options/175123)
**Author:** [@j.elastic](https://discuss.elastic.co/u/j.elastic)\ **Replies:** 6\ **Last updated:** [April 3, 2019, 11:00am UTC](https://discuss.elastic.co/t/query-autocomplete-options/175123 "2019-04-03T11:00:57Z")
Hi, I am currently working on implementing autocomplete functionality. So far I have looked into the following options: Completion suggester. We would like query-time ranking such that we can e.g. base it on term fre… --- ## [Aggregate not working as expected (ES VERSION : 6.2.2)](https://discuss.elastic.co/t/aggregate-not-working-as-expected-es-version-6-2-2/174487)
**Author:** [@sur1029](https://discuss.elastic.co/u/sur1029)\ **Replies:** 5\ **Last updated:** [April 3, 2019, 10:46am UTC](https://discuss.elastic.co/t/aggregate-not-working-as-expected-es-version-6-2-2/174487 "2019-04-03T10:46:32Z")
Hi, I have putting data in elastic search something like this: Data 1: { "app": "pigeon", "time": "2019-03-28T06:22:02.175517", "email": \[ { "flow\_name" : "AuthOTP", "1": 80, "2": 79, "3": 12, "4": 60 } \] , … --- ## [Migrating Splunk query to Elastic](https://discuss.elastic.co/t/migrating-splunk-query-to-elastic/174155)
**Author:** [@ravitandur](https://discuss.elastic.co/u/ravitandur)\ **Replies:** 3\ **Last updated:** [April 3, 2019, 10:27am UTC](https://discuss.elastic.co/t/migrating-splunk-query-to-elastic/174155 "2019-04-03T10:27:31Z")
Currently we are using Splunk and planning to migrate to Elastic. We are in the process of deciding how data needs to be ingested into Elastic Cluster. In this topic I will give provide Sample log data. Current Splunk… --- ## [Search across multiple ES data sources](https://discuss.elastic.co/t/search-across-multiple-es-data-sources/171959)
**Author:** [@vasekz](https://discuss.elastic.co/u/vasekz)\ **Replies:** 43\ **Last updated:** [April 3, 2019, 9:46am UTC](https://discuss.elastic.co/t/search-across-multiple-es-data-sources/171959 "2019-04-03T09:46:36Z")
Hi, I have a hundred of independent ES servers with data of the same structure. For example NY server keeps NY phone book, LA server keeps LA phone book, etc. Is there a way to query this data from a central point? For … --- ## [Indexing twitter data since 2015 into elasticsearch](https://discuss.elastic.co/t/indexing-twitter-data-since-2015-into-elasticsearch/174499)
**Author:** [@safaelahbizi](https://discuss.elastic.co/u/safaelahbizi)\ **Replies:** 7\ **Last updated:** [April 3, 2019, 9:37am UTC](https://discuss.elastic.co/t/indexing-twitter-data-since-2015-into-elasticsearch/174499 "2019-04-03T09:37:56Z")
Hi all,I have a document-oriented database (JSON files) Twitter tweets on a Bank since 2015, can you suggest me a method of modeling this data under elasticsearch, so that my queries will be easy and my data will have a… --- ## [Update Parent file with Child file field](https://discuss.elastic.co/t/update-parent-file-with-child-file-field/175138)
**Author:** [@ek9boy](https://discuss.elastic.co/u/ek9boy)\ **Replies:** 0\ **Last updated:** [April 3, 2019, 8:45am UTC](https://discuss.elastic.co/t/update-parent-file-with-child-file-field/175138 "2019-04-03T08:45:27Z")
Hi, I have a parent file: ID - 123 Name - ABA BTT - 000 BA - LOC - File\_ref - I have a child file: ID - 999 Name - ABA BTT - 000 BA - BA1 LOC - confdez File\_ref - 123 How can i update the parent with the m… --- ## [Declare index alias in filebeat.yaml and metricbeat.yaml](https://discuss.elastic.co/t/declare-index-alias-in-filebeat-yaml-and-metricbeat-yaml/175135)
**Author:** [@twiggy](https://discuss.elastic.co/u/twiggy)\ **Replies:** 0\ **Last updated:** [April 3, 2019, 8:36am UTC](https://discuss.elastic.co/t/declare-index-alias-in-filebeat-yaml-and-metricbeat-yaml/175135 "2019-04-03T08:36:50Z")
Hello, In order to implement an Index Lifecycle Management, I would like my daily indexes created by Filebeat to automatically have an alias. I tried to add an aliases parameter in my filebeat.yaml : setup.template: … --- ## [Lag in logs appearing](https://discuss.elastic.co/t/lag-in-logs-appearing/175098)
**Author:** [@naman\_kharbanda](https://discuss.elastic.co/u/naman_kharbanda)\ **Replies:** 1\ **Last updated:** [April 3, 2019, 8:08am UTC](https://discuss.elastic.co/t/lag-in-logs-appearing/175098 "2019-04-03T08:08:35Z")
Hi Team Been stuck in an issue for quite some time with no luck. Currently, we are running elasticsearch, logstash, and kibana in production environment. 3 master, 1 client, 6 data node cluster. All the nodes are 4 c… --- ## [Elasticsearch + Nginx + Proxy? - Magento 2.3.1](https://discuss.elastic.co/t/elasticsearch-nginx-proxy-magento-2-3-1/175129)
**Author:** [@manue](https://discuss.elastic.co/u/manue)\ **Replies:** 0\ **Last updated:** [April 3, 2019, 8:06am UTC](https://discuss.elastic.co/t/elasticsearch-nginx-proxy-magento-2-3-1/175129 "2019-04-03T08:06:48Z")
I'm installing Elasticsearch on my Ubuntu 18.04 under nginx for my Magento 2.3.1. Reading the official documentation, I find the following link, and says that to configure elasticsearch with nginx on the same server I mu… --- ## [Warning Elasticsearch JAVA\_HOME Magento 2.3.1](https://discuss.elastic.co/t/warning-elasticsearch-java-home-magento-2-3-1/175128)
**Author:** [@manue](https://discuss.elastic.co/u/manue)\ **Replies:** 0\ **Last updated:** [April 3, 2019, 8:02am UTC](https://discuss.elastic.co/t/warning-elasticsearch-java-home-magento-2-3-1/175128 "2019-04-03T08:02:43Z")
Can someone help me solve this warning? Also, is this configuration for elasticsearch correct? "/usr/bin/java -Xms1g -Xmx1g" My system is Ubuntu 18.04, Nginx and the system has 4GB of RAM $ sudo systemctl status elastic… --- ## [Watch using Slack not working (6.4.3)](https://discuss.elastic.co/t/watch-using-slack-not-working-6-4-3/173412)
**Author:** [@dis](https://discuss.elastic.co/u/dis)\ **Replies:** 3\ **Last updated:** [April 3, 2019, 7:59am UTC](https://discuss.elastic.co/t/watch-using-slack-not-working-6-4-3/173412 "2019-04-03T07:59:42Z")
I tested the same watch that use log for action and it was triggering so I remove the log and replace it with notify-slack but did not get any notification to the slack channel. { "trigger": { "schedul… --- ## [How to quering long type data](https://discuss.elastic.co/t/how-to-quering-long-type-data/175118)
**Author:** [@zarka](https://discuss.elastic.co/u/zarka)\ **Replies:** 1\ **Last updated:** [April 3, 2019, 7:51am UTC](https://discuss.elastic.co/t/how-to-quering-long-type-data/175118 "2019-04-03T07:51:05Z")
Hello all, I am trying to query to a long type data but its seems that its doesn't work, for example if the number :1.5035830264843164 is set to a long, and i am trying to query that field with the "get" func. its givin… --- ## [Configure Watcher Slack Multiple Accounts](https://discuss.elastic.co/t/configure-watcher-slack-multiple-accounts/175008)
**Author:** [@AndrePires](https://discuss.elastic.co/u/AndrePires)\ **Replies:** 1\ **Last updated:** [April 3, 2019, 7:45am UTC](https://discuss.elastic.co/t/configure-watcher-slack-multiple-accounts/175008 "2019-04-03T07:45:06Z")
I have multiple account configured in elasticsearch.yml and no matter if I define the account name kibana always sent by the first account in configuration, can someone tell me why and help me please? Thanks Here are my… --- ## [Elasticsearch Read from Multiple Locations](https://discuss.elastic.co/t/elasticsearch-read-from-multiple-locations/174980)
**Author:** [@SISA\_Nirmal\_kumar\_B](https://discuss.elastic.co/u/SISA_Nirmal_kumar_B)\ **Replies:** 4\ **Last updated:** [April 3, 2019, 7:40am UTC](https://discuss.elastic.co/t/elasticsearch-read-from-multiple-locations/174980 "2019-04-03T07:40:03Z")
Is it possible to configure elasticsearch to read data from multiple locations / path ? [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1343) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1345)