# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1956 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1957 --- ## [Copy and Sync ElasticSearch Index Across Hosts](https://discuss.elastic.co/t/copy-and-sync-elasticsearch-index-across-hosts/97960)
**Author:** [@gfitzy123](https://discuss.elastic.co/u/gfitzy123)\ **Replies:** 1\ **Last updated:** [September 7, 2017, 7:46pm UTC](https://discuss.elastic.co/t/copy-and-sync-elasticsearch-index-across-hosts/97960 "2017-09-07T19:46:30Z")
I have two hosts in the same data center with elastic search installed. I would like to copy indexes from one host to another, have them both synced. Is there a guide for how to do this? --- ## [Pyspark Dataframe Save Error](https://discuss.elastic.co/t/pyspark-dataframe-save-error/98277)
**Author:** [@David\_Latham](https://discuss.elastic.co/u/David_Latham)\ **Replies:** 3\ **Last updated:** [September 7, 2017, 7:19pm UTC](https://discuss.elastic.co/t/pyspark-dataframe-save-error/98277 "2017-09-07T19:19:01Z")
i’m running spark 1.5 and used es-hadoop 2.4 to connect to ES 2.1.1 server. reads and writes worked fine. after upgrading ES to 5.3.1 and downloading es-hadoop 5.3.1 (spark is still at 1.5) the reads work fine, but when … --- ## [Can we use "sub-partitioning" in ML?](https://discuss.elastic.co/t/can-we-use-sub-partitioning-in-ml/99002)
**Author:** [@Vitaly\_il](https://discuss.elastic.co/u/Vitaly_il)\ **Replies:** 5\ **Last updated:** [September 7, 2017, 6:20pm UTC](https://discuss.elastic.co/t/can-we-use-sub-partitioning-in-ml/99002 "2017-09-07T18:20:12Z")
Our goal is similar to discussed in this thread Machine learning - host stopped sending logs or events - we're trying to send alerts when certain hosts or components stopped to send data or we have anomaly in data volu… --- ## [NullPointerException in scroll](https://discuss.elastic.co/t/nullpointerexception-in-scroll/98717)
**Author:** [@Dan\_Markhasin](https://discuss.elastic.co/u/Dan_Markhasin)\ **Replies:** 9\ **Last updated:** [September 7, 2017, 3:57pm UTC](https://discuss.elastic.co/t/nullpointerexception-in-scroll/98717 "2017-09-07T15:57:52Z")
I've noticed this error today in the logs of our 5.4 cluster when running a scroll query - one that ran with no issues before and is running with no issues after this exception, which I was not able to reproduce. Has an… --- ## [Nested Object Returning with default values](https://discuss.elastic.co/t/nested-object-returning-with-default-values/99739)
**Author:** [@Jorge\_Cruz](https://discuss.elastic.co/u/Jorge_Cruz)\ **Replies:** 0\ **Last updated:** [September 7, 2017, 3:14pm UTC](https://discuss.elastic.co/t/nested-object-returning-with-default-values/99739 "2017-09-07T15:14:00Z")
Hi guys, Need help, using Elastic 5 when i do a search for a product on C# var searchResponse = await Client.SearchAsync\(s =\> s.Index(IndexName) .Query(q =\> q .Term(p =\> p … --- ## [Custom Realm Integration](https://discuss.elastic.co/t/custom-realm-integration/99057)
**Author:** [@Aclose](https://discuss.elastic.co/u/Aclose)\ **Replies:** 1\ **Last updated:** [September 7, 2017, 2:14pm UTC](https://discuss.elastic.co/t/custom-realm-integration/99057 "2017-09-07T14:14:53Z")
Hi all, I am working on a custom security realm for my ELK stack. I have started working on the custom realm (based on the example git repo) and have the actual authentication logic working. But I have a few questions. … --- ## [Instantiate Elasticsearch server within a Tomcat process](https://discuss.elastic.co/t/instantiate-elasticsearch-server-within-a-tomcat-process/99720)
**Author:** [@Sambit\_Kabi](https://discuss.elastic.co/u/Sambit_Kabi)\ **Replies:** 2\ **Last updated:** [September 7, 2017, 1:27pm UTC](https://discuss.elastic.co/t/instantiate-elasticsearch-server-within-a-tomcat-process/99720 "2017-09-07T13:27:29Z")
Hello , I have to instantiate ES within a Tomcat process. Normally ES is instantiated as a separate process and clients connect to it. What I would like to do is to instantiate the ES within a Tomcat and connect to it … --- ## [Trying to save the last data for parameter X aggregated on field UID](https://discuss.elastic.co/t/trying-to-save-the-last-data-for-parameter-x-aggregated-on-field-uid/99719)
**Author:** [@tomer](https://discuss.elastic.co/u/tomer)\ **Replies:** 0\ **Last updated:** [September 7, 2017, 12:24pm UTC](https://discuss.elastic.co/t/trying-to-save-the-last-data-for-parameter-x-aggregated-on-field-uid/99719 "2017-09-07T12:24:10Z")
Hi, I am trying to save the last data for parameter X aggregated on field transactionId using: aggregate { task\_id =\> "%{transactionId}" code =\> " if (event.get('SRI\_sent').eql? '0') event.set('SRI\_sent', … --- ## [Set maximum shards for all indices on one specific node](https://discuss.elastic.co/t/set-maximum-shards-for-all-indices-on-one-specific-node/99684)
**Author:** [@oranciog](https://discuss.elastic.co/u/oranciog)\ **Replies:** 3\ **Last updated:** [September 7, 2017, 12:05pm UTC](https://discuss.elastic.co/t/set-maximum-shards-for-all-indices-on-one-specific-node/99684 "2017-09-07T12:05:40Z")
Hello! Is there any settings that specify the maximum number of shards for all indexes for one node? My simplified scenario is that I have two machines, one with 8 CPUs and one with 4 CPUs, and one index with 10 shards… --- ## [Brute Force Attack - Watcher using Windows Event id's](https://discuss.elastic.co/t/brute-force-attack-watcher-using-windows-event-ids/99374)
**Author:** [@suchand](https://discuss.elastic.co/u/suchand)\ **Replies:** 3\ **Last updated:** [September 7, 2017, 11:53am UTC](https://discuss.elastic.co/t/brute-force-attack-watcher-using-windows-event-ids/99374 "2017-09-07T11:53:47Z")
Hi, Please share sample watcher to alert Brute Force Attack using windows Event id. (with throttling\_period). I need to show Source IP,Destination IP ,Computer name and User name in watcher history dashboard. --- ## [Custom Realm Authentication Validation](https://discuss.elastic.co/t/custom-realm-authentication-validation/99459)
**Author:** [@Aclose](https://discuss.elastic.co/u/Aclose)\ **Replies:** 4\ **Last updated:** [September 7, 2017, 11:03am UTC](https://discuss.elastic.co/t/custom-realm-authentication-validation/99459 "2017-09-07T11:03:33Z")
Hi All, I have created a custom realm and trying to validate that it is working in curl. It has the following request headers: audience referer stoken username How do I test this is working via curl? It seems to only… --- ## [Aggregate on a keyword](https://discuss.elastic.co/t/aggregate-on-a-keyword/99706)
**Author:** [@tomer](https://discuss.elastic.co/u/tomer)\ **Replies:** 1\ **Last updated:** [September 7, 2017, 11:00am UTC](https://discuss.elastic.co/t/aggregate-on-a-keyword/99706 "2017-09-07T11:00:10Z")
Hi, I am getting an error: Discover: Fielddata is disabled on text fields by default. Set fielddata=true on \[transactionId\] in order to load fielddata in memory by uninverting the inverted index. Note that this can ho… --- ## [Limiting search to few shards by providing routing IDs](https://discuss.elastic.co/t/limiting-search-to-few-shards-by-providing-routing-ids/99709)
**Author:** [@vivek7mehta](https://discuss.elastic.co/u/vivek7mehta)\ **Replies:** 1\ **Last updated:** [September 7, 2017, 10:39am UTC](https://discuss.elastic.co/t/limiting-search-to-few-shards-by-providing-routing-ids/99709 "2017-09-07T10:39:50Z")
I am not sure if this question is already asked, I tried to search and couldn’t find what I was looking for. I am using routing to reduce my search impact. I am providing routing IDs while indexing (e.g. user1, user2, u… --- ## [Incorrect Timestamp in Machine Learning Job Result](https://discuss.elastic.co/t/incorrect-timestamp-in-machine-learning-job-result/99111)
**Author:** [@nktvys](https://discuss.elastic.co/u/nktvys)\ **Replies:** 9\ **Last updated:** [September 7, 2017, 10:16am UTC](https://discuss.elastic.co/t/incorrect-timestamp-in-machine-learning-job-result/99111 "2017-09-07T10:16:35Z")
Hi, I have a few documents that have a timestamp of 01:46:00:038. But, after running a ML job, the results show these documents with a different time 07:16:00:038. I guess this is due to time difference of 5:30 but I do… --- ## [Pagination on elasticsearch results](https://discuss.elastic.co/t/pagination-on-elasticsearch-results/99564)
**Author:** [@Akhil\_Prashar](https://discuss.elastic.co/u/Akhil_Prashar)\ **Replies:** 0\ **Last updated:** [September 6, 2017, 11:02am UTC](https://discuss.elastic.co/t/pagination-on-elasticsearch-results/99564 "2017-09-06T11:02:01Z")
I would like to display 20 results per page. And am thinking that total number of hits should be divided by 20 and on click of next button I should get the next 20 results. this is a snippet of my code if(isset($result… --- ## [Java Client Bulk API performance settings ES 5.x](https://discuss.elastic.co/t/java-client-bulk-api-performance-settings-es-5-x/99112)
**Author:** [@Eduard\_Kubanda](https://discuss.elastic.co/u/Eduard_Kubanda)\ **Replies:** 5\ **Last updated:** [September 7, 2017, 9:38am UTC](https://discuss.elastic.co/t/java-client-bulk-api-performance-settings-es-5-x/99112 "2017-09-07T09:38:05Z")
Hi there, I am writing Java application to perform bulk update to Elasticsearch. I need to reach the best possible indexing performance. I understand complexity of cluster and hardware settings, but in this thread I wa… --- ## [Elasticsearch search term highlighting](https://discuss.elastic.co/t/elasticsearch-search-term-highlighting/99700)
**Author:** [@Narmatha](https://discuss.elastic.co/u/Narmatha)\ **Replies:** 0\ **Last updated:** [September 7, 2017, 9:30am UTC](https://discuss.elastic.co/t/elasticsearch-search-term-highlighting/99700 "2017-09-07T09:30:36Z")
I need to highlight using primary(tag1) and secondary(tag2) tags for same field search. And the search terms would be like term1 : \[us, uk, use\] term2: \[rally, roster\] Tried with the below approach but it doesn’t highl… --- ## [Search template not working with terms query](https://discuss.elastic.co/t/search-template-not-working-with-terms-query/99408)
**Author:** [@Narmatha](https://discuss.elastic.co/u/Narmatha)\ **Replies:** 2\ **Last updated:** [September 7, 2017, 9:29am UTC](https://discuss.elastic.co/t/search-template-not-working-with-terms-query/99408 "2017-09-07T09:29:30Z")
I have an index with a long field and i am just trying to use search template to use terms query but it throws exception. “pid”: { “type”: “long” } Search Template: PUT /\_search/template/article\_query\_template { “t… --- ## [Find nested objects that are null](https://discuss.elastic.co/t/find-nested-objects-that-are-null/99578)
**Author:** [@sina309](https://discuss.elastic.co/u/sina309)\ **Replies:** 1\ **Last updated:** [September 6, 2017, 4:31pm UTC](https://discuss.elastic.co/t/find-nested-objects-that-are-null/99578 "2017-09-06T16:31:19Z")
I have a nested field called ‘category’: PUT my\_index { "mappings": { "my\_type": { "properties": { "name": { "type": "keyword", "null\_value": "NULL" }, "categories… --- ## [Elasticsearch server stops right after start](https://discuss.elastic.co/t/elasticsearch-server-stops-right-after-start/99571)
**Author:** [@tkvmai](https://discuss.elastic.co/u/tkvmai)\ **Replies:** 4\ **Last updated:** [September 7, 2017, 9:13am UTC](https://discuss.elastic.co/t/elasticsearch-server-stops-right-after-start/99571 "2017-09-07T09:13:30Z")
I’ve just installed the elasticsearch 5.5.2 via rpm. When I try to start the server using service elasticsearch start, I got the following message Starting elasticsearch (via systemctl): \[ OK \] B… --- ## [Does X-Pack Security authenticates clients via client certificates](https://discuss.elastic.co/t/does-x-pack-security-authenticates-clients-via-client-certificates/99325)
**Author:** [@Bozzerreaneaux](https://discuss.elastic.co/u/Bozzerreaneaux)\ **Replies:** 2\ **Last updated:** [September 7, 2017, 9:09am UTC](https://discuss.elastic.co/t/does-x-pack-security-authenticates-clients-via-client-certificates/99325 "2017-09-07T09:09:59Z")
Hello, I am in the process of evaluating X-Pack security and in my current setup, I’ve successfully sorted the following SSL/TLS communication: Kibana ----\> AD LDAPS Server (IIS generated self-signed certificate … --- ## [Does the twitter plugin work with elasticsearch 5.5?](https://discuss.elastic.co/t/does-the-twitter-plugin-work-with-elasticsearch-5-5/97026)
**Author:** [@aliyesami](https://discuss.elastic.co/u/aliyesami)\ **Replies:** 2\ **Last updated:** [September 7, 2017, 8:13am UTC](https://discuss.elastic.co/t/does-the-twitter-plugin-work-with-elasticsearch-5-5/97026 "2017-09-07T08:13:29Z")
I am getting the following error and looking on web I don't see any resolution , please advise . \[2017-08-14T17:50:54,446\]\[WARN \]\[logstash.inputs.twitter \] Twitter client error {:message=\>"undefined method filter' for… --- ## [V552 : Multiple indices search using wildcard](https://discuss.elastic.co/t/v552-multiple-indices-search-using-wildcard/99553)
**Author:** [@mflash](https://discuss.elastic.co/u/mflash)\ **Replies:** 1\ **Last updated:** [September 7, 2017, 7:59am UTC](https://discuss.elastic.co/t/v552-multiple-indices-search-using-wildcard/99553 "2017-09-07T07:59:46Z")
hello. we about to upgrade to elasticsearch552. part of it is to change the indices design from one index and multiple types to index per type. we plan to name each index with the same prefix and also to have alias to e… --- ## [Multiple Search/Filter fields in ELK](https://discuss.elastic.co/t/multiple-search-filter-fields-in-elk/97719)
**Author:** [@saafianihan](https://discuss.elastic.co/u/saafianihan)\ **Replies:** 1\ **Last updated:** [September 7, 2017, 7:56am UTC](https://discuss.elastic.co/t/multiple-search-filter-fields-in-elk/97719 "2017-09-07T07:56:20Z")
Is it possible to add filter like this using ELK Stack? I have to search by fields.... while selecting User Name i have to enter the name of particular user in the Value: field and the result should be based on that… --- ## [Bulk timeout](https://discuss.elastic.co/t/bulk-timeout/99599)
**Author:** [@Alex\_Davidovich](https://discuss.elastic.co/u/Alex_Davidovich)\ **Replies:** 5\ **Last updated:** [September 6, 2017, 7:03pm UTC](https://discuss.elastic.co/t/bulk-timeout/99599 "2017-09-06T19:03:05Z")
I am planning to set a timeout for my bulk requests. Is there a possible way to know, when the timeout exceeds, whether the request is still being processed by ES? I want to retry some time after the timeout exceeds an… --- ## [Index on subfield combined](https://discuss.elastic.co/t/index-on-subfield-combined/96946)
**Author:** [@Deepak\_Chhikara](https://discuss.elastic.co/u/Deepak_Chhikara)\ **Replies:** 1\ **Last updated:** [September 7, 2017, 7:26am UTC](https://discuss.elastic.co/t/index-on-subfield-combined/96946 "2017-09-07T07:26:08Z")
I have data where phone number is in parts. Therefore I created as an array(object). But I want to search on the complete phone number now. “Phone”:{ “type” : “object”, “properties” : { “first” : { “type” : “text” … --- ## [How to ingest data in real time from oracle to Elasticsearch](https://discuss.elastic.co/t/how-to-ingest-data-in-real-time-from-oracle-to-elasticsearch/97729)
**Author:** [@amoussa](https://discuss.elastic.co/u/amoussa)\ **Replies:** 1\ **Last updated:** [September 7, 2017, 7:20am UTC](https://discuss.elastic.co/t/how-to-ingest-data-in-real-time-from-oracle-to-elasticsearch/97729 "2017-09-07T07:20:24Z")
Hi everyone, I am using a loop in scala to query an Oracle table every 10 second, since Oracle table get continuously insertion. I create a select request then I create n json string containing n line from oracle that I … --- ## [Please help me with a secondary aggregation Problem](https://discuss.elastic.co/t/please-help-me-with-a-secondary-aggregation-problem/99533)
**Author:** [@alex\_smith](https://discuss.elastic.co/u/alex_smith)\ **Replies:** 3\ **Last updated:** [September 7, 2017, 7:18am UTC](https://discuss.elastic.co/t/please-help-me-with-a-secondary-aggregation-problem/99533 "2017-09-07T07:18:32Z")
Hi, i am recently using elasticsearch as a db now. and i met a secondary agregation problem that i cant found answer in the documents, so that’s why i came here for help the problem is , suppose we have profile and act… --- ## [Index with heavy updates/deletes, deleted docs on the rise](https://discuss.elastic.co/t/index-with-heavy-updates-deletes-deleted-docs-on-the-rise/97985)
**Author:** [@hello](https://discuss.elastic.co/u/hello)\ **Replies:** 1\ **Last updated:** [September 7, 2017, 7:06am UTC](https://discuss.elastic.co/t/index-with-heavy-updates-deletes-deleted-docs-on-the-rise/97985 "2017-09-07T07:06:48Z")
ES 5.5.2 I’m running a single index that has lots of constant changes. I have noticed that my disk usage space keeps increasing and rarely drops. After doing some investigation, I found out that my docs.deleted count … --- ## [Using Ingest to parse a double value](https://discuss.elastic.co/t/using-ingest-to-parse-a-double-value/98459)
**Author:** [@sandsbl](https://discuss.elastic.co/u/sandsbl)\ **Replies:** 1\ **Last updated:** [September 7, 2017, 6:47am UTC](https://discuss.elastic.co/t/using-ingest-to-parse-a-double-value/98459 "2017-09-07T06:47:54Z")
I am relatively new to Elasticsearch. I am using Ingest node processors to parse incoming log entries sent from other servers using Filebeat. There are values within the log entries that I want to parse as double precisi… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1955) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1957)