# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1617 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1618 --- ## [Aggregate records netflow](https://discuss.elastic.co/t/aggregate-records-netflow/139293)
**Author:** [@eddie4](https://discuss.elastic.co/u/eddie4)\ **Replies:** 2\ **Last updated:** [July 14, 2018, 3:49pm UTC](https://discuss.elastic.co/t/aggregate-records-netflow/139293 "2018-07-14T15:49:24Z")
The problem: We operate a elastic search cluster for storing netflow data. One of our clients operates a UDP service that is queried an insane amount by different IP's. This one client is responsible for 2/3 of the flow… --- ## [Unable to install elasticsearch on ubuntu 16.04](https://discuss.elastic.co/t/unable-to-install-elasticsearch-on-ubuntu-16-04/139225)
**Author:** [@Blason](https://discuss.elastic.co/u/Blason)\ **Replies:** 9\ **Last updated:** [July 14, 2018, 1:52pm UTC](https://discuss.elastic.co/t/unable-to-install-elasticsearch-on-ubuntu-16-04/139225 "2018-07-14T13:52:49Z")
Hi Team, I am trying to install elasticsearch on Ubuntu 16.04 through ks.cfg but somehow this is not going, can someone please have a look at the error and confirm what could be th issue? --- ## [Combining Rescore Query with Highlight Query](https://discuss.elastic.co/t/combining-rescore-query-with-highlight-query/140025)
**Author:** [@Saiprasad\_Krishnamur](https://discuss.elastic.co/u/Saiprasad_Krishnamur)\ **Replies:** 0\ **Last updated:** [July 14, 2018, 11:10am UTC](https://discuss.elastic.co/t/combining-rescore-query-with-highlight-query/140025 "2018-07-14T11:10:12Z")
I'm trying to apply Highlight Query and want to give more score to the number of fields highlighted by the highlight query than the term frequency on a field. For example: DOC 1: { "first\_name": "John" "last\_name": … --- ## [Keep indices while updating ES from 2.4 to 6.X](https://discuss.elastic.co/t/keep-indices-while-updating-es-from-2-4-to-6-x/140023)
**Author:** [@Jensxy](https://discuss.elastic.co/u/Jensxy)\ **Replies:** 2\ **Last updated:** [July 14, 2018, 11:07am UTC](https://discuss.elastic.co/t/keep-indices-while-updating-es-from-2-4-to-6-x/140023 "2018-07-14T11:07:10Z")
I have created several indices with ES2.4 and now I want to update ES to ES6.X. What steps do I have to take care off, when I want to reuse my indices? --- ## [Closing indices by itself](https://discuss.elastic.co/t/closing-indices-by-itself/139839)
**Author:** [@Silas\_Hansen](https://discuss.elastic.co/u/Silas_Hansen)\ **Replies:** 5\ **Last updated:** [July 14, 2018, 8:54am UTC](https://discuss.elastic.co/t/closing-indices-by-itself/139839 "2018-07-14T08:54:10Z")
Hi Our cluster has begun going into RED state every few minutes. The log doesn't tell anything about why it's going to RED, but judging from the below, it seems that it's closing and opening indices by itself, for some… --- ## [Single Node Cluster Shard Allocation Problem](https://discuss.elastic.co/t/single-node-cluster-shard-allocation-problem/140017)
**Author:** [@adwaitjoshi](https://discuss.elastic.co/u/adwaitjoshi)\ **Replies:** 1\ **Last updated:** [July 14, 2018, 6:45am UTC](https://discuss.elastic.co/t/single-node-cluster-shard-allocation-problem/140017 "2018-07-14T06:45:10Z")
I have a single node cluster and each time I set the replication to 0, I see that after some time the status goes to yellow and the .monitoring\* and the .watcher\* indexes has unassigned shards. I have to manually set the… --- ## [Kibana/elastic search - Fetching search data](https://discuss.elastic.co/t/kibana-elastic-search-fetching-search-data/139993)
**Author:** [@rgarg](https://discuss.elastic.co/u/rgarg)\ **Replies:** 5\ **Last updated:** [July 14, 2018, 6:17am UTC](https://discuss.elastic.co/t/kibana-elastic-search-fetching-search-data/139993 "2018-07-14T06:17:38Z")
Kibana version 6.2.2 I am trying to export my dashboard using POST API call from an external server. Is there a way I can achieve that? The tool only shows me curl command using GET. Here is what i am want to perform … --- ## [Custom Type Field Causes Multiple Types Error](https://discuss.elastic.co/t/custom-type-field-causes-multiple-types-error/138107)
**Author:** [@Darin\_Hensley](https://discuss.elastic.co/u/Darin_Hensley)\ **Replies:** 4\ **Last updated:** [July 14, 2018, 2:10am UTC](https://discuss.elastic.co/t/custom-type-field-causes-multiple-types-error/138107 "2018-07-14T02:10:31Z")
I am new to Elastic search. Following the article https://www.elastic.co/guide/en/elasticsearch/reference/6.x/removal-of-types.html#\_custom\_type\_field I made a index that could have multiple types using the type keyword. … --- ## [Having issues sending windows server logs to our elastic cluster](https://discuss.elastic.co/t/having-issues-sending-windows-server-logs-to-our-elastic-cluster/139675)
**Author:** [@victor.nilsson](https://discuss.elastic.co/u/victor.nilsson)\ **Replies:** 3\ **Last updated:** [July 14, 2018, 1:04am UTC](https://discuss.elastic.co/t/having-issues-sending-windows-server-logs-to-our-elastic-cluster/139675 "2018-07-14T01:04:24Z")
Hi, i tried sending windows logs to our elasticsearch cluster to our already existing winlogbeat template but for some reason these new windows machines are having trouble. For some reason, the data is not showing up in … --- ## [ReadTimeout](https://discuss.elastic.co/t/readtimeout/136771)
**Author:** [@adwaitjoshi](https://discuss.elastic.co/u/adwaitjoshi)\ **Replies:** 23\ **Last updated:** [July 14, 2018, 12:59am UTC](https://discuss.elastic.co/t/readtimeout/136771 "2018-07-14T00:59:42Z")
We are currently sending data to elastic search using a python plugin and suddenly started getting read time out errors on elastic. So i increased the read timeout to 60 seconds. The process ran for 6 hours and failed wi… --- ## [Null date field is epoch in painless](https://discuss.elastic.co/t/null-date-field-is-epoch-in-painless/138832)
**Author:** [@fredericogalvao](https://discuss.elastic.co/u/fredericogalvao)\ **Replies:** 2\ **Last updated:** [July 13, 2018, 7:05pm UTC](https://discuss.elastic.co/t/null-date-field-is-epoch-in-painless/138832 "2018-07-13T19:05:45Z")
I have an index with a mapping with a field like this: "some\_date\_field": { "type": "date" } and when that field has a value of null, through a painless script it comes as a DateTime representing the epoch (and some o… --- ## [Elasticsearch Java REST clients](https://discuss.elastic.co/t/elasticsearch-java-rest-clients/139825)
**Author:** [@John\_McAfee1](https://discuss.elastic.co/u/John_McAfee1)\ **Replies:** 2\ **Last updated:** [July 13, 2018, 7:20pm UTC](https://discuss.elastic.co/t/elasticsearch-java-rest-clients/139825 "2018-07-13T19:20:45Z")
Hello, I am using Elasticsearch 6.2.2 and am attempting to create a connection to my ES server using the Java Rest Clients. Here is the code I am using for the connection: credentialsProvider.setCredentials(AuthScope.… --- ## [Not able to create index for an unchanged log file](https://discuss.elastic.co/t/not-able-to-create-index-for-an-unchanged-log-file/139939)
**Author:** [@Ritwik\_Sharma](https://discuss.elastic.co/u/Ritwik_Sharma)\ **Replies:** 4\ **Last updated:** [July 13, 2018, 7:20pm UTC](https://discuss.elastic.co/t/not-able-to-create-index-for-an-unchanged-log-file/139939 "2018-07-13T19:20:13Z")
Elasticsearch version (5.1.1): JVM version (1.8.0\_77): Description of the problem including expected versus actual behavior: With proper Filebeat and Logstash configuration, index should be created in Elasticsearch, b… --- ## [Connecting Metricbeat to Telegraf](https://discuss.elastic.co/t/connecting-metricbeat-to-telegraf/139770)
**Author:** [@shubhamh](https://discuss.elastic.co/u/shubhamh)\ **Replies:** 0\ **Last updated:** [July 12, 2018, 1:47pm UTC](https://discuss.elastic.co/t/connecting-metricbeat-to-telegraf/139770 "2018-07-12T13:47:59Z")
Hello, Is it possible to connect Metricbeat with Telegraf? I'm looking to connect Metricbeat with Telegraf so that i can access the aggregated jolokia connections that telegraf would be collecting. My colleague submitte… --- ## [Xpack transport client issue ES 5.6.3](https://discuss.elastic.co/t/xpack-transport-client-issue-es-5-6-3/139683)
**Author:** [@Rah](https://discuss.elastic.co/u/Rah)\ **Replies:** 2\ **Last updated:** [July 13, 2018, 6:51pm UTC](https://discuss.elastic.co/t/xpack-transport-client-issue-es-5-6-3/139683 "2018-07-13T18:51:40Z")
Hi, I am trying to enable SSL on two node elasticsearch setup with single xpack transport client. I generated cert based on below entries in instances.yaml instances: name: "node1" ip: "192.168.11.115" dns: "node… --- ## [Can a watch search over two different Indexes](https://discuss.elastic.co/t/can-a-watch-search-over-two-different-indexes/137649)
**Author:** [@robrang558](https://discuss.elastic.co/u/robrang558)\ **Replies:** 5\ **Last updated:** [July 13, 2018, 6:38pm UTC](https://discuss.elastic.co/t/can-a-watch-search-over-two-different-indexes/137649 "2018-07-13T18:38:28Z")
I have a watch set up to send an email anytime that the metricbeat index's field "mysql.status.connections" shows nothing over 5 minutes. It works great with the only exception that when the pipeline bottlenecks, all me… --- ## [Dynamically loading elasticsearch index](https://discuss.elastic.co/t/dynamically-loading-elasticsearch-index/139960)
**Author:** [@prabhurajreddy](https://discuss.elastic.co/u/prabhurajreddy)\ **Replies:** 17\ **Last updated:** [July 13, 2018, 6:22pm UTC](https://discuss.elastic.co/t/dynamically-loading-elasticsearch-index/139960 "2018-07-13T18:22:23Z")
I have this specific requirement to load different elasticsearch index data for different users without restarting the elasticsearch, I can do this using open and close index. Create elasticsearch index loop: Index so… --- ## [Date format in response](https://discuss.elastic.co/t/date-format-in-response/139988)
**Author:** [@mats990](https://discuss.elastic.co/u/mats990)\ **Replies:** 0\ **Last updated:** [July 13, 2018, 6:13pm UTC](https://discuss.elastic.co/t/date-format-in-response/139988 "2018-07-13T18:13:19Z")
Hi, Few general Elasticsearch question regarding date data type. When I'm indexing my data I'll get that same data in json response in \_source part (if I index string I get String, if I index long/epoch I'll get long/e… --- ## [Search Rate Dramatically Falls](https://discuss.elastic.co/t/search-rate-dramatically-falls/139987)
**Author:** [@Sebastien\_Williams](https://discuss.elastic.co/u/Sebastien_Williams)\ **Replies:** 0\ **Last updated:** [July 13, 2018, 6:10pm UTC](https://discuss.elastic.co/t/search-rate-dramatically-falls/139987 "2018-07-13T18:10:07Z")
I have an index of approximately 200 million records, with a 3 node cluster each with 32 gb of memory. However my search rate has been dramatically throttled. From around 6000 RPS to only 20 RPS. I thought that this may… --- ## [ES not returning results when doing multi-thread msearch](https://discuss.elastic.co/t/es-not-returning-results-when-doing-multi-thread-msearch/139855)
**Author:** [@paulshadepanda](https://discuss.elastic.co/u/paulshadepanda)\ **Replies:** 10\ **Last updated:** [July 13, 2018, 5:29pm UTC](https://discuss.elastic.co/t/es-not-returning-results-when-doing-multi-thread-msearch/139855 "2018-07-13T17:29:54Z")
A little background. Below is probably not what ElasticSearch is designed for but this is the most efficient way I can think of for achieving what I want to achieve. Setup and Goal: I have an index (ES 1.7), 800k docume… --- ## [Resolving Version conflicts](https://discuss.elastic.co/t/resolving-version-conflicts/139401)
**Author:** [@Suryatejreddy](https://discuss.elastic.co/u/Suryatejreddy)\ **Replies:** 1\ **Last updated:** [July 13, 2018, 4:43pm UTC](https://discuss.elastic.co/t/resolving-version-conflicts/139401 "2018-07-13T16:43:01Z")
I am doing updates on elastic search record using \_update\_by\_query. I am doing ?conflicts=proceed right now. When there are any version conflicts will this query skip the updation for that field and go to next field? Is … --- ## [Why do aggregation queries on keyword field produce fieldata in JVM HEAP?](https://discuss.elastic.co/t/why-do-aggregation-queries-on-keyword-field-produce-fieldata-in-jvm-heap/139331)
**Author:** [@MarkDai](https://discuss.elastic.co/u/MarkDai)\ **Replies:** 1\ **Last updated:** [July 13, 2018, 4:32pm UTC](https://discuss.elastic.co/t/why-do-aggregation-queries-on-keyword-field-produce-fieldata-in-jvm-heap/139331 "2018-07-13T16:32:12Z")
Hi all, Does anyone know why making aggregations on keyword fields of an index produce fieldata cache in JVM HEAP? Per the docs on elastic official site, most fields except text will use doc\_values to support aggregati… --- ## [Change path.data to elasticsearch](https://discuss.elastic.co/t/change-path-data-to-elasticsearch/138678)
**Author:** [@arso](https://discuss.elastic.co/u/arso)\ **Replies:** 1\ **Last updated:** [July 13, 2018, 4:21pm UTC](https://discuss.elastic.co/t/change-path-data-to-elasticsearch/138678 "2018-07-13T16:21:31Z")
Hi, I have elasticseach 5.6.10-1 installed on RedHat 7. I want to change path of data to /data (for example) So i changed parameter "path.data" to elasticsearch.yml on /etc/elasticsearch put when i restart elasticsear… --- ## [Getting license error when trying to view Monitoring after upgrade to 6.3.1](https://discuss.elastic.co/t/getting-license-error-when-trying-to-view-monitoring-after-upgrade-to-6-3-1/138807)
**Author:** [@andyshinn](https://discuss.elastic.co/u/andyshinn)\ **Replies:** 2\ **Last updated:** [July 13, 2018, 4:16pm UTC](https://discuss.elastic.co/t/getting-license-error-when-trying-to-view-monitoring-after-upgrade-to-6-3-1/138807 "2018-07-13T16:16:08Z")
I just upgraded a test cluster to 6.3.1 (Kibana and Elasticsearch). I was trying to verify the health of the cluster by going to the Monitoring section of Kibana (which was working on the previous Basic license). But now… --- ## [No Monitoring Data Found(cluster\_stats not exist)](https://discuss.elastic.co/t/no-monitoring-data-found-cluster-stats-not-exist/139251)
**Author:** [@laywin](https://discuss.elastic.co/u/laywin)\ **Replies:** 1\ **Last updated:** [July 13, 2018, 4:07pm UTC](https://discuss.elastic.co/t/no-monitoring-data-found-cluster-stats-not-exist/139251 "2018-07-13T16:07:41Z")
hello, when i visit kibana monitoring, No Monitoring Data Found is present, i found .monitoring-es-6-\* indices doesn't have cluster\_stats and es cluster master node show the java.lang.NullPointerException. detail except… --- ## [Running different instance in same 2 nodes](https://discuss.elastic.co/t/running-different-instance-in-same-2-nodes/139971)
**Author:** [@john\_99](https://discuss.elastic.co/u/john_99)\ **Replies:** 0\ **Last updated:** [July 13, 2018, 3:24pm UTC](https://discuss.elastic.co/t/running-different-instance-in-same-2-nodes/139971 "2018-07-13T15:24:50Z")
Hi, I am running two instance in same two nodes with 5.0.0 and 6.3. in current 5.0.0 we are using default http port which is 9200 and in the 6.3 i am using custom port number which is 9201 i tried with 9300 but no luck… --- ## [Experiences in "how to manage much data" needed](https://discuss.elastic.co/t/experiences-in-how-to-manage-much-data-needed/139898)
**Author:** [@MarcusCaepio](https://discuss.elastic.co/u/MarcusCaepio)\ **Replies:** 7\ **Last updated:** [July 13, 2018, 3:16pm UTC](https://discuss.elastic.co/t/experiences-in-how-to-manage-much-data-needed/139898 "2018-07-13T15:16:58Z")
Hi all, the following situation is given: ELK: 6.3 Cluster: 8 Data nodes, each of them with ~24TB dedicated Elastic datastore Daily Data: ~250GB Primary Data, ~520.000.000 Documents The indices are written daily, i… --- ## [Elastic 6.3 not finding config file](https://discuss.elastic.co/t/elastic-6-3-not-finding-config-file/139850)
**Author:** [@john\_99](https://discuss.elastic.co/u/john_99)\ **Replies:** 2\ **Last updated:** [July 13, 2018, 3:08pm UTC](https://discuss.elastic.co/t/elastic-6-3-not-finding-config-file/139850 "2018-07-13T15:08:56Z")
Hi All, When i install Elasticsearch or Kibana 6.3 with RPM file why i am not able to see config file in the /etc/elasticsearch location? And also i don't see scripts and X-pack folder at same time. but it says Insta… --- ## [Deleting fields in Elasticsearch](https://discuss.elastic.co/t/deleting-fields-in-elasticsearch/139965)
**Author:** [@amruth](https://discuss.elastic.co/u/amruth)\ **Replies:** 0\ **Last updated:** [July 13, 2018, 2:47pm UTC](https://discuss.elastic.co/t/deleting-fields-in-elasticsearch/139965 "2018-07-13T14:47:48Z")
Hi, I am ingesting data to elasticsearch using logstash and my indexes are created every month(sample-%{+YYYY.MM}). sample-2018.04 and sample-2018.05 indexes have unwanted fields(nearly 8000 fields). Now, I've correcte… --- ## [ES Certutil - cert or ca?](https://discuss.elastic.co/t/es-certutil-cert-or-ca/139961)
**Author:** [@tdasch](https://discuss.elastic.co/u/tdasch)\ **Replies:** 0\ **Last updated:** [July 13, 2018, 2:24pm UTC](https://discuss.elastic.co/t/es-certutil-cert-or-ca/139961 "2018-07-13T14:24:02Z")
I am using this blog post to setup TLS/SSL for my cluster. It's a great post and it's worked well for me, but i'm going back through it with a finer tooth comb to better understand what I am actually doing and what is be… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1616) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1618)