# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1847 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1848 --- ## [Upgrade to es 6.1.0 trouble](https://discuss.elastic.co/t/upgrade-to-es-6-1-0-trouble/112268)
**Author:** [@mathias](https://discuss.elastic.co/u/mathias)\ **Replies:** 8\ **Last updated:** [December 21, 2017, 1:31am UTC](https://discuss.elastic.co/t/upgrade-to-es-6-1-0-trouble/112268 "2017-12-21T01:31:40Z")
Hi, I try to upgrade the ELK stack from 5.6.3 to 6.1.0. I get some errors when trying to load the old templates. 15:33:23.975 \[\[main\]-pipeline-manager\] INFO logstash.outputs.elasticsearch - Installing elasticsearch t… --- ## [How to delete one piece of data from elasticsearch](https://discuss.elastic.co/t/how-to-delete-one-piece-of-data-from-elasticsearch/112677)
**Author:** [@kiwi0217](https://discuss.elastic.co/u/kiwi0217)\ **Replies:** 3\ **Last updated:** [December 21, 2017, 1:29am UTC](https://discuss.elastic.co/t/how-to-delete-one-piece-of-data-from-elasticsearch/112677 "2017-12-21T01:29:33Z")
As following shows: the system recorded a duplicate data. And I want to delete one piece of data. How can I do to remove data. By id or somehow else? Data sample path:/var/log/command.log @timestamp:December 18th 2017… --- ## [Upgrade 5.2 \> 6.x](https://discuss.elastic.co/t/upgrade-5-2-6-x/112653)
**Author:** [@Olfax](https://discuss.elastic.co/u/Olfax)\ **Replies:** 1\ **Last updated:** [December 21, 2017, 1:02am UTC](https://discuss.elastic.co/t/upgrade-5-2-6-x/112653 "2017-12-21T01:02:01Z")
Hi, When I try to update my project in ELS 1.6. I am encountering a problem : IllegalArgumentException("mapping source must be pairs of fieldnames and properties definition."); I try something easy as describe on http… --- ## [Problem with rolling-upgrades documentation](https://discuss.elastic.co/t/problem-with-rolling-upgrades-documentation/112724)
**Author:** [@JimJohnson](https://discuss.elastic.co/u/JimJohnson)\ **Replies:** 1\ **Last updated:** [December 21, 2017, 12:38am UTC](https://discuss.elastic.co/t/problem-with-rolling-upgrades-documentation/112724 "2017-12-21T00:38:17Z")
Hello! I'm currently running a single node 6.0.0 sandbox server and planning to upgrade to 6.1.1 but wanted to try and setup my ES environment in a more modular and easy-to-upgrade way. I'm working on re-configuring the… --- ## [Config https for Elasticsearch 5.6](https://discuss.elastic.co/t/config-https-for-elasticsearch-5-6/111792)
**Author:** [@Derrick](https://discuss.elastic.co/u/Derrick)\ **Replies:** 8\ **Last updated:** [December 20, 2017, 10:28pm UTC](https://discuss.elastic.co/t/config-https-for-elasticsearch-5-6/111792 "2017-12-20T22:28:23Z")
Hi, we are upgrading our ES from 2 to 5.6, but cannot make https works, could someone can provide the config? this is what we have in elasticsearcy.yml. --------------------------------- XPack Config -----------------… --- ## [Connecting to MSSQL on version 6.1](https://discuss.elastic.co/t/connecting-to-mssql-on-version-6-1/112721)
**Author:** [@Paola](https://discuss.elastic.co/u/Paola)\ **Replies:** 0\ **Last updated:** [December 20, 2017, 9:20pm UTC](https://discuss.elastic.co/t/connecting-to-mssql-on-version-6-1/112721 "2017-12-20T21:20:45Z")
Hello! I'm trying to use Kibana+Elasticsearch for analytics, BI, in my company project. Here we have our databases on aws but we can acess it thro sql instances. I'm a little lost on how can I use elasticsearch with a … --- ## [How to get a count from an aggregation?](https://discuss.elastic.co/t/how-to-get-a-count-from-an-aggregation/112681)
**Author:** [@Kris\_Hermstad](https://discuss.elastic.co/u/Kris_Hermstad)\ **Replies:** 2\ **Last updated:** [December 20, 2017, 7:47pm UTC](https://discuss.elastic.co/t/how-to-get-a-count-from-an-aggregation/112681 "2017-12-20T19:47:43Z")
Sorry if this sounds like a duplicate. I've been reading all the various count/aggregation threads and I haven't really been able to figure this one out yet. POST /profile/\_search { "size": 0, "aggregations": { … --- ## [Shards per index for smaller index](https://discuss.elastic.co/t/shards-per-index-for-smaller-index/110627)
**Author:** [@askids](https://discuss.elastic.co/u/askids)\ **Replies:** 2\ **Last updated:** [December 20, 2017, 7:32pm UTC](https://discuss.elastic.co/t/shards-per-index-for-smaller-index/110627 "2017-12-20T19:32:37Z")
hi, Now that with v5.6 and above, since ES is moving towards removing the concept of mapping type and essentially with one index holding only one type (unless we define our own type attribute), does it really make sense… --- ## [Elasticsearch in Distributed mode](https://discuss.elastic.co/t/elasticsearch-in-distributed-mode/112668)
**Author:** [@Anumod](https://discuss.elastic.co/u/Anumod)\ **Replies:** 3\ **Last updated:** [December 20, 2017, 5:39pm UTC](https://discuss.elastic.co/t/elasticsearch-in-distributed-mode/112668 "2017-12-20T17:39:51Z")
Hi , can some one can tell how to make elastic search in distributed mode and to switch to local mode. (which parameter to update and file) thanks in advance. regards Anumod --- ## [Search query nested fields](https://discuss.elastic.co/t/search-query-nested-fields/112436)
**Author:** [@xavi23](https://discuss.elastic.co/u/xavi23)\ **Replies:** 1\ **Last updated:** [December 20, 2017, 5:31pm UTC](https://discuss.elastic.co/t/search-query-nested-fields/112436 "2017-12-20T17:31:53Z")
Hello, I create an index with nested fields, and I load many JSON documents in this index. When I try to search an especific field inside nested filed, always elasticsearch return the all JSON. I need that ES return m… --- ## [Elasticsearch 6.0 multiple types problem](https://discuss.elastic.co/t/elasticsearch-6-0-multiple-types-problem/108928)
**Author:** [@mati](https://discuss.elastic.co/u/mati)\ **Replies:** 3\ **Last updated:** [December 20, 2017, 5:30pm UTC](https://discuss.elastic.co/t/elasticsearch-6-0-multiple-types-problem/108928 "2017-12-20T17:30:41Z")
Hi everyone, I wanna ask about help with sending logs to Elasticsearch. I use kv filter to parse logs from Fortigate devices. One of logged fields is named type which is automaticaly parsed to meta field \_type. Since… --- ## [Exact document match](https://discuss.elastic.co/t/exact-document-match/112307)
**Author:** [@ayushmat316](https://discuss.elastic.co/u/ayushmat316)\ **Replies:** 1\ **Last updated:** [December 20, 2017, 5:13pm UTC](https://discuss.elastic.co/t/exact-document-match/112307 "2017-12-20T17:13:05Z")
Is there a query I can use to match a document to a set of documents in an index on a set of fields, so that the highest score is for an exact match, and the score reduces for any fuzzy matches? --- ## [Memory Issues: linear growth in the memory when using daily indexing](https://discuss.elastic.co/t/memory-issues-linear-growth-in-the-memory-when-using-daily-indexing/112662)
**Author:** [@pravj](https://discuss.elastic.co/u/pravj)\ **Replies:** 1\ **Last updated:** [December 20, 2017, 4:51pm UTC](https://discuss.elastic.co/t/memory-issues-linear-growth-in-the-memory-when-using-daily-indexing/112662 "2017-12-20T16:51:08Z")
Hi all, I have an ELK setup that uses per-day-indexing PREFIX-%{+YYYY.MM.dd}. The memory consumed by the setup keeps growing with more indices, leading to a system restart with extra memory allocation. I observe a drop… --- ## ["setFrom" and "setSize" from SearchResponse?](https://discuss.elastic.co/t/setfrom-and-setsize-from-searchresponse/112664)
**Author:** [@Arth](https://discuss.elastic.co/u/Arth)\ **Replies:** 1\ **Last updated:** [December 20, 2017, 4:12pm UTC](https://discuss.elastic.co/t/setfrom-and-setsize-from-searchresponse/112664 "2017-12-20T16:12:24Z")
Hi, Is it possible to get from SearchResponse the "setFrom" and "setSize" parameters set in SearchRequest ? Thanks --- ## [Web crawler for elastic leatest versions](https://discuss.elastic.co/t/web-crawler-for-elastic-leatest-versions/112260)
**Author:** [@elitzur\_e](https://discuss.elastic.co/u/elitzur_e)\ **Replies:** 3\ **Last updated:** [December 20, 2017, 3:47pm UTC](https://discuss.elastic.co/t/web-crawler-for-elastic-leatest-versions/112260 "2017-12-20T15:47:24Z")
Hi guys, i have been looking around for a solution to replace the now dead ,google on premise solution. i really want to use a solution based on ES. though i can’t seem to find a crawler for the job. i saw a few proje… --- ## [Increment similar event count if occurs inside time window](https://discuss.elastic.co/t/increment-similar-event-count-if-occurs-inside-time-window/112669)
**Author:** [@cj\_elastic](https://discuss.elastic.co/u/cj_elastic)\ **Replies:** 0\ **Last updated:** [December 20, 2017, 3:43pm UTC](https://discuss.elastic.co/t/increment-similar-event-count-if-occurs-inside-time-window/112669 "2017-12-20T15:43:15Z")
I have several events that are processed by logstash and gets inserted to elastic db. For certain events instead of creating a record I need to increment a counter field in my record if it matches a given type and creati… --- ## [Elasticsearch Docker-Compose Security Environmental Variables Not Working](https://discuss.elastic.co/t/elasticsearch-docker-compose-security-environmental-variables-not-working/112666)
**Author:** [@dmc2015](https://discuss.elastic.co/u/dmc2015)\ **Replies:** 0\ **Last updated:** [December 20, 2017, 3:21pm UTC](https://discuss.elastic.co/t/elasticsearch-docker-compose-security-environmental-variables-not-working/112666 "2017-12-20T15:21:23Z")
This works docker run -d -p 9200:9200 --name elasticsearch -e "http.host=0.0.0.0" -e "transport.host=127.0.0.1" -e "xpack.security.enabled=false" docker.elastic.co/elasticsearch/elasticsearch:5.2.2 And it does not ask … --- ## [ES 5.4.0 - Collector Timed Out and Nodes Disconnected](https://discuss.elastic.co/t/es-5-4-0-collector-timed-out-and-nodes-disconnected/112661)
**Author:** [@bobby259](https://discuss.elastic.co/u/bobby259)\ **Replies:** 0\ **Last updated:** [December 20, 2017, 3:14pm UTC](https://discuss.elastic.co/t/es-5-4-0-collector-timed-out-and-nodes-disconnected/112661 "2017-12-20T15:14:08Z")
We started to see this issue with our Elasticsearch 5.4.0 Cluster. Below are the logs: \[2017-12-20T01:40:21,100\]\[ERROR\]\[o.e.x.m.c.i.IndexRecoveryCollector\] \[es-master-01\] collector \[index-recovery\] timed out when colle… --- ## [How to get data more than 10000 in elasticsearch](https://discuss.elastic.co/t/how-to-get-data-more-than-10000-in-elasticsearch/107869)
**Author:** [@kanchan](https://discuss.elastic.co/u/kanchan)\ **Replies:** 26\ **Last updated:** [December 20, 2017, 2:27pm UTC](https://discuss.elastic.co/t/how-to-get-data-more-than-10000-in-elasticsearch/107869 "2017-12-20T14:27:13Z")
Hi Team, I am trying to fetch data using rest client in java side, but not able to fetch more than 10000 and even if i am trying to fetch data less then 10000 like 5000 or 7000 it is taking too much time. please let me… --- ## [Complex report with cardinality, filtering and so on](https://discuss.elastic.co/t/complex-report-with-cardinality-filtering-and-so-on/112396)
**Author:** [@Evgeniy\_Ivlev](https://discuss.elastic.co/u/Evgeniy_Ivlev)\ **Replies:** 2\ **Last updated:** [December 20, 2017, 2:18pm UTC](https://discuss.elastic.co/t/complex-report-with-cardinality-filtering-and-so-on/112396 "2017-12-20T14:18:23Z")
Hi My data have following columns: MAC (keyword) - mac of device errors (integer) - errors in record on device switch (keyword) - switch connected to device Schema is denormalized for fast search purposes. In 30 min… --- ## [Windows Event Viewer Json Date format value](https://discuss.elastic.co/t/windows-event-viewer-json-date-format-value/112651)
**Author:** [@rush](https://discuss.elastic.co/u/rush)\ **Replies:** 0\ **Last updated:** [December 20, 2017, 2:14pm UTC](https://discuss.elastic.co/t/windows-event-viewer-json-date-format-value/112651 "2017-12-20T14:14:58Z")
Im trying to add evtx( windows eventlogs) to ES, for that im using a Map. When i convert eventlog to Json by powershell. 'TimeCreated' output come as below. "TimeCreated":"/Date(1512629819348)/" In map I coded as be… --- ## [Upgraded ES 5.6 \> 6.1 Now \_bulk not accepting header text/json](https://discuss.elastic.co/t/upgraded-es-5-6-6-1-now-bulk-not-accepting-header-text-json/112448)
**Author:** [@ericohtake](https://discuss.elastic.co/u/ericohtake)\ **Replies:** 6\ **Last updated:** [December 20, 2017, 1:03pm UTC](https://discuss.elastic.co/t/upgraded-es-5-6-6-1-now-bulk-not-accepting-header-text-json/112448 "2017-12-20T13:03:57Z")
Hello, Today we updated ES to version 6.1 coming from 5.6 and all went good except for indexing Linux logs via a RSYSLOG plugin called omelasticsearch. I've setup an error output file that tells that the Content-Type he… --- ## [Building queries by Java API but calling ELS by Rest](https://discuss.elastic.co/t/building-queries-by-java-api-but-calling-els-by-rest/112589)
**Author:** [@hym](https://discuss.elastic.co/u/hym)\ **Replies:** 3\ **Last updated:** [December 20, 2017, 10:21am UTC](https://discuss.elastic.co/t/building-queries-by-java-api-but-calling-els-by-rest/112589 "2017-12-20T10:21:40Z")
Hi, I've found Java API for building queries very convenient in the java application, on the other hand, I want to use Rest Client to call Elastic cluster. Is this a right approach to use Java API to build my queries a… --- ## [Elasticsearch 6.0: failed to obtain node locks](https://discuss.elastic.co/t/elasticsearch-6-0-failed-to-obtain-node-locks/110994)
**Author:** [@lanlin](https://discuss.elastic.co/u/lanlin)\ **Replies:** 7\ **Last updated:** [December 20, 2017, 10:14am UTC](https://discuss.elastic.co/t/elasticsearch-6-0-failed-to-obtain-node-locks/110994 "2017-12-20T10:14:56Z")
failed to start multi instance on one server after upgrade from 5.x to 6.0. system: centos 7.4 elasticsearch: 6.0.1 i use the systemd to start elasticsearch, one master node and two data node. it works fine under 5.x… --- ## [Closing and reopening index](https://discuss.elastic.co/t/closing-and-reopening-index/111037)
**Author:** [@Hemanth\_Gowda](https://discuss.elastic.co/u/Hemanth_Gowda)\ **Replies:** 2\ **Last updated:** [December 20, 2017, 10:02am UTC](https://discuss.elastic.co/t/closing-and-reopening-index/111037 "2017-12-20T10:02:02Z")
Hi, What are the pros and cons of closing and reopening of an index.I am using this for updating my synonyms file. Will it have any impact on performance perspective of cluster.I have gone through below link.But didn't … --- ## [Cluster not formed](https://discuss.elastic.co/t/cluster-not-formed/112585)
**Author:** [@Alex\_Davidovich](https://discuss.elastic.co/u/Alex_Davidovich)\ **Replies:** 6\ **Last updated:** [December 20, 2017, 9:40am UTC](https://discuss.elastic.co/t/cluster-not-formed/112585 "2017-12-20T09:40:47Z")
Usually, all works well. The hosts IPs and ports are configured properly and were not changed. Why didn't the cluster form this time? Elastic-1 \[2017-12-19T13:03:18,058\]\[INFO \]\[o.e.d.DiscoveryModule \] \[node-1\] u… --- ## [Update stats](https://discuss.elastic.co/t/update-stats/110667)
**Author:** [@matw](https://discuss.elastic.co/u/matw)\ **Replies:** 9\ **Last updated:** [December 20, 2017, 9:10am UTC](https://discuss.elastic.co/t/update-stats/110667 "2017-12-20T09:10:18Z")
How can i find out how often documents were updated via the \_stats request? can't find it, so i'm guessing it could be the get.exists\_total value of the \_stats request since at every update there has to be a request wh… --- ## [How to call the elasticsearch two node cluster from .net application](https://discuss.elastic.co/t/how-to-call-the-elasticsearch-two-node-cluster-from-net-application/112593)
**Author:** [@sateesh.tv](https://discuss.elastic.co/u/sateesh.tv)\ **Replies:** 0\ **Last updated:** [December 20, 2017, 9:00am UTC](https://discuss.elastic.co/t/how-to-call-the-elasticsearch-two-node-cluster-from-net-application/112593 "2017-12-20T09:00:31Z")
we have installed and configured two node master master cluster elasticsearch setup in our server, able to cache the data and replication between both nodes are fine. issue :- we are calling one server Connectionstring … --- ## [Need the backend path of timelion graphs](https://discuss.elastic.co/t/need-the-backend-path-of-timelion-graphs/112414)
**Author:** [@sumeet\_dembra](https://discuss.elastic.co/u/sumeet_dembra)\ **Replies:** 2\ **Last updated:** [December 20, 2017, 8:49am UTC](https://discuss.elastic.co/t/need-the-backend-path-of-timelion-graphs/112414 "2017-12-20T08:49:20Z")
Hi, I want to know the backend path on server where timelion dashboards/visualizations are saved after clicking on Save button from Kibana. The purpose is, I want to push whole ELK server configuration and dashboard us… --- ## [Error on elastic log](https://discuss.elastic.co/t/error-on-elastic-log/112582)
**Author:** [@sbampa](https://discuss.elastic.co/u/sbampa)\ **Replies:** 2\ **Last updated:** [December 20, 2017, 8:41am UTC](https://discuss.elastic.co/t/error-on-elastic-log/112582 "2017-12-20T08:41:25Z")
Hi all, after the upgrade to 6.0.0 of my elk stack, i receive in every node the following error: \[ERROR\]\[o.e.x.m.c.n.NodeStatsCollector\] \[node1\] collector \[node\_stats\] timed out when collecting data and monitoring is … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1846) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1848)