# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1543 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1544 --- ## [Facing issue while indexing the data](https://discuss.elastic.co/t/facing-issue-while-indexing-the-data/149242)
**Author:** [@johnrabi](https://discuss.elastic.co/u/johnrabi)\ **Replies:** 6\ **Last updated:** [September 20, 2018, 10:29am UTC](https://discuss.elastic.co/t/facing-issue-while-indexing-the-data/149242 "2018-09-20T10:29:39Z")
hi any one help me how to resolve this issue, while indexing time facing this exception ? my \_id is : http:/\*\*\*\*\*\* like bulkresponse json{"error":{"root\_cause":\[{"type":"action\_request\_validation\_exception","reason":"… --- ## [No index compression with "best\_compression" in 6.3.2](https://discuss.elastic.co/t/no-index-compression-with-best-compression-in-6-3-2/149046)
**Author:** [@Hari\_Prasad](https://discuss.elastic.co/u/Hari_Prasad)\ **Replies:** 6\ **Last updated:** [September 20, 2018, 9:37am UTC](https://discuss.elastic.co/t/no-index-compression-with-best-compression-in-6-3-2/149046 "2018-09-20T09:37:54Z")
I am using Elasticsearch 6.3.2 to index log data, which is sent from Logstash 6.3.2. Below is my Logstash pipeline config (output part) output { elasticsearch { hosts =\> "my-host:9200" index =\> "%{\[@metadata\]\[index\_t… --- ## [Accidentally deleted all indices from the cluster. How do I restore the data?](https://discuss.elastic.co/t/accidentally-deleted-all-indices-from-the-cluster-how-do-i-restore-the-data/148806)
**Author:** [@rshetty](https://discuss.elastic.co/u/rshetty)\ **Replies:** 7\ **Last updated:** [September 20, 2018, 9:14am UTC](https://discuss.elastic.co/t/accidentally-deleted-all-indices-from-the-cluster-how-do-i-restore-the-data/148806 "2018-09-20T09:14:33Z")
Hi, I know we messed up big time by accidentally deleting all the indices from the cluster but I needed input regarding what is the proper procedure to restore it back. While running the curator tool, accidentally gave… --- ## [Data transformation for date field](https://discuss.elastic.co/t/data-transformation-for-date-field/146713)
**Author:** [@Gauti](https://discuss.elastic.co/u/Gauti)\ **Replies:** 5\ **Last updated:** [September 20, 2018, 9:06am UTC](https://discuss.elastic.co/t/data-transformation-for-date-field/146713 "2018-09-20T09:06:03Z")
Hi All, We are trying to upload a csv file where it has a date field, so using date filter we are converting the field from string to date, the problme we are facing here is, few fields has "proper date" few fields are… --- ## [ELK Stack for CICD dashboard](https://discuss.elastic.co/t/elk-stack-for-cicd-dashboard/148816)
**Author:** [@shirm](https://discuss.elastic.co/u/shirm)\ **Replies:** 2\ **Last updated:** [September 20, 2018, 7:57am UTC](https://discuss.elastic.co/t/elk-stack-for-cicd-dashboard/148816 "2018-09-20T07:57:41Z")
Hi All, We are in process of creating our CICD dashboard for our DevOps pipeline. At present these are the devops tools that we use:- Feature: JIRA VCS: GitHub CI: TeamCity Binary Repo: Nexus CD: Nolio QualityMetr… --- ## [How to calculate the throughput of parallel indexing?](https://discuss.elastic.co/t/how-to-calculate-the-throughput-of-parallel-indexing/149213)
**Author:** [@Todd](https://discuss.elastic.co/u/Todd)\ **Replies:** 8\ **Last updated:** [September 20, 2018, 7:40am UTC](https://discuss.elastic.co/t/how-to-calculate-the-throughput-of-parallel-indexing/149213 "2018-09-20T07:40:11Z")
There is a test scenario for me, the configuration file is (track.json): {% if index\_count is not defined %} {% set index\_count = 1 %} {% endif %} {% set index\_prefix = "billions-jssz.benchmark.scene1-" %} {% import "ra… --- ## [Elasticsearch query issue with reserved characters](https://discuss.elastic.co/t/elasticsearch-query-issue-with-reserved-characters/149235)
**Author:** [@Nikesh](https://discuss.elastic.co/u/Nikesh)\ **Replies:** 0\ **Last updated:** [September 20, 2018, 6:37am UTC](https://discuss.elastic.co/t/elasticsearch-query-issue-with-reserved-characters/149235 "2018-09-20T06:37:30Z")
Hi all, I have indexed two documents {"title": "+" } {"title": "a + b" } By using query string query , I have search queries for the above two documents in different manner. Also, I have not changed any analyzers. D… --- ## [Elasticsearch 5.2.0 installation on Ubuntu](https://discuss.elastic.co/t/elasticsearch-5-2-0-installation-on-ubuntu/149229)
**Author:** [@abbasali](https://discuss.elastic.co/u/abbasali)\ **Replies:** 3\ **Last updated:** [September 20, 2018, 6:31am UTC](https://discuss.elastic.co/t/elasticsearch-5-2-0-installation-on-ubuntu/149229 "2018-09-20T06:31:42Z")
Hello Everyone, My OS: Ubuntu 18.0.4 LTS Installing Elastic version: 5.2.0 Issue: Right after restart the elasticsearch it stopped. Log file error is following "\[2018-09-20T14:58:29,588\]\[INFO \]\[o.e.n.Node … --- ## [Elasticsearch Benchmarking docs/s](https://discuss.elastic.co/t/elasticsearch-benchmarking-docs-s/149027)
**Author:** [@Micah\_Hunsberger](https://discuss.elastic.co/u/Micah_Hunsberger)\ **Replies:** 6\ **Last updated:** [September 20, 2018, 5:27am UTC](https://discuss.elastic.co/t/elasticsearch-benchmarking-docs-s/149027 "2018-09-20T05:27:25Z")
What kind of optimizations is Elastic using on their benchmarking hosts? I have a bare-metals server, with 20 cpu cores, 64 gb of ram, and a mounted nvme drive, but when I use rally locally with esrally --distribution-v… --- ## [Elasticsearch index design for repeated streams](https://discuss.elastic.co/t/elasticsearch-index-design-for-repeated-streams/149221)
**Author:** [@gansvv](https://discuss.elastic.co/u/gansvv)\ **Replies:** 0\ **Last updated:** [September 20, 2018, 5:24am UTC](https://discuss.elastic.co/t/elasticsearch-index-design-for-repeated-streams/149221 "2018-09-20T05:24:55Z")
I would like to use Elasticsearch to index incoming "events" data. Events are described by a number of metadata fields (like event type, category, service type, service name, etc.). Apart from the metadata fields there i… --- ## [Status of copied shards in elastic](https://discuss.elastic.co/t/status-of-copied-shards-in-elastic/149199)
**Author:** [@dorinand](https://discuss.elastic.co/u/dorinand)\ **Replies:** 2\ **Last updated:** [September 20, 2018, 5:05am UTC](https://discuss.elastic.co/t/status-of-copied-shards-in-elastic/149199 "2018-09-20T05:05:07Z")
I would like to get information about actual state of relocating process of shard. I can get this information about shard according to docu: curl -s -X GET "localhost:9201/\_cat/shards/my\_index" | grep RELOCATING my\_inde… --- ## [Could someone help me ? --How to implement join datatype by Java API](https://discuss.elastic.co/t/could-someone-help-me-how-to-implement-join-datatype-by-java-api/148781)
**Author:** [@Tina](https://discuss.elastic.co/u/Tina)\ **Replies:** 0\ **Last updated:** [September 17, 2018, 7:39am UTC](https://discuss.elastic.co/t/could-someone-help-me-how-to-implement-join-datatype-by-java-api/148781 "2018-09-17T07:39:43Z")
As the mapping type will be removed, so we plan to use the join datatype for parent/child doc, but I don't know which Java api should be used, could someone help provide below function by Java code ? thank you in advan… --- ## [Reg: node unicast discovery + Azure VMSS](https://discuss.elastic.co/t/reg-node-unicast-discovery-azure-vmss/149203)
**Author:** [@Karthik\_Ramachandran](https://discuss.elastic.co/u/Karthik_Ramachandran)\ **Replies:** 0\ **Last updated:** [September 19, 2018, 11:44pm UTC](https://discuss.elastic.co/t/reg-node-unicast-discovery-azure-vmss/149203 "2018-09-19T23:44:01Z")
Trying to understand how unicast discovery will behave when using Azure VMSS. Scenario Master Nodes in Azure VMSS (Say 3 nodes) Azure VMSS is attached to Load Balancer with a Front End. Query Against the setting "dis… --- ## [How to extract \_ttl field value on documents](https://discuss.elastic.co/t/how-to-extract-ttl-field-value-on-documents/148893)
**Author:** [@pbathala](https://discuss.elastic.co/u/pbathala)\ **Replies:** 6\ **Last updated:** [September 19, 2018, 10:49pm UTC](https://discuss.elastic.co/t/how-to-extract-ttl-field-value-on-documents/148893 "2018-09-19T22:49:10Z")
Hello, I am migrating my 2.x indices to 6.x (to time based indices). My 2.x index has \_ttl on them and no created timestamp, for me to migrate the index to 6.x cluster, I need to know the timestamp when the document is … --- ## [In 3 node elk cluster setup after enabling 1 node as master and 2 data node](https://discuss.elastic.co/t/in-3-node-elk-cluster-setup-after-enabling-1-node-as-master-and-2-data-node/149089)
**Author:** [@jyothi\_ca](https://discuss.elastic.co/u/jyothi_ca)\ **Replies:** 1\ **Last updated:** [September 19, 2018, 9:25pm UTC](https://discuss.elastic.co/t/in-3-node-elk-cluster-setup-after-enabling-1-node-as-master-and-2-data-node/149089 "2018-09-19T21:25:12Z")
Health status of master and data node is showing in red color We have 3 master eligible node and explicitly added node. unable to get green colour status of master and data node , don't know how to procced further --- ## [\[SOLVED\] Why Gradle daemon is disabled in Git repository?](https://discuss.elastic.co/t/solved-why-gradle-daemon-is-disabled-in-git-repository/149134)
**Author:** [@cbismuth](https://discuss.elastic.co/u/cbismuth)\ **Replies:** 2\ **Last updated:** [September 19, 2018, 8:37pm UTC](https://discuss.elastic.co/t/solved-why-gradle-daemon-is-disabled-in-git-repository/149134 "2018-09-19T20:37:08Z")
Hi, I'd like to speed up my code contribution workflow. I'm using IntelliJ with Gradle integration. I trigger Gradle "run --jvm-debug" task from IntelliJ as a Gradle run configuration and I use IntelliJ default test ru… --- ## [Elasticsearch reindex painless compile error](https://discuss.elastic.co/t/elasticsearch-reindex-painless-compile-error/148772)
**Author:** [@nayun\_oh](https://discuss.elastic.co/u/nayun_oh)\ **Replies:** 1\ **Last updated:** [September 19, 2018, 7:37pm UTC](https://discuss.elastic.co/t/elasticsearch-reindex-painless-compile-error/148772 "2018-09-19T19:37:05Z")
I have to reindex dynamically like the code below. curl -XPOST 'http://localhost:9200/\_reindex' -H 'Content-Type: application/json' -d ' { "source": { "index": "apache-\*", "query": { "bool": { "must": \[ { "rang… --- ## [ElasticSearch Wont Start after intial config](https://discuss.elastic.co/t/elasticsearch-wont-start-after-intial-config/149026)
**Author:** [@koocaroo](https://discuss.elastic.co/u/koocaroo)\ **Replies:** 6\ **Last updated:** [September 19, 2018, 6:34pm UTC](https://discuss.elastic.co/t/elasticsearch-wont-start-after-intial-config/149026 "2018-09-19T18:34:16Z")
After installing elastic i started it once just as a test, and the service started fine. I stopped it and continued to go through the 6.4 guide. Once i finished and tried to start the service again it now fails and gives… --- ## [Elastic Search with Unicode behaves abruptly with python](https://discuss.elastic.co/t/elastic-search-with-unicode-behaves-abruptly-with-python/149166)
**Author:** [@Mayank\_Kumar\_Arora](https://discuss.elastic.co/u/Mayank_Kumar_Arora)\ **Replies:** 0\ **Last updated:** [September 19, 2018, 5:35pm UTC](https://discuss.elastic.co/t/elastic-search-with-unicode-behaves-abruptly-with-python/149166 "2018-09-19T17:35:06Z")
When I am using elasticsearch with python for unicode characters, I am seeing some unusual result. When we pass the query in a variable it results in No Records Found. But when we pass the query as it is in body part as … --- ## [Multi-level bucket aggregation using High-level Java Client](https://discuss.elastic.co/t/multi-level-bucket-aggregation-using-high-level-java-client/146924)
**Author:** [@naveengauba](https://discuss.elastic.co/u/naveengauba)\ **Replies:** 1\ **Last updated:** [September 19, 2018, 5:00pm UTC](https://discuss.elastic.co/t/multi-level-bucket-aggregation-using-high-level-java-client/146924 "2018-09-19T17:00:39Z")
Hi I have written a java web app to display data from an Elastic Search repository. Both the Elastic Search Server and Elasticsearch-rest-high-level-client are at version 6.2.4. I have a question regarding the Bucket … --- ## [How to specify the index in a pre registered search template in 6.3](https://discuss.elastic.co/t/how-to-specify-the-index-in-a-pre-registered-search-template-in-6-3/149153)
**Author:** [@jmlucjav](https://discuss.elastic.co/u/jmlucjav)\ **Replies:** 0\ **Last updated:** [September 19, 2018, 4:13pm UTC](https://discuss.elastic.co/t/how-to-specify-the-index-in-a-pre-registered-search-template-in-6-3/149153 "2018-09-19T16:13:26Z")
Hi, I am using a pre registered search templates in ES6.3, all is working fine, but I must be missing something obvious, where can I specify what index I want to hit when using the template? I don't see a way to either… --- ## [Discourse and ElasticSearch](https://discuss.elastic.co/t/discourse-and-elasticsearch/149131)
**Author:** [@eladis](https://discuss.elastic.co/u/eladis)\ **Replies:** 0\ **Last updated:** [September 19, 2018, 1:38pm UTC](https://discuss.elastic.co/t/discourse-and-elasticsearch/149131 "2018-09-19T13:38:06Z")
I want to use ElasticSearch replacing Discourse builtin search. The platform that this forum is using. It needs to be a plugin, no core code modification. Is there anyone here who can do that or is it not possible? If an… --- ## [(Bug?) Multi Index search with exclusion aliased indices](https://discuss.elastic.co/t/bug-multi-index-search-with-exclusion-aliased-indices/149116)
**Author:** [@cleaner](https://discuss.elastic.co/u/cleaner)\ **Replies:** 0\ **Last updated:** [September 19, 2018, 11:33am UTC](https://discuss.elastic.co/t/bug-multi-index-search-with-exclusion-aliased-indices/149116 "2018-09-19T11:33:43Z")
Hi, We are running elastic 6.3.1. For our indicies are created aliases, let's say: alias.transaction-1 for transaction-1 alias.transaction-2 for transaction-2 and so on. Multindex search is used to find data in a… --- ## [Integer to String conversion for advance job detector(info\_content)](https://discuss.elastic.co/t/integer-to-string-conversion-for-advance-job-detector-info-content/149112)
**Author:** [@vinay\_2498](https://discuss.elastic.co/u/vinay_2498)\ **Replies:** 2\ **Last updated:** [September 19, 2018, 12:21pm UTC](https://discuss.elastic.co/t/integer-to-string-conversion-for-advance-job-detector-info-content/149112 "2018-09-19T12:21:42Z")
Hi, I have NetFlow data, where the byte field is an integer type (eg, 100). I have to convert the byte field from integer type to string type so that I can use high\_info\_content function in machine learning advance job … --- ## [Elasticsearch 6.\* still not running on rhel7.5](https://discuss.elastic.co/t/elasticsearch-6-still-not-running-on-rhel7-5/149095)
**Author:** [@adrwer](https://discuss.elastic.co/u/adrwer)\ **Replies:** 10\ **Last updated:** [September 19, 2018, 12:10pm UTC](https://discuss.elastic.co/t/elasticsearch-6-still-not-running-on-rhel7-5/149095 "2018-09-19T12:10:47Z")
Blocked by another huddle....I installed Elasticsearch as adviced here: but it sends this error when i try checking if it runs curl: (7) Failed connect to localhost:9200; Connection refused i checked if the service w… --- ## [ML datafeed with bursty data](https://discuss.elastic.co/t/ml-datafeed-with-bursty-data/148842)
**Author:** [@mev](https://discuss.elastic.co/u/mev)\ **Replies:** 3\ **Last updated:** [September 19, 2018, 11:08am UTC](https://discuss.elastic.co/t/ml-datafeed-with-bursty-data/148842 "2018-09-19T11:08:04Z")
Hi, I have a feed of data coming in to my ES cluster which can arrive in bursts. I initially set the feed to bring in the last 14 days worth of data so I had some data to backtest. This can take hours as there are milli… --- ## [How to avoid data duplication in elasticsearch when data send from logstash?](https://discuss.elastic.co/t/how-to-avoid-data-duplication-in-elasticsearch-when-data-send-from-logstash/149044)
**Author:** [@nikhil.k](https://discuss.elastic.co/u/nikhil.k)\ **Replies:** 4\ **Last updated:** [September 19, 2018, 10:49am UTC](https://discuss.elastic.co/t/how-to-avoid-data-duplication-in-elasticsearch-when-data-send-from-logstash/149044 "2018-09-19T10:49:43Z")
Hi all, Logstash & Elasticsearch version - 5.4.3 Steps to produce the problem :- Use the below logstash.conf file input { file { path =\> \["path of the file"\] start\_position =\> "beginning" ignore\_older =\> 0 } } … --- ## [Replicas reduce performance complex queries drastically?](https://discuss.elastic.co/t/replicas-reduce-performance-complex-queries-drastically/148310)
**Author:** [@cdekker](https://discuss.elastic.co/u/cdekker)\ **Replies:** 5\ **Last updated:** [September 19, 2018, 10:18am UTC](https://discuss.elastic.co/t/replicas-reduce-performance-complex-queries-drastically/148310 "2018-09-19T10:18:37Z")
We are seeing some very strange query performance on most of our indices when replicas are enabled. Since we require high availability and all our data nodes are directly on local SSD drives we use 2 replicas for all ind… --- ## [Delete data in Elasticsearch(6.4.1) cluster is very slow](https://discuss.elastic.co/t/delete-data-in-elasticsearch-6-4-1-cluster-is-very-slow/149081)
**Author:** [@Chunbo\_Liao](https://discuss.elastic.co/u/Chunbo_Liao)\ **Replies:** 0\ **Last updated:** [September 19, 2018, 8:36am UTC](https://discuss.elastic.co/t/delete-data-in-elasticsearch-6-4-1-cluster-is-very-slow/149081 "2018-09-19T08:36:30Z")
Hi, I used python script to delete the data in Elasticsearch cluster(5 nodes). the speed is very slow, only 5K/s. my script code is: #!/usr/bin/python from elasticsearch import Elasticsearch import sys import time … --- ## [Cluster setting not affected](https://discuss.elastic.co/t/cluster-setting-not-affected/149074)
**Author:** [@Ilyas\_Ahsan](https://discuss.elastic.co/u/Ilyas_Ahsan)\ **Replies:** 0\ **Last updated:** [September 19, 2018, 7:52am UTC](https://discuss.elastic.co/t/cluster-setting-not-affected/149074 "2018-09-19T07:52:08Z")
Hi, I've set \_cluster setting "cluster.routing.allocation.node\_concurrent\_recoveries" : 10 "indices.recovery.max\_bytes\_per\_sec" : "80mb" with PUT \_cluster/settings { "persistent": { "cluster.routing.allocation… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1542) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1544)