# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1989

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1990

---

## [Data indexing in Elastic search by Restful API calls are possible or not?](https://discuss.elastic.co/t/data-indexing-in-elastic-search-by-restful-api-calls-are-possible-or-not/95910)

<div class="topic-metadata">

**Author:** [@rijinmp](https://discuss.elastic.co/u/rijinmp)\
**Replies:** 0\
**Last updated:** [August 4, 2017, 3:07pm UTC](https://discuss.elastic.co/t/data-indexing-in-elastic-search-by-restful-api-calls-are-possible-or-not/95910 "2017-08-04T15:07:49Z")

</div>

Hi All , Is it possible to fetch data from any web application by Restful API calls and it index to Elastic search . For example i would like to collect alert's information from some monitoring tools and this data…

---

## [Elasticsearch errors](https://discuss.elastic.co/t/elasticsearch-errors/89720)

<div class="topic-metadata">

**Author:** [@raghvendra](https://discuss.elastic.co/u/raghvendra)\
**Replies:** 15\
**Last updated:** [August 4, 2017, 2:28pm UTC](https://discuss.elastic.co/t/elasticsearch-errors/89720 "2017-08-04T14:28:15Z")

</div>

I ..I have 3 node of cluster . I have installed x pack . Everything was working fine but by mistake , one node of my cluster got disconnected . So I restarted cluster .. now it is giving these errors . \[2017-06-16T18…

---

## [How to index these documents](https://discuss.elastic.co/t/how-to-index-these-documents/95895)

<div class="topic-metadata">

**Author:** [@Red](https://discuss.elastic.co/u/Red)\
**Replies:** 0\
**Last updated:** [August 4, 2017, 2:16pm UTC](https://discuss.elastic.co/t/how-to-index-these-documents/95895 "2017-08-04T14:16:44Z")

</div>

i will index some doc, which are like this: { "location" :{ "type" : "point", "coordinates" : \[1, 2\] }, "PartA":{ "Date\_20170804":{ "DevId\_1":\[ { "loc": \[1.00000…

---

## [Are there memory leaks in ElasticSearch's TransportClient 5.4.3 or is my code flawed?](https://discuss.elastic.co/t/are-there-memory-leaks-in-elasticsearchs-transportclient-5-4-3-or-is-my-code-flawed/91989)

<div class="topic-metadata">

**Author:** [@Dan-K](https://discuss.elastic.co/u/Dan-K)\
**Replies:** 7\
**Last updated:** [August 4, 2017, 1:43pm UTC](https://discuss.elastic.co/t/are-there-memory-leaks-in-elasticsearchs-transportclient-5-4-3-or-is-my-code-flawed/91989 "2017-08-04T13:43:10Z")

</div>

Are there memory leaks in ElasticSearch's TransportClient 5.4.3? Or am I not using and closing the objects correctly? I'm using the client in a Jenkins (2.68) which is on JRE 1.8.0\_66 and writing my code in Groovy. Bul…

---

## [Elasticsearch Unreachable or Down!](https://discuss.elastic.co/t/elasticsearch-unreachable-or-down/95582)

<div class="topic-metadata">

**Author:** [@cjs6891](https://discuss.elastic.co/u/cjs6891)\
**Replies:** 8\
**Last updated:** [August 4, 2017, 12:43pm UTC](https://discuss.elastic.co/t/elasticsearch-unreachable-or-down/95582 "2017-08-04T12:43:33Z")

</div>

Hi, My ELK stack has been running great for months, until recently. I’ve been receiving the following error: \[2017-08-01T13:02:10,092\]\[ERROR\]\[logstash.outputs.elasticsearch\] Action \[2017-08-01T13:02:10,092\]\[ERROR\]\[log…

---

## [Need help - customized fields are not identified](https://discuss.elastic.co/t/need-help-customized-fields-are-not-identified/95872)

<div class="topic-metadata">

**Author:** [@ashleyl](https://discuss.elastic.co/u/ashleyl)\
**Replies:** 0\
**Last updated:** [August 4, 2017, 11:27am UTC](https://discuss.elastic.co/t/need-help-customized-fields-are-not-identified/95872 "2017-08-04T11:27:57Z")

</div>

I use filebeat sending log to host and noticed that elasticsearch generated "filebeat+date" as index name each day, and I know it is by default which indicated in filebeat.yml. I have customized log with clientip,pat…

---

## [Regex elasticsearch python API](https://discuss.elastic.co/t/regex-elasticsearch-python-api/94383)

<div class="topic-metadata">

**Author:** [@diegoorellanaga](https://discuss.elastic.co/u/diegoorellanaga)\
**Replies:** 1\
**Last updated:** [August 4, 2017, 11:04am UTC](https://discuss.elastic.co/t/regex-elasticsearch-python-api/94383 "2017-08-04T11:04:11Z")

</div>

Hi, I have been trying to make a regex ES search using the python API but I have not been able to. In my regex I'm trying to detect 8 consecutive digits: ".(^|\[^\\d\])\\d{8}($|\[^\\d\])." the app in https://regex101.com/ te…

---

## [Backup of elsticsearch indices](https://discuss.elastic.co/t/backup-of-elsticsearch-indices/95864)

<div class="topic-metadata">

**Author:** [@sanketdarji](https://discuss.elastic.co/u/sanketdarji)\
**Replies:** 0\
**Last updated:** [August 4, 2017, 11:03am UTC](https://discuss.elastic.co/t/backup-of-elsticsearch-indices/95864 "2017-08-04T11:03:16Z")

</div>

We have elk (elasticsearch 1.7 no plan for upgrade till now) setup in production, everyday we are getting ~15gb of data and space we have locally is ~150GB. We have good amount of external storage. Now our requirement …

---

## [Elastic-py + Kibana](https://discuss.elastic.co/t/elastic-py-kibana/95691)

<div class="topic-metadata">

**Author:** [@aditya](https://discuss.elastic.co/u/aditya)\
**Replies:** 1\
**Last updated:** [August 4, 2017, 10:48am UTC](https://discuss.elastic.co/t/elastic-py-kibana/95691 "2017-08-04T10:48:02Z")

</div>

How to integrate Kibana using elastic-search py . I know I can use iframe source of kibana in my html but i dont want to expose my kibana address to users.l

---

## [How to index a file with elasticsearch 5.5.1](https://discuss.elastic.co/t/how-to-index-a-file-with-elasticsearch-5-5-1/95657)

<div class="topic-metadata">

**Author:** [@bilpor](https://discuss.elastic.co/u/bilpor)\
**Replies:** 21\
**Last updated:** [August 4, 2017, 10:45am UTC](https://discuss.elastic.co/t/how-to-index-a-file-with-elasticsearch-5-5-1/95657 "2017-08-04T10:45:42Z")

</div>

I’m new to Elasticsearch. I have successfully installed Elasticsearch with Kibana, X-pack and ingest-attachment. I have both Elasticsearch and Kibana running. I have kept it simple at the moment with the install using de…

---

## [What if my storage is full?](https://discuss.elastic.co/t/what-if-my-storage-is-full/95658)

<div class="topic-metadata">

**Author:** [@gauravbhutani30](https://discuss.elastic.co/u/gauravbhutani30)\
**Replies:** 6\
**Last updated:** [August 4, 2017, 10:23am UTC](https://discuss.elastic.co/t/what-if-my-storage-is-full/95658 "2017-08-04T10:23:52Z")

</div>

Hi Everyone, We are running a elastisearch cluster of 3 nodes and we have mounted our storage on SAN. I was just wandering if the storage is full, what will happen to our cluster? We wanted to test this scenario. Plea…

---

## [BulkProcessor can not set refresh policy](https://discuss.elastic.co/t/bulkprocessor-can-not-set-refresh-policy/95630)

<div class="topic-metadata">

**Author:** [@LinPower](https://discuss.elastic.co/u/LinPower)\
**Replies:** 4\
**Last updated:** [August 4, 2017, 10:10am UTC](https://discuss.elastic.co/t/bulkprocessor-can-not-set-refresh-policy/95630 "2017-08-04T10:10:34Z")

</div>

I use BulkProcessor to index documents in java. And I want to set RefreshPolicy to each BulkRequest that processor created. But I can not find a method to do it. Is there a way to do so that I do not find? Or why is Bulk…

---

## [How to include TransportClient 5.3.2 without Lucene dependencies?](https://discuss.elastic.co/t/how-to-include-transportclient-5-3-2-without-lucene-dependencies/95846)

<div class="topic-metadata">

**Author:** [@Pietro\_Pagani](https://discuss.elastic.co/u/Pietro_Pagani)\
**Replies:** 1\
**Last updated:** [August 4, 2017, 9:45am UTC](https://discuss.elastic.co/t/how-to-include-transportclient-5-3-2-without-lucene-dependencies/95846 "2017-08-04T09:45:51Z")

</div>

Hi all, I’m trying to include the Java Transport Client in my webapp for enriching its searching functionalities by Elasticsearch integration. I have installed Elasticsearch version 5.3.2 on my laptop and I have added …

---

## [Searching document from elastic search via spring MVC](https://discuss.elastic.co/t/searching-document-from-elastic-search-via-spring-mvc/95845)

<div class="topic-metadata">

**Author:** [@Neetu](https://discuss.elastic.co/u/Neetu)\
**Replies:** 0\
**Last updated:** [August 4, 2017, 9:21am UTC](https://discuss.elastic.co/t/searching-document-from-elastic-search-via-spring-mvc/95845 "2017-08-04T09:21:35Z")

</div>

HI , Iam trying to connect elastic search server from my spring project and want to get the documents (files) from server and display in my search results. How can i do it .is there any demo project for the same from w…

---

## [Performance of Spark bulk index to Elasticsearch](https://discuss.elastic.co/t/performance-of-spark-bulk-index-to-elasticsearch/95468)

<div class="topic-metadata">

**Author:** [@guest444](https://discuss.elastic.co/u/guest444)\
**Replies:** 2\
**Last updated:** [August 4, 2017, 9:00am UTC](https://discuss.elastic.co/t/performance-of-spark-bulk-index-to-elasticsearch/95468 "2017-08-04T09:00:35Z")

</div>

I have a Spark app which uses Elasticsearch-Hadoop to bulk index logs. My log file has 80 million records. My app takes 3 hours to complete. I am looking for ways to improve my Spark, Elasticsearch-Hadoop, and/or Elastic…

---

## [Max number of threads \[1024\] for user \[elasticsearch\] is too low](https://discuss.elastic.co/t/max-number-of-threads-1024-for-user-elasticsearch-is-too-low/95542)

<div class="topic-metadata">

**Author:** [@aliyesami](https://discuss.elastic.co/u/aliyesami)\
**Replies:** 2\
**Last updated:** [August 4, 2017, 7:42am UTC](https://discuss.elastic.co/t/max-number-of-threads-1024-for-user-elasticsearch-is-too-low/95542 "2017-08-04T07:42:02Z")

</div>

I am using Centos and I start the elasticsearch as as service from root user . despite these settings I am still getting the warning of max number of threads too low. I have put the following lines in the /etc/security…

---

## [NEsted nad raw fields](https://discuss.elastic.co/t/nested-nad-raw-fields/95839)

<div class="topic-metadata">

**Author:** [@xavi23](https://discuss.elastic.co/u/xavi23)\
**Replies:** 0\
**Last updated:** [August 4, 2017, 8:17am UTC](https://discuss.elastic.co/t/nested-nad-raw-fields/95839 "2017-08-04T08:17:11Z")

</div>

Hello, Every time that I try to create a index that contain a nested raw field give the next error: Mapping definition for \[diagnostico\] has unsupported parameters: \[fields : {raw={type=keyword}}\]" It’s possible to …

---

## [Partial Matching with Synonym filters](https://discuss.elastic.co/t/partial-matching-with-synonym-filters/95832)

<div class="topic-metadata">

**Author:** [@Steve\_Jackson](https://discuss.elastic.co/u/Steve_Jackson)\
**Replies:** 0\
**Last updated:** [August 4, 2017, 7:49am UTC](https://discuss.elastic.co/t/partial-matching-with-synonym-filters/95832 "2017-08-04T07:49:42Z")

</div>

Hi. I am trying to use a synonym filter for searching known variations of a name. I have configured a type “people” with property “name” (string). This is configured to use a defined filter with the following synonym d…

---

## [Use Snapshot from Hadoop?](https://discuss.elastic.co/t/use-snapshot-from-hadoop/63773)

<div class="topic-metadata">

**Author:** [@ebuildy](https://discuss.elastic.co/u/ebuildy)\
**Replies:** 5\
**Last updated:** [August 4, 2017, 7:46am UTC](https://discuss.elastic.co/t/use-snapshot-from-hadoop/63773 "2017-08-04T07:46:48Z")

</div>

Just curious, is it possible to read a snapshot with Java? (Especially with Hadoop techo. such as Hive or Spark or PIG). We have a ton of snapshots, would like read data but I don't want to restore them one by one for …

---

## [Es 5.4.2.0 how to set the th percolate.size](https://discuss.elastic.co/t/es-5-4-2-0-how-to-set-the-th-percolate-size/95804)

<div class="topic-metadata">

**Author:** [@zqc0512](https://discuss.elastic.co/u/zqc0512)\
**Replies:** 6\
**Last updated:** [August 4, 2017, 7:40am UTC](https://discuss.elastic.co/t/es-5-4-2-0-how-to-set-the-th-percolate-size/95804 "2017-08-04T07:40:00Z")

</div>

i can’t add the flow config in elasticsearch.yml thread\_pool: percolate: size: 16 queue\_size: 2000 the error is \*\*\[2017-08-04T11:40:26,843\]\[WARN \]\[o.e.b.ElasticsearchUncaughtExceptionHandler\] \[node-1\] uncaught exce…

---

## [Millions of IllegalStateException in yourkit profiler connected to ES service](https://discuss.elastic.co/t/millions-of-illegalstateexception-in-yourkit-profiler-connected-to-es-service/95505)

<div class="topic-metadata">

**Author:** [@nrmohta](https://discuss.elastic.co/u/nrmohta)\
**Replies:** 1\
**Last updated:** [August 4, 2017, 7:38am UTC](https://discuss.elastic.co/t/millions-of-illegalstateexception-in-yourkit-profiler-connected-to-es-service/95505 "2017-08-04T07:38:49Z")

</div>

Hi All We are getting millions of IllegalStateException in yourkit profiler connected to ES service. Any help/direction will be very helpful, please suggest. ES version - 5.2.2 +--------------------------------------…

---

## [Multi type & multi\_match query - individual boosting](https://discuss.elastic.co/t/multi-type-multi-match-query-individual-boosting/95574)

<div class="topic-metadata">

**Author:** [@karpatil](https://discuss.elastic.co/u/karpatil)\
**Replies:** 1\
**Last updated:** [August 4, 2017, 7:31am UTC](https://discuss.elastic.co/t/multi-type-multi-match-query-individual-boosting/95574 "2017-08-04T07:31:52Z")

</div>

I have two types: books, compositions. Both of them have an author (string) field: book.author and composition.author. I would like to search in both of the two types at the same time, with multi\_match query, like: GE…

---

## [Java client can't connect when using a virtual IP](https://discuss.elastic.co/t/java-client-cant-connect-when-using-a-virtual-ip/95587)

<div class="topic-metadata">

**Author:** [@pshroads](https://discuss.elastic.co/u/pshroads)\
**Replies:** 1\
**Last updated:** [August 4, 2017, 7:28am UTC](https://discuss.elastic.co/t/java-client-cant-connect-when-using-a-virtual-ip/95587 "2017-08-04T07:28:32Z")

</div>

We are having issues with the java client connecting to elasticsearch through a virtual IP. We have the vip set up on our F5 with all the nodes of the cluster in the vip. We can connect to the cluster using the vip an…

---

## [In es 5 i set the threadpool but working not use this](https://discuss.elastic.co/t/in-es-5-i-set-the-threadpool-but-working-not-use-this/95822)

<div class="topic-metadata">

**Author:** [@zqc0512](https://discuss.elastic.co/u/zqc0512)\
**Replies:** 2\
**Last updated:** [August 4, 2017, 7:28am UTC](https://discuss.elastic.co/t/in-es-5-i-set-the-threadpool-but-working-not-use-this/95822 "2017-08-04T07:28:31Z")

</div>

i set in elastaticsearch.yml file but the nodes/stats not it. http://XX.XX.XX.XX:9200/\_nodes/stats thread\_pool: index: size: 12 queue\_size: 2000

---

## [Indices.query.bool.max\_clause\_count: 5120 not getting reflected](https://discuss.elastic.co/t/indices-query-bool-max-clause-count-5120-not-getting-reflected/95147)

<div class="topic-metadata">

**Author:** [@kaushalshriyan](https://discuss.elastic.co/u/kaushalshriyan)\
**Replies:** 1\
**Last updated:** [August 4, 2017, 7:15am UTC](https://discuss.elastic.co/t/indices-query-bool-max-clause-count-5120-not-getting-reflected/95147 "2017-08-04T07:15:12Z")

</div>

Hi, I am running elasticsearch-2.4.2-1.noarch on CentOS Linux release 7.2.1511 (Core). I am trying to add indices.query.bool.max\_clause\_count: 5120 in elasticsearch.yml and i have restarted the elasticsearch node. it is…

---

## [Decomissioning node question, does not start moving shards](https://discuss.elastic.co/t/decomissioning-node-question-does-not-start-moving-shards/94624)

<div class="topic-metadata">

**Author:** [@uschellh](https://discuss.elastic.co/u/uschellh)\
**Replies:** 2\
**Last updated:** [August 4, 2017, 7:14am UTC](https://discuss.elastic.co/t/decomissioning-node-question-does-not-start-moving-shards/94624 "2017-08-04T07:14:41Z")

</div>

Hello, we want to decomission nodes, i already excluded those nodes from allocation: "cluster.routing.allocation.exclude.\_name" ans also configured each index for the node where it should land (it will be 1 remaining o…

---

## [bulkRequest.get() hangs](https://discuss.elastic.co/t/bulkrequest-get-hangs/95795)

<div class="topic-metadata">

**Author:** [@Rohit\_Nigam](https://discuss.elastic.co/u/Rohit_Nigam)\
**Replies:** 1\
**Last updated:** [August 4, 2017, 7:02am UTC](https://discuss.elastic.co/t/bulkrequest-get-hangs/95795 "2017-08-04T07:02:43Z")

</div>

Hi I am using java transport client 5.5.0 and I have deployed elastic search version 5.5.0 using kubernetes in google container engine. I am using BulkRequestBuilder api to do number of inserts and also waiting for thei…

---

## [ORA-29263: HTTP protocol error](https://discuss.elastic.co/t/ora-29263-http-protocol-error/95714)

<div class="topic-metadata">

**Author:** [@JAYALAKSHMI](https://discuss.elastic.co/u/JAYALAKSHMI)\
**Replies:** 3\
**Last updated:** [August 4, 2017, 7:02am UTC](https://discuss.elastic.co/t/ora-29263-http-protocol-error/95714 "2017-08-04T07:02:19Z")

</div>

Hi All, I am having two cluster up and running on a single server. One for 2.4.5 and another for 5.5.0 . While hitting utl\_http request from DB for 5.5.0, we are getting the below error whereas it is working fine for 2…

---

## [Timing issues with Watcher](https://discuss.elastic.co/t/timing-issues-with-watcher/95549)

<div class="topic-metadata">

**Author:** [@mhus](https://discuss.elastic.co/u/mhus)\
**Replies:** 3\
**Last updated:** [August 4, 2017, 6:54am UTC](https://discuss.elastic.co/t/timing-issues-with-watcher/95549 "2017-08-04T06:54:47Z")

</div>

I have a watcher that checks for specific logfile entries and I need its action to trigger exactly once for any entries found within a specific timeframe. It currently checks for logfile entries once a minute using the f…

---

## [Restrict View Machine Learning Jobs to other users](https://discuss.elastic.co/t/restrict-view-machine-learning-jobs-to-other-users/95823)

<div class="topic-metadata">

**Author:** [@dcam](https://discuss.elastic.co/u/dcam)\
**Replies:** 0\
**Last updated:** [August 4, 2017, 6:35am UTC](https://discuss.elastic.co/t/restrict-view-machine-learning-jobs-to-other-users/95823 "2017-08-04T06:35:40Z")

</div>

X-PACK Security allows User Restriction on Document/Index and Cluster Level. But not on MachineLearning jobs… Is this going to be part of X-Pack security in the future? We have a shared cluster and It is not allow to …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1988)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1990)
