# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1903 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1904 --- ## [Alphabetical sorting on children](https://discuss.elastic.co/t/alphabetical-sorting-on-children/105377)
**Author:** [@nino\_aloi](https://discuss.elastic.co/u/nino_aloi)\ **Replies:** 3\ **Last updated:** [November 1, 2017, 3:06pm UTC](https://discuss.elastic.co/t/alphabetical-sorting-on-children/105377 "2017-11-01T15:06:39Z")
Hi, I currently need to run some queries on my company dataset stored in elastic. A simplified version of the mapping in place is the following: Mapping for Child { "\_parent": { "type": "parent" }, "properties": {… --- ## [Need Help with Installing Certificates into Elasticsearch](https://discuss.elastic.co/t/need-help-with-installing-certificates-into-elasticsearch/104715)
**Author:** [@tamisalex](https://discuss.elastic.co/u/tamisalex)\ **Replies:** 7\ **Last updated:** [November 1, 2017, 2:39pm UTC](https://discuss.elastic.co/t/need-help-with-installing-certificates-into-elasticsearch/104715 "2017-11-01T14:39:54Z")
I've been trying to get some certificates created by certgen installed but I keep encountering this error. I've tried many things like, but I'm at a brick wall. Any help would be much appreciated Error: Blockquote Ca… --- ## [Request Entity Too Large Exception](https://discuss.elastic.co/t/request-entity-too-large-exception/105987)
**Author:** [@ajit](https://discuss.elastic.co/u/ajit)\ **Replies:** 3\ **Last updated:** [November 1, 2017, 1:53pm UTC](https://discuss.elastic.co/t/request-entity-too-large-exception/105987 "2017-11-01T13:53:56Z")
I am getting below exception. org.elasticsearch.client.ResponseException: PUT http://172.21.153.176:9200/test2/jsonindextype/\_bulk: HTTP/1.1 413 Request Entity Too Large I am pushing 200000 records to elasticsearch but… --- ## [Elastic doesn't harvesting specifics logs types from specific machines](https://discuss.elastic.co/t/elastic-doesnt-harvesting-specifics-logs-types-from-specific-machines/106017)
**Author:** [@shaked571](https://discuss.elastic.co/u/shaked571)\ **Replies:** 1\ **Last updated:** [November 1, 2017, 1:44pm UTC](https://discuss.elastic.co/t/elastic-doesnt-harvesting-specifics-logs-types-from-specific-machines/106017 "2017-11-01T13:44:52Z")
my team use ELK to control our logs. We have about 30 different log types, that we are sending both from our grid machines and both from our client side machines. The client side machines work with filebeat--\>logstash-… --- ## [Need help to index data from MongoDB (3.2.7) into Elastic Search (5.6.3)](https://discuss.elastic.co/t/need-help-to-index-data-from-mongodb-3-2-7-into-elastic-search-5-6-3/105712)
**Author:** [@rahmathullatssr](https://discuss.elastic.co/u/rahmathullatssr)\ **Replies:** 2\ **Last updated:** [November 1, 2017, 1:44pm UTC](https://discuss.elastic.co/t/need-help-to-index-data-from-mongodb-3-2-7-into-elastic-search-5-6-3/105712 "2017-11-01T13:44:19Z")
Hi All, I need help to index MongoDB (3.2.7) data into Elastic Search (5.6.3) In a real-time manner. After some research, I found that river plugin is deprecated. But I could read that MongoConnector can be used. Is Mon… --- ## [Elasticsearch Migration Plugin - Custom Aggregation Plugin](https://discuss.elastic.co/t/elasticsearch-migration-plugin-custom-aggregation-plugin/103177)
**Author:** [@Deb](https://discuss.elastic.co/u/Deb)\ **Replies:** 3\ **Last updated:** [November 1, 2017, 12:07pm UTC](https://discuss.elastic.co/t/elasticsearch-migration-plugin-custom-aggregation-plugin/103177 "2017-11-01T12:07:27Z")
I am trying out the elasticsearch migration plugin to check if I can migrate from 2.3.x to 5.x. I have some custom aggregation plugin in my 2.3.x cluster. Running "Cluster Check-up" it is showing green for "Plugins". S… --- ## [Bulk Indexing performance on AWS ES service](https://discuss.elastic.co/t/bulk-indexing-performance-on-aws-es-service/106011)
**Author:** [@michaels](https://discuss.elastic.co/u/michaels)\ **Replies:** 12\ **Last updated:** [November 1, 2017, 11:34am UTC](https://discuss.elastic.co/t/bulk-indexing-performance-on-aws-es-service/106011 "2017-11-01T11:34:43Z")
Hi I am performing a massive bulk indexing daily and it seems that whatever I do my cluster nodes quickly use 100% CPU for hours which causes my searches to perform bad. My configuration is as follows: AWS ES cluster… --- ## [How to get exact word first next followed matches with word?](https://discuss.elastic.co/t/how-to-get-exact-word-first-next-followed-matches-with-word/105420)
**Author:** [@pavani](https://discuss.elastic.co/u/pavani)\ **Replies:** 0\ **Last updated:** [October 26, 2017, 11:46am UTC](https://discuss.elastic.co/t/how-to-get-exact-word-first-next-followed-matches-with-word/105420 "2017-10-26T11:46:14Z")
hello everyone I am very new to Elasticsearch, I need to fetch the data with particular word match ex: I have data as cricketnplay, cricket23, cricket, criketlegend when I match the word cricket result will be li… --- ## [How to make the ES merge to use my new setting](https://discuss.elastic.co/t/how-to-make-the-es-merge-to-use-my-new-setting/105996)
**Author:** [@Eli\_Revach](https://discuss.elastic.co/u/Eli_Revach)\ **Replies:** 0\ **Last updated:** [November 1, 2017, 7:56am UTC](https://discuss.elastic.co/t/how-to-make-the-es-merge-to-use-my-new-setting/105996 "2017-11-01T07:56:43Z")
Hello, ES 1.7 ,very large cluster arount 200 Nodes ( 100B events per month) . I am struggling to keep my number of segments per shard low without having to perform some forced \_optimize (we like to do that in order t… --- ## [LDAP X-pack error Config: Error 403 Forbidden](https://discuss.elastic.co/t/ldap-x-pack-error-config-error-403-forbidden/105582)
**Author:** [@Serg](https://discuss.elastic.co/u/Serg)\ **Replies:** 14\ **Last updated:** [November 1, 2017, 9:44am UTC](https://discuss.elastic.co/t/ldap-x-pack-error-config-error-403-forbidden/105582 "2017-11-01T09:44:04Z")
I installed x-pack and edited config elasticsearch.yml xpack: security: authc: realms: ldap1: type: ldap order: 0 url: "ldap://ldap" bind\_dn: "cn=admin,dc=my" bind\_password: pass user\_search: base\_dn: "dc=my" … --- ## [Dynamic index not working according to month](https://discuss.elastic.co/t/dynamic-index-not-working-according-to-month/105980)
**Author:** [@vinay\_garg](https://discuss.elastic.co/u/vinay_garg)\ **Replies:** 2\ **Last updated:** [November 1, 2017, 9:32am UTC](https://discuss.elastic.co/t/dynamic-index-not-working-according-to-month/105980 "2017-11-01T09:32:39Z")
Hi, I have below define configuration input { beats { port =\> "5051" type =\> "haproxy\_66" } } output { if \[type\] == "haproxy\_66" { elasticsearch { hosts =\> "127.0.0.1:9200" index =\> "haproxy\_66-%{+YYYY-MM-dd}… --- ## [How to create index using elastic client](https://discuss.elastic.co/t/how-to-create-index-using-elastic-client/105993)
**Author:** [@Rajeev\_Gaurav](https://discuss.elastic.co/u/Rajeev_Gaurav)\ **Replies:** 1\ **Last updated:** [November 1, 2017, 9:31am UTC](https://discuss.elastic.co/t/how-to-create-index-using-elastic-client/105993 "2017-11-01T09:31:11Z")
I am working on creating an index with required mapping. Currently, I am able to do with curl -X PUT command but I am exploring the use of creating index using the elastic client. Please let me know. Thanks, Rajeev --- ## [Index created by shrink donnot has sync id, and es node restart always copy from primary other than recovery from local](https://discuss.elastic.co/t/index-created-by-shrink-donnot-has-sync-id-and-es-node-restart-always-copy-from-primary-other-than-recovery-from-local/105988)
**Author:** [@gangxiong\_chen](https://discuss.elastic.co/u/gangxiong_chen)\ **Replies:** 0\ **Last updated:** [November 1, 2017, 6:49am UTC](https://discuss.elastic.co/t/index-created-by-shrink-donnot-has-sync-id-and-es-node-restart-always-copy-from-primary-other-than-recovery-from-local/105988 "2017-11-01T06:49:09Z")
es version : 5.2.2 create index : index-name and index some data ordinary index GET index-name/\_stats/?level=shards "commit": { "id": "jnPwdaydlNfju6jJXCUhxA==", "generation": 8, … --- ## [Getting connection aborted exception](https://discuss.elastic.co/t/getting-connection-aborted-exception/105985)
**Author:** [@ajit](https://discuss.elastic.co/u/ajit)\ **Replies:** 1\ **Last updated:** [November 1, 2017, 7:47am UTC](https://discuss.elastic.co/t/getting-connection-aborted-exception/105985 "2017-11-01T07:47:56Z")
I am pushing data to elasticsearch using RestClient bulk API. When file contains 100000 records it is working fine. But above 100000 records I am getting exception DEBUG \[I/O dispatcher 1\] RestClient.logFailedRequest(92… --- ## [Script\_score: the script could not be loaded](https://discuss.elastic.co/t/script-score-the-script-could-not-be-loaded/105816)
**Author:** [@Srinivasan\_Ramaswamy](https://discuss.elastic.co/u/Srinivasan_Ramaswamy)\ **Replies:** 1\ **Last updated:** [November 1, 2017, 7:30am UTC](https://discuss.elastic.co/t/script-score-the-script-could-not-be-loaded/105816 "2017-11-01T07:30:21Z")
I am trying to write a custom scoring plugin (for elasticsearch 5.6.2.) by following the example mentioned here https://www.elastic.co/guide/en/elasticsearch/reference/5.6/modules-scripting-engine.html I packaged my pl… --- ## [Custom Aggregation Plugin](https://discuss.elastic.co/t/custom-aggregation-plugin/105990)
**Author:** [@Vikas\_Kumar1](https://discuss.elastic.co/u/Vikas_Kumar1)\ **Replies:** 0\ **Last updated:** [November 1, 2017, 7:23am UTC](https://discuss.elastic.co/t/custom-aggregation-plugin/105990 "2017-11-01T07:23:01Z")
I want to control how elasticsearch generate aggregations. Like to control the order in which elasticsearch sort buckets. To customize count, calculating count based on score. How can I do that. I am thinking about to … --- ## [Java scroll api doesn't match curl scroll](https://discuss.elastic.co/t/java-scroll-api-doesnt-match-curl-scroll/105871)
**Author:** [@mm\_guo](https://discuss.elastic.co/u/mm_guo)\ **Replies:** 1\ **Last updated:** [November 1, 2017, 7:18am UTC](https://discuss.elastic.co/t/java-scroll-api-doesnt-match-curl-scroll/105871 "2017-11-01T07:18:41Z")
I use scroll command to pull data, such as curl localhost:9200/customer/\_search?scroll=3m -d '{"size":50,"sort":\[{"\_doc":{"order":"asc"}}\],"query":{"match\_all":{}}}'. No matter how many times I executed the command, th… --- ## [Closing Index in Production](https://discuss.elastic.co/t/closing-index-in-production/105837)
**Author:** [@Vikas\_Kumar1](https://discuss.elastic.co/u/Vikas_Kumar1)\ **Replies:** 8\ **Last updated:** [November 1, 2017, 7:14am UTC](https://discuss.elastic.co/t/closing-index-in-production/105837 "2017-11-01T07:14:53Z")
I want to update a filter and I can't do that without closing index. We are using elastic 2.4 and have 6 node cluster with minimum discoery node 4. --- ## [QueryBuilderQuery](https://discuss.elastic.co/t/querybuilderquery/105538)
**Author:** [@vivekpandey564](https://discuss.elastic.co/u/vivekpandey564)\ **Replies:** 2\ **Last updated:** [November 1, 2017, 7:13am UTC](https://discuss.elastic.co/t/querybuilderquery/105538 "2017-11-01T07:13:51Z")
if suppose i want to write query like select \* from xyz where a="abc" and (createdDate between "?" and aprovedDate betwenn "?") My intention is to write Query Builder query using this. --- ## [Correct way to handle date when data source is UTC already? - Kibana display](https://discuss.elastic.co/t/correct-way-to-handle-date-when-data-source-is-utc-already-kibana-display/105979)
**Author:** [@andynz2017](https://discuss.elastic.co/u/andynz2017)\ **Replies:** 0\ **Last updated:** [November 1, 2017, 6:16am UTC](https://discuss.elastic.co/t/correct-way-to-handle-date-when-data-source-is-utc-already-kibana-display/105979 "2017-11-01T06:16:09Z")
Hi All, I have a quick query regarding a data source that I'm extracting log data from and funneling into Elasticsearch via Logstash (Filebeat). If the data source logs are already in UTC and being stored in Elasticsea… --- ## [Another free plugin for authentication (like x-pack )](https://discuss.elastic.co/t/another-free-plugin-for-authentication-like-x-pack/105656)
**Author:** [@Amin1](https://discuss.elastic.co/u/Amin1)\ **Replies:** 2\ **Last updated:** [November 1, 2017, 5:45am UTC](https://discuss.elastic.co/t/another-free-plugin-for-authentication-like-x-pack/105656 "2017-11-01T05:45:01Z")
Since x-pack is commercial for more complex scenarios how can I add security (authentication and authorization) to users? I have though of an API Gateway but this will either give full access to ES and Kibana to all auth… --- ## [Unassigned shard by rsync index](https://discuss.elastic.co/t/unassigned-shard-by-rsync-index/105973)
**Author:** [@ebf9a541562425152e44](https://discuss.elastic.co/u/ebf9a541562425152e44)\ **Replies:** 2\ **Last updated:** [November 1, 2017, 4:28am UTC](https://discuss.elastic.co/t/unassigned-shard-by-rsync-index/105973 "2017-11-01T04:28:59Z")
Hi Guys, I'm using rsync to migrate my elasticsearch index between different clusters, i know Snapshot And Restore and elasticsearch-dump can do same things. But elasticsearch-dump can't migrate big index(my migrate … --- ## [ES can't work suddenly](https://discuss.elastic.co/t/es-cant-work-suddenly/105974)
**Author:** [@f26227279](https://discuss.elastic.co/u/f26227279)\ **Replies:** 2\ **Last updated:** [November 1, 2017, 4:09am UTC](https://discuss.elastic.co/t/es-cant-work-suddenly/105974 "2017-11-01T04:09:24Z")
Hi, today when I setup the ES, it can't run and show the log. C:\\ELK-Stack\\elasticsearch-5.5.1\\bin\>elasticsearch \[2017-11-01T11:44:38,152\]\[INFO \]\[o.e.n.Node \] \[\] initializing ... \[2017-11-01T11:44:38,249… --- ## [Sending logs to elastic search from outside](https://discuss.elastic.co/t/sending-logs-to-elastic-search-from-outside/105819)
**Author:** [@manojkal](https://discuss.elastic.co/u/manojkal)\ **Replies:** 3\ **Last updated:** [November 1, 2017, 2:38am UTC](https://discuss.elastic.co/t/sending-logs-to-elastic-search-from-outside/105819 "2017-11-01T02:38:32Z")
HI All!! I have elk setup running and want to send logs using the http interface from outside (for instance: AKAMAI ) to the elastic search. Please someone let me know any good solution. Thanks Manoj --- ## [Issue on painless numeric data types](https://discuss.elastic.co/t/issue-on-painless-numeric-data-types/105972)
**Author:** [@morphers82](https://discuss.elastic.co/u/morphers82)\ **Replies:** 0\ **Last updated:** [November 1, 2017, 2:36am UTC](https://discuss.elastic.co/t/issue-on-painless-numeric-data-types/105972 "2017-11-01T02:36:27Z")
I posted an issue and thought maybe someone could find any kind of problem with how I came to the issue. https://github.com/elastic/elasticsearch/issues/27199 I'm having problems with long datatypes acting like integer… --- ## [Faced "fatal error on the network layer" and "fatal error in thread" error](https://discuss.elastic.co/t/faced-fatal-error-on-the-network-layer-and-fatal-error-in-thread-error/105882)
**Author:** [@moznion](https://discuss.elastic.co/u/moznion)\ **Replies:** 4\ **Last updated:** [November 1, 2017, 1:25am UTC](https://discuss.elastic.co/t/faced-fatal-error-on-the-network-layer-and-fatal-error-in-thread-error/105882 "2017-11-01T01:25:23Z")
I faced "fatal error on the network layer" and "fatal error in thread" error and Elasticsearch process is die. Error log is following: \[2017-10-31T09:04:09,689\]\[ERROR\]\[o.e.t.n.Netty4Utils \] fatal error on the netw… --- ## [Consequences of violating 'Blocking operation' assertion](https://discuss.elastic.co/t/consequences-of-violating-blocking-operation-assertion/105053)
**Author:** [@lukas\_vlcek](https://discuss.elastic.co/u/lukas_vlcek)\ **Replies:** 2\ **Last updated:** [November 1, 2017, 1:23am UTC](https://discuss.elastic.co/t/consequences-of-violating-blocking-operation-assertion/105053 "2017-11-01T01:23:27Z")
In short: What are the risks of ignoring Blocking operation assert? There are some checks in Elasticsearch code to verify operation is not executed in transport thread. For instance, in BaseFuture class. It requires ass… --- ## [Elasticsearch opening way too many (200K) Pipes, FDs](https://discuss.elastic.co/t/elasticsearch-opening-way-too-many-200k-pipes-fds/105817)
**Author:** [@rajeev](https://discuss.elastic.co/u/rajeev)\ **Replies:** 8\ **Last updated:** [November 1, 2017, 1:13am UTC](https://discuss.elastic.co/t/elasticsearch-opening-way-too-many-200k-pipes-fds/105817 "2017-11-01T01:13:58Z")
We have elasticsearch running in our product, its not a cluster configuration. We have noticed despite maximum FD limit set to 65536, it has opened too many Pipes/ root\]# lsof | grep -i elasticsearch | wc -l 204875 ro… --- ## [Elasticsearch cluster is Red , the service is still running](https://discuss.elastic.co/t/elasticsearch-cluster-is-red-the-service-is-still-running/105959)
**Author:** [@linuxhustler](https://discuss.elastic.co/u/linuxhustler)\ **Replies:** 0\ **Last updated:** [October 31, 2017, 9:26pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-is-red-the-service-is-still-running/105959 "2017-10-31T21:26:59Z")
Elasticsearch contains the following: 1 cluster, 1 node, 1 shard, 0 replicas. Added ASA's to send logs to the server and ran out of disk space. Added disk space to the cloud server & tried to reroute it to the primary sh… --- ## [Spark + Elastic search write performance issue](https://discuss.elastic.co/t/spark-elastic-search-write-performance-issue/104422)
**Author:** [@Saravanan\_Balakrishn](https://discuss.elastic.co/u/Saravanan_Balakrishn)\ **Replies:** 1\ **Last updated:** [October 31, 2017, 7:08pm UTC](https://discuss.elastic.co/t/spark-elastic-search-write-performance-issue/104422 "2017-10-31T19:08:22Z")
Seeing low # of writes to elasticsearch using spark java. Here are the Configurations using 13.xlarge machines for ES cluster 4 instances each have 4 processors. Set refresh interval to -1 and replications to '0' and… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1902) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1904)