# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=750 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 751 --- ## [Consolidating/aggregating ES documents on one ELK stack](https://discuss.elastic.co/t/consolidating-aggregating-es-documents-on-one-elk-stack/257428)
**Author:** [@Asher](https://discuss.elastic.co/u/Asher)\ **Replies:** 8\ **Last updated:** [December 3, 2020, 10:17pm UTC](https://discuss.elastic.co/t/consolidating-aggregating-es-documents-on-one-elk-stack/257428 "2020-12-03T22:17:09Z")
Hi all, I'm trying to solve the following problem: I have data in RDSs (Aurora MySQL), a subset of which I'm going to map to Elasticsearch using the AWS Database Migration Service. Unfortunately, we have full deployment… --- ## [Ansible-elasticsearch es\_api\_basic\_auth\_username as 'elastic' user](https://discuss.elastic.co/t/ansible-elasticsearch-es-api-basic-auth-username-as-elastic-user/257150)
**Author:** [@tummulu](https://discuss.elastic.co/u/tummulu)\ **Replies:** 1\ **Last updated:** [December 3, 2020, 8:32pm UTC](https://discuss.elastic.co/t/ansible-elasticsearch-es-api-basic-auth-username-as-elastic-user/257150 "2020-12-03T20:32:37Z")
I am having two issues using this role with es\_api\_basic\_auth\_username as 'elastic', when I run it first time it updates the elastic user password but fails to update the reserved user passwords but Elasticsearch service… --- ## [Indexing JSON throws MapperParsingException](https://discuss.elastic.co/t/indexing-json-throws-mapperparsingexception/257563)
**Author:** [@hKerma](https://discuss.elastic.co/u/hKerma)\ **Replies:** 0\ **Last updated:** [December 3, 2020, 6:06pm UTC](https://discuss.elastic.co/t/indexing-json-throws-mapperparsingexception/257563 "2020-12-03T18:06:09Z")
Hi everyone, I created that topic, thinking I had a Logstash issue, but it seems like it's an Elasticsearch indexing issue. Let me recap : I'm trying to parse and index k8s audit logs, which are valid JSONs, with Logst… --- ## [Cosine Similarity Script Search does not work](https://discuss.elastic.co/t/cosine-similarity-script-search-does-not-work/257550)
**Author:** [@gustav\_z](https://discuss.elastic.co/u/gustav_z)\ **Replies:** 0\ **Last updated:** [December 3, 2020, 4:37pm UTC](https://discuss.elastic.co/t/cosine-similarity-script-search-does-not-work/257550 "2020-12-03T16:37:54Z")
Similar to these un-answered and closed topics: https://discuss.elastic.co/t/cosine-similarity-not-working-in-elastic-search/209702 https://discuss.elastic.co/t/elasticsearch-search-error/232784 I am seeing the same E… --- ## [ML query](https://discuss.elastic.co/t/ml-query/257418)
**Author:** [@Elk\_huh](https://discuss.elastic.co/u/Elk_huh)\ **Replies:** 3\ **Last updated:** [December 3, 2020, 4:26pm UTC](https://discuss.elastic.co/t/ml-query/257418 "2020-12-03T16:26:14Z")
Is it possible to do an ML job that says If event.code: 4264 and 4265 within 30 minutes ? --- ## [Batch transform done indicator](https://discuss.elastic.co/t/batch-transform-done-indicator/257345)
**Author:** [@kaijun](https://discuss.elastic.co/u/kaijun)\ **Replies:** 3\ **Last updated:** [December 3, 2020, 2:30pm UTC](https://discuss.elastic.co/t/batch-transform-done-indicator/257345 "2020-12-03T14:30:32Z")
I am performing a batch transform on my ES index (only transforming for once and not a continuous job). Is there an API or indicator that returns a response once the transformation is done (so that I could then stop the … --- ## [Get the difference between different format of datetime](https://discuss.elastic.co/t/get-the-difference-between-different-format-of-datetime/257325)
**Author:** [@Izek\_Chen](https://discuss.elastic.co/u/Izek_Chen)\ **Replies:** 1\ **Last updated:** [December 3, 2020, 2:10pm UTC](https://discuss.elastic.co/t/get-the-difference-between-different-format-of-datetime/257325 "2020-12-03T14:10:41Z")
I have data with two date field like this "@buildTimestamp": "2020-12-01T18:55:34.895-0800", "@timestamp": "2020-12-02T03:02:16.723Z" I'd like to use ingest pipeline script processor to get the difference. How can I… --- ## [Elasticsearch dead but subsys locked](https://discuss.elastic.co/t/elasticsearch-dead-but-subsys-locked/257066)
**Author:** [@ItsMee](https://discuss.elastic.co/u/ItsMee)\ **Replies:** 5\ **Last updated:** [December 3, 2020, 1:33pm UTC](https://discuss.elastic.co/t/elasticsearch-dead-but-subsys-locked/257066 "2020-12-03T13:33:22Z")
Dear All, I have tried to restart the elasticsearch but getting 'elasticsearch dead but subsys locked' after start. I have removed the lock the file(elasticsearch) under /var/lock/subsys/ multiple times but no luck. Co… --- ## [How to relate elasticsearc event error to input log line?](https://discuss.elastic.co/t/how-to-relate-elasticsearc-event-error-to-input-log-line/257375)
**Author:** [@Bootta](https://discuss.elastic.co/u/Bootta)\ **Replies:** 2\ **Last updated:** [December 3, 2020, 12:54pm UTC](https://discuss.elastic.co/t/how-to-relate-elasticsearc-event-error-to-input-log-line/257375 "2020-12-03T12:54:06Z")
Is there any way that I can link Elasticsearch error with my input logline so I can fix it? I'm trying to fix Elasticsearch event errors from large log file(500MB), so testing line by line is impossible. Here is Eleasti… --- ## [LogLevel DEBUG and INFO not required](https://discuss.elastic.co/t/loglevel-debug-and-info-not-required/257484)
**Author:** [@dfoot](https://discuss.elastic.co/u/dfoot)\ **Replies:** 0\ **Last updated:** [December 3, 2020, 10:07am UTC](https://discuss.elastic.co/t/loglevel-debug-and-info-not-required/257484 "2020-12-03T10:07:27Z")
We do not need DEBUG and INFO logs coming into ELK but only for one or more components e.g. hostname and index name. From below link add exclude\_lines for DEBUG and INFO - Exclude\_lines: \[‘^DEBUG’, ‘^INFO’\] but to inclu… --- ## [Mapping Issues](https://discuss.elastic.co/t/mapping-issues/257461)
**Author:** [@muaz761](https://discuss.elastic.co/u/muaz761)\ **Replies:** 9\ **Last updated:** [December 3, 2020, 9:56am UTC](https://discuss.elastic.co/t/mapping-issues/257461 "2020-12-03T09:56:10Z")
Hey, I am facing a problem with elastic search mapping. currently, my elastic search version is 1.7.2. When I index my data in a cluster it workes perfectly. But when I want to map it for search purposes it gives me an … --- ## [Logstash is not indexing data to elasticsearch](https://discuss.elastic.co/t/logstash-is-not-indexing-data-to-elasticsearch/257470)
**Author:** [@Aryaman\_Gupta](https://discuss.elastic.co/u/Aryaman_Gupta)\ **Replies:** 2\ **Last updated:** [December 3, 2020, 9:52am UTC](https://discuss.elastic.co/t/logstash-is-not-indexing-data-to-elasticsearch/257470 "2020-12-03T09:52:58Z")
I am not able index data from logstash to elasticsearch, hence I am not able to view the data index at the kibana UI. This issue I saw only when, running the logstash command from the php file, I guess it's www-data use… --- ## [Why is reindex from remote constantly slowing down on large indices?](https://discuss.elastic.co/t/why-is-reindex-from-remote-constantly-slowing-down-on-large-indices/257354)
**Author:** [@Dmitry\_O](https://discuss.elastic.co/u/Dmitry_O)\ **Replies:** 1\ **Last updated:** [December 3, 2020, 9:47am UTC](https://discuss.elastic.co/t/why-is-reindex-from-remote-constantly-slowing-down-on-large-indices/257354 "2020-12-03T09:47:54Z")
Hey, I have 2 clusters: Source cluster: 5.6 version, 3 node with 126 GB RAM on each. Dest cluster: 7.9 version, 3 node with 6 GB RAM on each and ES\_JAVA\_OPTS -Xms3g -Xmx3g I have ~60 indices of different sizes from (… --- ## [ElasticSearch running, problems connecting (ipTables problem)](https://discuss.elastic.co/t/elasticsearch-running-problems-connecting-iptables-problem/257468)
**Author:** [@Mikel\_U](https://discuss.elastic.co/u/Mikel_U)\ **Replies:** 1\ **Last updated:** [December 3, 2020, 9:35am UTC](https://discuss.elastic.co/t/elasticsearch-running-problems-connecting-iptables-problem/257468 "2020-12-03T09:35:20Z")
Hi, I want to create 3 nodes of ES and Kibana in production network. I would like to see ES in local network (site) and Kibana from Internet. My first (master) node is running. If I put network.host: 0.0.0.0: I can c… --- ## [Optimizing Aggregation Performance](https://discuss.elastic.co/t/optimizing-aggregation-performance/257477)
**Author:** [@muhammad\_ayoub](https://discuss.elastic.co/u/muhammad_ayoub)\ **Replies:** 0\ **Last updated:** [December 3, 2020, 9:34am UTC](https://discuss.elastic.co/t/optimizing-aggregation-performance/257477 "2020-12-03T09:34:25Z")
Hi all, firstly, please excuse me if my questione is not very well formed as I am new to elasticsearch and not very familiar with what details I should list. We have an elasticearch cluster with three nodes where all o… --- ## [java.lang.StackOverflowError: null](https://discuss.elastic.co/t/java-lang-stackoverflowerror-null/257295)
**Author:** [@yc1024](https://discuss.elastic.co/u/yc1024)\ **Replies:** 2\ **Last updated:** [December 3, 2020, 8:35am UTC](https://discuss.elastic.co/t/java-lang-stackoverflowerror-null/257295 "2020-12-03T08:35:37Z")
elasticsearch version : 6.7.1 \[search\]\[T#65\]\], exiting java.lang.StackOverflowError: null at java.util.stream.StreamOpFlag.fromCharacteristics(StreamOpFlag.java:733) ~\[?:1.8.0\_201\] at java.util.stream.StreamSupport.st… --- ## [Weights for synonyms](https://discuss.elastic.co/t/weights-for-synonyms/257467)
**Author:** [@TatianaParshina](https://discuss.elastic.co/u/TatianaParshina)\ **Replies:** 0\ **Last updated:** [December 3, 2020, 8:31am UTC](https://discuss.elastic.co/t/weights-for-synonyms/257467 "2020-12-03T08:31:58Z")
Hi, Is there a way to provide weight/boost for synonyms? For example, I have synonyms: \["laptop", "notebook"\]. I want that score of "laptop" should be more then score of "notebook" and I want to specify this score. I h… --- ## [IP filtering and Security audit not working "Trial License"](https://discuss.elastic.co/t/ip-filtering-and-security-audit-not-working-trial-license/257185)
**Author:** [@Abdelhalim](https://discuss.elastic.co/u/Abdelhalim)\ **Replies:** 4\ **Last updated:** [December 3, 2020, 8:07am UTC](https://discuss.elastic.co/t/ip-filtering-and-security-audit-not-working-trial-license/257185 "2020-12-03T08:07:55Z")
Hello, I am using trial License to try the IP filtering and Security audit (using version 8.0.0), but it's not working. I added this configuration to my elasticsearch.yml file: xpack.security.audit.enabled: true xpa… --- ## [Too many scroll error](https://discuss.elastic.co/t/too-many-scroll-error/255919)
**Author:** [@Amy\_Jonson](https://discuss.elastic.co/u/Amy_Jonson)\ **Replies:** 3\ **Last updated:** [December 3, 2020, 2:48am UTC](https://discuss.elastic.co/t/too-many-scroll-error/255919 "2020-12-03T02:48:28Z")
Hi, We encountered an error "Trying to create too many scroll context". What is the possible trigger of this error and how should we avoid it. We only resolve this issue when we restarted the ES. Thanks --- ## [Elasticsearch Head - Find and Remove Duplicate Documents](https://discuss.elastic.co/t/elasticsearch-head-find-and-remove-duplicate-documents/257438)
**Author:** [@test\_tester](https://discuss.elastic.co/u/test_tester)\ **Replies:** 0\ **Last updated:** [December 3, 2020, 2:39am UTC](https://discuss.elastic.co/t/elasticsearch-head-find-and-remove-duplicate-documents/257438 "2020-12-03T02:39:29Z")
Hi All, Background: Inside my application, users noticed duplicate transactions -\> investigating deeper, we noticed that we have duplicates in our elasticsearch database, likely because we did not restart our logstash/… --- ## [ILM: issue while trying to set replica:0](https://discuss.elastic.co/t/ilm-issue-while-trying-to-set-replica-0/257424)
**Author:** [@ppuschmann](https://discuss.elastic.co/u/ppuschmann)\ **Replies:** 3\ **Last updated:** [December 3, 2020, 1:43am UTC](https://discuss.elastic.co/t/ilm-issue-while-trying-to-set-replica-0/257424 "2020-12-03T01:43:29Z")
We're using the following ILM-policy with success. PUT \_ilm/policy/technical { "policy": { "phases": { "hot": { "min\_age": "0ms", "actions": { "set\_priority": { "priorit… --- ## [Penalize multiple fuzzy matches from one word](https://discuss.elastic.co/t/penalize-multiple-fuzzy-matches-from-one-word/257430)
**Author:** [@Tianyi\_Mao](https://discuss.elastic.co/u/Tianyi_Mao)\ **Replies:** 0\ **Last updated:** [December 2, 2020, 11:25pm UTC](https://discuss.elastic.co/t/penalize-multiple-fuzzy-matches-from-one-word/257430 "2020-12-02T23:25:57Z")
Suppose I am doing a multi\_match query with "good brain", on the following documents: a good brain is so fun some rain on grain and brain drain brain brain brain brain By adjusting the k1 value of BM25 scoring, one can… --- ## [How To create a table in hive](https://discuss.elastic.co/t/how-to-create-a-table-in-hive/257310)
**Author:** [@irfangk1](https://discuss.elastic.co/u/irfangk1)\ **Replies:** 0\ **Last updated:** [December 2, 2020, 6:59am UTC](https://discuss.elastic.co/t/how-to-create-a-table-in-hive/257310 "2020-12-02T06:59:42Z")
Hi, I am trying to create a ext. table in hive as mention is Elsatic doc. i need to know what are the below properties are STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler' TBLPROPERTIES('es.resource' = 'radi… --- ## [NEST: Performing retries with a single node](https://discuss.elastic.co/t/nest-performing-retries-with-a-single-node/255373)
**Author:** [@knafve](https://discuss.elastic.co/u/knafve)\ **Replies:** 1\ **Last updated:** [December 2, 2020, 10:15pm UTC](https://discuss.elastic.co/t/nest-performing-retries-with-a-single-node/255373 "2020-12-02T22:15:43Z")
I am using NEST to perform queries towards an Elasticsearch 6-cluster. The Elasticsearch cluster consists of a couple of nodes, but it's running behind a firewall/loadbalancer so from the client perspective it appears as… --- ## [Enable sub feature rules for user & rules](https://discuss.elastic.co/t/enable-sub-feature-rules-for-user-rules/257334)
**Author:** [@tacohen](https://discuss.elastic.co/u/tacohen)\ **Replies:** 0\ **Last updated:** [December 2, 2020, 10:16am UTC](https://discuss.elastic.co/t/enable-sub-feature-rules-for-user-rules/257334 "2020-12-02T10:16:18Z")
Hi everyone, I need your help with user & rules. i have ELK 7.6 and I'm trying to understand how to define "sub feature rules" for Users. the idea is to enable "sub feature rules" like: "save queries" which required pri… --- ## [Access Elastic via .NET](https://discuss.elastic.co/t/access-elastic-via-net/257116)
**Author:** [@Amit5](https://discuss.elastic.co/u/Amit5)\ **Replies:** 1\ **Last updated:** [December 2, 2020, 10:11pm UTC](https://discuss.elastic.co/t/access-elastic-via-net/257116 "2020-12-02T22:11:54Z")
Hi everyone I need to query our elastic search and pull some data from it. I read about about couple of ways to to it. What I tried so far is to Use NEST to query elastic: var response = client.Get(10, idx =\> idx.Inde… --- ## [Elasticsearch service suddenly stop after few minutes started](https://discuss.elastic.co/t/elasticsearch-service-suddenly-stop-after-few-minutes-started/257146)
**Author:** [@Junedi\_Rajagukguk](https://discuss.elastic.co/u/Junedi_Rajagukguk)\ **Replies:** 10\ **Last updated:** [December 2, 2020, 10:10pm UTC](https://discuss.elastic.co/t/elasticsearch-service-suddenly-stop-after-few-minutes-started/257146 "2020-12-02T22:10:38Z")
HI, i built cluster elasticserach which is 1 master, 1 logstash, 1 elastic i found this error when i start elasticservice in logstash server. and actualy i have another problem, my index always reset every 2 days(some… --- ## [Using dot notation in POCO used with NEST search](https://discuss.elastic.co/t/using-dot-notation-in-poco-used-with-nest-search/257417)
**Author:** [@BkQc](https://discuss.elastic.co/u/BkQc)\ **Replies:** 0\ **Last updated:** [December 2, 2020, 9:05pm UTC](https://discuss.elastic.co/t/using-dot-notation-in-poco-used-with-nest-search/257417 "2020-12-02T21:05:07Z")
I have a type of entry in elastic that is made of some imbricated properties like { "\_source": { "pipeline\_version":1.7, "agent":{ "hostname":"MyServer", "id":"a1df2f4e-6d… --- ## [SSL/TLS failed to load, java.io.IOException: extra data given to DerValue constructor](https://discuss.elastic.co/t/ssl-tls-failed-to-load-java-io-ioexception-extra-data-given-to-dervalue-constructor/256711)
**Author:** [@ctan](https://discuss.elastic.co/u/ctan)\ **Replies:** 2\ **Last updated:** [December 2, 2020, 8:21pm UTC](https://discuss.elastic.co/t/ssl-tls-failed-to-load-java-io-ioexception-extra-data-given-to-dervalue-constructor/256711 "2020-12-02T20:21:28Z")
Hello! We are setting up our first Elasticsearch cluster and hit a problem with using our private CAs. I am able to get a cert and upload it, but every time I start elasticsearch I get errs around this: java.io.IOExcep… --- ## [How to reindex data after 7.10 update](https://discuss.elastic.co/t/how-to-reindex-data-after-7-10-update/257101)
**Author:** [@rgeisman](https://discuss.elastic.co/u/rgeisman)\ **Replies:** 2\ **Last updated:** [December 2, 2020, 6:15pm UTC](https://discuss.elastic.co/t/how-to-reindex-data-after-7-10-update/257101 "2020-12-02T18:15:41Z")
Hello all. We just completed our nice 7.10 update and I have read in the docs that it is necessary for us to reindex the data on ES after an upgrade. We are using 5 ES boxes and Logstash. Could someone point me to/pro… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=749) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=751)