# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=725 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 726 --- ## [How can I sync an entire dynamodb table with Elasticsearch?](https://discuss.elastic.co/t/how-can-i-sync-an-entire-dynamodb-table-with-elasticsearch/261063)
**Author:** [@marcosvrrs](https://discuss.elastic.co/u/marcosvrrs)\ **Replies:** 3\ **Last updated:** [January 14, 2021, 1:35pm UTC](https://discuss.elastic.co/t/how-can-i-sync-an-entire-dynamodb-table-with-elasticsearch/261063 "2021-01-14T13:35:48Z")
Hi all, I am having trouble to connect ES to dynamodb. Today I use a python lambda (serverless) to send every dynamodb change (update, delete, modify) to the Elasticsearch clusters. But we want to be able to reindex old… --- ## [How to extract out a index worth of data to read](https://discuss.elastic.co/t/how-to-extract-out-a-index-worth-of-data-to-read/261117)
**Author:** [@Sampson\_Light](https://discuss.elastic.co/u/Sampson_Light)\ **Replies:** 0\ **Last updated:** [January 14, 2021, 11:59am UTC](https://discuss.elastic.co/t/how-to-extract-out-a-index-worth-of-data-to-read/261117 "2021-01-14T11:59:43Z")
Hi All, So my current elastic search setup is configured to receive records in monthly indexes. Typically, to view a record of a specific condition, all I would need to do is to input some filter conditions through ela… --- ## [How to prevent autmatically type conversion in elasticsearch](https://discuss.elastic.co/t/how-to-prevent-autmatically-type-conversion-in-elasticsearch/260999)
**Author:** [@Vahid\_Alizadeh](https://discuss.elastic.co/u/Vahid_Alizadeh)\ **Replies:** 2\ **Last updated:** [January 14, 2021, 7:19am UTC](https://discuss.elastic.co/t/how-to-prevent-autmatically-type-conversion-in-elasticsearch/260999 "2021-01-14T07:19:50Z")
hi, i use filebeat to send tomcat accesslog to logstash and after that send from logstash to elasticsearch, my data has a field with name logDate, i convert it to string in filebeat and logstash but its type in elastic… --- ## [How to tun two ES nodes on same server on two diffrent cluster](https://discuss.elastic.co/t/how-to-tun-two-es-nodes-on-same-server-on-two-diffrent-cluster/260983)
**Author:** [@mrunalini](https://discuss.elastic.co/u/mrunalini)\ **Replies:** 2\ **Last updated:** [January 14, 2021, 11:44am UTC](https://discuss.elastic.co/t/how-to-tun-two-es-nodes-on-same-server-on-two-diffrent-cluster/260983 "2021-01-14T11:44:21Z")
HI , We need to migrate one of the node from one ES cluster1 to ES clsuter2 without any data loss during the process , so we are trying to execute one more instance of elasticsearch on same node with cluster.name as cl… --- ## [Best Practices for templates created for Indexing?](https://discuss.elastic.co/t/best-practices-for-templates-created-for-indexing/260301)
**Author:** [@mohamed.farhan](https://discuss.elastic.co/u/mohamed.farhan)\ **Replies:** 4\ **Last updated:** [January 14, 2021, 11:18am UTC](https://discuss.elastic.co/t/best-practices-for-templates-created-for-indexing/260301 "2021-01-14T11:18:53Z")
Hello, Can anyone would let me know if there are best practices for creating templates for indices? --- ## [Filebeat -\> logstash -\> elastic -\> kibana succesfully connected each other .But i dont see any log from filebeat in kibana view. Also index created in elasticsearch when filebeat connected](https://discuss.elastic.co/t/filebeat-logstash-elastic-kibana-succesfully-connected-each-other-but-i-dont-see-any-log-from-filebeat-in-kibana-view-also-index-created-in-elasticsearch-when-filebeat-connected/261114)
**Author:** [@Seymur855](https://discuss.elastic.co/u/Seymur855)\ **Replies:** 0\ **Last updated:** [January 14, 2021, 10:59am UTC](https://discuss.elastic.co/t/filebeat-logstash-elastic-kibana-succesfully-connected-each-other-but-i-dont-see-any-log-from-filebeat-in-kibana-view-also-index-created-in-elasticsearch-when-filebeat-connected/261114 "2021-01-14T10:59:23Z")
ElasticSearch version :7.5.2 Kibana version : 7.5.2 Filebeat version: 7.6.0 Logstash version:7.10.1 filebeat.yml filebeat.inputs: type: log enabled: true paths: C:\\ELASTIC\_KIBANA\\filebeat-7.6.0-windows-x86\_64\\lo… --- ## [Hyphenation\_decompounder tokens do not consider "Operator" in multi-match query](https://discuss.elastic.co/t/hyphenation-decompounder-tokens-do-not-consider-operator-in-multi-match-query/261102)
**Author:** [@wn1099](https://discuss.elastic.co/u/wn1099)\ **Replies:** 0\ **Last updated:** [January 14, 2021, 10:10am UTC](https://discuss.elastic.co/t/hyphenation-decompounder-tokens-do-not-consider-operator-in-multi-match-query/261102 "2021-01-14T10:10:49Z")
Hi, I used hyphenation\_decompounder(https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-hyp-decomp-tokenfilter.html) for German language and followed the example as mentioned in the documentation. S… --- ## [Bootstrap check failed in es 7.10.1](https://discuss.elastic.co/t/bootstrap-check-failed-in-es-7-10-1/261080)
**Author:** [@f4ct0r](https://discuss.elastic.co/u/f4ct0r)\ **Replies:** 4\ **Last updated:** [January 14, 2021, 9:38am UTC](https://discuss.elastic.co/t/bootstrap-check-failed-in-es-7-10-1/261080 "2021-01-14T09:38:04Z")
Hey guys, I'm using kubernetes to deploy Elasticsearch 7.10.1. at first, my elasticsearch cluster running perfect. but when i restart the pods of elasticsearch, the elasticsearch cluster going error: ERROR: \[1\] bootst… --- ## [Logging in an ElasticSearch plugin](https://discuss.elastic.co/t/logging-in-an-elasticsearch-plugin/261097)
**Author:** [@coreation](https://discuss.elastic.co/u/coreation)\ **Replies:** 0\ **Last updated:** [January 14, 2021, 9:28am UTC](https://discuss.elastic.co/t/logging-in-an-elasticsearch-plugin/261097 "2021-01-14T09:28:18Z")
Hello everyone, I'm working on a simple ElasticSearch plugin that computes a score for a document. What I would love to do is to be able to debug the plugin so that I can write to the standard output which document is b… --- ## [Using Elasticsearch in intergration test](https://discuss.elastic.co/t/using-elasticsearch-in-intergration-test/260742)
**Author:** [@mojtaba\_safavi](https://discuss.elastic.co/u/mojtaba_safavi)\ **Replies:** 2\ **Last updated:** [January 14, 2021, 9:06am UTC](https://discuss.elastic.co/t/using-elasticsearch-in-intergration-test/260742 "2021-01-14T09:06:58Z")
I want elasticsearch in memorydb for Integration test in .net platform. same as other db in memorydb. --- ## [How to get splited tokens of query、 best matched document and those document's term vector at the same time when searching in elasticsearch](https://discuss.elastic.co/t/how-to-get-splited-tokens-of-query-best-matched-document-and-those-documents-term-vector-at-the-same-time-when-searching-in-elasticsearch/261094)
**Author:** [@Shiwei\_Zhang](https://discuss.elastic.co/u/Shiwei_Zhang)\ **Replies:** 0\ **Last updated:** [January 14, 2021, 8:43am UTC](https://discuss.elastic.co/t/how-to-get-splited-tokens-of-query-best-matched-document-and-those-documents-term-vector-at-the-same-time-when-searching-in-elasticsearch/261094 "2021-01-14T08:43:56Z")
I want to recalculate the score according to the tf and idf according to the term\_vector from elasticsearch, so I need : query's tokens splitted by analyzer(i use ik\_max\_word) of elasticsearch best matched document id t… --- ## [Range query on integer fields](https://discuss.elastic.co/t/range-query-on-integer-fields/261089)
**Author:** [@Jogi\_Michal](https://discuss.elastic.co/u/Jogi_Michal)\ **Replies:** 0\ **Last updated:** [January 14, 2021, 8:06am UTC](https://discuss.elastic.co/t/range-query-on-integer-fields/261089 "2021-01-14T08:06:43Z")
Hi all, My mapping: { 'doc': { 'sources': { 'properties': { 'depth': { 'type': 'integer' } } … --- ## [Disable Elastic Cloud Login](https://discuss.elastic.co/t/disable-elastic-cloud-login/260967)
**Author:** [@apox](https://discuss.elastic.co/u/apox)\ **Replies:** 2\ **Last updated:** [January 14, 2021, 7:04am UTC](https://discuss.elastic.co/t/disable-elastic-cloud-login/260967 "2021-01-14T07:04:00Z")
Hi Guy, How can I disable the Elastic Cloud Login in Kibana and use online the Elasticsearch Login? --- ## [What will be the mapping and DSL for creating a organisation employee profile user with maximum upload of 3 photos for storing and searching his photos please of image with timestamp](https://discuss.elastic.co/t/what-will-be-the-mapping-and-dsl-for-creating-a-organisation-employee-profile-user-with-maximum-upload-of-3-photos-for-storing-and-searching-his-photos-please-of-image-with-timestamp/260427)
**Author:** [@rajends1](https://discuss.elastic.co/u/rajends1)\ **Replies:** 11\ **Last updated:** [January 14, 2021, 6:05am UTC](https://discuss.elastic.co/t/what-will-be-the-mapping-and-dsl-for-creating-a-organisation-employee-profile-user-with-maximum-upload-of-3-photos-for-storing-and-searching-his-photos-please-of-image-with-timestamp/260427 "2021-01-14T06:05:43Z")
A.What will be the mapping and DSL query structure example for creating a organisation employee profile user with maximum upload of n photo limit with image size nMb and x height , y width for storing and searching h… --- ## [User Authentication/Lockout mechanism](https://discuss.elastic.co/t/user-authentication-lockout-mechanism/260980)
**Author:** [@Boopathi\_Raj](https://discuss.elastic.co/u/Boopathi_Raj)\ **Replies:** 2\ **Last updated:** [January 14, 2021, 3:44am UTC](https://discuss.elastic.co/t/user-authentication-lockout-mechanism/260980 "2021-01-14T03:44:41Z")
Hi Team, We want to implement the following user Authentication mechanism for Elastic/Kibana users. Lockout after 6 invalid tries Lockout for a minimum of 30 mins or until administrator enables the account ( After Loc… --- ## [CountRequest does not carry over default index for ElasticSearch 7.10.1](https://discuss.elastic.co/t/countrequest-does-not-carry-over-default-index-for-elasticsearch-7-10-1/261067)
**Author:** [@honelight](https://discuss.elastic.co/u/honelight)\ **Replies:** 0\ **Last updated:** [January 14, 2021, 1:11am UTC](https://discuss.elastic.co/t/countrequest-does-not-carry-over-default-index-for-elasticsearch-7-10-1/261067 "2021-01-14T01:11:31Z")
Hi: I am fairly new to the NEST Library. I am using both the Count function and the Search function, below is some sample code I wrote to recreate the issue: using System; using Nest; namespace NestCountTe… --- ## [Overriding Builtin Datastream Index / Component Templates](https://discuss.elastic.co/t/overriding-builtin-datastream-index-component-templates/259744)
**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\ **Replies:** 15\ **Last updated:** [January 13, 2021, 10:59pm UTC](https://discuss.elastic.co/t/overriding-builtin-datastream-index-component-templates/259744 "2021-01-13T22:59:06Z")
Hello, With legacy index templates, in order to add extra fields without risk that an Elastic update would ovverwrite changes, we created override templates with a higher order which contained extra fields settings etc. … --- ## [DateRangeQuery with NEST results with server error 400 - "all shards failed"](https://discuss.elastic.co/t/daterangequery-with-nest-results-with-server-error-400-all-shards-failed/261059)
**Author:** [@Izzy](https://discuss.elastic.co/u/Izzy)\ **Replies:** 1\ **Last updated:** [January 13, 2021, 10:40pm UTC](https://discuss.elastic.co/t/daterangequery-with-nest-results-with-server-error-400-all-shards-failed/261059 "2021-01-13T22:40:07Z")
I'm using NEST client on my .NET Core 3.1 (C#) application. I'm trying to write a search query by using QueryContainer. So far, search is working fine with textual fields, but when I'm trying to search according to Dat… --- ## [Is there a way to evaluate an expression and get the result?](https://discuss.elastic.co/t/is-there-a-way-to-evaluate-an-expression-and-get-the-result/260986)
**Author:** [@AgrPriyank](https://discuss.elastic.co/u/AgrPriyank)\ **Replies:** 0\ **Last updated:** [January 13, 2021, 11:31am UTC](https://discuss.elastic.co/t/is-there-a-way-to-evaluate-an-expression-and-get-the-result/260986 "2021-01-13T11:31:06Z")
I have multiple nodes scattered around different regions. My application is deployed region wise, i.e. the application present in region A will only talk to resources in region A. However, in order to provide high avail… --- ## [Connecting to ElasticSearch via JavaAPI is slow on the first hit](https://discuss.elastic.co/t/connecting-to-elasticsearch-via-javaapi-is-slow-on-the-first-hit/260997)
**Author:** [@pcvijayvignesh](https://discuss.elastic.co/u/pcvijayvignesh)\ **Replies:** 0\ **Last updated:** [January 13, 2021, 12:34pm UTC](https://discuss.elastic.co/t/connecting-to-elasticsearch-via-javaapi-is-slow-on-the-first-hit/260997 "2021-01-13T12:34:40Z")
I have a Java server running on one of our on-premise servers and it will connect to Elastic server hosted in AWS. Whenever a request is made from the Java application it will connect to elastic with the below piece of … --- ## [Inges pipeline - KV processor not working with foreach](https://discuss.elastic.co/t/inges-pipeline-kv-processor-not-working-with-foreach/261060)
**Author:** [@Minor\_Vargas](https://discuss.elastic.co/u/Minor_Vargas)\ **Replies:** 0\ **Last updated:** [January 13, 2021, 10:01pm UTC](https://discuss.elastic.co/t/inges-pipeline-kv-processor-not-working-with-foreach/261060 "2021-01-13T22:01:32Z")
hello guys! I'm using an ingest pipeline. I'm using the foreach processor and inside of it the kv processor but it's not really working.. Having the following array (made after using the split processor) "detail" : \[ … --- ## [Upgrading from 5.6 to 7.5.0 -\> What problems could I face on the query/aggregation side and indexing side](https://discuss.elastic.co/t/upgrading-from-5-6-to-7-5-0-what-problems-could-i-face-on-the-query-aggregation-side-and-indexing-side/261054)
**Author:** [@JonathanAaron](https://discuss.elastic.co/u/JonathanAaron)\ **Replies:** 0\ **Last updated:** [January 13, 2021, 9:29pm UTC](https://discuss.elastic.co/t/upgrading-from-5-6-to-7-5-0-what-problems-could-i-face-on-the-query-aggregation-side-and-indexing-side/261054 "2021-01-13T21:29:23Z")
We do basic bool/must type queries based a couple of fields and several nested terms aggregations with some sum aggs. On the indexing side of things we're going with bulk indexing. My team is getting a new cluster set … --- ## [Index.lifecycle.rollover\_alias \[filebeat-7.9.1\] does not point to index \[filebeat-7.9.1-2020.09.30\]](https://discuss.elastic.co/t/index-lifecycle-rollover-alias-filebeat-7-9-1-does-not-point-to-index-filebeat-7-9-1-2020-09-30/259798)
**Author:** [@NaiaraSS](https://discuss.elastic.co/u/NaiaraSS)\ **Replies:** 6\ **Last updated:** [January 13, 2021, 9:25pm UTC](https://discuss.elastic.co/t/index-lifecycle-rollover-alias-filebeat-7-9-1-does-not-point-to-index-filebeat-7-9-1-2020-09-30/259798 "2021-01-13T21:25:28Z")
Hi everyone! I was balancing my nodes, and after i get sucessfull i needed to improve my storeage, after i finish this procedure, i got this error in node master: \[ERROR\]\[o.e.b.ElasticsearchUncaughtExceptionHandler\] \[n… --- ## [Match query with best match at top](https://discuss.elastic.co/t/match-query-with-best-match-at-top/261036)
**Author:** [@Padam\_Sethia](https://discuss.elastic.co/u/Padam_Sethia)\ **Replies:** 0\ **Last updated:** [January 13, 2021, 6:46pm UTC](https://discuss.elastic.co/t/match-query-with-best-match-at-top/261036 "2021-01-13T18:46:30Z")
Hello , I am having real difficulty getting best matches at top. Here's a sample of my document { "\_index": "finished\_goods", "\_type": "\_doc", "\_id": "1", "\_score": 1, … --- ## [Unified Highlighter throws too\_complex\_to\_determinize\_exception with \>288 filter terms](https://discuss.elastic.co/t/unified-highlighter-throws-too-complex-to-determinize-exception-with-288-filter-terms/261035)
**Author:** [@idoub](https://discuss.elastic.co/u/idoub)\ **Replies:** 0\ **Last updated:** [January 13, 2021, 6:35pm UTC](https://discuss.elastic.co/t/unified-highlighter-throws-too-complex-to-determinize-exception-with-288-filter-terms/261035 "2021-01-13T18:35:04Z")
There seems to be a problem with the Unified Highlighter in Lucene 8.6.2 that is affecting ElasticSearch 7.9.1. I already asked the Lucene developers if they knew of the bug and they said it's an ElasticSearch specific i… --- ## [Elasticsearch service not accessible from external system](https://discuss.elastic.co/t/elasticsearch-service-not-accessible-from-external-system/260892)
**Author:** [@umesh2020](https://discuss.elastic.co/u/umesh2020)\ **Replies:** 2\ **Last updated:** [January 13, 2021, 5:12pm UTC](https://discuss.elastic.co/t/elasticsearch-service-not-accessible-from-external-system/260892 "2021-01-13T17:12:49Z")
I have installed elasticsearch on CentOS and trying to start the service in a single-node mode. I see that the service is bound properly at 10.100.1.197. However, when I execute the command http://10.100.1.197:9200, … --- ## [Data Correction](https://discuss.elastic.co/t/data-correction/260256)
**Author:** [@stevezemlicka](https://discuss.elastic.co/u/stevezemlicka)\ **Replies:** 6\ **Last updated:** [January 13, 2021, 4:55pm UTC](https://discuss.elastic.co/t/data-correction/260256 "2021-01-13T16:55:26Z")
I have an index that is comprised of two separate data dumps. Upon further analysis, it was discovered that one of those seems to have had a 1hr shift. This has been partially rectified by using offsets with the visual… --- ## [\[Population Job\]: port scanner](https://discuss.elastic.co/t/population-job-port-scanner/260870)
**Author:** [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\ **Replies:** 2\ **Last updated:** [January 13, 2021, 4:51pm UTC](https://discuss.elastic.co/t/population-job-port-scanner/260870 "2021-01-13T16:51:23Z")
Hello everybody, I would like to create a machine learning job to detect port scanner so I have configured my job like that: Job Type: Population Population field: destination.ip Add metric: Distinct count(destinati… --- ## [Can't Access a Watcher Payload Object in Action Condition](https://discuss.elastic.co/t/cant-access-a-watcher-payload-object-in-action-condition/261022)
**Author:** [@esguy](https://discuss.elastic.co/u/esguy)\ **Replies:** 0\ **Last updated:** [January 13, 2021, 4:22pm UTC](https://discuss.elastic.co/t/cant-access-a-watcher-payload-object-in-action-condition/261022 "2021-01-13T16:22:24Z")
I'm attempting to set up a condition for an action using an attribute of the current watch payload. The watch payload is defined as the following in a script transform: return \[ 'table': lessRows.stream().… --- ## [How to re-run failed batch updates](https://discuss.elastic.co/t/how-to-re-run-failed-batch-updates/259695)
**Author:** [@Oleg\_Ruchovets](https://discuss.elastic.co/u/Oleg_Ruchovets)\ **Replies:** 1\ **Last updated:** [January 13, 2021, 4:12pm UTC](https://discuss.elastic.co/t/how-to-re-run-failed-batch-updates/259695 "2021-01-13T16:12:45Z")
Hello, I am running a heavy load on elastic using bulk-update. esrally --pipeline=benchmark-only --track=eventdata --track-repository=eventdata --challenge=bulk-update --track-params=bulk\_size:30000,bulk\_indexing\_client… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=724) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=726)