# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=467 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 468 --- ## [Using the payload data (fields) after aggregated to bucket, in Elastic Watcher Action email](https://discuss.elastic.co/t/using-the-payload-data-fields-after-aggregated-to-bucket-in-elastic-watcher-action-email/300779)
**Author:** [@SararhHewage](https://discuss.elastic.co/u/SararhHewage)\ **Replies:** 3\ **Last updated:** [March 29, 2022, 12:08pm UTC](https://discuss.elastic.co/t/using-the-payload-data-fields-after-aggregated-to-bucket-in-elastic-watcher-action-email/300779 "2022-03-29T12:08:40Z")
HI, I am seeking some help to resolve an issue that I am having in one of my Elastic Watchers. First of all, I must say this is a complex Watcher. In our environment, we gather some log data from file transferring jobs… --- ## [Stop standard tokenizer from splitting on punctuations](https://discuss.elastic.co/t/stop-standard-tokenizer-from-splitting-on-punctuations/300951)
**Author:** [@Nipun\_Tulsyan](https://discuss.elastic.co/u/Nipun_Tulsyan)\ **Replies:** 0\ **Last updated:** [March 29, 2022, 11:28am UTC](https://discuss.elastic.co/t/stop-standard-tokenizer-from-splitting-on-punctuations/300951 "2022-03-29T11:28:00Z")
Hi We use the "standard" tokenizer in custom analyzer definitions. By default the standard tokenizer splits words on hyphens and ampersands, so for example "i-mac" is tokenized to "i" and "mac" Is there any way to co… --- ## [Filtering a Pivot Transform](https://discuss.elastic.co/t/filtering-a-pivot-transform/299371)
**Author:** [@iamtheschmitzer](https://discuss.elastic.co/u/iamtheschmitzer)\ **Replies:** 4\ **Last updated:** [March 29, 2022, 9:35am UTC](https://discuss.elastic.co/t/filtering-a-pivot-transform/299371 "2022-03-29T09:35:37Z")
I have a pivot transform that calculates a duration between two timestamped documents by grouping them, matching like documents, then aggregating the min timestamp, the max timestamp and using a script to calculate the d… --- ## [Elasticsearch index mapping?](https://discuss.elastic.co/t/elasticsearch-index-mapping/300926)
**Author:** [@AJITH](https://discuss.elastic.co/u/AJITH)\ **Replies:** 1\ **Last updated:** [March 29, 2022, 9:27am UTC](https://discuss.elastic.co/t/elasticsearch-index-mapping/300926 "2022-03-29T09:27:34Z")
i'm beginner of Elasticsearch i doing now a simple project for my training purpose , my project is user login system with fileuploading and search option, user can upload multiple textfiles on his account there is no l… --- ## [Finding document similarity by distance and visualising clusters](https://discuss.elastic.co/t/finding-document-similarity-by-distance-and-visualising-clusters/300939)
**Author:** [@sandydesu](https://discuss.elastic.co/u/sandydesu)\ **Replies:** 0\ **Last updated:** [March 29, 2022, 9:24am UTC](https://discuss.elastic.co/t/finding-document-similarity-by-distance-and-visualising-clusters/300939 "2022-03-29T09:24:06Z")
I'm new to the stack and learning as I go along so any help would be much appreciated. I have 9.5 million records of people, with formatted\_name, formatted\_address and formatted\_birthday as indexable fields in Elasticse… --- ## [Concurrent IndexSearch clarification](https://discuss.elastic.co/t/concurrent-indexsearch-clarification/300073)
**Author:** [@dlants](https://discuss.elastic.co/u/dlants)\ **Replies:** 0\ **Last updated:** [March 18, 2022, 4:51pm UTC](https://discuss.elastic.co/t/concurrent-indexsearch-clarification/300073 "2022-03-18T16:51:04Z")
This blog post describes concurrent query execution in Lucene (at the IndexSearcher level), and claims: Concurrent query execution is a surprisingly little known sleeper feature in Lucene, since it is not yet exposed i… --- ## [ES \[Get by document ID\] vs \[Search by terms\] returns different results](https://discuss.elastic.co/t/es-get-by-document-id-vs-search-by-terms-returns-different-results/300700)
**Author:** [@T-Muller-25](https://discuss.elastic.co/u/T-Muller-25)\ **Replies:** 0\ **Last updated:** [March 25, 2022, 1:26pm UTC](https://discuss.elastic.co/t/es-get-by-document-id-vs-search-by-terms-returns-different-results/300700 "2022-03-25T13:26:50Z")
Hi, From my understanding, there is no difference between the get by document id and search by terms but the performance. However, I just encountered a very strange issue. when I use: GET /my\_index/\_doc/1 --\> it retur… --- ## [Elasticsearch date range query for range on a date-time field](https://discuss.elastic.co/t/elasticsearch-date-range-query-for-range-on-a-date-time-field/300759)
**Author:** [@Shaiwal\_Sharma](https://discuss.elastic.co/u/Shaiwal_Sharma)\ **Replies:** 4\ **Last updated:** [March 29, 2022, 8:29am UTC](https://discuss.elastic.co/t/elasticsearch-date-range-query-for-range-on-a-date-time-field/300759 "2022-03-29T08:29:28Z")
I have to get records (training) wherein I have a start\_date, and I have to get all records that have not yet ended. So I don't have an end\_date field, but just the start date, so end\_date is start\_date + 60 days. So wha… --- ## [AND in SQL query is translated to nested bool](https://discuss.elastic.co/t/and-in-sql-query-is-translated-to-nested-bool/300923)
**Author:** [@avnere](https://discuss.elastic.co/u/avnere)\ **Replies:** 0\ **Last updated:** [March 29, 2022, 8:15am UTC](https://discuss.elastic.co/t/and-in-sql-query-is-translated-to-nested-bool/300923 "2022-03-29T08:15:35Z")
Hi, When I translate the following to DSL I see multiple nested bool instead one bool that contains all the conditions. Can I control it? GET \_sql/translate { "query": """ SELECT \* FROM "base" WHERE "Id" = '62… --- ## [Trying to include tensorflow library in my ES plugin and getting the following error](https://discuss.elastic.co/t/trying-to-include-tensorflow-library-in-my-es-plugin-and-getting-the-following-error/300735)
**Author:** [@ashwin91kumar](https://discuss.elastic.co/u/ashwin91kumar)\ **Replies:** 3\ **Last updated:** [March 29, 2022, 8:13am UTC](https://discuss.elastic.co/t/trying-to-include-tensorflow-library-in-my-es-plugin-and-getting-the-following-error/300735 "2022-03-29T08:13:59Z")
\#8 6.878 -\> Rolled back file:///plugins/plugin.zip #8 6.878 Exception in thread "main" java.lang.IllegalStateException: codebase property already set: codebase.tensorflow-core-api -\> file:/usr/share/elasticsearch/plugins… --- ## [Frequent timeout when using elasticsearch-py 8.1.0](https://discuss.elastic.co/t/frequent-timeout-when-using-elasticsearch-py-8-1-0/300831)
**Author:** [@Dheeraj\_Gupta](https://discuss.elastic.co/u/Dheeraj_Gupta)\ **Replies:** 1\ **Last updated:** [March 29, 2022, 7:51am UTC](https://discuss.elastic.co/t/frequent-timeout-when-using-elasticsearch-py-8-1-0/300831 "2022-03-29T07:51:23Z")
We have recently upgraded our Elasticsearch to 8.1.0. We have a some Python scripts which perform some searching/computations on data in the Elasticsearch cluster which use elasticsearch-py. Due to systems loads, during… --- ## [First time with grok](https://discuss.elastic.co/t/first-time-with-grok/300867)
**Author:** [@fabek.75](https://discuss.elastic.co/u/fabek.75)\ **Replies:** 2\ **Last updated:** [March 29, 2022, 7:43am UTC](https://discuss.elastic.co/t/first-time-with-grok/300867 "2022-03-29T07:43:10Z")
Hi there. I'm trying to use grok for the first time to parse a line log like this: Mar 15 10:45:13 myapp.com myapp: \[Info\] \<99999999999999\> /path/path1: \[10.255.255.255:99999\] POST /our\_queue/worker/import? 204 In th… --- ## [Why Elasticsearch new version appending -000001 for index name](https://discuss.elastic.co/t/why-elasticsearch-new-version-appending-000001-for-index-name/300808)
**Author:** [@Prashant\_Kamble](https://discuss.elastic.co/u/Prashant_Kamble)\ **Replies:** 6\ **Last updated:** [March 29, 2022, 5:37am UTC](https://discuss.elastic.co/t/why-elasticsearch-new-version-appending-000001-for-index-name/300808 "2022-03-29T05:37:49Z")
We are getting index name appended with -000001 for index name. Just wanted to understand why Elasticsearch appending this value for index name in elastcsearch cluster 7.10? What is the significance of it? --- ## [ELK Product Upgrade](https://discuss.elastic.co/t/elk-product-upgrade/300905)
**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\ **Replies:** 1\ **Last updated:** [March 29, 2022, 4:46am UTC](https://discuss.elastic.co/t/elk-product-upgrade/300905 "2022-03-29T04:46:03Z")
Hi We are using Out of the box Logstash, Elasticsearch and customized Kibana. All are in 7.10.2 . We are in process in upgrade. In case upgrade delayed till May 2022 which will be EOL for 7.10.2, do we have any function… --- ## [Centralized management and monitoring of clusters](https://discuss.elastic.co/t/centralized-management-and-monitoring-of-clusters/300903)
**Author:** [@Atul\_Chadha](https://discuss.elastic.co/u/Atul_Chadha)\ **Replies:** 1\ **Last updated:** [March 29, 2022, 2:11am UTC](https://discuss.elastic.co/t/centralized-management-and-monitoring-of-clusters/300903 "2022-03-29T02:11:39Z")
Is there a way to manage and monitor various cluster across different Data centers in version 7.x ? Specific need is to manage x-pack users from one location across different clusters. --- ## [Pokémon - match\_phrase fails with edge\_ngram & asciifolding](https://discuss.elastic.co/t/pokemon-match-phrase-fails-with-edge-ngram-asciifolding/300901)
**Author:** [@omikron](https://discuss.elastic.co/u/omikron)\ **Replies:** 0\ **Last updated:** [March 29, 2022, 1:40am UTC](https://discuss.elastic.co/t/pokemon-match-phrase-fails-with-edge-ngram-asciifolding/300901 "2022-03-29T01:40:34Z")
Hi, I am having an issue with the match\_phrase query against the field with the edge\_ngram tokenizer and asciifolding filter (Elasticsearch v7.7). The field is: "mainTitle": { "type": "text", "fields": { "autocomp… --- ## [Failed to update snapshot in repository](https://discuss.elastic.co/t/failed-to-update-snapshot-in-repository/300879)
**Author:** [@alicango](https://discuss.elastic.co/u/alicango)\ **Replies:** 0\ **Last updated:** [March 28, 2022, 5:06pm UTC](https://discuss.elastic.co/t/failed-to-update-snapshot-in-repository/300879 "2022-03-28T17:06:01Z")
I have a cluster that has 3 masters, 2 hot, 2 warms, 2 colds nodes. I am trying to take a snapshot but I got this error; "type": "snapshot\_exception", "reason": "\[cul-backup:cul-snap-2022.03.28-xxxxxxxxx/xxxxxxxxxx\] f… --- ## [Validating Rollup index](https://discuss.elastic.co/t/validating-rollup-index/300799)
**Author:** [@b-v](https://discuss.elastic.co/u/b-v)\ **Replies:** 3\ **Last updated:** [March 28, 2022, 10:26pm UTC](https://discuss.elastic.co/t/validating-rollup-index/300799 "2022-03-28T22:26:41Z")
How to validate if the rolled up index has all the data from the source index. I have a rollup job scheduled to run everyday. I will be deleting the source index after the rollup schedule is done, I want to know if the r… --- ## [Elasticsearch query](https://discuss.elastic.co/t/elasticsearch-query/300708)
**Author:** [@chrisml](https://discuss.elastic.co/u/chrisml)\ **Replies:** 3\ **Last updated:** [March 28, 2022, 8:41pm UTC](https://discuss.elastic.co/t/elasticsearch-query/300708 "2022-03-28T20:41:24Z")
Could anyone shed any light on the nested bool should/musts here? Is it necessary or just poorly written? (the query is generated, depending on user-input) --- ## [How to build an Elasticsearch query that will take into account the distance between words?](https://discuss.elastic.co/t/how-to-build-an-elasticsearch-query-that-will-take-into-account-the-distance-between-words/300886)
**Author:** [@asil](https://discuss.elastic.co/u/asil)\ **Replies:** 1\ **Last updated:** [March 28, 2022, 8:14pm UTC](https://discuss.elastic.co/t/how-to-build-an-elasticsearch-query-that-will-take-into-account-the-distance-between-words/300886 "2022-03-28T20:14:16Z")
I'm running with elasticsearch:7.6.2 I have an index with 4 simple documents: PUT demo\_idx/\_doc/1 { "content": "Distributed nature, simple REST APIs, speed, and scalability, Elasticsearch is the central c… --- ## [Is it possible to auto increment documents as they are indexed?](https://discuss.elastic.co/t/is-it-possible-to-auto-increment-documents-as-they-are-indexed/300887)
**Author:** [@Matthew\_Dominic\_Ramp](https://discuss.elastic.co/u/Matthew_Dominic_Ramp)\ **Replies:** 1\ **Last updated:** [March 28, 2022, 7:56pm UTC](https://discuss.elastic.co/t/is-it-possible-to-auto-increment-documents-as-they-are-indexed/300887 "2022-03-28T19:56:48Z")
Context: I am using the bulk API to index several documents into an index I would like to auto increment a field, 'y', present in the documents, which would tally the order in which documents are indexed. (I know i… --- ## [Saved field "logdate" of data view "app\*" is invalid for use with the "Date Histogram" aggregation](https://discuss.elastic.co/t/saved-field-logdate-of-data-view-app-is-invalid-for-use-with-the-date-histogram-aggregation/300868)
**Author:** [@userR](https://discuss.elastic.co/u/userR)\ **Replies:** 1\ **Last updated:** [March 28, 2022, 3:48pm UTC](https://discuss.elastic.co/t/saved-field-logdate-of-data-view-app-is-invalid-for-use-with-the-date-histogram-aggregation/300868 "2022-03-28T15:48:20Z")
Recently, we upgraded our production machine which meant I would have to re-deploy Filebeat on this new server. All the log paths and log formats are the same, however, for whatever reason, it is having an issue with log… --- ## [Wildcard conflicting](https://discuss.elastic.co/t/wildcard-conflicting/300870)
**Author:** [@OlivierC](https://discuss.elastic.co/u/OlivierC)\ **Replies:** 0\ **Last updated:** [March 28, 2022, 3:44pm UTC](https://discuss.elastic.co/t/wildcard-conflicting/300870 "2022-03-28T15:44:50Z")
Hello, I try to find a query for something looking easy for a human, but I can't create it with ES. Let's imagine we have an index named words with a few data: PUT words/\_doc/1 { "name": "elastic" } PUT words/\_doc/2… --- ## [Elasticsearch not able to search string contains special character](https://discuss.elastic.co/t/elasticsearch-not-able-to-search-string-contains-special-character/300866)
**Author:** [@Koushik\_Chatterjee](https://discuss.elastic.co/u/Koushik_Chatterjee)\ **Replies:** 1\ **Last updated:** [March 28, 2022, 3:35pm UTC](https://discuss.elastic.co/t/elasticsearch-not-able-to-search-string-contains-special-character/300866 "2022-03-28T15:35:01Z")
I am developing an web application where I'm using Elasticsearch. I'm trying to search strings contains - or @ eg. email address koushik@testmail.com, but it's not working. Other fields like first name, last name etc. wo… --- ## [I create user login system with file uploading , and user can upload unlimited textfiles and search word, how to create and mapping index this case?](https://discuss.elastic.co/t/i-create-user-login-system-with-file-uploading-and-user-can-upload-unlimited-textfiles-and-search-word-how-to-create-and-mapping-index-this-case/300835)
**Author:** [@AJITH](https://discuss.elastic.co/u/AJITH)\ **Replies:** 13\ **Last updated:** [March 28, 2022, 3:15pm UTC](https://discuss.elastic.co/t/i-create-user-login-system-with-file-uploading-and-user-can-upload-unlimited-textfiles-and-search-word-how-to-create-and-mapping-index-this-case/300835 "2022-03-28T15:15:05Z")
--- ## [How to upload textfile to ESdatabase and make it searchable?](https://discuss.elastic.co/t/how-to-upload-textfile-to-esdatabase-and-make-it-searchable/300855)
**Author:** [@AJITH](https://discuss.elastic.co/u/AJITH)\ **Replies:** 2\ **Last updated:** [March 28, 2022, 3:13pm UTC](https://discuss.elastic.co/t/how-to-upload-textfile-to-esdatabase-and-make-it-searchable/300855 "2022-03-28T15:13:51Z")
i try to upload textfile to ES database, i try convert textfile to String formate and then store. i dont know is it proper way? or any other way is available in ES for store textfiles and make it searchable? --- ## [Search scroll high off-heap memory usage](https://discuss.elastic.co/t/search-scroll-high-off-heap-memory-usage/300812)
**Author:** [@ebuildy](https://discuss.elastic.co/u/ebuildy)\ **Replies:** 3\ **Last updated:** [March 28, 2022, 1:48pm UTC](https://discuss.elastic.co/t/search-scroll-high-off-heap-memory-usage/300812 "2022-03-28T13:48:30Z")
Cluster: Elasticsearch v7.17.1 running with elastic docker image on kubernetes 6 data nodes: 4 CPUs / 14 Go HEAP / 28 Go memory Indice: 3 primary shards (+ 1 replica) , 60 Go data Usage: nightly full index export, w… --- ## [Elasticsearch Hadoop - Analyzer support](https://discuss.elastic.co/t/elasticsearch-hadoop-analyzer-support/300404)
**Author:** [@Shalini\_Pereira](https://discuss.elastic.co/u/Shalini_Pereira)\ **Replies:** 3\ **Last updated:** [March 28, 2022, 1:14pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-analyzer-support/300404 "2022-03-28T13:14:31Z")
Does es-hadoop maven dependency have support for built-in analyzers? I am setting up a project to read & write data from Elasticsearch using spark and have created simple analyzers on index but need more help on this fu… --- ## [Connection timed out when remote cluster re-indexing](https://discuss.elastic.co/t/connection-timed-out-when-remote-cluster-re-indexing/300694)
**Author:** [@Prashant\_Kamble](https://discuss.elastic.co/u/Prashant_Kamble)\ **Replies:** 13\ **Last updated:** [March 28, 2022, 1:02pm UTC](https://discuss.elastic.co/t/connection-timed-out-when-remote-cluster-re-indexing/300694 "2022-03-28T13:02:46Z")
Getting Connection timed out error while re-indexing data from old cluster to new cluster. curl: (28) Failed to connect to elasticsearchurl port 9200: Connection timed out We are using curl command like this curl -… --- ## [Remote reindex ElasticSearch API giving Null Pointer Exception](https://discuss.elastic.co/t/remote-reindex-elasticsearch-api-giving-null-pointer-exception/300843)
**Author:** [@Prashant\_Kamble](https://discuss.elastic.co/u/Prashant_Kamble)\ **Replies:** 1\ **Last updated:** [March 28, 2022, 1:01pm UTC](https://discuss.elastic.co/t/remote-reindex-elasticsearch-api-giving-null-pointer-exception/300843 "2022-03-28T13:01:09Z")
Remote reindex Elasticsearch API giving Null Pointer Exception GET ..../tasks/{taskid} ------ ----- "error" : { "type" : "null\_pointer\_exception", "reason" : null } Can someone know what could be the cause… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=466) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=468)