# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=908 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 909 --- ## [Counting users that returned to the website](https://discuss.elastic.co/t/counting-users-that-returned-to-the-website/234454)
**Author:** [@sanjaysubramanian](https://discuss.elastic.co/u/sanjaysubramanian)\ **Replies:** 4\ **Last updated:** [May 27, 2020, 6:00pm UTC](https://discuss.elastic.co/t/counting-users-that-returned-to-the-website/234454 "2020-05-27T18:00:52Z")
The following is a simplified look at our mappings in Elastic search { "mappings" : { "properties": { "userid": { "type": "keyword" }, "yyyy\_mm\_dd": { "type": "date", … --- ## [Java process hangs during BulkRequestProcessor add - Waiting for Semaphore](https://discuss.elastic.co/t/java-process-hangs-during-bulkrequestprocessor-add-waiting-for-semaphore/233798)
**Author:** [@Thales\_Valias](https://discuss.elastic.co/u/Thales_Valias)\ **Replies:** 4\ **Last updated:** [May 27, 2020, 5:54pm UTC](https://discuss.elastic.co/t/java-process-hangs-during-bulkrequestprocessor-add-waiting-for-semaphore/233798 "2020-05-27T17:54:48Z")
Context We have a Java application with embedded Elasticsearch 6.0.0. We make use of ES Bulk Request Processor to get tons of documents loaded into our (single) index. The Problem So far so good, except in cases where… --- ## [Shards keep re-initializing](https://discuss.elastic.co/t/shards-keep-re-initializing/233968)
**Author:** [@reshippie](https://discuss.elastic.co/u/reshippie)\ **Replies:** 7\ **Last updated:** [May 27, 2020, 5:39pm UTC](https://discuss.elastic.co/t/shards-keep-re-initializing/233968 "2020-05-27T17:39:39Z")
I've got a 7 node cluster, each node has 64GB of RAM, 2x XEON E5-2623v4 CPUs(16 Threads) and 12TB of SSD in RAID6. It's hosting 56.63TB of data across 187 Indices and 2,346 shards. Elasticsearch v6.8.3 behind Graylog. … --- ## [Must\_not boolean query in 7.7](https://discuss.elastic.co/t/must-not-boolean-query-in-7-7/233269)
**Author:** [@marspy](https://discuss.elastic.co/u/marspy)\ **Replies:** 6\ **Last updated:** [May 27, 2020, 5:13pm UTC](https://discuss.elastic.co/t/must-not-boolean-query-in-7-7/233269 "2020-05-27T17:13:56Z")
After upgrading elasticsearch to 7.7 there is problem with parsing must\_not query: {"error":{"root\_cause":\[{"type":"parsing\_exception","reason":"Failed to parse","line":1,"col":104}\],"type":"parsing\_exception","reason":… --- ## [Can't view fields In Discovery or via query even though they're available in Kibana visualizations](https://discuss.elastic.co/t/cant-view-fields-in-discovery-or-via-query-even-though-theyre-available-in-kibana-visualizations/234582)
**Author:** [@schoffelman](https://discuss.elastic.co/u/schoffelman)\ **Replies:** 8\ **Last updated:** [May 27, 2020, 4:49pm UTC](https://discuss.elastic.co/t/cant-view-fields-in-discovery-or-via-query-even-though-theyre-available-in-kibana-visualizations/234582 "2020-05-27T16:49:31Z")
I have a few indexes, defined by a template, and each index is distinguished by year. When querying the current years index (previous years are fine), I get no fields to return any values. When looking at visualizations … --- ## [How to aggregate on bitwise operator individual flag values?](https://discuss.elastic.co/t/how-to-aggregate-on-bitwise-operator-individual-flag-values/234588)
**Author:** [@randomuser](https://discuss.elastic.co/u/randomuser)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 4:36pm UTC](https://discuss.elastic.co/t/how-to-aggregate-on-bitwise-operator-individual-flag-values/234588 "2020-05-27T16:36:10Z")
We have cities where each has some sporting places, and some places are present in multiple cities: London: Multiplex, Fivestar Berlin: Multiplex, Bestgym Paris: Multiplex, Bestgym, Fivestar We have places where ea… --- ## [Creating custom tracks in Rally with Docker image](https://discuss.elastic.co/t/creating-custom-tracks-in-rally-with-docker-image/234515)
**Author:** [@jkhere](https://discuss.elastic.co/u/jkhere)\ **Replies:** 4\ **Last updated:** [May 27, 2020, 2:57pm UTC](https://discuss.elastic.co/t/creating-custom-tracks-in-rally-with-docker-image/234515 "2020-05-27T14:57:32Z")
I am trying to create a custom track from an existing index using the instructions in the Rally documentation page. I am running Rally as a Docker Image. Following is the commad that I used to create the track docker … --- ## [Flattened Type Not Working in version 7.4](https://discuss.elastic.co/t/flattened-type-not-working-in-version-7-4/234513)
**Author:** [@rishabh\_jain](https://discuss.elastic.co/u/rishabh_jain)\ **Replies:** 6\ **Last updated:** [May 27, 2020, 2:57pm UTC](https://discuss.elastic.co/t/flattened-type-not-working-in-version-7-4/234513 "2020-05-27T14:57:24Z")
I'm using AWS elasticsearch { "mappings":{ "properties": { "name": { "type": "text" }, "info": { "type": "flattened" } } } } Errror message is ::: { "error": { "root\_cause": \[ { "type": "mapper\_parsing\_… --- ## [Aggregate query similar to kibana Discover](https://discuss.elastic.co/t/aggregate-query-similar-to-kibana-discover/234518)
**Author:** [@Alder](https://discuss.elastic.co/u/Alder)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 10:14am UTC](https://discuss.elastic.co/t/aggregate-query-similar-to-kibana-discover/234518 "2020-05-27T10:14:41Z")
Good morning everyone. How can I make an aggregated query that has the same Kibana Discovery behavior? Even without searching, all fields in my index are aggregated. GET /amazoninf.teste.analisador/\_search { "size":… --- ## [Possible values for 'discovery-type'](https://discuss.elastic.co/t/possible-values-for-discovery-type/234532)
**Author:** [@tmporary](https://discuss.elastic.co/u/tmporary)\ **Replies:** 1\ **Last updated:** [May 27, 2020, 1:05pm UTC](https://discuss.elastic.co/t/possible-values-for-discovery-type/234532 "2020-05-27T13:05:35Z")
I'm looking through the docs and I can't find it. What are possible values for 'discovery\_type' config property? Why I can only find references to single-node value? --- ## [Migrating to Elasticsearch 5](https://discuss.elastic.co/t/migrating-to-elasticsearch-5/234339)
**Author:** [@Raj\_Techie](https://discuss.elastic.co/u/Raj_Techie)\ **Replies:** 7\ **Last updated:** [May 27, 2020, 1:31pm UTC](https://discuss.elastic.co/t/migrating-to-elasticsearch-5/234339 "2020-05-27T13:31:42Z")
I am using Elasticsearch version 5 and logstash 6.0. Changed logstash.conf file with hostname and id paswd. I could see I am able to log in but getting error like "Couldn't index Event to Elasticsearch" . Error Status-\>4… --- ## [ICU transform filters slowing down indexing: how avoid duplicate transliterations?](https://discuss.elastic.co/t/icu-transform-filters-slowing-down-indexing-how-avoid-duplicate-transliterations/234547)
**Author:** [@Pyppe](https://discuss.elastic.co/u/Pyppe)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 1:28pm UTC](https://discuss.elastic.co/t/icu-transform-filters-slowing-down-indexing-how-avoid-duplicate-transliterations/234547 "2020-05-27T13:28:24Z")
I was investigating slow Bulk API indexing as discussed in https://discuss.elastic.co/t/bulk-index-slowing-down-as-index-size-increases/234288. It turns out the root cause seems to be slow ICU transform filters, when we… --- ## [Prevail must\_not over filter condition](https://discuss.elastic.co/t/prevail-must-not-over-filter-condition/234537)
**Author:** [@Clony](https://discuss.elastic.co/u/Clony)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 12:15pm UTC](https://discuss.elastic.co/t/prevail-must-not-over-filter-condition/234537 "2020-05-27T12:15:31Z")
Given following document { "colours": \["red", "yellow", "blue"\] } I want to perfom a query that filters by "red" but I don't want document that has "yellow" even if it has "red". This is the following query I'm pe… --- ## [ILM not deleting indices](https://discuss.elastic.co/t/ilm-not-deleting-indices/234437)
**Author:** [@Guerreiro\_Sousa](https://discuss.elastic.co/u/Guerreiro_Sousa)\ **Replies:** 2\ **Last updated:** [May 27, 2020, 11:59am UTC](https://discuss.elastic.co/t/ilm-not-deleting-indices/234437 "2020-05-27T11:59:34Z")
I created this policy for testing e apliquei a um template: { "policy": { "phases": { "hot": { "min\_age": "0ms", "actions": { "set\_priority": { "priority":… --- ## [Elasticsearch SLM policy Error](https://discuss.elastic.co/t/elasticsearch-slm-policy-error/234516)
**Author:** [@zil2020](https://discuss.elastic.co/u/zil2020)\ **Replies:** 1\ **Last updated:** [May 27, 2020, 10:51am UTC](https://discuss.elastic.co/t/elasticsearch-slm-policy-error/234516 "2020-05-27T10:51:53Z")
Hello everyone. Elasticsearch 7.3.0 I need help with setup SLM for automate backups. In terminal elastic@elastic: curl -X PUT "localhost:9200/\_slm/policy/nightly-snapshots?pretty" -H 'Content-Type: application/json' … --- ## [Dynamic template in very dynamic document](https://discuss.elastic.co/t/dynamic-template-in-very-dynamic-document/234392)
**Author:** [@psteh](https://discuss.elastic.co/u/psteh)\ **Replies:** 3\ **Last updated:** [May 27, 2020, 10:03am UTC](https://discuss.elastic.co/t/dynamic-template-in-very-dynamic-document/234392 "2020-05-27T10:03:54Z")
I have SQL queries that would be indexed into ElasticSearch. The problem I encounter is that the fields in documents are very dynamic, it could be text, object, integer, etc. Sample of body (Note that this is not the s… --- ## [\[UpdateRequest\] failed to parse field \[doc\] while trying to update some fields](https://discuss.elastic.co/t/updaterequest-failed-to-parse-field-doc-while-trying-to-update-some-fields/234509)
**Author:** [@Moreno17](https://discuss.elastic.co/u/Moreno17)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 9:53am UTC](https://discuss.elastic.co/t/updaterequest-failed-to-parse-field-doc-while-trying-to-update-some-fields/234509 "2020-05-27T09:53:06Z")
Hi all, I am new with elasticsearch and I am trying to update a document that I have inserted before. The problem is that I had this error and I don't know what I am doing wrong: {'error': {'root\_cause': \[{'type': 'x\_co… --- ## [Old plugin migration](https://discuss.elastic.co/t/old-plugin-migration/234508)
**Author:** [@Yann\_Barraud](https://discuss.elastic.co/u/Yann_Barraud)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 9:52am UTC](https://discuss.elastic.co/t/old-plugin-migration/234508 "2020-05-27T09:52:17Z")
Hi all, I have an old plugin running in 2.x version I want to migrate to actual versions. Unfortunately, the whole API is now moved and I did not follow the evols. Anyone can point me to the right directions to start t… --- ## [Elasticsearch can not retrieve Thai language](https://discuss.elastic.co/t/elasticsearch-can-not-retrieve-thai-language/234500)
**Author:** [@laifuchicago](https://discuss.elastic.co/u/laifuchicago)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 9:22am UTC](https://discuss.elastic.co/t/elasticsearch-can-not-retrieve-thai-language/234500 "2020-05-27T09:22:51Z")
To author: Currently, our team is trying to do the inference in Thai language. But in the retrieving part, Elasticsearch seems to have some limitations about Thai language. For example, we can only search Thai word. Can… --- ## [Warm phase timing](https://discuss.elastic.co/t/warm-phase-timing/234496)
**Author:** [@Angelos](https://discuss.elastic.co/u/Angelos)\ **Replies:** 1\ **Last updated:** [May 27, 2020, 9:08am UTC](https://discuss.elastic.co/t/warm-phase-timing/234496 "2020-05-27T09:08:31Z")
Hello, I am implementing ILM policy for some indices(Hot, Warm, Delete). Why is there the option of timing, in warm phase? What is the benefit of having some delay before the index moves to the the warm phase(waiting … --- ## [Ingest pipeline version control and deployment](https://discuss.elastic.co/t/ingest-pipeline-version-control-and-deployment/234493)
**Author:** [@whatgeorgemade](https://discuss.elastic.co/u/whatgeorgemade)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 8:54am UTC](https://discuss.elastic.co/t/ingest-pipeline-version-control-and-deployment/234493 "2020-05-27T08:54:23Z")
I'm wondering how other people deal with managing their ingest pipelines in terms of version control and deployment to the cluster. I put pipeline definitions in Git so I can track the changes and, more importantly, the… --- ## [What is the process to index the .txt using logsth and filebeat?](https://discuss.elastic.co/t/what-is-the-process-to-index-the-txt-using-logsth-and-filebeat/234379)
**Author:** [@Youssef\_SBAI](https://discuss.elastic.co/u/Youssef_SBAI)\ **Replies:** 9\ **Last updated:** [May 27, 2020, 8:42am UTC](https://discuss.elastic.co/t/what-is-the-process-to-index-the-txt-using-logsth-and-filebeat/234379 "2020-05-27T08:42:02Z")
What is the process to index the .txt using logsth and filebeat ?? --- ## [Grouped country wise channel id in first index the next index having each row in channel id i want to sum the next index record but i dont know how to use](https://discuss.elastic.co/t/grouped-country-wise-channel-id-in-first-index-the-next-index-having-each-row-in-channel-id-i-want-to-sum-the-next-index-record-but-i-dont-know-how-to-use/230282)
**Author:** [@Ramesh\_Kumar](https://discuss.elastic.co/u/Ramesh_Kumar)\ **Replies:** 0\ **Last updated:** [April 29, 2020, 1:53am UTC](https://discuss.elastic.co/t/grouped-country-wise-channel-id-in-first-index-the-next-index-having-each-row-in-channel-id-i-want-to-sum-the-next-index-record-but-i-dont-know-how-to-use/230282 "2020-04-29T01:53:56Z")
{ "aggs" : { "country\_groups" : { "terms" : { "field" : "country.keyword", "size":30000 }, "aggs": { "channel\_ids": { "terms": { "field" : "channel\_id.ke… --- ## [Is it possible to combine two different fields of same object to filter the document?](https://discuss.elastic.co/t/is-it-possible-to-combine-two-different-fields-of-same-object-to-filter-the-document/234483)
**Author:** [@MirunaliniSridharan](https://discuss.elastic.co/u/MirunaliniSridharan)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 8:09am UTC](https://discuss.elastic.co/t/is-it-possible-to-combine-two-different-fields-of-same-object-to-filter-the-document/234483 "2020-05-27T08:09:27Z")
I need to filter the document only if two fields of same object has the filtered value. My data is like this: { "cust\_data": { "products": \[ { "item": "watch", "qty": \[ "10" \] }, { "item": "purse", "qty": \[ … --- ## [Dedicated Ingest Node ES](https://discuss.elastic.co/t/dedicated-ingest-node-es/234479)
**Author:** [@kirankumar](https://discuss.elastic.co/u/kirankumar)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 7:52am UTC](https://discuss.elastic.co/t/dedicated-ingest-node-es/234479 "2020-05-27T07:52:28Z")
Hey my environment betas -\> logstash -\> ES ( 1 node ) I am planning to use the filebeat module to do some parsing betas -\> ES( 1node ) I am handling about max 1.5 TB(MAX) of logs with 10 diff index created on a dail… --- ## [Require help: custom realm](https://discuss.elastic.co/t/require-help-custom-realm/234477)
**Author:** [@gbalix](https://discuss.elastic.co/u/gbalix)\ **Replies:** 1\ **Last updated:** [May 27, 2020, 7:44am UTC](https://discuss.elastic.co/t/require-help-custom-realm/234477 "2020-05-27T07:44:25Z")
Hi, I trying write a custom realm (elasticsearch version: 7.7.0) and leverage existing user auth and lookup system (similar to LDAP). Search in Elasticsearch documentation take me to https://www.elastic.co/guide/en/ela… --- ## [Dynamic Template convert JSON object to Text](https://discuss.elastic.co/t/dynamic-template-convert-json-object-to-text/234450)
**Author:** [@psteh](https://discuss.elastic.co/u/psteh)\ **Replies:** 1\ **Last updated:** [May 27, 2020, 6:31am UTC](https://discuss.elastic.co/t/dynamic-template-convert-json-object-to-text/234450 "2020-05-27T06:31:28Z")
Is it possible to convert JSON object to Text using Dynamic Template? My aim is to have all fields in this object property to be Text I am not using Logstash, this is from AWS Cloudwatch log to AWS Elasticsearch Servic… --- ## [Ingestion of multiple csv files in python](https://discuss.elastic.co/t/ingestion-of-multiple-csv-files-in-python/234468)
**Author:** [@richylyq](https://discuss.elastic.co/u/richylyq)\ **Replies:** 0\ **Last updated:** [May 27, 2020, 7:12am UTC](https://discuss.elastic.co/t/ingestion-of-multiple-csv-files-in-python/234468 "2020-05-27T07:12:06Z")
If i have multiple csv files with recurring dates, and i am planning to bulk ingest them with a python script, will the data be automatically ingested per date or the data will be duplicated as per the amount of recurrin… --- ## [FScrawler issue while crawling through a remote host](https://discuss.elastic.co/t/fscrawler-issue-while-crawling-through-a-remote-host/234456)
**Author:** [@Umesh\_S\_Bhimani](https://discuss.elastic.co/u/Umesh_S_Bhimani)\ **Replies:** 2\ **Last updated:** [May 27, 2020, 6:50am UTC](https://discuss.elastic.co/t/fscrawler-issue-while-crawling-through-a-remote-host/234456 "2020-05-27T06:50:30Z")
Hi, There is an issue while crawling through files from remote host. Please see the code snippet below --- name: "new\_attachment" server: hostname: "\*\*\*\*\*\*\*\*\*\*\*\*\*\*" port: 22 username: "\*\*\*\*\*\*\*\*\*\*" password: "\*\*… --- ## [Close Indices snapshot not being taken in ES 7.4.2](https://discuss.elastic.co/t/close-indices-snapshot-not-being-taken-in-es-7-4-2/234322)
**Author:** [@Gaurav6141](https://discuss.elastic.co/u/Gaurav6141)\ **Replies:** 1\ **Last updated:** [May 27, 2020, 6:09am UTC](https://discuss.elastic.co/t/close-indices-snapshot-not-being-taken-in-es-7-4-2/234322 "2020-05-27T06:09:56Z")
Hi, I was trying to take snapshot of all indices but it looks like close indices are omitted from snapshot until specified explicitly with name. This what I did. I created two indices and injected some dummy documents … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=907) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=909)