# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1199 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1200 --- ## [Partial Search of a sentence not working as expected](https://discuss.elastic.co/t/partial-search-of-a-sentence-not-working-as-expected/193067)
**Author:** [@GuruPrasath\_Ramesh](https://discuss.elastic.co/u/GuruPrasath_Ramesh)\ **Replies:** 12\ **Last updated:** [August 7, 2019, 9:17am UTC](https://discuss.elastic.co/t/partial-search-of-a-sentence-not-working-as-expected/193067 "2019-08-07T09:17:55Z")
I use Translate API to get the native elastic search queries from SQL queries. At first try, we use the RLIKE query to match a partial word in a sentence. POST /\_xpack/sql/translate { "query": "SELECT \* FROM c1s\_may… --- ## [ELK with AzureDevops TFS](https://discuss.elastic.co/t/elk-with-azuredevops-tfs/194187)
**Author:** [@Felipe\_Cabral\_Jeroni](https://discuss.elastic.co/u/Felipe_Cabral_Jeroni)\ **Replies:** 0\ **Last updated:** [August 7, 2019, 9:08am UTC](https://discuss.elastic.co/t/elk-with-azuredevops-tfs/194187 "2019-08-07T09:08:03Z")
Hi guys, I was searching for but I couldn't find the right answer. We have a Azure Devops (old tfs) on premise where we perform the application deployment. We were thinking about integrate its logs with ELK, however I d… --- ## [Query dates and always return iso8601 format](https://discuss.elastic.co/t/query-dates-and-always-return-iso8601-format/194186)
**Author:** [@ftr](https://discuss.elastic.co/u/ftr)\ **Replies:** 0\ **Last updated:** [August 7, 2019, 9:07am UTC](https://discuss.elastic.co/t/query-dates-and-always-return-iso8601-format/194186 "2019-08-07T09:07:30Z")
In my organisation, many application coders use elasticsearch both for indexing and searching. In an effort to not do the same work over and over again and also to share data, we are trying to collect some of the indices… --- ## [Create new document on index and update a second document](https://discuss.elastic.co/t/create-new-document-on-index-and-update-a-second-document/194174)
**Author:** [@grahams](https://discuss.elastic.co/u/grahams)\ **Replies:** 2\ **Last updated:** [August 7, 2019, 8:41am UTC](https://discuss.elastic.co/t/create-new-document-on-index-and-update-a-second-document/194174 "2019-08-07T08:41:36Z")
Hi, ES newbie here. Is it possible, say in an ingest pipeline, to store the document into one index and then take some of the fields and update a second index. For example an order document would be stored and a custome… --- ## [How to transfer data from one elastic index to other](https://discuss.elastic.co/t/how-to-transfer-data-from-one-elastic-index-to-other/194056)
**Author:** [@shubham\_dixit](https://discuss.elastic.co/u/shubham_dixit)\ **Replies:** 2\ **Last updated:** [August 7, 2019, 8:07am UTC](https://discuss.elastic.co/t/how-to-transfer-data-from-one-elastic-index-to-other/194056 "2019-08-07T08:07:38Z")
I have different sources of data coming from files . I want to create only one index for all the sources .Suppose source A data has three fields (a,b,c) and source B data has four fields (d,e,f,g) .I want to fit them in … --- ## [How to merge two indexes based on common field in Elasticsearch?](https://discuss.elastic.co/t/how-to-merge-two-indexes-based-on-common-field-in-elasticsearch/194114)
**Author:** [@EZprogramming](https://discuss.elastic.co/u/EZprogramming)\ **Replies:** 2\ **Last updated:** [August 7, 2019, 7:34am UTC](https://discuss.elastic.co/t/how-to-merge-two-indexes-based-on-common-field-in-elasticsearch/194114 "2019-08-07T07:34:52Z")
Given two indexes test and amazon. PUT /test/\_doc/1 { "customer\_id" : "1234", "customer\_name" : "origin", "farm\_name": "Origin Delta" } PUT /amazon/\_doc/2 { "customer\_id" : "1234", "farm\_name": "Origin Delta… --- ## [Elasticsearch Python client: how to resume connection after node is stopped](https://discuss.elastic.co/t/elasticsearch-python-client-how-to-resume-connection-after-node-is-stopped/194168)
**Author:** [@haotian9850](https://discuss.elastic.co/u/haotian9850)\ **Replies:** 0\ **Last updated:** [August 7, 2019, 7:22am UTC](https://discuss.elastic.co/t/elasticsearch-python-client-how-to-resume-connection-after-node-is-stopped/194168 "2019-08-07T07:22:45Z")
Hey there, I am working on a Elasticsearch cluster upgrade automation tool. For demo purposes (to show that my upgrade can achieve zero downtime), I have written a Python program that constantly streams data into the clu… --- ## [Bearer key require when using Clien builder php client library](https://discuss.elastic.co/t/bearer-key-require-when-using-clien-builder-php-client-library/194166)
**Author:** [@killallskywalker](https://discuss.elastic.co/u/killallskywalker)\ **Replies:** 0\ **Last updated:** [August 7, 2019, 7:12am UTC](https://discuss.elastic.co/t/bearer-key-require-when-using-clien-builder-php-client-library/194166 "2019-08-07T07:12:01Z")
I keep getting this error {"error":{"root\_cause":\[{"type":"security\_exception","reason":"action \[indices:data/write/index\] requires authentication","header":{"WWW-Authenticate":\["Bearer realm=\\"security\\"","ApiKey","Bas… --- ## [Kibana not working after setting logging.dest property, please help](https://discuss.elastic.co/t/kibana-not-working-after-setting-logging-dest-property-please-help/194162)
**Author:** [@Ayush\_Verma](https://discuss.elastic.co/u/Ayush_Verma)\ **Replies:** 1\ **Last updated:** [August 7, 2019, 7:02am UTC](https://discuss.elastic.co/t/kibana-not-working-after-setting-logging-dest-property-please-help/194162 "2019-08-07T07:02:03Z")
I have elasticsearch 7.3 and kibana 7.2 , after setting logging.dest property kibana is not working this is the log : journalctl -u kibana.service Aug 07 06:44:50 elastic-stage-vyakar kibana\[5134\]: throw er; // … --- ## [Is there any elastic API to validate everything(indices, visualizations, rules etc...) before migration?](https://discuss.elastic.co/t/is-there-any-elastic-api-to-validate-everything-indices-visualizations-rules-etc-before-migration/194157)
**Author:** [@G086486](https://discuss.elastic.co/u/G086486)\ **Replies:** 0\ **Last updated:** [August 7, 2019, 6:41am UTC](https://discuss.elastic.co/t/is-there-any-elastic-api-to-validate-everything-indices-visualizations-rules-etc-before-migration/194157 "2019-08-07T06:41:40Z")
Hi, We are planning to migrate to 7.2 but i am looking for APIs which provides the validate everything before migration and same API will run post migration to verify everything got migrated. Thanks! --- ## [How to calculate two aggregations on same field within the same body?](https://discuss.elastic.co/t/how-to-calculate-two-aggregations-on-same-field-within-the-same-body/193889)
**Author:** [@Kaushik123](https://discuss.elastic.co/u/Kaushik123)\ **Replies:** 5\ **Last updated:** [August 7, 2019, 3:43am UTC](https://discuss.elastic.co/t/how-to-calculate-two-aggregations-on-same-field-within-the-same-body/193889 "2019-08-07T03:43:25Z")
I am trying to find the sum aggregate data(total count) of a field for my query. I also want to find the sum aggregate data of that same field, but on a different day/time. How can I write that has this type of functiona… --- ## [Comparing the result(sum count) of 2 aggregations - ElasticSearch](https://discuss.elastic.co/t/comparing-the-result-sum-count-of-2-aggregations-elasticsearch/193826)
**Author:** [@Kaushik123](https://discuss.elastic.co/u/Kaushik123)\ **Replies:** 1\ **Last updated:** [August 7, 2019, 3:39am UTC](https://discuss.elastic.co/t/comparing-the-result-sum-count-of-2-aggregations-elasticsearch/193826 "2019-08-07T03:39:45Z")
Hi all, I am relatively new to Elasticsearch and am trying to write a script that is supposed to compare two different aggregations. For example, I have 2 sum aggregations of the same field, but calculated at 2 differe… --- ## [Elasticsearch index problem](https://discuss.elastic.co/t/elasticsearch-index-problem/193943)
**Author:** [@dcuti8](https://discuss.elastic.co/u/dcuti8)\ **Replies:** 2\ **Last updated:** [August 7, 2019, 1:24am UTC](https://discuss.elastic.co/t/elasticsearch-index-problem/193943 "2019-08-07T01:24:54Z")
environment: OS: Windows Server 2019 CORE: 4-Core RAM: 8GB HDD: 60GB elasticsearch: 7.3.0 kibana:7.3.0 JVM：4GB One cluster, one node I put the sql server trace log data （last 7 days） into elasticsearch and show … --- ## [Wildcard queries on date based indexes, searches all indexes?](https://discuss.elastic.co/t/wildcard-queries-on-date-based-indexes-searches-all-indexes/194121)
**Author:** [@Aharon](https://discuss.elastic.co/u/Aharon)\ **Replies:** 0\ **Last updated:** [August 7, 2019, 12:38am UTC](https://discuss.elastic.co/t/wildcard-queries-on-date-based-indexes-searches-all-indexes/194121 "2019-08-07T00:38:24Z")
About me: ES: 6.5.4 X-PACK Document Security on all indexes 200TB of date based indexes Multi-tenant environment 7 days of data on Hot data nodes 180 days in Warm data nodes Question: If I have a user log into Ki… --- ## [Exception on ingest an attachment using client.index()](https://discuss.elastic.co/t/exception-on-ingest-an-attachment-using-client-index/193641)
**Author:** [@n2nelastic](https://discuss.elastic.co/u/n2nelastic)\ **Replies:** 10\ **Last updated:** [August 6, 2019, 11:48pm UTC](https://discuss.elastic.co/t/exception-on-ingest-an-attachment-using-client-index/193641 "2019-08-06T23:48:02Z")
I have properly set up an index and pipeline to ingest base64 encoded documents. Using the elasticsearch client, I call client.index() to process a base64 document, but I get "ResponseError: Exception" from client.index… --- ## [How to filter date field by days and hours separately](https://discuss.elastic.co/t/how-to-filter-date-field-by-days-and-hours-separately/193946)
**Author:** [@Guylot](https://discuss.elastic.co/u/Guylot)\ **Replies:** 5\ **Last updated:** [August 6, 2019, 9:33pm UTC](https://discuss.elastic.co/t/how-to-filter-date-field-by-days-and-hours-separately/193946 "2019-08-06T21:33:19Z")
Hi, I want to create a query that returns all the data from last 3 days and only between 09:00 AM - 18:00 PM. My date field contains both the date and the time of the day (For example "time" : "2019-08-06T06:40:55Z"). … --- ## [Query using Shingle filter on 5.1.2 and 5.2.2 behave differently](https://discuss.elastic.co/t/query-using-shingle-filter-on-5-1-2-and-5-2-2-behave-differently/193007)
**Author:** [@mingchi](https://discuss.elastic.co/u/mingchi)\ **Replies:** 2\ **Last updated:** [August 6, 2019, 9:30pm UTC](https://discuss.elastic.co/t/query-using-shingle-filter-on-5-1-2-and-5-2-2-behave-differently/193007 "2019-08-06T21:30:20Z")
I have a shingle filter: "custom\_shingle\_filter": { "type": "shingle", "max\_shingle\_size": 2, "min\_shingle\_size": 2, "token\_separator": "", "output\_unigrams": true } Then I use this shingle filte… --- ## [Does Elasticsearch Docker Image Contain Logstash and/or Kibana?](https://discuss.elastic.co/t/does-elasticsearch-docker-image-contain-logstash-and-or-kibana/194043)
**Author:** [@redapplesonly](https://discuss.elastic.co/u/redapplesonly)\ **Replies:** 2\ **Last updated:** [August 6, 2019, 4:39pm UTC](https://discuss.elastic.co/t/does-elasticsearch-docker-image-contain-logstash-and-or-kibana/194043 "2019-08-06T16:39:18Z")
Hi, I'm a complete newbie to the world of Elasticsearch. But I'm reading through the online docs, though, and coming up-to-speed fast. I'd like to build my first Logstash / Elasticsearch / Kibana pipeline, and I starte… --- ## [Access field name with blanks via painless](https://discuss.elastic.co/t/access-field-name-with-blanks-via-painless/194062)
**Author:** [@brille1980](https://discuss.elastic.co/u/brille1980)\ **Replies:** 1\ **Last updated:** [August 6, 2019, 7:45pm UTC](https://discuss.elastic.co/t/access-field-name-with-blanks-via-painless/194062 "2019-08-06T19:45:49Z")
Hi there, how do I access a field name that includes blanks (e.g. "Event ID" : 23) via script? ctx.Event\\ ID = 42 doesn't work ("Error parsing ingest pipeline: JSON Parse error: Invalid escape character") neither does… --- ## [How to filter out unnecessary field from the kibana output](https://discuss.elastic.co/t/how-to-filter-out-unnecessary-field-from-the-kibana-output/194093)
**Author:** [@zatom](https://discuss.elastic.co/u/zatom)\ **Replies:** 0\ **Last updated:** [August 6, 2019, 7:32pm UTC](https://discuss.elastic.co/t/how-to-filter-out-unnecessary-field-from-the-kibana-output/194093 "2019-08-06T19:32:42Z")
Hi, I am wondering if we can write queries that automatically removes the fields in the output that we don't want. I am asking this because my nested aggregation keeps crashing my cluster. If we could remove millions of … --- ## [How to deal with the transition when a field changes format "string" -\> "timestamp"](https://discuss.elastic.co/t/how-to-deal-with-the-transition-when-a-field-changes-format-string-timestamp/193649)
**Author:** [@jcaballero](https://discuss.elastic.co/u/jcaballero)\ **Replies:** 4\ **Last updated:** [August 6, 2019, 7:28pm UTC](https://discuss.elastic.co/t/how-to-deal-with-the-transition-when-a-field-changes-format-string-timestamp/193649 "2019-08-06T19:28:42Z")
Hello. Facts: Using ElasticSearch version 5.6.10 Currently, the Template \[1\] for one of my indices contains a section like this, since LogStash is creating field "my\_datefield" as a string, with one of these two p… --- ## [How to get a range of documents before and after \_id](https://discuss.elastic.co/t/how-to-get-a-range-of-documents-before-and-after-id/194086)
**Author:** [@nolatone](https://discuss.elastic.co/u/nolatone)\ **Replies:** 0\ **Last updated:** [August 6, 2019, 6:51pm UTC](https://discuss.elastic.co/t/how-to-get-a-range-of-documents-before-and-after-id/194086 "2019-08-06T18:51:06Z")
Hello all, I'm investigating using Elasticsearch (and other parts of the ELK stack) for the data source for log analysis tools my team is developing. We're currently working with logs loaded into a postgres DB. One of … --- ## [Comparing 2 sum metric aggregations](https://discuss.elastic.co/t/comparing-2-sum-metric-aggregations/194084)
**Author:** [@Kaushik123](https://discuss.elastic.co/u/Kaushik123)\ **Replies:** 0\ **Last updated:** [August 6, 2019, 6:44pm UTC](https://discuss.elastic.co/t/comparing-2-sum-metric-aggregations/194084 "2019-08-06T18:44:35Z")
Is it possible to compare two metric aggregations - both return the sum of a field. Both aggregations are performed on the same field, but at different time intervals using the bool and range query. For example, if the… --- ## [ES 7.3 | XPack | Custom realm](https://discuss.elastic.co/t/es-7-3-xpack-custom-realm/194079)
**Author:** [@cambierr](https://discuss.elastic.co/u/cambierr)\ **Replies:** 0\ **Last updated:** [August 6, 2019, 6:25pm UTC](https://discuss.elastic.co/t/es-7-3-xpack-custom-realm/194079 "2019-08-06T18:25:05Z")
Hi all, I'm running a local ES cluster using basic XPack license and I'm interested in creating a custom realm, my goal being to be able to authenticate myself using my gitlab account. My idea is to add to the kibana l… --- ## [Failed to retrieve password hash for reserved user \[kibana\]](https://discuss.elastic.co/t/failed-to-retrieve-password-hash-for-reserved-user-kibana/193592)
**Author:** [@niudaye123](https://discuss.elastic.co/u/niudaye123)\ **Replies:** 6\ **Last updated:** [August 6, 2019, 5:35pm UTC](https://discuss.elastic.co/t/failed-to-retrieve-password-hash-for-reserved-user-kibana/193592 "2019-08-06T17:35:38Z")
I have to repurpose all the nodes in my cluster, during that process I accidentally deleted the \_security index which is for built in user information. Now in the log it said failed to retrieve password hash for reserved… --- ## [Elasticsearch docker container not writing to local disk](https://discuss.elastic.co/t/elasticsearch-docker-container-not-writing-to-local-disk/193859)
**Author:** [@carson](https://discuss.elastic.co/u/carson)\ **Replies:** 6\ **Last updated:** [August 6, 2019, 5:27pm UTC](https://discuss.elastic.co/t/elasticsearch-docker-container-not-writing-to-local-disk/193859 "2019-08-06T17:27:25Z")
I have a docker container with a volume mount for /var/log/elasticsearch/ and /var/lib/elasticsearch/ so that Elasticsearch will write to disk, as the container seems to be running out of space after several hours of upt… --- ## [Field 'tags' is backed by an array but the associated Spark Schema does not reflect this](https://discuss.elastic.co/t/field-tags-is-backed-by-an-array-but-the-associated-spark-schema-does-not-reflect-this/194049)
**Author:** [@basha5](https://discuss.elastic.co/u/basha5)\ **Replies:** 0\ **Last updated:** [August 6, 2019, 3:58pm UTC](https://discuss.elastic.co/t/field-tags-is-backed-by-an-array-but-the-associated-spark-schema-does-not-reflect-this/194049 "2019-08-06T15:58:42Z")
Hi, I am trying to read the data from index in ES using pyspark. I am able to load the data into the dataframe. Used this code reader = spark.read.format("es").option("es.read.metadata", True).option("es.port","9200").… --- ## [How to get the best performance with index update](https://discuss.elastic.co/t/how-to-get-the-best-performance-with-index-update/193776)
**Author:** [@Henrique\_Brasileiro](https://discuss.elastic.co/u/Henrique_Brasileiro)\ **Replies:** 6\ **Last updated:** [August 6, 2019, 3:57pm UTC](https://discuss.elastic.co/t/how-to-get-the-best-performance-with-index-update/193776 "2019-08-06T15:57:56Z")
I have a index with length greater than 1 TB and I want to update a field but update by query is very slow, mor slow that delete all and insert all. How best alternative to mass update? --- ## [Scaling Number of Coordinator Nodes](https://discuss.elastic.co/t/scaling-number-of-coordinator-nodes/194044)
**Author:** [@sirsteve](https://discuss.elastic.co/u/sirsteve)\ **Replies:** 0\ **Last updated:** [August 6, 2019, 3:52pm UTC](https://discuss.elastic.co/t/scaling-number-of-coordinator-nodes/194044 "2019-08-06T15:52:26Z")
Hi, I'm looking at how to scale out ES clusters and have been thinking about how to go about deciding on the number of dedicated coordinator nodes to be used. I've noticed that coordinator nodes are useful in shielding… --- ## [WHY ES-2.4.6 IS EASILY BINDING WITH LOCALHOST TO IP but ES-7.3/7.1 IS NOT BINDING](https://discuss.elastic.co/t/why-es-2-4-6-is-easily-binding-with-localhost-to-ip-but-es-7-3-7-1-is-not-binding/193834)
**Author:** [@rameshkr1994](https://discuss.elastic.co/u/rameshkr1994)\ **Replies:** 5\ **Last updated:** [August 6, 2019, 3:26pm UTC](https://discuss.elastic.co/t/why-es-2-4-6-is-easily-binding-with-localhost-to-ip-but-es-7-3-7-1-is-not-binding/193834 "2019-08-06T15:26:26Z")
Dear All. Facing some issue while binding Localhost to IP in elastic search:- Case 01:-1: when i try bind localhost to IP in Elastic search 2.4.6 that is working very fine:- network.host:localhost Case 02:slight\_smi… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1198) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1200)