# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1015 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1016 --- ## [Rename fieldname in incoming logs](https://discuss.elastic.co/t/rename-fieldname-in-incoming-logs/219469)
**Author:** [@CyberSeppi](https://discuss.elastic.co/u/CyberSeppi)\ **Replies:** 1\ **Last updated:** [February 15, 2020, 11:42am UTC](https://discuss.elastic.co/t/rename-fieldname-in-incoming-logs/219469 "2020-02-15T11:42:10Z")
Hi All, we have now two different shippers sending logs to our es cluster (no logstash included). FileBeat is sending the log-message itself in field "message" and fluentbit (we have limited control over its configura… --- ## [Out of memory exception for coordinating nodes](https://discuss.elastic.co/t/out-of-memory-exception-for-coordinating-nodes/216538)
**Author:** [@deebify](https://discuss.elastic.co/u/deebify)\ **Replies:** 5\ **Last updated:** [February 15, 2020, 9:43am UTC](https://discuss.elastic.co/t/out-of-memory-exception-for-coordinating-nodes/216538 "2020-02-15T09:43:37Z")
I've a ES cluster 6.6.2 composed of 3 master, 4 datanodes, 2 coordinating nodes. 2 kibana instances connecting to 2 coordinating nodes. 2 coordinating nodes are 16GB of RAM, and 7GB of Heap (min=max heap). On coordina… --- ## [ElasticSearch plugin: access to text field](https://discuss.elastic.co/t/elasticsearch-plugin-access-to-text-field/219464)
**Author:** [@KTOIA](https://discuss.elastic.co/u/KTOIA)\ **Replies:** 0\ **Last updated:** [February 15, 2020, 7:08am UTC](https://discuss.elastic.co/t/elasticsearch-plugin-access-to-text-field/219464 "2020-02-15T07:08:36Z")
I need to access to text field at ES document. I have used LeafReaderContext and only found leafContext.reader().getSortedSetDocValues(fieldName) But it contains a set of all values. Is Any way to access text field val… --- ## [How to add attachments to index and how to apply auto complete feature on it](https://discuss.elastic.co/t/how-to-add-attachments-to-index-and-how-to-apply-auto-complete-feature-on-it/219394)
**Author:** [@SivaPrasad\_Ampolu](https://discuss.elastic.co/u/SivaPrasad_Ampolu)\ **Replies:** 0\ **Last updated:** [February 14, 2020, 3:08pm UTC](https://discuss.elastic.co/t/how-to-add-attachments-to-index-and-how-to-apply-auto-complete-feature-on-it/219394 "2020-02-14T15:08:43Z")
Hello, Can some one suggest me how to achieve adding index to the attachments and searching functionality in c#. If some one shares the code snippet on top of latest elastic search it will be really helpful to me, than… --- ## [Using original query score in a rescore function score query](https://discuss.elastic.co/t/using-original-query-score-in-a-rescore-function-score-query/219087)
**Author:** [@markhuds](https://discuss.elastic.co/u/markhuds)\ **Replies:** 3\ **Last updated:** [February 14, 2020, 10:26pm UTC](https://discuss.elastic.co/t/using-original-query-score-in-a-rescore-function-score-query/219087 "2020-02-14T22:26:52Z")
I would like to accomplish the following with a query: 1.) Perform a complex query that calculates a score for each matched document 2.) Rescore top N documents using a cosineSimilarity function for the dense\_vector fi… --- ## [Creating a Plug and Play Ingested DB?](https://discuss.elastic.co/t/creating-a-plug-and-play-ingested-db/219443)
**Author:** [@fallenreaper](https://discuss.elastic.co/u/fallenreaper)\ **Replies:** 0\ **Last updated:** [February 14, 2020, 8:17pm UTC](https://discuss.elastic.co/t/creating-a-plug-and-play-ingested-db/219443 "2020-02-14T20:17:48Z")
Thought to myself: ES does great for making queryable data, but one of the issues with things like Docker is that you need to commonly reingest the dataset in order for a docker instance of elasticsearch to be be stood … --- ## [Slow first request on an index after a short amount of time](https://discuss.elastic.co/t/slow-first-request-on-an-index-after-a-short-amount-of-time/219292)
**Author:** [@Spencer\_Uresk](https://discuss.elastic.co/u/Spencer_Uresk)\ **Replies:** 5\ **Last updated:** [February 14, 2020, 7:28pm UTC](https://discuss.elastic.co/t/slow-first-request-on-an-index-after-a-short-amount-of-time/219292 "2020-02-14T19:28:48Z")
We are having a really weird performance issue with our ES cluster, and I've run out of things to check so I thought I'd see if anyone has run into anything similar or has ideas for further debugging. Our symptom is thi… --- ## [BulkIndexError using Elasticsearch in Python](https://discuss.elastic.co/t/bulkindexerror-using-elasticsearch-in-python/219417)
**Author:** [@brendanwalker](https://discuss.elastic.co/u/brendanwalker)\ **Replies:** 2\ **Last updated:** [February 14, 2020, 5:30pm UTC](https://discuss.elastic.co/t/bulkindexerror-using-elasticsearch-in-python/219417 "2020-02-14T17:30:33Z")
I am writing a program to search through really large (\>400mb) csv files provided by the government. Some of these files have over 1,000,000 rows. This is a local program that roughly 5 people will use in my company to h… --- ## [Elasticsearch installation password issue?](https://discuss.elastic.co/t/elasticsearch-installation-password-issue/219376)
**Author:** [@benjatune](https://discuss.elastic.co/u/benjatune)\ **Replies:** 1\ **Last updated:** [February 14, 2020, 4:55pm UTC](https://discuss.elastic.co/t/elasticsearch-installation-password-issue/219376 "2020-02-14T16:55:38Z")
HI, I am installing elasticsearch 5.6.3 on ubuntu. I am using command service elasticsearch start user is ubuntu and the terminal ask for my password I have tried many default and I can't surpass it. Please advise. --- ## [Realistic Sizing for ElasticSearch](https://discuss.elastic.co/t/realistic-sizing-for-elasticsearch/219404)
**Author:** [@rukmalf](https://discuss.elastic.co/u/rukmalf)\ **Replies:** 1\ **Last updated:** [February 14, 2020, 4:50pm UTC](https://discuss.elastic.co/t/realistic-sizing-for-elasticsearch/219404 "2020-02-14T16:50:54Z")
Hi, I am new to this forum. I have been playing around a bit with ES. The thing that confuses me is that how to size a ES setup. For example if we go with the official channels (with the SEs) they recommend to have hot… --- ## [Cluster Design question](https://discuss.elastic.co/t/cluster-design-question/218674)
**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\ **Replies:** 2\ **Last updated:** [February 14, 2020, 4:36pm UTC](https://discuss.elastic.co/t/cluster-design-question/218674 "2020-02-14T16:36:55Z")
I am setting up new cluster. Will have few new systems. and have some question. four high end servers with faster disk, 192gig ram, faster network connection with multiple cpu. (master/data) one server will be little … --- ## [Search source code and also use as store for them at the same time](https://discuss.elastic.co/t/search-source-code-and-also-use-as-store-for-them-at-the-same-time/219365)
**Author:** [@ice3man543](https://discuss.elastic.co/u/ice3man543)\ **Replies:** 6\ **Last updated:** [February 14, 2020, 4:20pm UTC](https://discuss.elastic.co/t/search-source-code-and-also-use-as-store-for-them-at-the-same-time/219365 "2020-02-14T16:20:52Z")
I am building a search engine for some internal code and we decided to use elasticsearch. The issue is i also need access to those documents directly with an ID while providing search on them. Reading around, some forum… --- ## [Cluster Rolling Upgrade : Necessary to disable replica shard allocation for each node?](https://discuss.elastic.co/t/cluster-rolling-upgrade-necessary-to-disable-replica-shard-allocation-for-each-node/219399)
**Author:** [@Travis](https://discuss.elastic.co/u/Travis)\ **Replies:** 3\ **Last updated:** [February 14, 2020, 4:07pm UTC](https://discuss.elastic.co/t/cluster-rolling-upgrade-necessary-to-disable-replica-shard-allocation-for-each-node/219399 "2020-02-14T16:07:07Z")
Hello Elasticers, I'm asking if it's really necessary to disable replica shard allocation for each node as described in the documentation As this is a cluster setting, why not disable replica shard allocation one time,… --- ## [How to split a string into several parts GROK](https://discuss.elastic.co/t/how-to-split-a-string-into-several-parts-grok/219396)
**Author:** [@111291](https://discuss.elastic.co/u/111291)\ **Replies:** 1\ **Last updated:** [February 14, 2020, 3:30pm UTC](https://discuss.elastic.co/t/how-to-split-a-string-into-several-parts-grok/219396 "2020-02-14T15:30:22Z")
Hello, I have a cropped string: "20021416", format "yymmddhh". How to break it into a date ("yy-mm-dd") and an hour of time Best regards --- ## [Using a "missing" field option in a group by statement in a Data Transform](https://discuss.elastic.co/t/using-a-missing-field-option-in-a-group-by-statement-in-a-data-transform/219069)
**Author:** [@ebalmeida](https://discuss.elastic.co/u/ebalmeida)\ **Replies:** 2\ **Last updated:** [February 14, 2020, 3:07pm UTC](https://discuss.elastic.co/t/using-a-missing-field-option-in-a-group-by-statement-in-a-data-transform/219069 "2020-02-14T15:07:47Z")
Hi guys, I'm trying to create a data transform (using kibana's interface) in elasticsearch that includes missing docs for one of it's group by parameters as such: However, once I hit apply changes, it obliterates the… --- ## [Grok pattern works but not applied on Kibana (2nd)](https://discuss.elastic.co/t/grok-pattern-works-but-not-applied-on-kibana-2nd/219187)
**Author:** [@Cuju](https://discuss.elastic.co/u/Cuju)\ **Replies:** 1\ **Last updated:** [February 14, 2020, 2:55pm UTC](https://discuss.elastic.co/t/grok-pattern-works-but-not-applied-on-kibana-2nd/219187 "2020-02-14T14:55:56Z")
Hello, I have an issue I try to fix for a couple of days, without success. I posted it on the wrong channel so here we go again. I need to grok the message field (they don't have the same syntax) from my Kibana but it f… --- ## [Behavior of a deleted pipeline](https://discuss.elastic.co/t/behavior-of-a-deleted-pipeline/219213)
**Author:** [@Cuju](https://discuss.elastic.co/u/Cuju)\ **Replies:** 2\ **Last updated:** [February 14, 2020, 2:54pm UTC](https://discuss.elastic.co/t/behavior-of-a-deleted-pipeline/219213 "2020-02-14T14:54:43Z")
Hello, I had to delete and reinstall Filebeat because of some things I did wrong. In the old configuration I had, it gave me some available fields which are also in the new old, even if the pipeline doesn't exist (like … --- ## [ES 2 master node configuration](https://discuss.elastic.co/t/es-2-master-node-configuration/219175)
**Author:** [@Tushar\_Khanna](https://discuss.elastic.co/u/Tushar_Khanna)\ **Replies:** 2\ **Last updated:** [February 14, 2020, 2:52pm UTC](https://discuss.elastic.co/t/es-2-master-node-configuration/219175 "2020-02-14T14:52:21Z")
Hi Team, There are 2 master eligible nodes with below configuration. Node 1 (only master) , Node2(master and data and belonging to one of the data center) , in addition there are 4 more only data nodes belonging to one … --- ## [How to use another field for query if the first does not exist value](https://discuss.elastic.co/t/how-to-use-another-field-for-query-if-the-first-does-not-exist-value/219291)
**Author:** [@adrianog3](https://discuss.elastic.co/u/adrianog3)\ **Replies:** 2\ **Last updated:** [February 14, 2020, 2:45pm UTC](https://discuss.elastic.co/t/how-to-use-another-field-for-query-if-the-first-does-not-exist-value/219291 "2020-02-14T14:45:28Z")
I would like to do a date filter on a field called "last\_update\_date", however, if the value is "null", I should use another field called "creation\_date". Is there any way to do this? The filter for the "last\_update\_dat… --- ## [Why do shards seem to get recreated when they already exist?](https://discuss.elastic.co/t/why-do-shards-seem-to-get-recreated-when-they-already-exist/219228)
**Author:** [@mikewillis](https://discuss.elastic.co/u/mikewillis)\ **Replies:** 5\ **Last updated:** [February 14, 2020, 2:29pm UTC](https://discuss.elastic.co/t/why-do-shards-seem-to-get-recreated-when-they-already-exist/219228 "2020-02-14T14:29:24Z")
Elasticsearch 6.8.6. I'm wondering if someone can explain why after opening, unfreezing and freezing an index, some replica shards sometimes appear to be get recreated from primaries even though they already exist on di… --- ## [Why between tag (in range query) doesn't work in Elastic Search queries?](https://discuss.elastic.co/t/why-between-tag-in-range-query-doesnt-work-in-elastic-search-queries/219137)
**Author:** [@busra](https://discuss.elastic.co/u/busra)\ **Replies:** 3\ **Last updated:** [February 14, 2020, 2:27pm UTC](https://discuss.elastic.co/t/why-between-tag-in-range-query-doesnt-work-in-elastic-search-queries/219137 "2020-02-14T14:27:06Z")
In Elasticsearch i have mapping such as ; "body": { "properties":{ "time\_Stamp":{ "type" : "date", "format": "dd.MM.yyyy HH:mm:ss" }, "value1":{ .... } .... } } } I want to get data between two dates. If i … --- ## [6.4 to 7.3, After Upgrade Elasticsearch uses 50% more Disk storage](https://discuss.elastic.co/t/6-4-to-7-3-after-upgrade-elasticsearch-uses-50-more-disk-storage/218766)
**Author:** [@oshan](https://discuss.elastic.co/u/oshan)\ **Replies:** 3\ **Last updated:** [February 14, 2020, 12:24pm UTC](https://discuss.elastic.co/t/6-4-to-7-3-after-upgrade-elasticsearch-uses-50-more-disk-storage/218766 "2020-02-14T12:24:25Z")
I am using ES 6.4 and after full indexing its size is 64GB for the Geo shapes index. then I did all the code migrations and did the full indexing using ES 7.3 setup. now that index size is 97GB. Is this an expected cha… --- ## [None of the configured nodes are available when GC took more than 30 sec](https://discuss.elastic.co/t/none-of-the-configured-nodes-are-available-when-gc-took-more-than-30-sec/218965)
**Author:** [@chelawatankit](https://discuss.elastic.co/u/chelawatankit)\ **Replies:** 12\ **Last updated:** [February 14, 2020, 11:38am UTC](https://discuss.elastic.co/t/none-of-the-configured-nodes-are-available-when-gc-took-more-than-30-sec/218965 "2020-02-14T11:38:14Z")
Hi, I am using Elasticsearch 7.1.1 version. To connect with elasticsearch node I am using java transport client of 7.1.1 version. When I perform continuously insert, fetch and delete records from the index. (Night run)… --- ## [Location of json data file and yml](https://discuss.elastic.co/t/location-of-json-data-file-and-yml/219347)
**Author:** [@Vagelis](https://discuss.elastic.co/u/Vagelis)\ **Replies:** 0\ **Last updated:** [February 14, 2020, 10:18am UTC](https://discuss.elastic.co/t/location-of-json-data-file-and-yml/219347 "2020-02-14T10:18:15Z")
I would like to specify in the yml file where the json data file is located. It is the file that I would like the elasticsearch to read. I have set in the yml path.data: /etc/elasticsearch/data and elasticsearch seem… --- ## [How to push nested documents with filebeat to a dynamically create index](https://discuss.elastic.co/t/how-to-push-nested-documents-with-filebeat-to-a-dynamically-create-index/219192)
**Author:** [@Baylib](https://discuss.elastic.co/u/Baylib)\ **Replies:** 1\ **Last updated:** [February 14, 2020, 10:31am UTC](https://discuss.elastic.co/t/how-to-push-nested-documents-with-filebeat-to-a-dynamically-create-index/219192 "2020-02-14T10:31:57Z")
Hi, I create nested json documents. I manage to push them with filebeat to get the mapping done dynamicaly. There was some arrays of objects. Then reindexed them in new index with the mapping changed for those arrays… --- ## [Deleting Logs on ElastaCloud](https://discuss.elastic.co/t/deleting-logs-on-elastacloud/219349)
**Author:** [@Bill.S.Preston](https://discuss.elastic.co/u/Bill.S.Preston)\ **Replies:** 0\ **Last updated:** [February 14, 2020, 10:28am UTC](https://discuss.elastic.co/t/deleting-logs-on-elastacloud/219349 "2020-02-14T10:28:59Z")
I have a lot of dummy logs from an ElastaCloud Environment that were generated during a testing phase that I no longer want. I would like to start from a clean slate. Is there any way for me to delete these? --- ## [I am totally new to elasticsearch and using version 7. I have to save images into elasticsearch](https://discuss.elastic.co/t/i-am-totally-new-to-elasticsearch-and-using-version-7-i-have-to-save-images-into-elasticsearch/219344)
**Author:** [@komal-jaiswal](https://discuss.elastic.co/u/komal-jaiswal)\ **Replies:** 1\ **Last updated:** [February 14, 2020, 10:14am UTC](https://discuss.elastic.co/t/i-am-totally-new-to-elasticsearch-and-using-version-7-i-have-to-save-images-into-elasticsearch/219344 "2020-02-14T10:14:45Z")
I am totally new to elasticsearch and using version 7. I have to save images into elasticsearch. I dont have any idea how to store images into ES.Please help me out --- ## [Fatal Error Elasticsearch](https://discuss.elastic.co/t/fatal-error-elasticsearch/219302)
**Author:** [@vivektsb](https://discuss.elastic.co/u/vivektsb)\ **Replies:** 3\ **Last updated:** [February 14, 2020, 9:37am UTC](https://discuss.elastic.co/t/fatal-error-elasticsearch/219302 "2020-02-14T09:37:32Z")
HI Team, We are extending the topic https://discuss.elastic.co/t/fatal-error-in-thread-elasticsearch/214360. We have faced the again same issue when executing queries even we reduce heap size to around 30 GB to make us… --- ## [Splitting message field](https://discuss.elastic.co/t/splitting-message-field/218768)
**Author:** [@liammcc](https://discuss.elastic.co/u/liammcc)\ **Replies:** 5\ **Last updated:** [February 14, 2020, 9:10am UTC](https://discuss.elastic.co/t/splitting-message-field/218768 "2020-02-14T09:10:05Z")
Good morning we have recently just set up kibana and don't have much knowledge on it. It is splitting everything well apart from our message which can be seen below. 2020-02-11T11:59:25.700Z das43423-fsdads434-sfafd4 IN… --- ## [Data Volume for k8s](https://discuss.elastic.co/t/data-volume-for-k8s/217808)
**Author:** [@SadeekM](https://discuss.elastic.co/u/SadeekM)\ **Replies:** 1\ **Last updated:** [February 14, 2020, 9:04am UTC](https://discuss.elastic.co/t/data-volume-for-k8s/217808 "2020-02-14T09:04:08Z")
Hi, I'm running Elastic on K8S and Docker, all my container running fine. But I'm specifying data volume during deployment Vol "/xyz/data0" . but it's not storing data on this location its storing on default location "… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1014) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1016)