# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1130 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1131 --- ## [How to decide between regex and wildcard for a scenario](https://discuss.elastic.co/t/how-to-decide-between-regex-and-wildcard-for-a-scenario/202902)
**Author:** [@Seetha93](https://discuss.elastic.co/u/Seetha93)\ **Replies:** 0\ **Last updated:** [October 9, 2019, 7:00pm UTC](https://discuss.elastic.co/t/how-to-decide-between-regex-and-wildcard-for-a-scenario/202902 "2019-10-09T19:00:17Z")
When we are trying to do a regex on around 10 different terms, we get the following exception: ElasticsearchException\[Elasticsearch exception \[type=too\_complex\_to\_determinize\_exception, reason=too\_complex\_to\_determinize… --- ## [ECS and Python logging](https://discuss.elastic.co/t/ecs-and-python-logging/202554)
**Author:** [@darren.skinner](https://discuss.elastic.co/u/darren.skinner)\ **Replies:** 10\ **Last updated:** [October 9, 2019, 6:19pm UTC](https://discuss.elastic.co/t/ecs-and-python-logging/202554 "2019-10-09T18:19:41Z")
Hi, I'm working on an update to a set of interlinked internal projects to adopt the ECS for easier correlation and tracking of pipelines. One of the apps uses python logging, so i'm trying to work on renaming the stand… --- ## [Query unseen items (Unseen Cards in Tinder)](https://discuss.elastic.co/t/query-unseen-items-unseen-cards-in-tinder/202883)
**Author:** [@davidbiller](https://discuss.elastic.co/u/davidbiller)\ **Replies:** 0\ **Last updated:** [October 9, 2019, 5:09pm UTC](https://discuss.elastic.co/t/query-unseen-items-unseen-cards-in-tinder/202883 "2019-10-09T17:09:43Z")
I use AWS Amplify. AppSync and DynamoDB. By DynamoDB stream, I fill ElasticSearch. I would like to offer cards to swipe. Since the user should see only not swiped cards, I need a possibility to filter the seen ones. Wh… --- ## [Adding rack awareness to Elasticsearch cluster on GKE](https://discuss.elastic.co/t/adding-rack-awareness-to-elasticsearch-cluster-on-gke/202888)
**Author:** [@pinakinab](https://discuss.elastic.co/u/pinakinab)\ **Replies:** 0\ **Last updated:** [October 9, 2019, 5:25pm UTC](https://discuss.elastic.co/t/adding-rack-awareness-to-elasticsearch-cluster-on-gke/202888 "2019-10-09T17:25:29Z")
We are trying to setup elasticsearch cluster on GKE. We are using official helm chart of elasticsearch for the same. We are able to setup a cluster. However we are not able to add allocation awareness attributes in the c… --- ## [Size of nested array is always 0](https://discuss.elastic.co/t/size-of-nested-array-is-always-0/202569)
**Author:** [@igushev](https://discuss.elastic.co/u/igushev)\ **Replies:** 2\ **Last updated:** [October 9, 2019, 5:18pm UTC](https://discuss.elastic.co/t/size-of-nested-array-is-always-0/202569 "2019-10-09T17:18:20Z")
Schema looks like this: "mappings": { "\_doc": { "\_all": { "enabled": false }, "properties": { "category\_boost": { "type": "nested", "properties" : { … --- ## [Search set of intervals](https://discuss.elastic.co/t/search-set-of-intervals/202734)
**Author:** [@poorvig89](https://discuss.elastic.co/u/poorvig89)\ **Replies:** 2\ **Last updated:** [October 9, 2019, 5:08pm UTC](https://discuss.elastic.co/t/search-set-of-intervals/202734 "2019-10-09T17:08:16Z")
Given a set of time intervals in indexed data. is there a way where we can identify if a given time lies in any of the intervals present. For eg: If the indexed data has { "time\_shifts": \[ \[11:30:00, 14:30:00\] \[15:… --- ## [Failed to parse date field with format epoch\_millis](https://discuss.elastic.co/t/failed-to-parse-date-field-with-format-epoch-millis/202000)
**Author:** [@GitsBdr](https://discuss.elastic.co/u/GitsBdr)\ **Replies:** 1\ **Last updated:** [October 9, 2019, 4:48pm UTC](https://discuss.elastic.co/t/failed-to-parse-date-field-with-format-epoch-millis/202000 "2019-10-09T16:48:43Z")
Hi all, Thanks in advance for your appreciated help. Would you know from where can come this error ? It occurs when I zoom in a specific window of 2 / 3 minutes in a timelion visualization I'm using kibana-7.3.2 an… --- ## [Elasticsearch 8 release date](https://discuss.elastic.co/t/elasticsearch-8-release-date/202759)
**Author:** [@MKU](https://discuss.elastic.co/u/MKU)\ **Replies:** 3\ **Last updated:** [October 9, 2019, 3:46pm UTC](https://discuss.elastic.co/t/elasticsearch-8-release-date/202759 "2019-10-09T15:46:45Z")
Hi all, I would like to know the approximate month or date of Elasticsearch 8 release . Thanks --- ## [Options to archive elasticsearch data](https://discuss.elastic.co/t/options-to-archive-elasticsearch-data/202863)
**Author:** [@Tim\_Flowers](https://discuss.elastic.co/u/Tim_Flowers)\ **Replies:** 0\ **Last updated:** [October 9, 2019, 3:12pm UTC](https://discuss.elastic.co/t/options-to-archive-elasticsearch-data/202863 "2019-10-09T15:12:16Z")
I am looking for the best option to export and archive large amounts of data from elasticsearch. I have to keep some data in cold storage so to speak. It will be data that potentially may never be searched again, but w… --- ## [FSCrawler Ubuntu](https://discuss.elastic.co/t/fscrawler-ubuntu/202115)
**Author:** [@glondres](https://discuss.elastic.co/u/glondres)\ **Replies:** 4\ **Last updated:** [October 9, 2019, 2:52pm UTC](https://discuss.elastic.co/t/fscrawler-ubuntu/202115 "2019-10-09T14:52:50Z")
Hello! I was running Elastic in Windows but now I have to migrate to Ubuntu in a cloud server. The problem is that I was using FSCrawler to ingest the files to the stack, which runs smooth on Windows. However, there is… --- ## [Change default number of Shards in a planned created cluster](https://discuss.elastic.co/t/change-default-number-of-shards-in-a-planned-created-cluster/202859)
**Author:** [@Mai\_Waly](https://discuss.elastic.co/u/Mai_Waly)\ **Replies:** 0\ **Last updated:** [October 9, 2019, 2:49pm UTC](https://discuss.elastic.co/t/change-default-number-of-shards-in-a-planned-created-cluster/202859 "2019-10-09T14:49:57Z")
Hi All, We are planning to implement a 3 node elastic search cluster and one logstash and one kibana. we will use filebeats and metricbeats how to make the default number of shard 3 not 1 as I know 7.4 has the default … --- ## [Elasticsearch socket block OR timeout](https://discuss.elastic.co/t/elasticsearch-socket-block-or-timeout/202545)
**Author:** [@ashishtiwari1993](https://discuss.elastic.co/u/ashishtiwari1993)\ **Replies:** 4\ **Last updated:** [October 9, 2019, 2:31pm UTC](https://discuss.elastic.co/t/elasticsearch-socket-block-or-timeout/202545 "2019-10-09T14:31:52Z")
Hi Team, Cluster Specification: ES version - 6.2.2 Nodes : 3 (true =\> master, data, ingest) Heap : 30 GB per node RAM : 128 GB , 64 GB, 64 GB Core: 24 Disk Available : approx 200 GB indexes - 169 Replica - 0 Per inde… --- ## [Unknown log source from filebeat](https://discuss.elastic.co/t/unknown-log-source-from-filebeat/202812)
**Author:** [@v.n](https://discuss.elastic.co/u/v.n)\ **Replies:** 1\ **Last updated:** [October 9, 2019, 1:49pm UTC](https://discuss.elastic.co/t/unknown-log-source-from-filebeat/202812 "2019-10-09T13:49:24Z")
Hi! I have four nodes cluster from the two ones are data and master nodes, one dedicated master node and one coordinating node. I collect logs from windows and linux hosts with winlogbeat and filebeat which are sent to … --- ## [Upsert data in ElasticSearch using python dataframes](https://discuss.elastic.co/t/upsert-data-in-elasticsearch-using-python-dataframes/202841)
**Author:** [@myrtod](https://discuss.elastic.co/u/myrtod)\ **Replies:** 0\ **Last updated:** [October 9, 2019, 1:48pm UTC](https://discuss.elastic.co/t/upsert-data-in-elasticsearch-using-python-dataframes/202841 "2019-10-09T13:48:06Z")
Hi all ! I am using python to read a csv, transform it and then load it in ElasticSearch (using Espandas). Given the mapping, I wish to add some more data from other csvs, as fields. For example, suppose I have a csv … --- ## [Manage indices and shards](https://discuss.elastic.co/t/manage-indices-and-shards/202832)
**Author:** [@kentatoi](https://discuss.elastic.co/u/kentatoi)\ **Replies:** 0\ **Last updated:** [October 9, 2019, 12:49pm UTC](https://discuss.elastic.co/t/manage-indices-and-shards/202832 "2019-10-09T12:49:14Z")
Hi, I have an ELK-stack configured on a bunch of servers. For now we only have one master node and using Logstash on each serv to ship the logs. I created indices as follow: vertical\_typeOfLogs\_YYYY-MM-DD Now I want … --- ## [Query to get distinct values satisfying two or more conditions](https://discuss.elastic.co/t/query-to-get-distinct-values-satisfying-two-or-more-conditions/202659)
**Author:** [@ajsal\_shereef](https://discuss.elastic.co/u/ajsal_shereef)\ **Replies:** 3\ **Last updated:** [October 9, 2019, 11:42am UTC](https://discuss.elastic.co/t/query-to-get-distinct-values-satisfying-two-or-more-conditions/202659 "2019-10-09T11:42:43Z")
Hi, I'm a newbie to elastic search. I was working on some example queries. I have loaded Kibana flight data to the console. Now, I wanted to know the query which will fetch distict flights which land in Italy. Any help … --- ## [Insert and update relational data with denormalization](https://discuss.elastic.co/t/insert-and-update-relational-data-with-denormalization/202556)
**Author:** [@meynety](https://discuss.elastic.co/u/meynety)\ **Replies:** 1\ **Last updated:** [October 9, 2019, 11:33am UTC](https://discuss.elastic.co/t/insert-and-update-relational-data-with-denormalization/202556 "2019-10-09T11:33:42Z")
Hello, As a new ES user, I'm facing some questions about data structure, denormalization and what comes with it : Considering a simple 1:n data structure, like Device -\> Record, where a Device produces a high number of… --- ## [Roll over Rollup index](https://discuss.elastic.co/t/roll-over-rollup-index/202822)
**Author:** [@Fay\_De\_Raille\_Di](https://discuss.elastic.co/u/Fay_De_Raille_Di)\ **Replies:** 0\ **Last updated:** [October 9, 2019, 11:28am UTC](https://discuss.elastic.co/t/roll-over-rollup-index/202822 "2019-10-09T11:28:22Z")
Hello, In order to keep data for a long time, I need to perform a rollover (ilm) on a rollup index. The idea is that the rollup index does not grow forever. I'am a bit confused rollover works with aliases that allows … --- ## [Azure Repository Plugin OnPremise](https://discuss.elastic.co/t/azure-repository-plugin-onpremise/202813)
**Author:** [@das\_santosh](https://discuss.elastic.co/u/das_santosh)\ **Replies:** 0\ **Last updated:** [October 9, 2019, 10:24am UTC](https://discuss.elastic.co/t/azure-repository-plugin-onpremise/202813 "2019-10-09T10:24:49Z")
Hi ElasticsearchTeam, We are trying to do the setup for Azure repository on Azure Stack Environment and we have followed the below link and steps to do the setup . https://www.elastic.co/guide/en/elasticsearch/plugins… --- ## [Preserve all underscores in a piece of text](https://discuss.elastic.co/t/preserve-all-underscores-in-a-piece-of-text/201738)
**Author:** [@theflyingcarpet](https://discuss.elastic.co/u/theflyingcarpet)\ **Replies:** 1\ **Last updated:** [October 9, 2019, 10:17am UTC](https://discuss.elastic.co/t/preserve-all-underscores-in-a-piece-of-text/201738 "2019-10-09T10:17:05Z")
Hi, I'm trying to use an underscore separated key to make array sub-elements easier to combine in searches. The key is of the form 53\_dock\_pt1\_sometoken\_tb1 where the tokens are hierarchical and I've ingested using st… --- ## [Disable other conditions in query if first one works](https://discuss.elastic.co/t/disable-other-conditions-in-query-if-first-one-works/202810)
**Author:** [@Behemo1h](https://discuss.elastic.co/u/Behemo1h)\ **Replies:** 0\ **Last updated:** [October 9, 2019, 10:11am UTC](https://discuss.elastic.co/t/disable-other-conditions-in-query-if-first-one-works/202810 "2019-10-09T10:11:14Z")
Hi guys, for example i have 2 field, title1, title2 I have 2 condition for search: 'should'=\>\[ { 'term'=\>{ 'title1'=\>'onetwofree' } }, { 'term'=\>{ 'title1'=\>'freetwoone' } } \] So i need if 1st condition ('o… --- ## [Storing data in Nested type vs Storing directly in outer layer](https://discuss.elastic.co/t/storing-data-in-nested-type-vs-storing-directly-in-outer-layer/202805)
**Author:** [@rakmo](https://discuss.elastic.co/u/rakmo)\ **Replies:** 0\ **Last updated:** [October 9, 2019, 9:45am UTC](https://discuss.elastic.co/t/storing-data-in-nested-type-vs-storing-directly-in-outer-layer/202805 "2019-10-09T09:45:37Z")
I have a 100 fields to be stored, whose structure is defined. Which structure is preferred of these both? // Mapping 1 { "data": "nested" } // Sample Data Structure 1 { "data": { "f1": "value", … --- ## [Date\_histogram and day buckets](https://discuss.elastic.co/t/date-histogram-and-day-buckets/201838)
**Author:** [@gturner](https://discuss.elastic.co/u/gturner)\ **Replies:** 5\ **Last updated:** [October 9, 2019, 9:45am UTC](https://discuss.elastic.co/t/date-histogram-and-day-buckets/201838 "2019-10-09T09:45:28Z")
Hi, Previously on v5 when using the following query we would only be returned the buckets that are within the range specified. We need the min buckets to be able to graph correctly. On v7.3 the same query returns a bu… --- ## [Elasticsearch snapshot IN\_PROGRESS for a long time. The delete snapshot API is also not working](https://discuss.elastic.co/t/elasticsearch-snapshot-in-progress-for-a-long-time-the-delete-snapshot-api-is-also-not-working/202623)
**Author:** [@nisham](https://discuss.elastic.co/u/nisham)\ **Replies:** 1\ **Last updated:** [October 9, 2019, 9:13am UTC](https://discuss.elastic.co/t/elasticsearch-snapshot-in-progress-for-a-long-time-the-delete-snapshot-api-is-also-not-working/202623 "2019-10-09T09:13:34Z")
Hello, I have a Elasticsearch cluster with following configuration. Elasticsearch version : 5.1.1 Number of Nodes : 10 A daily snapshot process is running in the Cluster. In which the last snapshot was created few da… --- ## [My index loses data every 30 days](https://discuss.elastic.co/t/my-index-loses-data-every-30-days/202015)
**Author:** [@Lotfi\_Zaouai](https://discuss.elastic.co/u/Lotfi_Zaouai)\ **Replies:** 6\ **Last updated:** [October 9, 2019, 9:12am UTC](https://discuss.elastic.co/t/my-index-loses-data-every-30-days/202015 "2019-10-09T09:12:05Z")
I use Elasticsearch and Kibana, I submit my data with the bulk API in vb.net program. I did not make any special configuration in elastic search. here is the content of the file elasticsearch.yml : bootstrap.memory\_l… --- ## [Highlight - Fragment size not working as expected](https://discuss.elastic.co/t/highlight-fragment-size-not-working-as-expected/202765)
**Author:** [@Ilamparithi\_Karthike](https://discuss.elastic.co/u/Ilamparithi_Karthike)\ **Replies:** 1\ **Last updated:** [October 9, 2019, 9:04am UTC](https://discuss.elastic.co/t/highlight-fragment-size-not-working-as-expected/202765 "2019-10-09T09:04:20Z")
Hi, I am using the latest version of the elastic search(7.4.0). I have used highlighting for my search. I have used the number of fragments as 100 and fragment\_size as 50 but the thing is it highlights the entire paragr… --- ## [Combine range query with term](https://discuss.elastic.co/t/combine-range-query-with-term/202773)
**Author:** [@Stella\_Sunshine](https://discuss.elastic.co/u/Stella_Sunshine)\ **Replies:** 2\ **Last updated:** [October 9, 2019, 7:36am UTC](https://discuss.elastic.co/t/combine-range-query-with-term/202773 "2019-10-09T07:36:40Z")
Hey everybody, the title seems as if the solution is easy... but my problem is a bit more tricky. I have several products which can have several articles and each article has a price list with different price list ids. … --- ## [Request Entity Too Large when index file json has size large 100mb](https://discuss.elastic.co/t/request-entity-too-large-when-index-file-json-has-size-large-100mb/202760)
**Author:** [@Vo\_Van\_Huy](https://discuss.elastic.co/u/Vo_Van_Huy)\ **Replies:** 4\ **Last updated:** [October 9, 2019, 8:19am UTC](https://discuss.elastic.co/t/request-entity-too-large-when-index-file-json-has-size-large-100mb/202760 "2019-10-09T08:19:10Z")
How to index file json has size large 100mb with fscrawler and elastic. I use fscrawler 2.6 and elastic 6.8.0. --- ## [Query efficiency (kibana/time based patterns)](https://discuss.elastic.co/t/query-efficiency-kibana-time-based-patterns/197878)
**Author:** [@darkmoon](https://discuss.elastic.co/u/darkmoon)\ **Replies:** 26\ **Last updated:** [October 9, 2019, 7:55am UTC](https://discuss.elastic.co/t/query-efficiency-kibana-time-based-patterns/197878 "2019-10-09T07:55:03Z")
avencar posted a very good question, that is exactly what we're seeing. I'll quote here: Hi Matthew, I appreciate the response. We do have a time filter field name selected for the index pattern. Also, we have a l… --- ## [Time optimisation for elasticsearch cosine similarity](https://discuss.elastic.co/t/time-optimisation-for-elasticsearch-cosine-similarity/202782)
**Author:** [@anamika1305](https://discuss.elastic.co/u/anamika1305)\ **Replies:** 0\ **Last updated:** [October 9, 2019, 7:34am UTC](https://discuss.elastic.co/t/time-optimisation-for-elasticsearch-cosine-similarity/202782 "2019-10-09T07:34:29Z")
I have upload 29lakhs record with embeddings. I am trying to get cosine similarity for my input query. My query is currently taking 5secs to return the result. How Can I optimise the time to 1 sec or less? [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1129) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1131)