# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=771 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 772 --- ## [Compare if hosts/feeds are missing from last week](https://discuss.elastic.co/t/compare-if-hosts-feeds-are-missing-from-last-week/254412)
**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\ **Replies:** 3\ **Last updated:** [November 5, 2020, 8:25pm UTC](https://discuss.elastic.co/t/compare-if-hosts-feeds-are-missing-from-last-week/254412 "2020-11-05T20:25:46Z")
We have 1000's of hosts (windows/linux/solaris/network devices) coming to ELK cluster. We wanted to understand if there the hosts/devices missed sending the data. I could think of below options Get list of hosts comin… --- ## [Force replication](https://discuss.elastic.co/t/force-replication/254429)
**Author:** [@vincent2mots](https://discuss.elastic.co/u/vincent2mots)\ **Replies:** 4\ **Last updated:** [November 5, 2020, 8:10pm UTC](https://discuss.elastic.co/t/force-replication/254429 "2020-11-05T20:10:50Z")
Hi there! I started a new fresh Elasticsearch (7.9) cluster with sample flights data. If I look up for the "number\_of\_replicas" setting of this index, I get 1. And, if I try to use the cat/shards API, I see one primary… --- ## [Index openxml structured documents with Elasticsearch](https://discuss.elastic.co/t/index-openxml-structured-documents-with-elasticsearch/254445)
**Author:** [@vhd.afr](https://discuss.elastic.co/u/vhd.afr)\ **Replies:** 0\ **Last updated:** [November 5, 2020, 5:53pm UTC](https://discuss.elastic.co/t/index-openxml-structured-documents-with-elasticsearch/254445 "2020-11-05T17:53:00Z")
We have a set of structured documents. The structure is extremely inspired by openxml data model. Briefly speaking, documents are made up of an ordered set of paragraphs, each paragraph itself has id and an ordered set o… --- ## [Context Suggester: measures to limit memory usage](https://discuss.elastic.co/t/context-suggester-measures-to-limit-memory-usage/254372)
**Author:** [@Bhavik92](https://discuss.elastic.co/u/Bhavik92)\ **Replies:** 0\ **Last updated:** [November 5, 2020, 8:23am UTC](https://discuss.elastic.co/t/context-suggester-measures-to-limit-memory-usage/254372 "2020-11-05T08:23:12Z")
We're using elasticsearch for our search use-case and have an index that serves both regular queries as well as autocompletion. For autocompletion, I've enabled completion suggester on it. However, there is growing con… --- ## [Validating that documents conform to strict mappings](https://discuss.elastic.co/t/validating-that-documents-conform-to-strict-mappings/254421)
**Author:** [@mjuric](https://discuss.elastic.co/u/mjuric)\ **Replies:** 2\ **Last updated:** [November 5, 2020, 2:59pm UTC](https://discuss.elastic.co/t/validating-that-documents-conform-to-strict-mappings/254421 "2020-11-05T14:59:01Z")
We need to validate that documents delivered to us conform to strict mappings in ElastiSearch before they are indexed. Is there a way to use the strict mapping validation component of ElasticSearch as a library outside t… --- ## [Syntax changes](https://discuss.elastic.co/t/syntax-changes/254418)
**Author:** [@somethingcool](https://discuss.elastic.co/u/somethingcool)\ **Replies:** 1\ **Last updated:** [November 5, 2020, 2:31pm UTC](https://discuss.elastic.co/t/syntax-changes/254418 "2020-11-05T14:31:24Z")
Currently we are using Elastic 2.3.x and migrating to 6.8.x and noticed that one of our queries is no longer returning data. The data between the environment versions is 100% the same. We have a job that writes the same … --- ## [Cloned/Split Indexes Take Double Disk Space When Increasing Shards](https://discuss.elastic.co/t/cloned-split-indexes-take-double-disk-space-when-increasing-shards/254342)
**Author:** [@scott\_stash](https://discuss.elastic.co/u/scott_stash)\ **Replies:** 4\ **Last updated:** [November 5, 2020, 1:32pm UTC](https://discuss.elastic.co/t/cloned-split-indexes-take-double-disk-space-when-increasing-shards/254342 "2020-11-05T13:32:43Z")
Currently I have some large index's (100GB - 500GB) that have been allocated 5 shards. I would like to increase these to 10 - 20 shards each. If I use the Split API or Clone API it takes 1-2 minutes for the new index t… --- ## [Paging for multisearch (from & size are not quite doing it)](https://discuss.elastic.co/t/paging-for-multisearch-from-size-are-not-quite-doing-it/254408)
**Author:** [@LanceWalton](https://discuss.elastic.co/u/LanceWalton)\ **Replies:** 0\ **Last updated:** [November 5, 2020, 1:09pm UTC](https://discuss.elastic.co/t/paging-for-multisearch-from-size-are-not-quite-doing-it/254408 "2020-11-05T13:09:44Z")
Hi. I have a question regarding using a multisearch across many indexes with from & size parameters for the purposes of paging. I have many indexes that I want to combine into a multisearch. The problem I'm having is t… --- ## [Using the Elasticsearch SQL API in Visual FoxPro (VFP) 9](https://discuss.elastic.co/t/using-the-elasticsearch-sql-api-in-visual-foxpro-vfp-9/254405)
**Author:** [@JCannon](https://discuss.elastic.co/u/JCannon)\ **Replies:** 0\ **Last updated:** [November 5, 2020, 12:55pm UTC](https://discuss.elastic.co/t/using-the-elasticsearch-sql-api-in-visual-foxpro-vfp-9/254405 "2020-11-05T12:55:42Z")
I am trying to see if I can get a program in Visual FoxPro (VFP) to work with the Elasticsearch SQL API. I have very little experience with both using REST APIs in VFP and Elasticsearch. Trying something new here. So… --- ## [Not getting data in Elastic & Kibna from logstash](https://discuss.elastic.co/t/not-getting-data-in-elastic-kibna-from-logstash/254154)
**Author:** [@Atul\_Chadha](https://discuss.elastic.co/u/Atul_Chadha)\ **Replies:** 2\ **Last updated:** [November 5, 2020, 12:10pm UTC](https://discuss.elastic.co/t/not-getting-data-in-elastic-kibna-from-logstash/254154 "2020-11-05T12:10:08Z")
I am trying to upgrade our 5.6 cluster to 7.6 and can certainly use some expertise. I have configured the filebeat with below config filebeat: config: inputs: path: /etc/filebeat/filebeat.yml filebeat: inputs: - i… --- ## [Problem with seting up of index lifecycle](https://discuss.elastic.co/t/problem-with-seting-up-of-index-lifecycle/254298)
**Author:** [@grynhtjnyuk](https://discuss.elastic.co/u/grynhtjnyuk)\ **Replies:** 2\ **Last updated:** [November 5, 2020, 11:52am UTC](https://discuss.elastic.co/t/problem-with-seting-up-of-index-lifecycle/254298 "2020-11-05T11:52:22Z")
I have the index with data from filebeat. I have set up the hot phase: maximum index size 600mb maximum age 4d Could you tell me, how to achive this behaviour: when the index come to 600mb OR age 4d , the index skip… --- ## [Cross field serch problem](https://discuss.elastic.co/t/cross-field-serch-problem/254360)
**Author:** [@squareEngine](https://discuss.elastic.co/u/squareEngine)\ **Replies:** 1\ **Last updated:** [November 5, 2020, 9:23am UTC](https://discuss.elastic.co/t/cross-field-serch-problem/254360 "2020-11-05T09:23:56Z")
Hi I'm trying to implement search functionality in our project using Nest. I have following query: query .Bool(must =\> must .Filter(m =\> m .MultiMatch(qs =\> qs .Type(TextQueryType.CrossFields) .Len… --- ## [Help: Elasticsearch Regexp query](https://discuss.elastic.co/t/help-elasticsearch-regexp-query/253445)
**Author:** [@Ketan\_Talreja](https://discuss.elastic.co/u/Ketan_Talreja)\ **Replies:** 6\ **Last updated:** [November 5, 2020, 7:58am UTC](https://discuss.elastic.co/t/help-elasticsearch-regexp-query/253445 "2020-11-05T07:58:48Z")
Hello All, I am new to elasticsearch and recently started using ES 6.x which is integrated with one of the third party application which stores all the data using indexes in ES. I have a scenario where I would like to r… --- ## [How to find the common phrase in a bucket](https://discuss.elastic.co/t/how-to-find-the-common-phrase-in-a-bucket/254362)
**Author:** [@Ehsan\_sarshar](https://discuss.elastic.co/u/Ehsan_sarshar)\ **Replies:** 0\ **Last updated:** [November 5, 2020, 7:42am UTC](https://discuss.elastic.co/t/how-to-find-the-common-phrase-in-a-bucket/254362 "2020-11-05T07:42:35Z")
I want to create an ecommerce search functionality. that user search for a product name and then I group the result base on product category. and then I want to find a common phrase in each category and suggest to user f… --- ## [Roll up Jobs](https://discuss.elastic.co/t/roll-up-jobs/254354)
**Author:** [@Dimple\_Goyal](https://discuss.elastic.co/u/Dimple_Goyal)\ **Replies:** 0\ **Last updated:** [November 5, 2020, 6:39am UTC](https://discuss.elastic.co/t/roll-up-jobs/254354 "2020-11-05T06:39:03Z")
Can I filter the documents in elastic search before rolling them up, or can I define filter query in rollup job, If yes how? --- ## [Partially dynamic mappings](https://discuss.elastic.co/t/partially-dynamic-mappings/254289)
**Author:** [@SorenAndersenCactus](https://discuss.elastic.co/u/SorenAndersenCactus)\ **Replies:** 2\ **Last updated:** [November 5, 2020, 4:46am UTC](https://discuss.elastic.co/t/partially-dynamic-mappings/254289 "2020-11-05T04:46:02Z")
Hi there! We have an elastic mapping that looks something like: "mappings": { "full-text-content": { "dynamic": "strict", "properties": {} "doi": { … --- ## [Request entity too large / error in filebeat](https://discuss.elastic.co/t/request-entity-too-large-error-in-filebeat/254238)
**Author:** [@grynhtjnyuk](https://discuss.elastic.co/u/grynhtjnyuk)\ **Replies:** 9\ **Last updated:** [November 5, 2020, 3:32am UTC](https://discuss.elastic.co/t/request-entity-too-large-error-in-filebeat/254238 "2020-11-05T03:32:58Z")
I have filebeat installed on kubernetes, and elasticsearch installed on kubernetes also. I got this error and I do not see logs in elasticsearch. Could you please tell me how can I solve the problem: \[elasticsearch\] el… --- ## [How to get previous indexed document in painless script](https://discuss.elastic.co/t/how-to-get-previous-indexed-document-in-painless-script/253966)
**Author:** [@Adriann](https://discuss.elastic.co/u/Adriann)\ **Replies:** 2\ **Last updated:** [November 5, 2020, 3:12am UTC](https://discuss.elastic.co/t/how-to-get-previous-indexed-document-in-painless-script/253966 "2020-11-05T03:12:55Z")
Hello, I want to access previous index document using painless script to compute value difference between document for my visualization. I want to count network utilization using data forwarded via logstash snmp. Is I… --- ## [Enable debug logs](https://discuss.elastic.co/t/enable-debug-logs/254339)
**Author:** [@animageofmine](https://discuss.elastic.co/u/animageofmine)\ **Replies:** 0\ **Last updated:** [November 5, 2020, 12:54am UTC](https://discuss.elastic.co/t/enable-debug-logs/254339 "2020-11-05T00:54:28Z")
This is a quick question, if someone can confirm this. Does this disable info logs? { "persistent": { "logger": { "org": { "elasticsearch": { "deprecation": "ERROR" … --- ## [How to view detailed progress of INITIALIZING replica shard(s)?](https://discuss.elastic.co/t/how-to-view-detailed-progress-of-initializing-replica-shard-s/254333)
**Author:** [@21908](https://discuss.elastic.co/u/21908)\ **Replies:** 1\ **Last updated:** [November 4, 2020, 9:56pm UTC](https://discuss.elastic.co/t/how-to-view-detailed-progress-of-initializing-replica-shard-s/254333 "2020-11-04T21:56:53Z")
I have a 3 node Elasticsearch cluster. All 3 nodes are master, ingest and data nodes. I shutdown one of the nodes. As expected, the cluster goes into a yellow state. If I query the cluster using the following "\_cat/s… --- ## [Elasticserach change TimeZone](https://discuss.elastic.co/t/elasticserach-change-timezone/254143)
**Author:** [@KA3AXCTAH](https://discuss.elastic.co/u/KA3AXCTAH)\ **Replies:** 4\ **Last updated:** [November 4, 2020, 9:55pm UTC](https://discuss.elastic.co/t/elasticserach-change-timezone/254143 "2020-11-04T21:55:51Z")
i have a Elasticsearch cluster for storing logz, and my current timezone is+06, but Elasticsearch work in UTC +0, so how can i change the timezone in Elasticsearch cluster? --- ## [AWS Kinesis streaming to elastic.co](https://discuss.elastic.co/t/aws-kinesis-streaming-to-elastic-co/254170)
**Author:** [@hyochang](https://discuss.elastic.co/u/hyochang)\ **Replies:** 4\ **Last updated:** [November 4, 2020, 8:26pm UTC](https://discuss.elastic.co/t/aws-kinesis-streaming-to-elastic-co/254170 "2020-11-04T20:26:17Z")
Hello, I have a project requiring to stream log files to elastic.co using AWS Kiness(firehoss or data stream) . The project team wants to use elastic.co instead of AWS ElasticService. Does anyone have experience with… --- ## [Stackoverflow on Elasticsearch file indexation with ingest-attachment](https://discuss.elastic.co/t/stackoverflow-on-elasticsearch-file-indexation-with-ingest-attachment/253455)
**Author:** [@Mathulbrich](https://discuss.elastic.co/u/Mathulbrich)\ **Replies:** 7\ **Last updated:** [November 4, 2020, 8:11pm UTC](https://discuss.elastic.co/t/stackoverflow-on-elasticsearch-file-indexation-with-ingest-attachment/253455 "2020-11-04T20:11:59Z")
Hi, Our company recently had some connectivity issues with Elasticsearch. Suddenly, on some days of the week the cluster had RED status and in the logs the only information found was that the node had been disconnected. … --- ## [Upgrade Assistant showing critical message](https://discuss.elastic.co/t/upgrade-assistant-showing-critical-message/254301)
**Author:** [@rudraram](https://discuss.elastic.co/u/rudraram)\ **Replies:** 1\ **Last updated:** [November 4, 2020, 5:41pm UTC](https://discuss.elastic.co/t/upgrade-assistant-showing-critical-message/254301 "2020-11-04T17:41:20Z")
Hi Team, Wondering how to resolve this critical warning in Upgrade Assitant currently we are on elasticsearch 6.8 version and planning to upgrade to Elastic 7.9 I see following message tagged as critical " Bulk threa… --- ## [ECS field for application data and payloads](https://discuss.elastic.co/t/ecs-field-for-application-data-and-payloads/254131)
**Author:** [@strokirk](https://discuss.elastic.co/u/strokirk)\ **Replies:** 3\ **Last updated:** [November 4, 2020, 5:04pm UTC](https://discuss.elastic.co/t/ecs-field-for-application-data-and-payloads/254131 "2020-11-04T17:04:47Z")
Hi, I'd like to hear if there are any suggestions in the ECS framework on how to provide app-specific fields. Do you use your own namespace for that, or just put it in the global namespace? Any recommendations for field… --- ## [How do I add a lifecycle policy to an index via the API?](https://discuss.elastic.co/t/how-do-i-add-a-lifecycle-policy-to-an-index-via-the-api/254295)
**Author:** [@jmcclelland](https://discuss.elastic.co/u/jmcclelland)\ **Replies:** 4\ **Last updated:** [November 4, 2020, 4:56pm UTC](https://discuss.elastic.co/t/how-do-i-add-a-lifecycle-policy-to-an-index-via-the-api/254295 "2020-11-04T16:56:12Z")
In Kibana, if I click on an index, and then click the Manage button, I have the option to "Add lifecycle policy" to that existing index - I'm asked for the policy to add and the rollover index. How do I do this via the … --- ## [Combining proximity with min number of words](https://discuss.elastic.co/t/combining-proximity-with-min-number-of-words/254283)
**Author:** [@flm](https://discuss.elastic.co/u/flm)\ **Replies:** 0\ **Last updated:** [November 4, 2020, 2:18pm UTC](https://discuss.elastic.co/t/combining-proximity-with-min-number-of-words/254283 "2020-11-04T14:18:33Z")
Is there a way to create a query to match a minimum number of words from a sentence, with the additional condition that the matching words must be at a maximum total distance from each other? Here's an example: Searchi… --- ## [ELK integration with Service now](https://discuss.elastic.co/t/elk-integration-with-service-now/251770)
**Author:** [@Ganesh2303](https://discuss.elastic.co/u/Ganesh2303)\ **Replies:** 2\ **Last updated:** [November 4, 2020, 1:40pm UTC](https://discuss.elastic.co/t/elk-integration-with-service-now/251770 "2020-11-04T13:40:38Z")
HI Team, I hope everyone safe on this pandemic situation. My question is how to integrate ELK with ServiceNow. Currently, we are using version 6.4 and task is if any error code in logs get indexed in ES or logs are fa… --- ## [How to Handle Index Template Changes with Data Streams](https://discuss.elastic.co/t/how-to-handle-index-template-changes-with-data-streams/254273)
**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\ **Replies:** 0\ **Last updated:** [November 4, 2020, 1:35pm UTC](https://discuss.elastic.co/t/how-to-handle-index-template-changes-with-data-streams/254273 "2020-11-04T13:35:49Z")
Hi All, I was wondering if there is any guidance on handle index template changes with data streams. Currently with regular indexes the guidance seems to be add a version number to part of the index name (ie: 7.9.3 or x… --- ## [Elasticsearch Hight used CPU](https://discuss.elastic.co/t/elasticsearch-hight-used-cpu/254181)
**Author:** [@ASRLO](https://discuss.elastic.co/u/ASRLO)\ **Replies:** 2\ **Last updated:** [November 4, 2020, 12:50pm UTC](https://discuss.elastic.co/t/elasticsearch-hight-used-cpu/254181 "2020-11-04T12:50:10Z")
Hello everybody, I have a question about elasticsearch and logstash. At the resource levels I find that elasticsearch and logtash use too much CPU and I wonder if like filebeat and its max\_procs: it is possible to do t… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=770) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=772)