# \#none **URL:** https://discuss.elastic.co/tag/none.md?no_tags=true&page=1896 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1897 --- ## [Getting exception Process ClusterEvent Timeout Exception after 5 minutes](https://discuss.elastic.co/t/getting-exception-process-clusterevent-timeout-exception-after-5-minutes/198244)
**Author:** [@Jayakrishnan\_Nair](https://discuss.elastic.co/u/Jayakrishnan_Nair)\ **Replies:** 2\ **Last updated:** [September 16, 2019, 7:05am UTC](https://discuss.elastic.co/t/getting-exception-process-clusterevent-timeout-exception-after-5-minutes/198244 "2019-09-16T07:05:33Z")
Hi All, I have cluster with 16 data node and 3 master nodes. With total of 22500 shard distributed across 16 nodes. The put-mapping event fails even after 5 minutes after configuring the timeout value. We are using el… --- ## [How to use search\_as\_you\_type datatype to get substring(infix) completion](https://discuss.elastic.co/t/how-to-use-search-as-you-type-datatype-to-get-substring-infix-completion/199570)
**Author:** [@MKU](https://discuss.elastic.co/u/MKU)\ **Replies:** 2\ **Last updated:** [September 16, 2019, 6:22am UTC](https://discuss.elastic.co/t/how-to-use-search-as-you-type-datatype-to-get-substring-infix-completion/199570 "2019-09-16T06:22:29Z")
Hi, The new search\_as\_you\_type feature should provide both infix and prefix completion, but i am seeing only prefix completion. { "mappings":{ "properties":{ "mail":{"type":"search\_as\_you\_type"} }}} and the query whic… --- ## [How to get the AWS EC2/Account details using the logstash AWS plugins](https://discuss.elastic.co/t/how-to-get-the-aws-ec2-account-details-using-the-logstash-aws-plugins/199580)
**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\ **Replies:** 0\ **Last updated:** [September 16, 2019, 6:22am UTC](https://discuss.elastic.co/t/how-to-get-the-aws-ec2-account-details-using-the-logstash-aws-plugins/199580 "2019-09-16T06:22:18Z")
How to get the following AWS EC2/Account information using the logstash Cloudwatch plugin or with any other logstash AWS plugin. Account\_name Account\_number resource\_name VM Name Private IP Address Operating System … --- ## [Warning can not be imported as a dangling index, as index with same name already exists in cluster metadata](https://discuss.elastic.co/t/warning-can-not-be-imported-as-a-dangling-index-as-index-with-same-name-already-exists-in-cluster-metadata/199577)
**Author:** [@Nikhil\_Pillai](https://discuss.elastic.co/u/Nikhil_Pillai)\ **Replies:** 6\ **Last updated:** [September 16, 2019, 6:13am UTC](https://discuss.elastic.co/t/warning-can-not-be-imported-as-a-dangling-index-as-index-with-same-name-already-exists-in-cluster-metadata/199577 "2019-09-16T06:13:05Z")
I am running ELK 6.5.4 with 3 node cluster. Cluster health is GREEN I see below error in one of the node. \[2019-09-16T11:05:49,832\]\[WARN \]\[o.e.g.DanglingIndicesState\] \[node-3\] \[\[.watcher-history-9-2019.07.12/1fkhSke8S7… --- ## [What are the common situations in which primary shard goes down](https://discuss.elastic.co/t/what-are-the-common-situations-in-which-primary-shard-goes-down/199576)
**Author:** [@MKU](https://discuss.elastic.co/u/MKU)\ **Replies:** 1\ **Last updated:** [September 16, 2019, 6:08am UTC](https://discuss.elastic.co/t/what-are-the-common-situations-in-which-primary-shard-goes-down/199576 "2019-09-16T06:08:30Z")
Hi, I am doing a case study, and i would want to know the situations in which primary shard goes down, which can cause data loss and how to avoid them. Thanks --- ## [Slow Aggregation over Time based indices. Each index has around ~10M records](https://discuss.elastic.co/t/slow-aggregation-over-time-based-indices-each-index-has-around-10m-records/199566)
**Author:** [@durgaharish1993](https://discuss.elastic.co/u/durgaharish1993)\ **Replies:** 5\ **Last updated:** [September 16, 2019, 6:08am UTC](https://discuss.elastic.co/t/slow-aggregation-over-time-based-indices-each-index-has-around-10m-records/199566 "2019-09-16T06:08:16Z")
I am using a monthly time based indexes ( Eg - prefix-01-2019, prefix-02-2019 .. so on ) for storing the time based data. Each index has ~10 Million documents with 13 fields in each document. I am trying to perform … --- ## [Not able to figure out number of shards in my cluster](https://discuss.elastic.co/t/not-able-to-figure-out-number-of-shards-in-my-cluster/199436)
**Author:** [@adarshzphin](https://discuss.elastic.co/u/adarshzphin)\ **Replies:** 4\ **Last updated:** [September 16, 2019, 6:08am UTC](https://discuss.elastic.co/t/not-able-to-figure-out-number-of-shards-in-my-cluster/199436 "2019-09-16T06:08:12Z")
I have 5 node cluster. 1 dedicated master node ( 16 GB/4 core ) and 4 data nodes (32 GB/8 cores/ 5 TB SSD )on each data node . I am having around 10 TB of data to store in one index(as of now not doing time base indexing… --- ## [Elasticsearch “AND in query\_string” vs. “default\_operator AND”](https://discuss.elastic.co/t/elasticsearch-and-in-query-string-vs-default-operator-and/199578)
**Author:** [@spotlight2001](https://discuss.elastic.co/u/spotlight2001)\ **Replies:** 0\ **Last updated:** [September 16, 2019, 5:42am UTC](https://discuss.elastic.co/t/elasticsearch-and-in-query-string-vs-default-operator-and/199578 "2019-09-16T05:42:10Z")
elasticsearch v7.1.1 I dont understand the difference between a query\_string containing "AND" vs. "default\_operator AND" I thought it should yield the same result, but doesnt: Data: HTTP POST http://localhost:9200/\_b… --- ## [Logstash filter plugin](https://discuss.elastic.co/t/logstash-filter-plugin/199359)
**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\ **Replies:** 3\ **Last updated:** [September 16, 2019, 5:37am UTC](https://discuss.elastic.co/t/logstash-filter-plugin/199359 "2019-09-16T05:37:27Z")
Hi I'm using logstash 7.0 . I'm having multiple events to filter. Instead of having one single config file, I prefer to have multiple filter config files for each event. As an example, I'm having a login event and I sto… --- ## [Kibana aggregation sum wrong result](https://discuss.elastic.co/t/kibana-aggregation-sum-wrong-result/199494)
**Author:** [@111210](https://discuss.elastic.co/u/111210)\ **Replies:** 9\ **Last updated:** [September 16, 2019, 5:25am UTC](https://discuss.elastic.co/t/kibana-aggregation-sum-wrong-result/199494 "2019-09-16T05:25:16Z")
I don't understand why does Kibana sum different result when I just enable filter or disable filter. It should be same. Disable Enable --- ## [Logstash 6.6.1 Crashing](https://discuss.elastic.co/t/logstash-6-6-1-crashing/197103)
**Author:** [@msk\_76](https://discuss.elastic.co/u/msk_76)\ **Replies:** 2\ **Last updated:** [September 16, 2019, 5:23am UTC](https://discuss.elastic.co/t/logstash-6-6-1-crashing/197103 "2019-09-16T05:23:05Z")
I have a regular problem of logstash crashing with FATAL on Linux RHEL 6.9. The logstash version is 6.6.1. The pipeline.yml contains following config : pipeline.id: sys\_username\_mapping pipeline.workers: 1 path.conf… --- ## [Is there a way to remove duplicate code in logstash?](https://discuss.elastic.co/t/is-there-a-way-to-remove-duplicate-code-in-logstash/199569)
**Author:** [@Yungyoung\_Ok](https://discuss.elastic.co/u/Yungyoung_Ok)\ **Replies:** 1\ **Last updated:** [September 16, 2019, 5:21am UTC](https://discuss.elastic.co/t/is-there-a-way-to-remove-duplicate-code-in-logstash/199569 "2019-09-16T05:21:41Z")
Can I include duplicate code in a specific file in the log? For example, when importing data from multiple db tables, you need to keep writing jdbc { jdbc\_driver\_library =\> "mysql-connector-java-5.1.36-bin.jar" jdbc\_… --- ## [Elastic Cloud on Azure](https://discuss.elastic.co/t/elastic-cloud-on-azure/199419)
**Author:** [@RichardH](https://discuss.elastic.co/u/RichardH)\ **Replies:** 2\ **Last updated:** [September 16, 2019, 5:03am UTC](https://discuss.elastic.co/t/elastic-cloud-on-azure/199419 "2019-09-16T05:03:40Z")
We will be rolling out our first production elastic cluster. At this stage we are looking at pros and cons of on prem vs cloud, however even when to comes to cloud we need to decide between provisioning on cloud.elastic… --- ## [Can we have set type field behaviour in elasticsearch..?](https://discuss.elastic.co/t/can-we-have-set-type-field-behaviour-in-elasticsearch/199572)
**Author:** [@yash.tandon](https://discuss.elastic.co/u/yash.tandon)\ **Replies:** 0\ **Last updated:** [September 16, 2019, 4:54am UTC](https://discuss.elastic.co/t/can-we-have-set-type-field-behaviour-in-elasticsearch/199572 "2019-09-16T04:54:40Z")
--- ## [Feed lost data to ELK](https://discuss.elastic.co/t/feed-lost-data-to-elk/198997)
**Author:** [@Rajith\_konara](https://discuss.elastic.co/u/Rajith_konara)\ **Replies:** 2\ **Last updated:** [September 16, 2019, 3:44am UTC](https://discuss.elastic.co/t/feed-lost-data-to-elk/198997 "2019-09-16T03:44:10Z")
Hi all, I' am having an production incident, we loss 12 hours of data due to some incident, now the service is back to normal and elastic is serving the data, but we need to fill the loss data gap. We have the relevant … --- ## [Https://discuss.elastic.co/t/feed-lost-data-to-elk/198997](https://discuss.elastic.co/t/https-discuss-elastic-co-t-feed-lost-data-to-elk-198997/199561)
**Author:** [@Rajith\_konara](https://discuss.elastic.co/u/Rajith_konara)\ **Replies:** 0\ **Last updated:** [September 16, 2019, 3:43am UTC](https://discuss.elastic.co/t/https-discuss-elastic-co-t-feed-lost-data-to-elk-198997/199561 "2019-09-16T03:43:20Z")
Continuing the discussion from Feed lost data to ELK: --- ## [Elasticsearch sometimes bulk update fail?](https://discuss.elastic.co/t/elasticsearch-sometimes-bulk-update-fail/199199)
**Author:** [@ElvisLin](https://discuss.elastic.co/u/ElvisLin)\ **Replies:** 3\ **Last updated:** [September 16, 2019, 2:54am UTC](https://discuss.elastic.co/t/elasticsearch-sometimes-bulk-update-fail/199199 "2019-09-16T02:54:22Z")
Elasticsearch version: 7.0.0 I can not reproduce the problem. My system is frequently sync db data to Elasticsearch server through bulk method. The proccess will do update/create/delete in bulk body. I'm using client… --- ## [How to add new fields on document on ingestion based on value of other fields](https://discuss.elastic.co/t/how-to-add-new-fields-on-document-on-ingestion-based-on-value-of-other-fields/199519)
**Author:** [@opsuthar](https://discuss.elastic.co/u/opsuthar)\ **Replies:** 1\ **Last updated:** [September 15, 2019, 10:16pm UTC](https://discuss.elastic.co/t/how-to-add-new-fields-on-document-on-ingestion-based-on-value-of-other-fields/199519 "2019-09-15T22:16:23Z")
I have a scenario where different applications are sending different fields for the same purpose which is making getting the aggregates/query data difficult and resulting in Big query. Here is one of the field which spe… --- ## [Kibana Access Behind NAT IP](https://discuss.elastic.co/t/kibana-access-behind-nat-ip/197896)
**Author:** [@Jensjp](https://discuss.elastic.co/u/Jensjp)\ **Replies:** 2\ **Last updated:** [September 15, 2019, 9:23pm UTC](https://discuss.elastic.co/t/kibana-access-behind-nat-ip/197896 "2019-09-15T21:23:21Z")
Hi , I have kibana setup in an external server which is made available inside the corporate network through a Natted IP. The NAT is one-to-one to the kibana host. The issue is when I use the internal IP of the kibana mac… --- ## [Get aggregations on nested array of objects](https://discuss.elastic.co/t/get-aggregations-on-nested-array-of-objects/199554)
**Author:** [@hassanAwanAlvi](https://discuss.elastic.co/u/hassanAwanAlvi)\ **Replies:** 0\ **Last updated:** [September 15, 2019, 8:10pm UTC](https://discuss.elastic.co/t/get-aggregations-on-nested-array-of-objects/199554 "2019-09-15T20:10:06Z")
Hi there, I have a complex situation. Let me define my context. I am working on a project related to YouTube videos. I have data of videos. A typical document looks like. { "\_index": "tubecvideos", "\_type": "\_doc",… --- ## [One elasticsearch to input from other elasticsearches](https://discuss.elastic.co/t/one-elasticsearch-to-input-from-other-elasticsearches/199540)
**Author:** [@Marta\_Zagrajek](https://discuss.elastic.co/u/Marta_Zagrajek)\ **Replies:** 1\ **Last updated:** [September 15, 2019, 8:04pm UTC](https://discuss.elastic.co/t/one-elasticsearch-to-input-from-other-elasticsearches/199540 "2019-09-15T20:04:53Z")
Hi there :slight\_smile: I want to create one big elastichsearch cluster which will combine logs from other elasticsearch clusters (even up to 10). Is there a possibility to do that using logstash? My further explanati… --- ## [Python json array ... minor problems](https://discuss.elastic.co/t/python-json-array-minor-problems/195989)
**Author:** [@mathurin68](https://discuss.elastic.co/u/mathurin68)\ **Replies:** 6\ **Last updated:** [September 15, 2019, 7:41pm UTC](https://discuss.elastic.co/t/python-json-array-minor-problems/195989 "2019-09-15T19:41:59Z")
Elasticstack 7.3 I did a bulk import some info from shodan in json form, this is one of the hosts... { "host": { "data": \[ { "banner": "421 4.3.2 Service not available\\r\\n", "port": 25, … --- ## [SonicWall Firewall and SIEM or SNMP](https://discuss.elastic.co/t/sonicwall-firewall-and-siem-or-snmp/199546)
**Author:** [@jabalo1327](https://discuss.elastic.co/u/jabalo1327)\ **Replies:** 1\ **Last updated:** [September 15, 2019, 5:49pm UTC](https://discuss.elastic.co/t/sonicwall-firewall-and-siem-or-snmp/199546 "2019-09-15T17:49:30Z")
How Do I configure my sonicwall firewall to send all the logs to the cloud for this product and what product Do I actually need? Is there any approximate price range for month? I will like to see all the data that my s… --- ## [How can I crawling Kibana Chart or insert Kibana Chart to other web application?](https://discuss.elastic.co/t/how-can-i-crawling-kibana-chart-or-insert-kibana-chart-to-other-web-application/199014)
**Author:** [@111208](https://discuss.elastic.co/u/111208)\ **Replies:** 2\ **Last updated:** [September 15, 2019, 1:02pm UTC](https://discuss.elastic.co/t/how-can-i-crawling-kibana-chart-or-insert-kibana-chart-to-other-web-application/199014 "2019-09-15T13:02:19Z")
I'm developing Dashboard Web application project(Project A). My Client is already using Kibana for Data Viz. They also want to see specific Kibana Chart(they used) in dashboard card on web site I developed. User Flow. … --- ## [Basic grok query - logstash](https://discuss.elastic.co/t/basic-grok-query-logstash/199520)
**Author:** [@Blason](https://discuss.elastic.co/u/Blason)\ **Replies:** 5\ **Last updated:** [September 15, 2019, 3:24pm UTC](https://discuss.elastic.co/t/basic-grok-query-logstash/199520 "2019-09-15T15:24:34Z")
Hi Team, I am still learning grok and have certain basic query which I tried searching but could not find the perfect answer hence asking to this community. My apologies if that was already asked. What is \[type\] in fil… --- ## [How to run conf file in two different machines/nodes?](https://discuss.elastic.co/t/how-to-run-conf-file-in-two-different-machines-nodes/199179)
**Author:** [@rkhapre](https://discuss.elastic.co/u/rkhapre)\ **Replies:** 7\ **Last updated:** [September 15, 2019, 3:22pm UTC](https://discuss.elastic.co/t/how-to-run-conf-file-in-two-different-machines-nodes/199179 "2019-09-15T15:22:17Z")
Hi All I have two conf file confile1.conf and confile2.conf The confile1.conf is sitting on Machine 1 The confile2.conf is sitting on Machine 2 Now i want to operate everything from Machine 1 From Machine 1 , i am … --- ## [Is that a good practice to query ES during a Restore process?](https://discuss.elastic.co/t/is-that-a-good-practice-to-query-es-during-a-restore-process/199522)
**Author:** [@Yotam\_Levy](https://discuss.elastic.co/u/Yotam_Levy)\ **Replies:** 3\ **Last updated:** [September 15, 2019, 1:47pm UTC](https://discuss.elastic.co/t/is-that-a-good-practice-to-query-es-during-a-restore-process/199522 "2019-09-15T13:47:52Z")
hello, I'm trying to measure the Restore process while it happens by querying ES (a simple get index request, then take the index size from it) basically I want to know how much data is there in my restoring index every… --- ## [Can't upload CSV file to elastic search via logstash](https://discuss.elastic.co/t/cant-upload-csv-file-to-elastic-search-via-logstash/199361)
**Author:** [@vedansh](https://discuss.elastic.co/u/vedansh)\ **Replies:** 2\ **Last updated:** [September 15, 2019, 1:14pm UTC](https://discuss.elastic.co/t/cant-upload-csv-file-to-elastic-search-via-logstash/199361 "2019-09-15T13:14:04Z")
logstash-car.conf I will go through all the question related to this topic but didn't find the solution yet input { file { path =\> "C:\\Users\\vedansh.p\\Desktop\\ELK\\CSVLogsDemo\\cars.csv" start\_position =\> "beginning" … --- ## [How to aggregate nested fields with null values?](https://discuss.elastic.co/t/how-to-aggregate-nested-fields-with-null-values/199536)
**Author:** [@Doronpt](https://discuss.elastic.co/u/Doronpt)\ **Replies:** 1\ **Last updated:** [September 15, 2019, 1:12pm UTC](https://discuss.elastic.co/t/how-to-aggregate-nested-fields-with-null-values/199536 "2019-09-15T13:12:21Z")
Hi, I'm having trouble aggregating my nested data, maybe you can help. I'll simplify the problem, I've a nested field that looks like: PUT test/doc/\_mapping { "properties": { "fields": { "type" : "n… --- ## [Logstash-output-mongodb plugin not support login authentication](https://discuss.elastic.co/t/logstash-output-mongodb-plugin-not-support-login-authentication/199535)
**Author:** [@wys1010](https://discuss.elastic.co/u/wys1010)\ **Replies:** 0\ **Last updated:** [September 15, 2019, 12:38pm UTC](https://discuss.elastic.co/t/logstash-output-mongodb-plugin-not-support-login-authentication/199535 "2019-09-15T12:38:45Z")
Why does the \[logstash-output-mongodb\] plugin not support login authentication? I hope to add this feature, thanks! [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1895) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1897)