# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1971

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1972

---

## [How to get average respose time(count group by) of api calls](https://discuss.elastic.co/t/how-to-get-average-respose-time-count-group-by-of-api-calls/238448)

<div class="topic-metadata">

**Author:** [@suresh123](https://discuss.elastic.co/u/suresh123)\
**Replies:** 3\
**Last updated:** [June 25, 2020, 7:25pm UTC](https://discuss.elastic.co/t/how-to-get-average-respose-time-count-group-by-of-api-calls/238448 "2020-06-25T19:25:54Z")

</div>

Hi Experts, I am trying to get the average response of group calls Example: /services/term1/us-en/paymentmethod-1 /services/term1/in-en/paymentmethod-1 /services/term1/ch-gn/paymentmethod-1 I need to club all of th…

---

## [Divergent data between ES / Kibana and actual data sent](https://discuss.elastic.co/t/divergent-data-between-es-kibana-and-actual-data-sent/238748)

<div class="topic-metadata">

**Author:** [@FernandoMOTA](https://discuss.elastic.co/u/FernandoMOTA)\
**Replies:** 0\
**Last updated:** [June 25, 2020, 6:55pm UTC](https://discuss.elastic.co/t/divergent-data-between-es-kibana-and-actual-data-sent/238748 "2020-06-25T18:55:56Z")

</div>

I performed a data ingestion in ES, via Logstash originating from a SQL Server bank, when I perform a load with a small volume when I perform the conference, the data is correct, but when I use more than 100000 data and …

---

## [How to create index by ingesting MongoDB data?](https://discuss.elastic.co/t/how-to-create-index-by-ingesting-mongodb-data/235389)

<div class="topic-metadata">

**Author:** [@FernandoMOTA](https://discuss.elastic.co/u/FernandoMOTA)\
**Replies:** 1\
**Last updated:** [June 25, 2020, 6:55pm UTC](https://discuss.elastic.co/t/how-to-create-index-by-ingesting-mongodb-data/235389 "2020-06-25T18:55:29Z")

</div>

All tutorials I used brought me the following error: \> D, \[2020-06-01T07: 33: 35.814000 # 276\] DEBUG -: MONGODB | \[202\] localhost: 27017 # 1 | example.find | STARTED | {"find" =\> "movie", "filter" =\> {"\_ id" =\> {"$ gt" …

---

## [Kibana 7.7 as trusted page](https://discuss.elastic.co/t/kibana-7-7-as-trusted-page/238018)

<div class="topic-metadata">

**Author:** [@d.silwon](https://discuss.elastic.co/u/d.silwon)\
**Replies:** 4\
**Last updated:** [June 25, 2020, 6:33pm UTC](https://discuss.elastic.co/t/kibana-7-7-as-trusted-page/238018 "2020-06-25T18:33:26Z")

</div>

Dears, I have another challange. We use basic license. We have enabled SSL/TLS inside ELK. Our Kibana site shows padlock with an exclamation mark: Could you tell me how to configure Kibana as trusted page, plase? Do…

---

## [Message "Your query is taking a while"](https://discuss.elastic.co/t/message-your-query-is-taking-a-while/238728)

<div class="topic-metadata">

**Author:** [@jelocabral](https://discuss.elastic.co/u/jelocabral)\
**Replies:** 2\
**Last updated:** [June 25, 2020, 6:19pm UTC](https://discuss.elastic.co/t/message-your-query-is-taking-a-while/238728 "2020-06-25T18:19:36Z")

</div>

Hi people, I've implemented the netflow module with Filebeat. In my ELK 7.8.0 I'm receiving a lots of flows from a BGP router, and when I go to the Filebeat Netflow dashboards and I query for a long date range (24 hs and…

---

## [A few questions about Analyzers and the use of dictionaries](https://discuss.elastic.co/t/a-few-questions-about-analyzers-and-the-use-of-dictionaries/238732)

<div class="topic-metadata">

**Author:** [@Ubeta](https://discuss.elastic.co/u/Ubeta)\
**Replies:** 0\
**Last updated:** [June 25, 2020, 5:44pm UTC](https://discuss.elastic.co/t/a-few-questions-about-analyzers-and-the-use-of-dictionaries/238732 "2020-06-25T17:44:12Z")

</div>

Hi! I currently have Elastic Search set up on my my Debian VM on Google Cloud and currently have the elastic search set up there using the Nori Analyzer as my primary analyzer. I am able to set up a dictionary and have…

---

## [Process single data to apply multiple split and store as array](https://discuss.elastic.co/t/process-single-data-to-apply-multiple-split-and-store-as-array/238189)

<div class="topic-metadata">

**Author:** [@karthick2020](https://discuss.elastic.co/u/karthick2020)\
**Replies:** 1\
**Last updated:** [June 25, 2020, 4:28pm UTC](https://discuss.elastic.co/t/process-single-data-to-apply-multiple-split-and-store-as-array/238189 "2020-06-25T16:28:24Z")

</div>

Hi Team, I am looking for clarifications on below sample log: 30338 /opt/IBM/WebSphere/AppServe 19.1 1.3~ 4609 /opt/BESClient/bin/BESClien 0.2 0.4~20235 /opt/IBM/WebSphere/AppServe 18.8 0.3~ 354 /opt/IBM/WebSphere/App…

---

## [Logstash with Amazon ElasticSearch Service](https://discuss.elastic.co/t/logstash-with-amazon-elasticsearch-service/238723)

<div class="topic-metadata">

**Author:** [@aagarwal3](https://discuss.elastic.co/u/aagarwal3)\
**Replies:** 0\
**Last updated:** [June 25, 2020, 4:16pm UTC](https://discuss.elastic.co/t/logstash-with-amazon-elasticsearch-service/238723 "2020-06-25T16:16:40Z")

</div>

Hello, I am trying to access the logs by adding the appenders inside the logging section in config.yml file. logging: appenders: - type: uri threshold: ALL endpoint: https://search-pipeportal-awyql5336h5vmo…

---

## [Numeric field (long) shown as string in kibana discovery](https://discuss.elastic.co/t/numeric-field-long-shown-as-string-in-kibana-discovery/237656)

<div class="topic-metadata">

**Author:** [@ndg](https://discuss.elastic.co/u/ndg)\
**Replies:** 3\
**Last updated:** [June 25, 2020, 4:15pm UTC](https://discuss.elastic.co/t/numeric-field-long-shown-as-string-in-kibana-discovery/237656 "2020-06-25T16:15:22Z")

</div>

Hi! We are installing and testing the ELK stack in a test env in out company. I am working towards migrating rsyslog logs from Graylog to ELK. But even when some fields are mapped as long in elasticsearch when i go to …

---

## [Return \_shard and \_node for each hit](https://discuss.elastic.co/t/return-shard-and-node-for-each-hit/238722)

<div class="topic-metadata">

**Author:** [@rocky67z](https://discuss.elastic.co/u/rocky67z)\
**Replies:** 0\
**Last updated:** [June 25, 2020, 4:14pm UTC](https://discuss.elastic.co/t/return-shard-and-node-for-each-hit/238722 "2020-06-25T16:14:44Z")

</div>

I have successfully used the explain parameter in my query to return \_shard and \_node for each hit (which is exactly what I needed). I actually don't need all of the additional score computation detail (which is most li…

---

## [Negative valued bars stacking issue](https://discuss.elastic.co/t/negative-valued-bars-stacking-issue/238720)

<div class="topic-metadata">

**Author:** [@Maybe](https://discuss.elastic.co/u/Maybe)\
**Replies:** 0\
**Last updated:** [June 25, 2020, 4:10pm UTC](https://discuss.elastic.co/t/negative-valued-bars-stacking-issue/238720 "2020-06-25T16:10:00Z")

</div>

Hello, I'm making a barchart using Timelion. I want to stack two series based on timestamp. Everything works fine if all are positive values. Once there're negative valued bars, it won't go to negative scale, it wont st…

---

## [I'm linking ELK to Snort. but there's been an error with the logstash](https://discuss.elastic.co/t/im-linking-elk-to-snort-but-theres-been-an-error-with-the-logstash/238563)

<div class="topic-metadata">

**Author:** [@arse\_nal](https://discuss.elastic.co/u/arse_nal)\
**Replies:** 4\
**Last updated:** [June 25, 2020, 4:06pm UTC](https://discuss.elastic.co/t/im-linking-elk-to-snort-but-theres-been-an-error-with-the-logstash/238563 "2020-06-25T16:06:47Z")

</div>

I'm linking ELK to Snort. there's been an error with the logstash But I can't figure out a way to deal with this error. Help me. I Use ELK 6.2.2, Centos 7, and snort 2.9.16. configure file code!

---

## [Trying to use \_analyze through JAVA API but exception thrown](https://discuss.elastic.co/t/trying-to-use-analyze-through-java-api-but-exception-thrown/238714)

<div class="topic-metadata">

**Author:** [@Ubeta](https://discuss.elastic.co/u/Ubeta)\
**Replies:** 0\
**Last updated:** [June 25, 2020, 3:47pm UTC](https://discuss.elastic.co/t/trying-to-use-analyze-through-java-api-but-exception-thrown/238714 "2020-06-25T15:47:03Z")

</div>

Hi! I'm currently using the Elastic Cloud Service and trying to use the \_analyze function of the High-Level Restful Java API. When I set my analyzer and the to-be analyzed text, my Java code works fine. However, when t…

---

## [A new node cannot access a backup repository](https://discuss.elastic.co/t/a-new-node-cannot-access-a-backup-repository/238622)

<div class="topic-metadata">

**Author:** [@dferez](https://discuss.elastic.co/u/dferez)\
**Replies:** 3\
**Last updated:** [June 25, 2020, 3:28pm UTC](https://discuss.elastic.co/t/a-new-node-cannot-access-a-backup-repository/238622 "2020-06-25T15:28:50Z")

</div>

Hi. Before, it had two nodes in a cluster (node1 and node2). It also had a backup repository shared by NFS between the two machines on the nodes. Everything worked perfectly, the backups were done correctly and I could …

---

## [Logstash-GemNotFound-belzebuth](https://discuss.elastic.co/t/logstash-gemnotfound-belzebuth/238709)

<div class="topic-metadata">

**Author:** [@guruprasadh4](https://discuss.elastic.co/u/guruprasadh4)\
**Replies:** 0\
**Last updated:** [June 25, 2020, 3:27pm UTC](https://discuss.elastic.co/t/logstash-gemnotfound-belzebuth/238709 "2020-06-25T15:27:39Z")

</div>

Hello team, input{ file { path =\> "/tmp/date.log" start\_position =\> beginning sincedb\_path =\> "/dev/null" } } filter {} output { …

---

## [Transforms, Index Template and ILM](https://discuss.elastic.co/t/transforms-index-template-and-ilm/238695)

<div class="topic-metadata">

**Author:** [@andrezenun](https://discuss.elastic.co/u/andrezenun)\
**Replies:** 1\
**Last updated:** [June 25, 2020, 3:21pm UTC](https://discuss.elastic.co/t/transforms-index-template-and-ilm/238695 "2020-06-25T15:21:05Z")

</div>

Hi, I'm starting to use transforms and I notice that I don't have the possibility to use ILM on the transform indexes. I create the Index Template using the pattern created by transform and associate an ILM policy to tha…

---

## [Search-ui without App Search](https://discuss.elastic.co/t/search-ui-without-app-search/238708)

<div class="topic-metadata">

**Author:** [@SeanPlacchetti](https://discuss.elastic.co/u/SeanPlacchetti)\
**Replies:** 0\
**Last updated:** [June 25, 2020, 3:17pm UTC](https://discuss.elastic.co/t/search-ui-without-app-search/238708 "2020-06-25T15:17:20Z")

</div>

I know the search-ui was built to work with App Search, but if I wanted to see if anyone knows of an example of someone not using a custom search API on top of elasticsearch (we'd probably still have a proxy server but i…

---

## [Elastic Search Aggregation and Complex Query](https://discuss.elastic.co/t/elastic-search-aggregation-and-complex-query/238706)

<div class="topic-metadata">

**Author:** [@surajdalvi](https://discuss.elastic.co/u/surajdalvi)\
**Replies:** 1\
**Last updated:** [June 25, 2020, 3:14pm UTC](https://discuss.elastic.co/t/elastic-search-aggregation-and-complex-query/238706 "2020-06-25T15:14:32Z")

</div>

I have created the index PUT ten2 { "mappings": { "documents": { "properties": { "title": { "type": "text", "fields": { "raw": { "type": "keyword" } } },"uid": { "typ…

---

## [Raise an alert when a device goes down](https://discuss.elastic.co/t/raise-an-alert-when-a-device-goes-down/238666)

<div class="topic-metadata">

**Author:** [@Anirudhan](https://discuss.elastic.co/u/Anirudhan)\
**Replies:** 0\
**Last updated:** [June 25, 2020, 12:20pm UTC](https://discuss.elastic.co/t/raise-an-alert-when-a-device-goes-down/238666 "2020-06-25T12:20:57Z")

</div>

Basically I am trying to raise an alert when a device goes down. But want to raise an alert after 20 mins. For eg:- {"hostName": "WIN\_27806", "status": false,"lastChangedTime": Jun 25, 2020 @ 16:58:38.000} Can the quer…

---

## [Display growing count of objects](https://discuss.elastic.co/t/display-growing-count-of-objects/238415)

<div class="topic-metadata">

**Author:** [@kurtgn](https://discuss.elastic.co/u/kurtgn)\
**Replies:** 4\
**Last updated:** [June 25, 2020, 2:57pm UTC](https://discuss.elastic.co/t/display-growing-count-of-objects/238415 "2020-06-25T14:57:44Z")

</div>

I am registering subscribers in my Elasticsearch database. Each subscriber has a CREATED\_AT timestamp field. And I can create a chart that shows how many new subscribers I get each day. This is easily done just by groupi…

---

## [Cannot retrieve keystore values in pipeline](https://discuss.elastic.co/t/cannot-retrieve-keystore-values-in-pipeline/238703)

<div class="topic-metadata">

**Author:** [@bodi4](https://discuss.elastic.co/u/bodi4)\
**Replies:** 0\
**Last updated:** [June 25, 2020, 2:54pm UTC](https://discuss.elastic.co/t/cannot-retrieve-keystore-values-in-pipeline/238703 "2020-06-25T14:54:13Z")

</div>

Faced a problem with logstash getting started after upgrade to 7.8 release. Using different variables for storing passwords in keystore. like for elasticsearch users, cert paswords etc.. This variables is used in many …

---

## [Logging which user creates and deletes indexes](https://discuss.elastic.co/t/logging-which-user-creates-and-deletes-indexes/238352)

<div class="topic-metadata">

**Author:** [@ebru](https://discuss.elastic.co/u/ebru)\
**Replies:** 6\
**Last updated:** [June 25, 2020, 2:46pm UTC](https://discuss.elastic.co/t/logging-which-user-creates-and-deletes-indexes/238352 "2020-06-25T14:46:11Z")

</div>

Hi, I am new to ElasticSearch and am trying to see if there is a way to see which user creates/deletes indexes. Currently I can see it in logs when an index is created or deleted, but can't see which user initiated these…

---

## [Query dsl, must and must\_not](https://discuss.elastic.co/t/query-dsl-must-and-must-not/238542)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 2\
**Last updated:** [June 25, 2020, 2:41pm UTC](https://discuss.elastic.co/t/query-dsl-must-and-must-not/238542 "2020-06-25T14:41:31Z")

</div>

I have a version: v100.01 version: v100.01.xyz how do I only match v100.01 either using regexp or wildcard following both query gives me both result { "query": { "regexp": { "version": "v\<0-9\>\<0-9\>\<0-9\>.…

---

## [Restrict user to specific Kibana index](https://discuss.elastic.co/t/restrict-user-to-specific-kibana-index/238431)

<div class="topic-metadata">

**Author:** [@Anushka\_Thachil](https://discuss.elastic.co/u/Anushka_Thachil)\
**Replies:** 3\
**Last updated:** [June 25, 2020, 2:14pm UTC](https://discuss.elastic.co/t/restrict-user-to-specific-kibana-index/238431 "2020-06-25T14:14:40Z")

</div>

I have created a user and assigned it a role to view logs of a single index. But the user is able to see all the index patterns created in Kibana (logs visible only for the allowed index). But I would like the user to se…

---

## [Confused about central management](https://discuss.elastic.co/t/confused-about-central-management/238676)

<div class="topic-metadata">

**Author:** [@DonHansDampf](https://discuss.elastic.co/u/DonHansDampf)\
**Replies:** 2\
**Last updated:** [June 25, 2020, 2:05pm UTC](https://discuss.elastic.co/t/confused-about-central-management/238676 "2020-06-25T14:05:54Z")

</div>

Hey there, just started out with the Elastic Stack as main logging "technology". We set up our cluster, attached Kibana, deployed two Logstash Servers for traditional syslogging, aaaand discovered Beats: The "faster/bet…

---

## [Getting error while connecting to metricbeat on AWS Elasticsearch](https://discuss.elastic.co/t/getting-error-while-connecting-to-metricbeat-on-aws-elasticsearch/238673)

<div class="topic-metadata">

**Author:** [@Anshumanabhishek](https://discuss.elastic.co/u/Anshumanabhishek)\
**Replies:** 1\
**Last updated:** [June 25, 2020, 1:59pm UTC](https://discuss.elastic.co/t/getting-error-while-connecting-to-metricbeat-on-aws-elasticsearch/238673 "2020-06-25T13:59:07Z")

</div>

Hi, I am running metricbeat on kubernetes and try to connect AWS Elasticsearch service and getting this error pipeline/output.go:155 Failed to connect to backoff(elasticsearch(https://xxx-hat333wclpfnnkdkuuigwsti5a.us-…

---

## ["Service Unavailable" on aggs query search](https://discuss.elastic.co/t/service-unavailable-on-aggs-query-search/238682)

<div class="topic-metadata">

**Author:** [@bdrmahesh](https://discuss.elastic.co/u/bdrmahesh)\
**Replies:** 0\
**Last updated:** [June 25, 2020, 1:47pm UTC](https://discuss.elastic.co/t/service-unavailable-on-aggs-query-search/238682 "2020-06-25T13:47:32Z")

</div>

I have a aggregation query written in nodejs. I have couple of aggregation queries in the node api. It happens randomly and only a couple times in a day that I get error Invoke Error { …

---

## [Wrong date format when reading from elasticsearch index](https://discuss.elastic.co/t/wrong-date-format-when-reading-from-elasticsearch-index/238135)

<div class="topic-metadata">

**Author:** [@samargh](https://discuss.elastic.co/u/samargh)\
**Replies:** 6\
**Last updated:** [June 25, 2020, 1:43pm UTC](https://discuss.elastic.co/t/wrong-date-format-when-reading-from-elasticsearch-index/238135 "2020-06-25T13:43:57Z")

</div>

i'm reading data from elactisearch index , i have date format issue 1501545600000 wich supposed to be in yyyy/mm/dd format from pyspark import SparkConf from pyspark.sql import SQLContext q ="""{ "query": { "ma…

---

## [Kibana Metrics – 500 Internal Server Error](https://discuss.elastic.co/t/kibana-metrics-500-internal-server-error/238260)

<div class="topic-metadata">

**Author:** [@tvander](https://discuss.elastic.co/u/tvander)\
**Replies:** 2\
**Last updated:** [June 25, 2020, 1:36pm UTC](https://discuss.elastic.co/t/kibana-metrics-500-internal-server-error/238260 "2020-06-25T13:36:40Z")

</div>

When i'm trying to access to the metrics page (https://kibana-elk.pxdtools.io:5601/app/metrics) on Kibana i have an error 500 showing on the right bottom corner, and i can't use this page, i've got the "There is no data …

---

## [How not to overwrite duplicates? save old documents](https://discuss.elastic.co/t/how-not-to-overwrite-duplicates-save-old-documents/238656)

<div class="topic-metadata">

**Author:** [@lyubava](https://discuss.elastic.co/u/lyubava)\
**Replies:** 2\
**Last updated:** [June 25, 2020, 1:36pm UTC](https://discuss.elastic.co/t/how-not-to-overwrite-duplicates-save-old-documents/238656 "2020-06-25T13:36:20Z")

</div>

Hi all! I use this filter to prevent duplicates: fingerprint { source =\> "name" target =\> "\[@metadata\]\[fingerprint\]" method =\> "MURMUR3" } And it works. I don't see documents with the same 'name' field in …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1970)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1972)
