# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1865

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1866

---

## [OutOfMemoryError: unable to create new native thread](https://discuss.elastic.co/t/outofmemoryerror-unable-to-create-new-native-thread/245079)

<div class="topic-metadata">

**Author:** [@Goutham\_Pratapa](https://discuss.elastic.co/u/Goutham_Pratapa)\
**Replies:** 0\
**Last updated:** [August 15, 2020, 7:36am UTC](https://discuss.elastic.co/t/outofmemoryerror-unable-to-create-new-native-thread/245079 "2020-08-15T07:36:09Z")

</div>

Hi all, I am relatively new to ElasticSearch and I Am running into this issue almost every day in my machine. The following are details about my hardware. $ ulimit -a core file size (blocks, -c) 0 data seg si…

---

## [Purpose of pipeline.js in filebeat module](https://discuss.elastic.co/t/purpose-of-pipeline-js-in-filebeat-module/245077)

<div class="topic-metadata">

**Author:** [@bornatalebi](https://discuss.elastic.co/u/bornatalebi)\
**Replies:** 0\
**Last updated:** [August 15, 2020, 7:18am UTC](https://discuss.elastic.co/t/purpose-of-pipeline-js-in-filebeat-module/245077 "2020-08-15T07:18:17Z")

</div>

Hi, I want to edit the cisco filebeat module to read more types of ios logs ( e.g., ssh login attemps). There is a pipeline.js file that does most of the job. I know it's used for Script processor. but i couldn't find a…

---

## [Questions regarding index.gc\_deletes](https://discuss.elastic.co/t/questions-regarding-index-gc-deletes/244452)

<div class="topic-metadata">

**Author:** [@lang1991](https://discuss.elastic.co/u/lang1991)\
**Replies:** 4\
**Last updated:** [August 15, 2020, 6:17am UTC](https://discuss.elastic.co/t/questions-regarding-index-gc-deletes/244452 "2020-08-15T06:17:51Z")

</div>

I have a few questions regarding "index.gc\_deletes", and I can't seem to find the answers in Elasticsearch documents. Context: We have a stream of events to be indexed by Elasticsearch, including "upsert" and "delete" …

---

## [Cannot get AD auth to work with Trial license](https://discuss.elastic.co/t/cannot-get-ad-auth-to-work-with-trial-license/244706)

<div class="topic-metadata">

**Author:** [@hazcod](https://discuss.elastic.co/u/hazcod)\
**Replies:** 3\
**Last updated:** [August 15, 2020, 6:08am UTC](https://discuss.elastic.co/t/cannot-get-ad-auth-to-work-with-trial-license/244706 "2020-08-15T06:08:11Z")

</div>

Hi, I am trying to setup Active Directory authentication for my elastic 7.80 stack. The steps i've taken: Enable trial license Put my ldaps certificate in /etc/elasticsearch/ad-ca.pem Configure ldaps realm in elastics…

---

## [Will elasticsearch create logs directory if not exist?](https://discuss.elastic.co/t/will-elasticsearch-create-logs-directory-if-not-exist/245003)

<div class="topic-metadata">

**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\
**Replies:** 2\
**Last updated:** [August 15, 2020, 4:14am UTC](https://discuss.elastic.co/t/will-elasticsearch-create-logs-directory-if-not-exist/245003 "2020-08-15T04:14:38Z")

</div>

Hi Will elasticsearch create logs directory I have given in path.logs, if not exist? It seems like service not starting up if log directory is not there. Is there anyway I can tell elasticsearch to create the direct…

---

## [Elasticsearch snapshot/restore](https://discuss.elastic.co/t/elasticsearch-snapshot-restore/245006)

<div class="topic-metadata">

**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\
**Replies:** 3\
**Last updated:** [August 15, 2020, 3:39am UTC](https://discuss.elastic.co/t/elasticsearch-snapshot-restore/245006 "2020-08-15T03:39:28Z")

</div>

Hi I want to take backup of existing data before upgrading elasticsearch, place it back after upgrade. What is the best way to do that? I read about snapshot & restore. Is this right one for a production environment wit…

---

## [Unable to view hosted elastic monitoring logs](https://discuss.elastic.co/t/unable-to-view-hosted-elastic-monitoring-logs/244209)

<div class="topic-metadata">

**Author:** [@Erica\_Case](https://discuss.elastic.co/u/Erica_Case)\
**Replies:** 2\
**Last updated:** [August 15, 2020, 2:33am UTC](https://discuss.elastic.co/t/unable-to-view-hosted-elastic-monitoring-logs/244209 "2020-08-15T02:33:19Z")

</div>

We are currently experiencing problems with hosted elastic cluster, and tried to look at the logs to troubleshoot. However, the logs only show one page, and state: logs 1 of NaN. This means we have transparency into a…

---

## [Recover a broken 3 node elasticsearch cluster that has only 1 node left](https://discuss.elastic.co/t/recover-a-broken-3-node-elasticsearch-cluster-that-has-only-1-node-left/244959)

<div class="topic-metadata">

**Author:** [@efan](https://discuss.elastic.co/u/efan)\
**Replies:** 5\
**Last updated:** [August 15, 2020, 2:00am UTC](https://discuss.elastic.co/t/recover-a-broken-3-node-elasticsearch-cluster-that-has-only-1-node-left/244959 "2020-08-15T02:00:50Z")

</div>

Hi, I have Elasticsearch cluster (7.6.1) that had 3 nodes. 2 of the nodes were accidentally dropped while all 3 servers were running. 1 of the 3 servers survived. I want to save the cluster and its data. How do I add new…

---

## [FILEBEAT - GOOGLE CLOUD MODULE - PUB/SUB](https://discuss.elastic.co/t/filebeat-google-cloud-module-pub-sub/244804)

<div class="topic-metadata">

**Author:** [@juaromu](https://discuss.elastic.co/u/juaromu)\
**Replies:** 6\
**Last updated:** [August 14, 2020, 9:49pm UTC](https://discuss.elastic.co/t/filebeat-google-cloud-module-pub-sub/244804 "2020-08-14T21:49:49Z")

</div>

Hi there: Running Filebeat, 7.8.1 and using the Google Cloud Module, PUB/SUB, to pull out VPC Firewall Logs. Getting an error (I believe JSON related) when Filebeat starts: ERROR \[google.pubsub\] googlepu…

---

## [Filebeat to logstash reading all file from beginning](https://discuss.elastic.co/t/filebeat-to-logstash-reading-all-file-from-beginning/244620)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 17\
**Last updated:** [August 14, 2020, 8:16pm UTC](https://discuss.elastic.co/t/filebeat-to-logstash-reading-all-file-from-beginning/244620 "2020-08-14T20:16:09Z")

</div>

I have a filebeat running and properly configure I have logstash running which has input - filter- output. and all works good when I startup problem is when I restart the logstash it reads all the file located in that…

---

## [Elasticsearch - failed to turn off translog retention](https://discuss.elastic.co/t/elasticsearch-failed-to-turn-off-translog-retention/245060)

<div class="topic-metadata">

**Author:** [@gferrette](https://discuss.elastic.co/u/gferrette)\
**Replies:** 0\
**Last updated:** [August 14, 2020, 7:37pm UTC](https://discuss.elastic.co/t/elasticsearch-failed-to-turn-off-translog-retention/245060 "2020-08-14T19:37:32Z")

</div>

Hello! I've made an upgrade from ES 7.0.1 to ES 7.6.1 and after that, on nodes startup, its appearing on the logs the message below: \[2020-08-14T10:54:21,893\]\[WARN \]\[o.e.i.s.IndexShard \] \[machine\] \[.tasks\]\[0\] fai…

---

## [Time Series Visual Builder - most basic question ever](https://discuss.elastic.co/t/time-series-visual-builder-most-basic-question-ever/245022)

<div class="topic-metadata">

**Author:** [@dandcp](https://discuss.elastic.co/u/dandcp)\
**Replies:** 1\
**Last updated:** [August 14, 2020, 7:18pm UTC](https://discuss.elastic.co/t/time-series-visual-builder-most-basic-question-ever/245022 "2020-08-14T19:18:12Z")

</div>

This is probably the easiest question anyone has asked. I see tons of references to people using the Time Series Visual Builder to do calculations on fields, etc. But the one thing I can't figure out is do I have to be…

---

## [Kibana - Request Timeout after 3000ms](https://discuss.elastic.co/t/kibana-request-timeout-after-3000ms/241753)

<div class="topic-metadata">

**Author:** [@gferrette](https://discuss.elastic.co/u/gferrette)\
**Replies:** 2\
**Last updated:** [August 14, 2020, 7:17pm UTC](https://discuss.elastic.co/t/kibana-request-timeout-after-3000ms/241753 "2020-08-14T19:17:37Z")

</div>

Hello! Please, we are getting the error below in kibana log a few times during the day. We had already change the values below on kibana.yml and restarted kibana, but the error persists showing the same value "3000ms",…

---

## [Create visualization and dashboard through Java REST jest client?](https://discuss.elastic.co/t/create-visualization-and-dashboard-through-java-rest-jest-client/243566)

<div class="topic-metadata">

**Author:** [@Redcxx](https://discuss.elastic.co/u/Redcxx)\
**Replies:** 9\
**Last updated:** [August 14, 2020, 6:19pm UTC](https://discuss.elastic.co/t/create-visualization-and-dashboard-through-java-rest-jest-client/243566 "2020-08-14T18:19:07Z")

</div>

Hi may I know if there is a way to create visualization and dashboard through jest client? I know that there is an experimental saved\_objects api but I am not sure how can I access that using Jest client.

---

## [How to open Kibana discover url with filters from the elastic REST API](https://discuss.elastic.co/t/how-to-open-kibana-discover-url-with-filters-from-the-elastic-rest-api/245051)

<div class="topic-metadata">

**Author:** [@aravind.pk](https://discuss.elastic.co/u/aravind.pk)\
**Replies:** 0\
**Last updated:** [August 14, 2020, 5:57pm UTC](https://discuss.elastic.co/t/how-to-open-kibana-discover-url-with-filters-from-the-elastic-rest-api/245051 "2020-08-14T17:57:31Z")

</div>

I am Elastic REST API to access the \_search and \_count for our own app to yield the logs and handle some app specific business functions (based on the logs and determine the performance etc.). From our app, we would like…

---

## [Doubt about complex query](https://discuss.elastic.co/t/doubt-about-complex-query/245048)

<div class="topic-metadata">

**Author:** [@bgsouza](https://discuss.elastic.co/u/bgsouza)\
**Replies:** 0\
**Last updated:** [August 14, 2020, 5:08pm UTC](https://discuss.elastic.co/t/doubt-about-complex-query/245048 "2020-08-14T17:08:22Z")

</div>

Hello everyone I am a beginner in kibana and I'm having trouble setting up a query to generate a metric in Kibana. But I don't know if I'm structuring it wrong or if the query isn't even possible Giving a little contex…

---

## [Successfully started Logstash API endpoint {:port=\>9600} stuck here i am using window 10](https://discuss.elastic.co/t/successfully-started-logstash-api-endpoint-port-9600-stuck-here-i-am-using-window-10/245039)

<div class="topic-metadata">

**Author:** [@SUSHIL\_KUMAR1](https://discuss.elastic.co/u/SUSHIL_KUMAR1)\
**Replies:** 1\
**Last updated:** [August 14, 2020, 4:15pm UTC](https://discuss.elastic.co/t/successfully-started-logstash-api-endpoint-port-9600-stuck-here-i-am-using-window-10/245039 "2020-08-14T16:15:18Z")

</div>

input{ file{ path=\> "C:/Users/sushils/Desktop/metadata.csv" start\_position=\>"beginning" sincedb\_path=\> "NULL" } } filter { csv{ separator =\> "," columns =\> \["cord\_uid", "sha", "source\_x", "title", "doi", "pmci…

---

## [Uax\_url\_email for email get unexpected search result](https://discuss.elastic.co/t/uax-url-email-for-email-get-unexpected-search-result/245041)

<div class="topic-metadata">

**Author:** [@Jinlian\_Chen](https://discuss.elastic.co/u/Jinlian_Chen)\
**Replies:** 0\
**Last updated:** [August 14, 2020, 3:50pm UTC](https://discuss.elastic.co/t/uax-url-email-for-email-get-unexpected-search-result/245041 "2020-08-14T15:50:58Z")

</div>

Elasticsearch version: 7.8.0 Use uax\_url\_email and pattern\_capture to analyze emails, search email address get unexpected result. Two email address: hello-test hello-world@gmail.com hello-test-hello-world@gmail.com S…

---

## [DELETE documents documents that have field date1 in the given interval and the value of "date1 - date2" is greater than 1 hour](https://discuss.elastic.co/t/delete-documents-documents-that-have-field-date1-in-the-given-interval-and-the-value-of-date1-date2-is-greater-than-1-hour/245040)

<div class="topic-metadata">

**Author:** [@Rysiu](https://discuss.elastic.co/u/Rysiu)\
**Replies:** 0\
**Last updated:** [August 14, 2020, 3:39pm UTC](https://discuss.elastic.co/t/delete-documents-documents-that-have-field-date1-in-the-given-interval-and-the-value-of-date1-date2-is-greater-than-1-hour/245040 "2020-08-14T15:39:09Z")

</div>

We have a basic index with two fields: date1 and date2. PUT your\_index { "mappings": { "your\_type": { "properties": { "time1": { "type": "date", }, "time2": { "t…

---

## [Kibana Index Pattern via API](https://discuss.elastic.co/t/kibana-index-pattern-via-api/244957)

<div class="topic-metadata">

**Author:** [@Venkatesh\_Guruprasad](https://discuss.elastic.co/u/Venkatesh_Guruprasad)\
**Replies:** 3\
**Last updated:** [August 14, 2020, 3:16pm UTC](https://discuss.elastic.co/t/kibana-index-pattern-via-api/244957 "2020-08-14T15:16:33Z")

</div>

I have used API to create ES indexes. Unfortunately Kibana Index Patterns doesn't get auto-generated when we do that. I have tried using the following API call curl -X POST "http://localhost:5601/api/saved\_objects/index…

---

## [JMX Plugin Attributes (more than metric path)](https://discuss.elastic.co/t/jmx-plugin-attributes-more-than-metric-path/245017)

<div class="topic-metadata">

**Author:** [@Rodrigo\_Maia](https://discuss.elastic.co/u/Rodrigo_Maia)\
**Replies:** 0\
**Last updated:** [August 14, 2020, 1:27pm UTC](https://discuss.elastic.co/t/jmx-plugin-attributes-more-than-metric-path/245017 "2020-08-14T13:27:57Z")

</div>

Let's say I have the JMX config for my ActiveMQ: { "object\_name" : "org.apache.activemq:type=Broker,brokerName=\*,destinationName=\*,destinationType=Topic", "attributes" : \[ "AverageBlockedTime","AverageEn…

---

## [Ignore groups that are not in the log](https://discuss.elastic.co/t/ignore-groups-that-are-not-in-the-log/244754)

<div class="topic-metadata">

**Author:** [@idyuzhev](https://discuss.elastic.co/u/idyuzhev)\
**Replies:** 7\
**Last updated:** [August 14, 2020, 2:56pm UTC](https://discuss.elastic.co/t/ignore-groups-that-are-not-in-the-log/244754 "2020-08-14T14:56:32Z")

</div>

Hello. I hope for your help. I need to parse the nginx-error-log, but the problem is that this or that group in the log may be absent and then no match occurs. Here's an example. 2020/08/11 14:16:35 \[warn\] 230521#230…

---

## [Serial Diff two metrics](https://discuss.elastic.co/t/serial-diff-two-metrics/244978)

<div class="topic-metadata">

**Author:** [@Shyrine](https://discuss.elastic.co/u/Shyrine)\
**Replies:** 3\
**Last updated:** [August 14, 2020, 2:53pm UTC](https://discuss.elastic.co/t/serial-diff-two-metrics/244978 "2020-08-14T14:53:39Z")

</div>

Hi, I am wondering if it is possible to have a serial diff in aggregation between two metrics.... ?? What I am trying to do is having an other bar or line, calculating the difference between the two bars (green and ora…

---

## [Reindex with https](https://discuss.elastic.co/t/reindex-with-https/245031)

<div class="topic-metadata">

**Author:** [@dimm](https://discuss.elastic.co/u/dimm)\
**Replies:** 0\
**Last updated:** [August 14, 2020, 2:29pm UTC](https://discuss.elastic.co/t/reindex-with-https/245031 "2020-08-14T14:29:40Z")

</div>

Hi, I'm tryning to migrate data from my OLD\_ELASTIC server (version 6.2) to the NEW\_ELASTIC (version 7.8.1) using REINDEX approcach but with https connection. My NEW\_ELASTIC elasticsearch.yml contains: ... reindex.rem…

---

## [server.basePath leads to indefinite loop](https://discuss.elastic.co/t/server-basepath-leads-to-indefinite-loop/242585)

<div class="topic-metadata">

**Author:** [@zaeemmasood](https://discuss.elastic.co/u/zaeemmasood)\
**Replies:** 3\
**Last updated:** [August 14, 2020, 2:10pm UTC](https://discuss.elastic.co/t/server-basepath-leads-to-indefinite-loop/242585 "2020-08-14T14:10:43Z")

</div>

Hello. I am using elk stack 7.6.2. When I introduce server.basePath parameter in kibana.yml the browser tends to go in an indefinite loop. Please advise.

---

## [Adopting beats/v7 v7.8.1 - custom beat no longer compiles, refactoring help needed](https://discuss.elastic.co/t/adopting-beats-v7-v7-8-1-custom-beat-no-longer-compiles-refactoring-help-needed/244200)

<div class="topic-metadata">

**Author:** [@rmauri](https://discuss.elastic.co/u/rmauri)\
**Replies:** 2\
**Last updated:** [August 14, 2020, 2:03pm UTC](https://discuss.elastic.co/t/adopting-beats-v7-v7-8-1-custom-beat-no-longer-compiles-refactoring-help-needed/244200 "2020-08-14T14:03:22Z")

</div>

I have several custom beats that I am now refactoring to adopt the beats/v7 and go modules. The trivial main.go no longer compile as there are breaking changes and the new API replacement is unclear how to use it. The …

---

## [How do I save Kibana dev tools console or history log](https://discuss.elastic.co/t/how-do-i-save-kibana-dev-tools-console-or-history-log/244965)

<div class="topic-metadata">

**Author:** [@RusseL](https://discuss.elastic.co/u/RusseL)\
**Replies:** 1\
**Last updated:** [August 14, 2020, 2:01pm UTC](https://discuss.elastic.co/t/how-do-i-save-kibana-dev-tools-console-or-history-log/244965 "2020-08-14T14:01:55Z")

</div>

Hi guys , I want to save the queries or historical records I run in Devtools console into an index, is that possible?

---

## [How do I add 3 fields and get an average?](https://discuss.elastic.co/t/how-do-i-add-3-fields-and-get-an-average/244628)

<div class="topic-metadata">

**Author:** [@dandcp](https://discuss.elastic.co/u/dandcp)\
**Replies:** 4\
**Last updated:** [August 14, 2020, 1:52pm UTC](https://discuss.elastic.co/t/how-do-i-add-3-fields-and-get-an-average/244628 "2020-08-14T13:52:43Z")

</div>

I want to add 3 different fields and then divide them for an average. The fields are: business\_poc\_flag technical\_poc\_flag functional\_poc\_flag The value is either a "1" or a "0" (business\_poc\_flag = 1 if the busine…

---

## [Boosting documents performance (Terms vs Should)](https://discuss.elastic.co/t/boosting-documents-performance-terms-vs-should/245018)

<div class="topic-metadata">

**Author:** [@Kushikawa](https://discuss.elastic.co/u/Kushikawa)\
**Replies:** 0\
**Last updated:** [August 14, 2020, 1:28pm UTC](https://discuss.elastic.co/t/boosting-documents-performance-terms-vs-should/245018 "2020-08-14T13:28:27Z")

</div>

Hi, I have something similar to the following document: { "title": "Alisha Solid Women's Cycling Shorts", "sku":\["54855","54856","54857","54858","54859"\] }, { "title": "Vishudh Printed Women's Anarkali Kurta", "…

---

## [How drop messages with total fields bigger than 1000](https://discuss.elastic.co/t/how-drop-messages-with-total-fields-bigger-than-1000/245012)

<div class="topic-metadata">

**Author:** [@dorinand](https://discuss.elastic.co/u/dorinand)\
**Replies:** 0\
**Last updated:** [August 14, 2020, 1:08pm UTC](https://discuss.elastic.co/t/how-drop-messages-with-total-fields-bigger-than-1000/245012 "2020-08-14T13:08:40Z")

</div>

I am receiving a lot of Limit of total fields \[1000\] errors. I increase the size to 2000 but the errors still occurs and dont want to increase the limit to bigger size . I was not able to find a filter or other way, how …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1864)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1866)
