# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1919

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1920

---

## [Optimize corpus before training](https://discuss.elastic.co/t/optimize-corpus-before-training/259732)

<div class="topic-metadata">

**Author:** [@Alder](https://discuss.elastic.co/u/Alder)\
**Replies:** 0\
**Last updated:** [December 28, 2020, 12:51pm UTC](https://discuss.elastic.co/t/optimize-corpus-before-training/259732 "2020-12-28T12:51:01Z")

</div>

Hi all from elastic team. I am building a pipiline to optimize a corpus before submitting to opennlp training. remove stopwords apply lemmatizer or stemmer The elastic has some functionality that I pass a text and re…

---

## [Cannot run Kibana](https://discuss.elastic.co/t/cannot-run-kibana/259677)

<div class="topic-metadata">

**Author:** [@111422](https://discuss.elastic.co/u/111422)\
**Replies:** 1\
**Last updated:** [December 28, 2020, 12:46pm UTC](https://discuss.elastic.co/t/cannot-run-kibana/259677 "2020-12-28T12:46:22Z")

</div>

After that I downloaded kibana to my windows, I opened in command prompt bin folder and ran kibana command. It showed "\\Kibana\\config was unexpected at this time." and did not run kibana. ElasticSearch was running normal…

---

## [Reverse Proxy & Security Questions](https://discuss.elastic.co/t/reverse-proxy-security-questions/256972)

<div class="topic-metadata">

**Author:** [@Ganymede](https://discuss.elastic.co/u/Ganymede)\
**Replies:** 3\
**Last updated:** [December 28, 2020, 12:45pm UTC](https://discuss.elastic.co/t/reverse-proxy-security-questions/256972 "2020-12-28T12:45:05Z")

</div>

Hello ES & Kibana aficionados! I'm very new to this whole topic (ES/Kibana/Network Security) and have some burning questions I'm certain you can help me out with. General Setup: Connection occurs via Citrix VPN. E…

---

## [JVM crashed after upgrade to apm java agent 1.19](https://discuss.elastic.co/t/jvm-crashed-after-upgrade-to-apm-java-agent-1-19/257583)

<div class="topic-metadata">

**Author:** [@jcotter91](https://discuss.elastic.co/u/jcotter91)\
**Replies:** 16\
**Last updated:** [December 28, 2020, 12:33pm UTC](https://discuss.elastic.co/t/jvm-crashed-after-upgrade-to-apm-java-agent-1-19/257583 "2020-12-28T12:33:08Z")

</div>

Kibana version: 7.10 Elasticsearch version: 7.10 APM Server version: 7.10 APM Agent language and version: Java APM 1.19 Fresh install or upgraded from other version? Upgraded from Java APM agent 1.15 to 1.19 Problem:…

---

## [Download kibana dashboards using API call](https://discuss.elastic.co/t/download-kibana-dashboards-using-api-call/259728)

<div class="topic-metadata">

**Author:** [@Gokul6](https://discuss.elastic.co/u/Gokul6)\
**Replies:** 2\
**Last updated:** [December 28, 2020, 12:21pm UTC](https://discuss.elastic.co/t/download-kibana-dashboards-using-api-call/259728 "2020-12-28T12:21:41Z")

</div>

i know that we can download our kibana dashboards as CSV but is it possible to download any kibana dashboard using tools like POSTMAN ?? by providing our login credentials and without logging into kibana is there a way t…

---

## [Elastic Agent and other Beats not run](https://discuss.elastic.co/t/elastic-agent-and-other-beats-not-run/259730)

<div class="topic-metadata">

**Author:** [@Minh\_Ti\_n\_Tr\_n](https://discuss.elastic.co/u/Minh_Ti_n_Tr_n)\
**Replies:** 0\
**Last updated:** [December 28, 2020, 12:20pm UTC](https://discuss.elastic.co/t/elastic-agent-and-other-beats-not-run/259730 "2020-12-28T12:20:16Z")

</div>

I install ELK in single-node mode with following configuration Host IP: 192.168.87.47 Elasticsearch.yml network.host: 0.0.0.0 node.name: elasticsearch cluster.initial\_master\_nodes: elasticsearch # Transport layer xpa…

---

## [Logstash grok hour and minute ruby](https://discuss.elastic.co/t/logstash-grok-hour-and-minute-ruby/259724)

<div class="topic-metadata">

**Author:** [@Cristiane\_Marcarini](https://discuss.elastic.co/u/Cristiane_Marcarini)\
**Replies:** 0\
**Last updated:** [December 28, 2020, 11:16am UTC](https://discuss.elastic.co/t/logstash-grok-hour-and-minute-ruby/259724 "2020-12-28T11:16:48Z")

</div>

Hi, I have a grok and I don't want to change it, but I wanted to have the hour and minutes separate, it could be using Ruby, something like that. Thanks else if "performanceLog" in \[path\] { grok { match =\> {"mess…

---

## [Multi match bool query returning 0 hits on large number of documents](https://discuss.elastic.co/t/multi-match-bool-query-returning-0-hits-on-large-number-of-documents/259523)

<div class="topic-metadata">

**Author:** [@Finley](https://discuss.elastic.co/u/Finley)\
**Replies:** 2\
**Last updated:** [December 28, 2020, 10:46am UTC](https://discuss.elastic.co/t/multi-match-bool-query-returning-0-hits-on-large-number-of-documents/259523 "2020-12-28T10:46:31Z")

</div>

Hi, I have 2 elk cluster in 7.10. A -\> 70 documents per hour B -\> 100 - 300 documents per second (825k on 1 hour) When I am doing a KQL search in kibana (discover) with just typing "POST", on the cluster A, it's retu…

---

## [Snapshot size limits](https://discuss.elastic.co/t/snapshot-size-limits/259703)

<div class="topic-metadata">

**Author:** [@noob1](https://discuss.elastic.co/u/noob1)\
**Replies:** 4\
**Last updated:** [December 28, 2020, 10:34am UTC](https://discuss.elastic.co/t/snapshot-size-limits/259703 "2020-12-28T10:34:12Z")

</div>

Hey All, I'm trying to understand if there is any size limit on how much size snapshot can be written to repository. Say, is it possible to write 200 GB of snapshot to repository? If yes which backend repository should …

---

## [How to sort results based on another field's value or weightage](https://discuss.elastic.co/t/how-to-sort-results-based-on-another-fields-value-or-weightage/259713)

<div class="topic-metadata">

**Author:** [@pushanbhattacharya](https://discuss.elastic.co/u/pushanbhattacharya)\
**Replies:** 1\
**Last updated:** [December 28, 2020, 10:03am UTC](https://discuss.elastic.co/t/how-to-sort-results-based-on-another-fields-value-or-weightage/259713 "2020-12-28T10:03:26Z")

</div>

Hi, Let's take an example. Say the index has 2 fields, viz., name and weightage. Values- name: Black Bus, weightage: 1 name: Blue Bus, weightage: 2 name: Black Car, weightage: 2 name: Blue Car, weightage: 1 Now, …

---

## [Cisco core switch integration](https://discuss.elastic.co/t/cisco-core-switch-integration/259711)

<div class="topic-metadata">

**Author:** [@sbathla](https://discuss.elastic.co/u/sbathla)\
**Replies:** 3\
**Last updated:** [December 28, 2020, 9:18am UTC](https://discuss.elastic.co/t/cisco-core-switch-integration/259711 "2020-12-28T09:18:09Z")

</div>

Hi All, I am trying to integrate elasticsearch with cisco core switch.I have done the required configuration in filebeat file and cisco module file. But while sending logs from core switch on port 9506, getting error t…

---

## [Export Canvas](https://discuss.elastic.co/t/export-canvas/259363)

<div class="topic-metadata">

**Author:** [@axfla](https://discuss.elastic.co/u/axfla)\
**Replies:** 2\
**Last updated:** [December 28, 2020, 8:51am UTC](https://discuss.elastic.co/t/export-canvas/259363 "2020-12-28T08:51:26Z")

</div>

Hello, I'm trying to export a workpad created in Canvas but I'm currently facing multiple problems: How can we export in PDF without the "elastic" frame ? During the export, text zones that were properly sized in the …

---

## [Build kibana via proxy](https://discuss.elastic.co/t/build-kibana-via-proxy/256212)

<div class="topic-metadata">

**Author:** [@lstoneir](https://discuss.elastic.co/u/lstoneir)\
**Replies:** 5\
**Last updated:** [December 28, 2020, 8:48am UTC](https://discuss.elastic.co/t/build-kibana-via-proxy/256212 "2020-12-28T08:48:36Z")

</div>

i have a source code of kibana 7.3.3 i want to build kibana by : yarn build --skip-node-download --skip-os-packages --skip-archives i have no internet access except an http proxy! i want to build kibana by using this…

---

## [Cookies issue while embedding kibana dashboard with iFrame](https://discuss.elastic.co/t/cookies-issue-while-embedding-kibana-dashboard-with-iframe/256777)

<div class="topic-metadata">

**Author:** [@Gokul6](https://discuss.elastic.co/u/Gokul6)\
**Replies:** 8\
**Last updated:** [December 28, 2020, 6:29am UTC](https://discuss.elastic.co/t/cookies-issue-while-embedding-kibana-dashboard-with-iframe/256777 "2020-12-28T06:29:14Z")

</div>

recently i read this in github. Currently, Kibana does not set the SameSite attribute on its session cookie. Up until recently, this was tolerable, but Chrome recently (version 80 ) updated its default configuration to …

---

## [Average bucket in histogram change when time filter change](https://discuss.elastic.co/t/average-bucket-in-histogram-change-when-time-filter-change/258285)

<div class="topic-metadata">

**Author:** [@vbarai](https://discuss.elastic.co/u/vbarai)\
**Replies:** 7\
**Last updated:** [December 28, 2020, 5:15am UTC](https://discuss.elastic.co/t/average-bucket-in-histogram-change-when-time-filter-change/258285 "2020-12-28T05:15:09Z")

</div>

Hi All, I am using latest ELK 7.10. I am facing weired issue with the Lens and Average Bucket Histogram. STEP 1 : Created 4 Index for Dec-2020 Days as below idx\_agg\_test\_20201201 idx\_agg\_test\_20201207 idx\_agg\_test\_2…

---

## [How to save only one data into mongodb by logstash-output-mongodb plugin?](https://discuss.elastic.co/t/how-to-save-only-one-data-into-mongodb-by-logstash-output-mongodb-plugin/259702)

<div class="topic-metadata">

**Author:** [@iooi](https://discuss.elastic.co/u/iooi)\
**Replies:** 0\
**Last updated:** [December 28, 2020, 3:58am UTC](https://discuss.elastic.co/t/how-to-save-only-one-data-into-mongodb-by-logstash-output-mongodb-plugin/259702 "2020-12-28T03:58:22Z")

</div>

Like this output configuration, just want to send id to mongodb output { mongodb { uri =\> 'mongodb://localhost' database =\> "testDB" collection =\> 'testCollection' codec =\> line { format =\> "%{id}"} …

---

## [Logstash 6.8 template gives 400 HTTP response code](https://discuss.elastic.co/t/logstash-6-8-template-gives-400-http-response-code/259699)

<div class="topic-metadata">

**Author:** [@mlpn](https://discuss.elastic.co/u/mlpn)\
**Replies:** 0\
**Last updated:** [December 27, 2020, 11:04pm UTC](https://discuss.elastic.co/t/logstash-6-8-template-gives-400-http-response-code/259699 "2020-12-27T23:04:36Z")

</div>

Hello, I'm in the middle of process of migrating ELK Stack from 5.4 to 7.1. I'm currently on 6.8 and my Logstash gives me HTTP response code 400 after start when I'm trying to import my template. I've renamed string valu…

---

## [Error: Your CLT does not support macOS 11](https://discuss.elastic.co/t/error-your-clt-does-not-support-macos-11/259680)

<div class="topic-metadata">

**Author:** [@yhoiseth](https://discuss.elastic.co/u/yhoiseth)\
**Replies:** 1\
**Last updated:** [December 27, 2020, 10:17pm UTC](https://discuss.elastic.co/t/error-your-clt-does-not-support-macos-11/259680 "2020-12-27T22:17:22Z")

</div>

After upgrading to macOS Big Sur 11.1 (20C69), I can’t upgrade Elasticsearch to 7.10.1. For background, I previously installed Elasticsearch using these instructions. I have since upgraded the Elasticsearch version many…

---

## [Can we use datastreams with Filebeat?659+](https://discuss.elastic.co/t/can-we-use-datastreams-with-filebeat-659/259693)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 0\
**Last updated:** [December 27, 2020, 6:26pm UTC](https://discuss.elastic.co/t/can-we-use-datastreams-with-filebeat-659/259693 "2020-12-27T18:26:12Z")

</div>

Hello, So "Can we use datastreams with Filebeat?" And more importantly, can we mix multiple inputs, where some use legacy ilm and some use datastreams? This is in a test 7.10.1 setup without Logstash. For example until…

---

## [Parse PostgreSQL CSV log](https://discuss.elastic.co/t/parse-postgresql-csv-log/259688)

<div class="topic-metadata">

**Author:** [@azlev](https://discuss.elastic.co/u/azlev)\
**Replies:** 3\
**Last updated:** [December 27, 2020, 5:52pm UTC](https://discuss.elastic.co/t/parse-postgresql-csv-log/259688 "2020-12-27T17:52:33Z")

</div>

Hello. At work we are consuming the PostgreSQL CSV log instead of plain log. This poses some advantages, like a better formatted input file, stable format, and easy to turn it on. To achieve it, we are using the filebe…

---

## [ES - Spark tuning for bulk writes](https://discuss.elastic.co/t/es-spark-tuning-for-bulk-writes/259167)

<div class="topic-metadata">

**Author:** [@Vishnu\_Singhal](https://discuss.elastic.co/u/Vishnu_Singhal)\
**Replies:** 16\
**Last updated:** [December 27, 2020, 3:32pm UTC](https://discuss.elastic.co/t/es-spark-tuning-for-bulk-writes/259167 "2020-12-27T15:32:05Z")

</div>

I;m using Spark 3 with ES 7.10 , ECK 1.3 I have following settings |es.batch.size.bytes|6000000| |es.batch.size.entries|10000| |es.batch.write.refresh|false| |es.batch.write.retry.count|6| Would like to know how can …

---

## [True/False Visualization](https://discuss.elastic.co/t/true-false-visualization/259665)

<div class="topic-metadata">

**Author:** [@rdesanno](https://discuss.elastic.co/u/rdesanno)\
**Replies:** 2\
**Last updated:** [December 27, 2020, 3:40pm UTC](https://discuss.elastic.co/t/true-false-visualization/259665 "2020-12-27T15:40:39Z")

</div>

Hi all! I'm perplexed on how to do something that should be easy and hoping that someone can point me in the right direction. I'm building a dashboard and want to have a box on it that pulls the last text value and dis…

---

## [Grok an Elasticsearch problem](https://discuss.elastic.co/t/grok-an-elasticsearch-problem/259675)

<div class="topic-metadata">

**Author:** [@mesutalf](https://discuss.elastic.co/u/mesutalf)\
**Replies:** 1\
**Last updated:** [December 27, 2020, 2:14pm UTC](https://discuss.elastic.co/t/grok-an-elasticsearch-problem/259675 "2020-12-27T14:14:19Z")

</div>

Hi, I use ELK (7.2.x) my localhost and I have problem. I have log file like this; 2020-11-30 05:52:33,018 \[9344\] INFO Zdk.ServiceProvider.ServiceThread \[\] - Thread \[Core\[8047e7a3-c403-4fe4-ab87-9bea0c0ab449\]:0\]: idle …

---

## [Logstash kafka input plugin not retrieving data](https://discuss.elastic.co/t/logstash-kafka-input-plugin-not-retrieving-data/259686)

<div class="topic-metadata">

**Author:** [@LogstashDeveloper](https://discuss.elastic.co/u/LogstashDeveloper)\
**Replies:** 0\
**Last updated:** [December 27, 2020, 1:39pm UTC](https://discuss.elastic.co/t/logstash-kafka-input-plugin-not-retrieving-data/259686 "2020-12-27T13:39:21Z")

</div>

Im using logstash kafka input plugin, but it does not retrieve data from kafka topic. Logstash log shows the following messages: Adding newly assigned partitions Setting offset for partition to the committed offset Fet…

---

## [Search for docs that are parents](https://discuss.elastic.co/t/search-for-docs-that-are-parents/259684)

<div class="topic-metadata">

**Author:** [@Luca\_Frost](https://discuss.elastic.co/u/Luca_Frost)\
**Replies:** 0\
**Last updated:** [December 27, 2020, 1:03pm UTC](https://discuss.elastic.co/t/search-for-docs-that-are-parents/259684 "2020-12-27T13:03:19Z")

</div>

Hi There, I'm looking for a way to search for documents where the join field specifies that they are a parent, that way I can still search for parents without children? Here's my very crude attempt which fails... POST…

---

## [Logstash kv field split problem](https://discuss.elastic.co/t/logstash-kv-field-split-problem/259552)

<div class="topic-metadata">

**Author:** [@abu.sayeed](https://discuss.elastic.co/u/abu.sayeed)\
**Replies:** 7\
**Last updated:** [December 27, 2020, 10:00am UTC](https://discuss.elastic.co/t/logstash-kv-field-split-problem/259552 "2020-12-27T10:00:10Z")

</div>

Logs like this: topic = abc, partition = 2, offset = 4386, serialized key size = -1, serialized value size = 1139, key = null, value = {"Name":"pc-1","test":false,"message":"elk test - Your pc-1 better. Thank you.","Cou…

---

## [Time filtered aggregations with very high cardinality](https://discuss.elastic.co/t/time-filtered-aggregations-with-very-high-cardinality/259673)

<div class="topic-metadata">

**Author:** [@Metheny](https://discuss.elastic.co/u/Metheny)\
**Replies:** 0\
**Last updated:** [December 27, 2020, 6:49am UTC](https://discuss.elastic.co/t/time-filtered-aggregations-with-very-high-cardinality/259673 "2020-12-27T06:49:29Z")

</div>

We have an index with a large amount of user reports (millions / 10s of millions). Assuming most users have reports, we need to calculate some statistics per-user with an input time range. For example, how many users ha…

---

## [Elasticsearch 7.10.1 new test cluster - cannot bring up - state not recovered](https://discuss.elastic.co/t/elasticsearch-7-10-1-new-test-cluster-cannot-bring-up-state-not-recovered/259520)

<div class="topic-metadata">

**Author:** [@lakshmi-github](https://discuss.elastic.co/u/lakshmi-github)\
**Replies:** 1\
**Last updated:** [December 26, 2020, 11:36pm UTC](https://discuss.elastic.co/t/elasticsearch-7-10-1-new-test-cluster-cannot-bring-up-state-not-recovered/259520 "2020-12-26T23:36:53Z")

</div>

Hello, I am trying to bring up a new ES 7.10.1 cluster for testing as follows: node1 - master (node.roles: \[ 'master'\]) node2 - master (node.roles: \[ 'master'\]) node3 - master (node.roles: \[ 'master'\]) node4 - data (n…

---

## [Aggregate filter dilemma](https://discuss.elastic.co/t/aggregate-filter-dilemma/259657)

<div class="topic-metadata">

**Author:** [@tommys](https://discuss.elastic.co/u/tommys)\
**Replies:** 4\
**Last updated:** [December 26, 2020, 10:58pm UTC](https://discuss.elastic.co/t/aggregate-filter-dilemma/259657 "2020-12-26T22:58:43Z")

</div>

Hi all, hoping to get some feedback on this as it took me 3 days to resolve which I think is potentially a knowledge gap on my side or a BUG. In summary: Two logs, I want to aggregate using the aggregate filter. One…

---

## [How can i do a Month over Month change in my graph?](https://discuss.elastic.co/t/how-can-i-do-a-month-over-month-change-in-my-graph/259322)

<div class="topic-metadata">

**Author:** [@marcosvrrs](https://discuss.elastic.co/u/marcosvrrs)\
**Replies:** 2\
**Last updated:** [December 26, 2020, 10:03pm UTC](https://discuss.elastic.co/t/how-can-i-do-a-month-over-month-change-in-my-graph/259322 "2020-12-26T22:03:42Z")

</div>

I have this graph that is a sum of transactions per month. How can I draw a line with the percentage change each month in this graph? I can't do this in TSVB, and didn't try in Timelion cause I'am bit of a newbie. Thank…

[Previous page](https://discuss.elastic.co/latest.md?page=1918)

[Next page](https://discuss.elastic.co/latest.md?page=1920)
