# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1754

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1755

---

## [Elasticsearch load is low, batch write latency is high, how to check the problem](https://discuss.elastic.co/t/elasticsearch-load-is-low-batch-write-latency-is-high-how-to-check-the-problem/268975)

<div class="topic-metadata">

**Author:** [@bxl](https://discuss.elastic.co/u/bxl)\
**Replies:** 1\
**Last updated:** [April 1, 2021, 7:09am UTC](https://discuss.elastic.co/t/elasticsearch-load-is-low-batch-write-latency-is-high-how-to-check-the-problem/268975 "2021-04-01T07:09:43Z")

</div>

elasticsearch load is low, batch write latency is high, how to check the problem , thanks 13:24:27 22.6s{ "completed" : false, "task" : { "node" : "6nPgzz7\_Q96pQzAompMFUQ", "id" : 470791605, "type" : "tr…

---

## [Unique count two fields combined](https://discuss.elastic.co/t/unique-count-two-fields-combined/268987)

<div class="topic-metadata">

**Author:** [@kasun](https://discuss.elastic.co/u/kasun)\
**Replies:** 1\
**Last updated:** [April 1, 2021, 6:59am UTC](https://discuss.elastic.co/t/unique-count-two-fields-combined/268987 "2021-04-01T06:59:49Z")

</div>

Hi all, For a pie chart, I am using unique count aggregation as the metric. However, I need to get the unique count when two fields combined. Is this possible using the advanced option in kibana visualizations? As an e…

---

## [Best design for managing 'likes' on each comment?](https://discuss.elastic.co/t/best-design-for-managing-likes-on-each-comment/267607)

<div class="topic-metadata">

**Author:** [@Jenny1](https://discuss.elastic.co/u/Jenny1)\
**Replies:** 9\
**Last updated:** [April 1, 2021, 6:59am UTC](https://discuss.elastic.co/t/best-design-for-managing-likes-on-each-comment/267607 "2021-04-01T06:59:46Z")

</div>

Hi, I'm new to Elasticsearch and struggling with the design. I have 2 indices. One is 'comment' index which contains comments users wrote, the other is 'ex\_comment' which also contains comments but crawling data. What …

---

## [Kibana maximum results capped at 10000](https://discuss.elastic.co/t/kibana-maximum-results-capped-at-10000/267196)

<div class="topic-metadata">

**Author:** [@shamzeer](https://discuss.elastic.co/u/shamzeer)\
**Replies:** 6\
**Last updated:** [April 1, 2021, 6:58am UTC](https://discuss.elastic.co/t/kibana-maximum-results-capped-at-10000/267196 "2021-04-01T06:58:37Z")

</div>

We are using Elastic and Kibana version on 7.10. As per the documentations, the maximum results returned would be 10000. However this causes a real issue for us in the metric visualization where we use visualization to …

---

## [Elasticsearch failed to start on Ubuntu 18.04](https://discuss.elastic.co/t/elasticsearch-failed-to-start-on-ubuntu-18-04/268262)

<div class="topic-metadata">

**Author:** [@Sebastian\_F](https://discuss.elastic.co/u/Sebastian_F)\
**Replies:** 21\
**Last updated:** [April 1, 2021, 6:54am UTC](https://discuss.elastic.co/t/elasticsearch-failed-to-start-on-ubuntu-18-04/268262 "2021-04-01T06:54:29Z")

</div>

Hi folks, I am an elastic noob and I am stuck with running elasticsearch on an Ubuntu 18.04 V-Server with 4 Cores, 8Gb Ram and a 100GB Hard drive. I followed the instructions from this post: Installieren und Konfigurier…

---

## [Changing the index pattern that a visualisation is based on](https://discuss.elastic.co/t/changing-the-index-pattern-that-a-visualisation-is-based-on/268290)

<div class="topic-metadata">

**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\
**Replies:** 6\
**Last updated:** [April 1, 2021, 6:49am UTC](https://discuss.elastic.co/t/changing-the-index-pattern-that-a-visualisation-is-based-on/268290 "2021-04-01T06:49:57Z")

</div>

I have found a set of visualisation on github that I want to use. But they are build around a different pattern of index name to what I have even though the mapping are the same (or at least mostly). I have the ndjson …

---

## [Is the dependent jars can be upgraded](https://discuss.elastic.co/t/is-the-dependent-jars-can-be-upgraded/268866)

<div class="topic-metadata">

**Author:** [@mohammed\_rizwan](https://discuss.elastic.co/u/mohammed_rizwan)\
**Replies:** 3\
**Last updated:** [April 1, 2021, 6:43am UTC](https://discuss.elastic.co/t/is-the-dependent-jars-can-be-upgraded/268866 "2021-04-01T06:43:54Z")

</div>

Hi team, We are using the elastic search 7.2.0 which depends on snakeyaml version 1.17. Snakeyaml 1.17 has security vulnerabilities and we plan to upgrade it to the latest version 1.28. Is upgrading the dependant snak…

---

## [Kibana APM without installing APM agents](https://discuss.elastic.co/t/kibana-apm-without-installing-apm-agents/268791)

<div class="topic-metadata">

**Author:** [@elk\_novice](https://discuss.elastic.co/u/elk_novice)\
**Replies:** 4\
**Last updated:** [April 1, 2021, 5:53am UTC](https://discuss.elastic.co/t/kibana-apm-without-installing-apm-agents/268791 "2021-04-01T05:53:27Z")

</div>

Hi All, I am newbie. Please let me know if its possible to use KIBANA APM, without having APM server and APM agent. Can we use kibana APM just by doing ECS mapping in logstash and storing the index in elasticsearch. OR…

---

## [How to create a search saved object with kibana API](https://discuss.elastic.co/t/how-to-create-a-search-saved-object-with-kibana-api/268963)

<div class="topic-metadata">

**Author:** [@BhavyaSree](https://discuss.elastic.co/u/BhavyaSree)\
**Replies:** 1\
**Last updated:** [April 1, 2021, 5:41am UTC](https://discuss.elastic.co/t/how-to-create-a-search-saved-object-with-kibana-api/268963 "2021-04-01T05:41:00Z")

</div>

I tried to create a search saved object with kibana API. I could able to create the object with selected columns and sort, but I am unable to add filters to the search. Below is the body of POST call I used. { "attri…

---

## [Filter Logstash based on field from Filebeat tags](https://discuss.elastic.co/t/filter-logstash-based-on-field-from-filebeat-tags/268965)

<div class="topic-metadata">

**Author:** [@Automation\_Scripts](https://discuss.elastic.co/u/Automation_Scripts)\
**Replies:** 2\
**Last updated:** [April 1, 2021, 5:33am UTC](https://discuss.elastic.co/t/filter-logstash-based-on-field-from-filebeat-tags/268965 "2021-04-01T05:33:09Z")

</div>

Hi guys, I need some help filtering some data from Filebeat in Logstash. My original filebeat log looks liks this: \*\*\* This is the log from docker from filebeat container ssl.log "@timestamp": "2021-03-31T23:14:55.7…

---

## [Node disconnecting randomly](https://discuss.elastic.co/t/node-disconnecting-randomly/265085)

<div class="topic-metadata">

**Author:** [@DENMODSupport](https://discuss.elastic.co/u/DENMODSupport)\
**Replies:** 27\
**Last updated:** [April 1, 2021, 5:20am UTC](https://discuss.elastic.co/t/node-disconnecting-randomly/265085 "2021-04-01T05:20:07Z")

</div>

Hi, We could see that nodes are disconnecting frequently from cluster. Below are the errors from Master and data nodes. We are using ELK version 5.3.1. Could you please help us to prevent the node disconnection issue? \*…

---

## [Processor not dropping events Beats Winlogbeat](https://discuss.elastic.co/t/processor-not-dropping-events-beats-winlogbeat/268873)

<div class="topic-metadata">

**Author:** [@stinkfly](https://discuss.elastic.co/u/stinkfly)\
**Replies:** 2\
**Last updated:** [April 1, 2021, 2:50am UTC](https://discuss.elastic.co/t/processor-not-dropping-events-beats-winlogbeat/268873 "2021-04-01T02:50:56Z")

</div>

Hi there, V7.11.2 This topic has been addressed before and I've read other people's solutions, no luck. Have tried multiple combinations of and/or to drop windows event logs 4624 or 4634 with LogonType 0,3 or 5. Howe…

---

## [Upload logfile in the kibana](https://discuss.elastic.co/t/upload-logfile-in-the-kibana/268972)

<div class="topic-metadata">

**Author:** [@Son\_Vu\_Bao](https://discuss.elastic.co/u/Son_Vu_Bao)\
**Replies:** 6\
**Last updated:** [April 1, 2021, 3:22am UTC](https://discuss.elastic.co/t/upload-logfile-in-the-kibana/268972 "2021-04-01T03:22:01Z")

</div>

Hi, I am new in Elasticsearch. I am trying to upload a log file into elasticsearch by using data visualizer. However, I ran to some error like below:

---

## [Kibana : Internal Server Error](https://discuss.elastic.co/t/kibana-internal-server-error/268938)

<div class="topic-metadata">

**Author:** [@sanju\_timsina](https://discuss.elastic.co/u/sanju_timsina)\
**Replies:** 5\
**Last updated:** [April 1, 2021, 2:29am UTC](https://discuss.elastic.co/t/kibana-internal-server-error/268938 "2021-04-01T02:29:29Z")

</div>

Hi, I am running Kibana 7.11 and I am getting this Internal Server Error when I try to get logs on the Kibana Portal. log \[11:09:04.725\] \[info\]\[listening\] Server running at http://0.0.0.0:5601 log \[11:09:05.303…

---

## [How to get the realtime data based on aggrgations](https://discuss.elastic.co/t/how-to-get-the-realtime-data-based-on-aggrgations/268787)

<div class="topic-metadata">

**Author:** [@anjilinga](https://discuss.elastic.co/u/anjilinga)\
**Replies:** 3\
**Last updated:** [March 31, 2021, 10:08pm UTC](https://discuss.elastic.co/t/how-to-get-the-realtime-data-based-on-aggrgations/268787 "2021-03-31T22:08:53Z")

</div>

Hi, With the below data, want to measure the time series graph with 30 sec resolution, how many are logged in and how many are Ready and how many are Busy. how to group by agent and find the status and sum the agents ba…

---

## [Make a pie chart based on one field where value is x, y, and z?](https://discuss.elastic.co/t/make-a-pie-chart-based-on-one-field-where-value-is-x-y-and-z/268828)

<div class="topic-metadata">

**Author:** [@riahc3](https://discuss.elastic.co/u/riahc3)\
**Replies:** 3\
**Last updated:** [March 31, 2021, 10:06pm UTC](https://discuss.elastic.co/t/make-a-pie-chart-based-on-one-field-where-value-is-x-y-and-z/268828 "2021-03-31T22:06:28Z")

</div>

Hello I have a index pattern called my-index-x with entries and a text field that says Results. What I want to do is in a pie chart for example, make three or more slices: One slices would represent the number that "Su…

---

## [Split filebeat log with a variable length into several new events](https://discuss.elastic.co/t/split-filebeat-log-with-a-variable-length-into-several-new-events/268957)

<div class="topic-metadata">

**Author:** [@rmartinez.rv](https://discuss.elastic.co/u/rmartinez.rv)\
**Replies:** 2\
**Last updated:** [March 31, 2021, 9:49pm UTC](https://discuss.elastic.co/t/split-filebeat-log-with-a-variable-length-into-several-new-events/268957 "2021-03-31T21:49:48Z")

</div>

Hi. I'm fairly new with ELK, and i been struggling a lot trying to make this work, with no luck, so i'm asking for a way to solve this... I'm using Filebeat to get logs into my elasticsearc server and, the line logs ar…

---

## [How to combine multi timelines in one vega graph using layers](https://discuss.elastic.co/t/how-to-combine-multi-timelines-in-one-vega-graph-using-layers/266932)

<div class="topic-metadata">

**Author:** [@bab](https://discuss.elastic.co/u/bab)\
**Replies:** 1\
**Last updated:** [March 31, 2021, 9:30pm UTC](https://discuss.elastic.co/t/how-to-combine-multi-timelines-in-one-vega-graph-using-layers/266932 "2021-03-31T21:30:37Z")

</div>

hi experts, am trying to combine multi time lines Vega graphic to one but i'm stock, can anyone check my code, where i missed. { $schema: https://vega.github.io/schema/vega-lite/v2.json data: { url: { %con…

---

## [Logstash importing hostname incorrectly](https://discuss.elastic.co/t/logstash-importing-hostname-incorrectly/268496)

<div class="topic-metadata">

**Author:** [@ASA01](https://discuss.elastic.co/u/ASA01)\
**Replies:** 6\
**Last updated:** [March 31, 2021, 9:02pm UTC](https://discuss.elastic.co/t/logstash-importing-hostname-incorrectly/268496 "2021-03-31T21:02:39Z")

</div>

Running across something I don't understand after building a new stack with the latest release of Logstash (7.11.1). It appears to be entering the hostname wrong or I understand it wrong. The system hostname is cmscd h…

---

## [Query\_string with fuzzy and stammer filter works wierd](https://discuss.elastic.co/t/query-string-with-fuzzy-and-stammer-filter-works-wierd/268956)

<div class="topic-metadata">

**Author:** [@fedoroko](https://discuss.elastic.co/u/fedoroko)\
**Replies:** 0\
**Last updated:** [March 31, 2021, 7:58pm UTC](https://discuss.elastic.co/t/query-string-with-fuzzy-and-stammer-filter-works-wierd/268956 "2021-03-31T19:58:31Z")

</div>

Found some strange thing with query\_string and stemmer/snowball filters, can't understand how does it work and how to fix this, help me, please. Analyzer and filter: 'analyzer' =\> \[ …

---

## [Source.bytes not showing up as a field in elb fileset for aws](https://discuss.elastic.co/t/source-bytes-not-showing-up-as-a-field-in-elb-fileset-for-aws/268675)

<div class="topic-metadata">

**Author:** [@EvanGertis](https://discuss.elastic.co/u/EvanGertis)\
**Replies:** 2\
**Last updated:** [March 31, 2021, 7:12pm UTC](https://discuss.elastic.co/t/source-bytes-not-showing-up-as-a-field-in-elb-fileset-for-aws/268675 "2021-03-31T19:12:31Z")

</div>

I am trying to use the aws module for filebeat. My goal is to recreate the ELB Inbound Traffic \[Filebeat AWS\] visualization. It does not work by default. I've added an s3 bucket for collecting elb logs and an s3 bucket n…

---

## [Console not listing exact match above partial match](https://discuss.elastic.co/t/console-not-listing-exact-match-above-partial-match/268401)

<div class="topic-metadata">

**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\
**Replies:** 2\
**Last updated:** [March 31, 2021, 7:12pm UTC](https://discuss.elastic.co/t/console-not-listing-exact-match-above-partial-match/268401 "2021-03-31T19:12:04Z")

</div>

Hello: Is there a way to configure kibana to list exact match first before partial match in console? I tried to delete indices with certain pattern (date time). for example: When I type "202101", I am getting a list …

---

## [Suricata -\> Filebeat -\> Elasticsearch](https://discuss.elastic.co/t/suricata-filebeat-elasticsearch/268944)

<div class="topic-metadata">

**Author:** [@nunex\_17](https://discuss.elastic.co/u/nunex_17)\
**Replies:** 0\
**Last updated:** [March 31, 2021, 6:51pm UTC](https://discuss.elastic.co/t/suricata-filebeat-elasticsearch/268944 "2021-03-31T18:51:59Z")

</div>

Hi there! I´m implementing a IDS solution (suricata). I am sending logs via filebeat to a remote ELK server. What happens is that i´m not getting real-time searches. For instance, on the "Discovery" page an event that h…

---

## [Filter postgresql ERROR, FATAL, PANIC messages from postgresql logs](https://discuss.elastic.co/t/filter-postgresql-error-fatal-panic-messages-from-postgresql-logs/268843)

<div class="topic-metadata">

**Author:** [@elk\_newbie](https://discuss.elastic.co/u/elk_newbie)\
**Replies:** 4\
**Last updated:** [March 31, 2021, 6:46pm UTC](https://discuss.elastic.co/t/filter-postgresql-error-fatal-panic-messages-from-postgresql-logs/268843 "2021-03-31T18:46:21Z")

</div>

Hi community, Is there any way to filter only ERROR, FATAL and PANIC messages from Postgresql logs? appreciate any help! Regards Patrick

---

## [Rally 2.1.0 released](https://discuss.elastic.co/t/rally-2-1-0-released/268943)

<div class="topic-metadata">

**Author:** [@Evgenia\_Badiyanova](https://discuss.elastic.co/u/Evgenia_Badiyanova)\
**Replies:** 0\
**Last updated:** [March 31, 2021, 6:25pm UTC](https://discuss.elastic.co/t/rally-2-1-0-released/268943 "2021-03-31T18:25:50Z")

</div>

We have just released Rally 2.1.0. This is a bug fix release but also adds quite a few enhancements. Here are some highlights: We added support for search\_after and point-in-time. There are new track operations: open-p…

---

## [Time in logstash is getting different due to daylight saving time](https://discuss.elastic.co/t/time-in-logstash-is-getting-different-due-to-daylight-saving-time/268934)

<div class="topic-metadata">

**Author:** [@anjilinga](https://discuss.elastic.co/u/anjilinga)\
**Replies:** 1\
**Last updated:** [March 31, 2021, 5:35pm UTC](https://discuss.elastic.co/t/time-in-logstash-is-getting-different-due-to-daylight-saving-time/268934 "2021-03-31T17:35:16Z")

</div>

Hi i am using ruby code in logstash as below and getting the time one hour less. ruby { code =\> "event.set('current\_window\_end', Time.now());" } if current time is 10 :00 (in London) getting the time as 9:00. i have …

---

## [How to embed visualization into my app](https://discuss.elastic.co/t/how-to-embed-visualization-into-my-app/268591)

<div class="topic-metadata">

**Author:** [@whitediver](https://discuss.elastic.co/u/whitediver)\
**Replies:** 3\
**Last updated:** [March 31, 2021, 4:48pm UTC](https://discuss.elastic.co/t/how-to-embed-visualization-into-my-app/268591 "2021-03-31T16:48:04Z")

</div>

Since the embedVisualizationWithId was removed from the Kibana, I have no way to embed visualization into my Kibana app. Does anybody know what I should use instead?

---

## [Using ILP with rollup](https://discuss.elastic.co/t/using-ilp-with-rollup/267204)

<div class="topic-metadata">

**Author:** [@vishal\_ramanlal](https://discuss.elastic.co/u/vishal_ramanlal)\
**Replies:** 1\
**Last updated:** [March 31, 2021, 4:21pm UTC](https://discuss.elastic.co/t/using-ilp-with-rollup/267204 "2021-03-31T16:21:57Z")

</div>

I am trying to configure Kibana to use a rollup to parse and simplify apache James data. I can currently push data to an index which sets the data according to a template. I can also use rollup to get and simplify the da…

---

## [Vega Visualizations in Kibana: 400 error setting default pattern](https://discuss.elastic.co/t/vega-visualizations-in-kibana-400-error-setting-default-pattern/268808)

<div class="topic-metadata">

**Author:** [@jonahzirkle](https://discuss.elastic.co/u/jonahzirkle)\
**Replies:** 4\
**Last updated:** [March 31, 2021, 4:20pm UTC](https://discuss.elastic.co/t/vega-visualizations-in-kibana-400-error-setting-default-pattern/268808 "2021-03-31T16:20:55Z")

</div>

Class/lab has me create index patterns; which works fine. I cannot proceed to the next step of going to Discover w/o setting a default pattern. When I click the start, for either pattern, a 400 error is throw w/an exce…

---

## [Discover JSON missing \_source field](https://discuss.elastic.co/t/discover-json-missing-source-field/268922)

<div class="topic-metadata">

**Author:** [@frebri](https://discuss.elastic.co/u/frebri)\
**Replies:** 2\
**Last updated:** [March 31, 2021, 4:01pm UTC](https://discuss.elastic.co/t/discover-json-missing-source-field/268922 "2021-03-31T16:01:47Z")

</div>

Hi, We reinstalled Kibana and Elastic with 7.12 and are accustomed to look at certain documents through just pure json, since it has a specific order and grouping. After the upgrade, the JSON tab seems to "pretty print"…

[Previous page](https://discuss.elastic.co/latest.md?page=1753)

[Next page](https://discuss.elastic.co/latest.md?page=1755)
