# \#none

**URL:** https://discuss.elastic.co/tag/none.md?page=1623

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1624

---

## [Logstash aggregate filter skipping records](https://discuss.elastic.co/t/logstash-aggregate-filter-skipping-records/219362)

<div class="topic-metadata">

**Author:** [@saifrehman](https://discuss.elastic.co/u/saifrehman)\
**Replies:** 4\
**Last updated:** [February 17, 2020, 3:24pm UTC](https://discuss.elastic.co/t/logstash-aggregate-filter-skipping-records/219362 "2020-02-17T15:24:26Z")

</div>

logstash aggregate filter skipping records. i have set the pipeline.worker to 1 but it's still missing nested records. I follow the instruction at here but noting work. It is not skipping records all the time. but it's …

---

## [ParserError: Illegal character ((CTRL-CHAR, code 27)): only regular white space (\\r, \\n, \\t) is allowed between tokens](https://discuss.elastic.co/t/parsererror-illegal-character-ctrl-char-code-27-only-regular-white-space-r-n-t-is-allowed-between-tokens/219550)

<div class="topic-metadata">

**Author:** [@Valm1980](https://discuss.elastic.co/u/Valm1980)\
**Replies:** 1\
**Last updated:** [February 17, 2020, 3:05pm UTC](https://discuss.elastic.co/t/parsererror-illegal-character-ctrl-char-code-27-only-regular-white-space-r-n-t-is-allowed-between-tokens/219550 "2020-02-17T15:05:08Z")

</div>

Hello, I am trying to filter out a log and drop any entries that have certain IP address, however I am getting an error: \[logstash.filters.json \] Error parsing json {:source=\>"message", :raw=\>"\\e\[32minfo\\e\[39m: 127.0…

---

## [Open closed index, inconsistent status](https://discuss.elastic.co/t/open-closed-index-inconsistent-status/219607)

<div class="topic-metadata">

**Author:** [@Miguel1](https://discuss.elastic.co/u/Miguel1)\
**Replies:** 5\
**Last updated:** [February 17, 2020, 2:53pm UTC](https://discuss.elastic.co/t/open-closed-index-inconsistent-status/219607 "2020-02-17T14:53:15Z")

</div>

Hi, folks! (my Elasticsearch version is 7.5.2) I have a closed index called "vpn-2019.52", a weekly vpn index and when I try to open it with: POST vpn-2019.52/\_open It timed out and reported nothing. After that I fou…

---

## [How can i accelarete loading csv to logstash](https://discuss.elastic.co/t/how-can-i-accelarete-loading-csv-to-logstash/219643)

<div class="topic-metadata">

**Author:** [@samargh](https://discuss.elastic.co/u/samargh)\
**Replies:** 1\
**Last updated:** [February 17, 2020, 2:52pm UTC](https://discuss.elastic.co/t/how-can-i-accelarete-loading-csv-to-logstash/219643 "2020-02-17T14:52:55Z")

</div>

i have a csv file that contains 6 millions rows but it takes too much time to load i tried PUT /twitter/\_settings { "index" : { "number\_of\_replicas" : 0 } } and even PUT /twitter/\_settings { "index" : { "ref…

---

## [Add\_field not getting the field](https://discuss.elastic.co/t/add-field-not-getting-the-field/219445)

<div class="topic-metadata">

**Author:** [@Kassio\_Silva](https://discuss.elastic.co/u/Kassio_Silva)\
**Replies:** 5\
**Last updated:** [February 17, 2020, 2:51pm UTC](https://discuss.elastic.co/t/add-field-not-getting-the-field/219445 "2020-02-17T14:51:37Z")

</div>

Hello guys, I am a newbie in logstash filtering and i having issues to get a specific field. i want to get the sum of "Accounting-Output-Octets" that is inside the "service\_data\_container" field, is it possible using m…

---

## [Kibana dashboard shows different values](https://discuss.elastic.co/t/kibana-dashboard-shows-different-values/219506)

<div class="topic-metadata">

**Author:** [@Vicky\_S](https://discuss.elastic.co/u/Vicky_S)\
**Replies:** 6\
**Last updated:** [February 17, 2020, 2:25pm UTC](https://discuss.elastic.co/t/kibana-dashboard-shows-different-values/219506 "2020-02-17T14:25:36Z")

</div>

Hi, I have created dashboards to monitor customer care details. I have visualizations to show the incoming and outgoing calls. In my computer kibana shows 71 incoming calls and 23 outgoing calls.I accessed the same dashb…

---

## [ELK on Virtual machine](https://discuss.elastic.co/t/elk-on-virtual-machine/219630)

<div class="topic-metadata">

**Author:** [@Rockk](https://discuss.elastic.co/u/Rockk)\
**Replies:** 1\
**Last updated:** [February 17, 2020, 2:28pm UTC](https://discuss.elastic.co/t/elk-on-virtual-machine/219630 "2020-02-17T14:28:07Z")

</div>

Hello Team, Can the ELK Stack(3 nodes - Elastic Search, Logstash and Kibana) be installed on the Virtual machines(Vmware or Hyper-V), Please advise. Also, what is the procedure to install and configure ELK Stack(3nodes…

---

## [Pulling the data from servicenow](https://discuss.elastic.co/t/pulling-the-data-from-servicenow/219624)

<div class="topic-metadata">

**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\
**Replies:** 3\
**Last updated:** [February 17, 2020, 2:11pm UTC](https://discuss.elastic.co/t/pulling-the-data-from-servicenow/219624 "2020-02-17T14:11:56Z")

</div>

Is there a way to pull the data from servicenow to be indexed into elasticsearch?

---

## [How Refresh works between primary and replica shards](https://discuss.elastic.co/t/how-refresh-works-between-primary-and-replica-shards/219181)

<div class="topic-metadata">

**Author:** [@Konathala\_Naveen](https://discuss.elastic.co/u/Konathala_Naveen)\
**Replies:** 5\
**Last updated:** [February 17, 2020, 2:01pm UTC](https://discuss.elastic.co/t/how-refresh-works-between-primary-and-replica-shards/219181 "2020-02-17T14:01:16Z")

</div>

How the refresh works between primary and replica shards 1.When the refresh happen on index.Does primary and replica shards refresh will happen in synchronous way? or After this indexing can happen asynchronously.

---

## [Elastic v8 Java Requirements](https://discuss.elastic.co/t/elastic-v8-java-requirements/219632)

<div class="topic-metadata">

**Author:** [@ahoffskov](https://discuss.elastic.co/u/ahoffskov)\
**Replies:** 0\
**Last updated:** [February 17, 2020, 1:54pm UTC](https://discuss.elastic.co/t/elastic-v8-java-requirements/219632 "2020-02-17T13:54:53Z")

</div>

Will AdoptOpenJDK be sufficient to run Elastic when upgrading to Elastic 8.0?

---

## [Logstash DNS unexpected error](https://discuss.elastic.co/t/logstash-dns-unexpected-error/215741)

<div class="topic-metadata">

**Author:** [@vmanyushin](https://discuss.elastic.co/u/vmanyushin)\
**Replies:** 5\
**Last updated:** [February 17, 2020, 1:41pm UTC](https://discuss.elastic.co/t/logstash-dns-unexpected-error/215741 "2020-02-17T13:41:56Z")

</div>

After upgrade to 7.5.1 a got error messages in log: \[2020-01-20T16:00:39,036\]\[ERROR\]\[logstash.filters.dns \]\[main\] DNS: Unexpected Error. {:field=\>"upstream\_hostname", :value=\>"172.16.21.57", :message=\>"Mutex relocki…

---

## [Elastic should consider joining the Open Cybersecurity Alliance](https://discuss.elastic.co/t/elastic-should-consider-joining-the-open-cybersecurity-alliance/219618)

<div class="topic-metadata">

**Author:** [@drmason131](https://discuss.elastic.co/u/drmason131)\
**Replies:** 0\
**Last updated:** [February 17, 2020, 12:41pm UTC](https://discuss.elastic.co/t/elastic-should-consider-joining-the-open-cybersecurity-alliance/219618 "2020-02-17T12:41:11Z")

</div>

I wondered if Elastic would be interested in taking part in the Open Cybersecurity Alliance. I believe it aligns with Elastic's values and would even make sense from a business perspective. The fewer barriers to bringin…

---

## [SSLHandshakeException](https://discuss.elastic.co/t/sslhandshakeexception/219616)

<div class="topic-metadata">

**Author:** [@Chelambarasan\_CR](https://discuss.elastic.co/u/Chelambarasan_CR)\
**Replies:** 0\
**Last updated:** [February 17, 2020, 12:30pm UTC](https://discuss.elastic.co/t/sslhandshakeexception/219616 "2020-02-17T12:30:21Z")

</div>

Getting the below error in Elastic 7.5.1 and readonly rest 1.19.0 version. I am using OSS Elastic and Open source read only rest verification. SSL and Auth works fine but after enabling certificate verification for inte…

---

## [Restore a partial data (results matching to a query) from a snapshot](https://discuss.elastic.co/t/restore-a-partial-data-results-matching-to-a-query-from-a-snapshot/219608)

<div class="topic-metadata">

**Author:** [@kaushik.vankayala](https://discuss.elastic.co/u/kaushik.vankayala)\
**Replies:** 1\
**Last updated:** [February 17, 2020, 12:13pm UTC](https://discuss.elastic.co/t/restore-a-partial-data-results-matching-to-a-query-from-a-snapshot/219608 "2020-02-17T12:13:35Z")

</div>

Hi Team, I am wondering if we can restore data from a snapshot that matches a query. This i am doing because i have a snapshot of about 96gb stored in custom S3 repository. There was a policy applied and the storage cl…

---

## [Filter some value on visualize "control" function](https://discuss.elastic.co/t/filter-some-value-on-visualize-control-function/215679)

<div class="topic-metadata">

**Author:** [@Tennis](https://discuss.elastic.co/u/Tennis)\
**Replies:** 3\
**Last updated:** [February 17, 2020, 12:11pm UTC](https://discuss.elastic.co/t/filter-some-value-on-visualize-control-function/215679 "2020-02-17T12:11:35Z")

</div>

I want to use the field: "product" to be a selection menu using the visualize feature "control". Data of field: "product" contains three types: keyboard, computer, screen. In default "control" function, my select menu …

---

## [Locked/read only indices Notifications](https://discuss.elastic.co/t/locked-read-only-indices-notifications/219610)

<div class="topic-metadata">

**Author:** [@cowensel](https://discuss.elastic.co/u/cowensel)\
**Replies:** 0\
**Last updated:** [February 17, 2020, 12:06pm UTC](https://discuss.elastic.co/t/locked-read-only-indices-notifications/219610 "2020-02-17T12:06:36Z")

</div>

Is there a way of being able to send an external email when Elasticsearch enters the read only state due to disk space or logstash cannot create records? We have had a couple of instances where this has happened and wou…

---

## [Add creation (not update) time of doc using ingest](https://discuss.elastic.co/t/add-creation-not-update-time-of-doc-using-ingest/217515)

<div class="topic-metadata">

**Author:** [@alza](https://discuss.elastic.co/u/alza)\
**Replies:** 11\
**Last updated:** [February 17, 2020, 11:53am UTC](https://discuss.elastic.co/t/add-creation-not-update-time-of-doc-using-ingest/217515 "2020-02-17T11:53:54Z")

</div>

I'm using the following pipeline to add creation timestamp to docs but it changes the timestamp every time that I put a newer version of a same doc to elastic. PUT \_ingest/pipeline/set\_creation\_date { "description":…

---

## [Permanently Delete All Old Documents with a Rollup Job?](https://discuss.elastic.co/t/permanently-delete-all-old-documents-with-a-rollup-job/218801)

<div class="topic-metadata">

**Author:** [@redapplesonly](https://discuss.elastic.co/u/redapplesonly)\
**Replies:** 5\
**Last updated:** [February 17, 2020, 11:48am UTC](https://discuss.elastic.co/t/permanently-delete-all-old-documents-with-a-rollup-job/218801 "2020-02-17T11:48:47Z")

</div>

Hello Master Elasticsearch Gurus, I am new to ELK and last year implemented a simple Elasticsearch server (ver 7.4.0, I know, I have to upgrade) that is archiving some simple production user data. When I set up ES, I t…

---

## [Migrating the Splunk Visualizations and Dashboards to Kibana](https://discuss.elastic.co/t/migrating-the-splunk-visualizations-and-dashboards-to-kibana/219580)

<div class="topic-metadata">

**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\
**Replies:** 2\
**Last updated:** [February 17, 2020, 11:20am UTC](https://discuss.elastic.co/t/migrating-the-splunk-visualizations-and-dashboards-to-kibana/219580 "2020-02-17T11:20:17Z")

</div>

Is there any best practice/tool to migrate the Splunk Reports/Visualizations/Dashboards to Kibana? Or the only way is to recreate them in Kibana?

---

## [Kibana folder is empty](https://discuss.elastic.co/t/kibana-folder-is-empty/219501)

<div class="topic-metadata">

**Author:** [@aniketharode](https://discuss.elastic.co/u/aniketharode)\
**Replies:** 2\
**Last updated:** [February 17, 2020, 11:16am UTC](https://discuss.elastic.co/t/kibana-folder-is-empty/219501 "2020-02-17T11:16:30Z")

</div>

I have recently downloaded the kibana zip on windows folder but it is completely empty no files is showing inside the zip

---

## [Why is synced flush failing for this index?](https://discuss.elastic.co/t/why-is-synced-flush-failing-for-this-index/219425)

<div class="topic-metadata">

**Author:** [@mikewillis](https://discuss.elastic.co/u/mikewillis)\
**Replies:** 2\
**Last updated:** [February 17, 2020, 11:03am UTC](https://discuss.elastic.co/t/why-is-synced-flush-failing-for-this-index/219425 "2020-02-17T11:03:26Z")

</div>

Elasticsearch 6.8.6. The index has ten primary shards and replicas is set to 1. Each shards is ~30GB. The index (and cluster) health is Green. No data is being written to the index. A flushed sync consistently fails on a…

---

## [Grok filter not triggered](https://discuss.elastic.co/t/grok-filter-not-triggered/219526)

<div class="topic-metadata">

**Author:** [@pol4bear](https://discuss.elastic.co/u/pol4bear)\
**Replies:** 2\
**Last updated:** [February 17, 2020, 11:03am UTC](https://discuss.elastic.co/t/grok-filter-not-triggered/219526 "2020-02-17T11:03:02Z")

</div>

Hi. I'm trying to transfer data from filebeat and metricbeat. I'm using Elastic Stack 7.6.0 and I saw document on Elastic homepage. Configure below is my logstash.conf but metricbeat works well but filebeat's apache2 and…

---

## [Too many wildcards in the search request causes system to immediately shoot to 100% CPU, HEAP- DOS attack](https://discuss.elastic.co/t/too-many-wildcards-in-the-search-request-causes-system-to-immediately-shoot-to-100-cpu-heap-dos-attack/219508)

<div class="topic-metadata">

**Author:** [@shamzeer](https://discuss.elastic.co/u/shamzeer)\
**Replies:** 1\
**Last updated:** [February 17, 2020, 10:49am UTC](https://discuss.elastic.co/t/too-many-wildcards-in-the-search-request-causes-system-to-immediately-shoot-to-100-cpu-heap-dos-attack/219508 "2020-02-17T10:49:14Z")

</div>

Hi, Greetings!! We recently came across a case where when there are wild card search like " ab bcd xyz" (just an example to indicate that wild cards are present beginning and end or anywhere on multiple words). Similar…

---

## [Logstash Json Input](https://discuss.elastic.co/t/logstash-json-input/219593)

<div class="topic-metadata">

**Author:** [@Ramon\_Mateo](https://discuss.elastic.co/u/Ramon_Mateo)\
**Replies:** 4\
**Last updated:** [February 17, 2020, 10:48am UTC](https://discuss.elastic.co/t/logstash-json-input/219593 "2020-02-17T10:48:19Z")

</div>

Hi. I have a problem with my input and pipeline. i'm new with pipelines and json filter. I don't know how to get logstash filter my json files and send to elasticsearch. This a exemple of my json file: {"tenantID": …

---

## [Suggester completion with short product model names](https://discuss.elastic.co/t/suggester-completion-with-short-product-model-names/219514)

<div class="topic-metadata">

**Author:** [@Martin\_Aronsen](https://discuss.elastic.co/u/Martin_Aronsen)\
**Replies:** 1\
**Last updated:** [February 17, 2020, 10:47am UTC](https://discuss.elastic.co/t/suggester-completion-with-short-product-model-names/219514 "2020-02-17T10:47:35Z")

</div>

Hi, We're building a database with various technological products, and trying to use the completion suggester to build an autocomplete search bar. This is built inside Invision Community, so we're using the same index …

---

## [Will there be any data loss when the disk reached its 90% watermark?](https://discuss.elastic.co/t/will-there-be-any-data-loss-when-the-disk-reached-its-90-watermark/219585)

<div class="topic-metadata">

**Author:** [@irobot678](https://discuss.elastic.co/u/irobot678)\
**Replies:** 1\
**Last updated:** [February 17, 2020, 10:38am UTC](https://discuss.elastic.co/t/will-there-be-any-data-loss-when-the-disk-reached-its-90-watermark/219585 "2020-02-17T10:38:05Z")

</div>

HI, I am using elastic stack of version 7.11 with x- pack installed I using filebeat to ingest the data into the elastic, but my disk is reached to 90% which is the watermark i configured. All i want to know is ? if i…

---

## [How to generate multiple time granular indexes?](https://discuss.elastic.co/t/how-to-generate-multiple-time-granular-indexes/219325)

<div class="topic-metadata">

**Author:** [@ziyang](https://discuss.elastic.co/u/ziyang)\
**Replies:** 3\
**Last updated:** [February 17, 2020, 10:32am UTC](https://discuss.elastic.co/t/how-to-generate-multiple-time-granular-indexes/219325 "2020-02-17T10:32:33Z")

</div>

I want to write monitoring data in ES. At present, there are 4 indicators, each indicator is 5 minutes granularity, every 5 minutes has more than 10,000 data, about 3 million data a day. The requirements are: How shou…

---

## [Kibana 7.5.2 - How to get size on Y axis in metrics dropdown](https://discuss.elastic.co/t/kibana-7-5-2-how-to-get-size-on-y-axis-in-metrics-dropdown/219570)

<div class="topic-metadata">

**Author:** [@svyas1](https://discuss.elastic.co/u/svyas1)\
**Replies:** 1\
**Last updated:** [February 17, 2020, 10:30am UTC](https://discuss.elastic.co/t/kibana-7-5-2-how-to-get-size-on-y-axis-in-metrics-dropdown/219570 "2020-02-17T10:30:33Z")

</div>

Hi Experts, I have Kibana 7.5.2 and have index in elastic search containing data for a process memory and cpu usage. While this data is available in elastic search index , not seeing size as a aggregation option in Y ax…

---

## [Problem using external Ruby script in Logstash](https://discuss.elastic.co/t/problem-using-external-ruby-script-in-logstash/219387)

<div class="topic-metadata">

**Author:** [@LuigiDelavega](https://discuss.elastic.co/u/LuigiDelavega)\
**Replies:** 5\
**Last updated:** [February 17, 2020, 10:23am UTC](https://discuss.elastic.co/t/problem-using-external-ruby-script-in-logstash/219387 "2020-02-17T10:23:53Z")

</div>

Hello guys, I'm having problem trying to get my ruby code filter into an external ruby file called test2.rb When i was using a ruby {} inside my configuration, it was working very well, and i am new to ruby so maybe my…

---

## [Elasticsearch, terms aggs according to sibling nested fields](https://discuss.elastic.co/t/elasticsearch-terms-aggs-according-to-sibling-nested-fields/216174)

<div class="topic-metadata">

**Author:** [@Noctis17](https://discuss.elastic.co/u/Noctis17)\
**Replies:** 4\
**Last updated:** [February 17, 2020, 10:17am UTC](https://discuss.elastic.co/t/elasticsearch-terms-aggs-according-to-sibling-nested-fields/216174 "2020-02-17T10:17:05Z")

</div>

Elasticsearch v7.5 Hello and good day! We have 2 indices named socialmedia and influencers Sample contents: socialmedia : { '\_id' : 1001, 'title' : "Title 1", 'smp\_id' : 1, "latest" : \[ { …

[Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1622)

[Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1624)
