# \#none **URL:** https://discuss.elastic.co/tag/none.md?no_tags=true&page=1955 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1956 --- ## [Best approach to split arrays of objects?](https://discuss.elastic.co/t/best-approach-to-split-arrays-of-objects/195567)
**Author:** [@daniel\_a](https://discuss.elastic.co/u/daniel_a)\ **Replies:** 0\ **Last updated:** [August 16, 2019, 9:47pm UTC](https://discuss.elastic.co/t/best-approach-to-split-arrays-of-objects/195567 "2019-08-16T21:47:13Z")
I've been trying to ingest audit logs from Google Cloud, but the logs contain several arrays of objects. What would be the best way to split the arrays? Let's say if there are 10-20 different arrays, not in a single log … --- ## [Time Series Index](https://discuss.elastic.co/t/time-series-index/195541)
**Author:** [@mhare](https://discuss.elastic.co/u/mhare)\ **Replies:** 6\ **Last updated:** [August 16, 2019, 9:03pm UTC](https://discuss.elastic.co/t/time-series-index/195541 "2019-08-16T21:03:41Z")
Using ELK 7.3 on Ubuntu 18.04 I am gathering memory and cpu data every 5 min from several devices under test, looking for memory leaks in the firmware. This is written to disk as a csv file. Since my visualizers are al… --- ## [Logstash - csv parsing failure](https://discuss.elastic.co/t/logstash-csv-parsing-failure/195415)
**Author:** [@cheriemilk](https://discuss.elastic.co/u/cheriemilk)\ **Replies:** 2\ **Last updated:** [August 16, 2019, 8:52pm UTC](https://discuss.elastic.co/t/logstash-csv-parsing-failure/195415 "2019-08-16T20:52:22Z")
Hi Team, I have below data in a csv file which has two columns only. As you see, the content in msg columns actually are a few of key-vlaue pairs, and I want logstash to parse these key-value pairs as well. indent pre… --- ## [How to connect to an API using Logstash?](https://discuss.elastic.co/t/how-to-connect-to-an-api-using-logstash/192123)
**Author:** [@EZprogramming](https://discuss.elastic.co/u/EZprogramming)\ **Replies:** 8\ **Last updated:** [August 14, 2019, 11:21pm UTC](https://discuss.elastic.co/t/how-to-connect-to-an-api-using-logstash/192123 "2019-08-14T23:21:08Z")
I have an API library written in Python, and I also have data that comes from AWS Athena through queries. Is there any way to merge these two data sources together using only Logstash? If not what are other suggestions? … --- ## [Kibana login page (Access control)](https://discuss.elastic.co/t/kibana-login-page-access-control/190248)
**Author:** [@Rozita\_Mirmotalebi\_U](https://discuss.elastic.co/u/Rozita_Mirmotalebi_U)\ **Replies:** 17\ **Last updated:** [August 16, 2019, 8:32pm UTC](https://discuss.elastic.co/t/kibana-login-page-access-control/190248 "2019-08-16T20:32:10Z")
Hello there, I have Elasticsearch (Version 1.30.0) and Kibana (Version 3.2.3) on Rancher. I am trying to enable the login page for security purposes. I have added the x-pack configs in Kibana. Also I tied enabling (pack… --- ## [How can I send syslogs to ELK Cloud with rsyslog?](https://discuss.elastic.co/t/how-can-i-send-syslogs-to-elk-cloud-with-rsyslog/195509)
**Author:** [@debjit](https://discuss.elastic.co/u/debjit)\ **Replies:** 4\ **Last updated:** [August 16, 2019, 7:59pm UTC](https://discuss.elastic.co/t/how-can-i-send-syslogs-to-elk-cloud-with-rsyslog/195509 "2019-08-16T19:59:34Z")
How can I send syslogs to ELK Cloud with rsyslog without using filebeat ? I am evaluating ELK at the moment and using Elastic Cloud trial. I can see there are Pipelines for Logstash ? What is the endpoint for Logstash on… --- ## [Which ways to copy subfields of kubernetes.container.\_module.labels.\* to kubernetes.lables.\*?](https://discuss.elastic.co/t/which-ways-to-copy-subfields-of-kubernetes-container-module-labels-to-kubernetes-lables/195546)
**Author:** [@asp](https://discuss.elastic.co/u/asp)\ **Replies:** 4\ **Last updated:** [August 16, 2019, 7:46pm UTC](https://discuss.elastic.co/t/which-ways-to-copy-subfields-of-kubernetes-container-module-labels-to-kubernetes-lables/195546 "2019-08-16T19:46:22Z")
Hi, to simplify filtering I want to copy all substructure of kubernetes.container.\_module.labels.\* to kubernetes.lables.\*. Just moving a copy levels up. The structure below .labels is dynamic, so I cannot hardcode the … --- ## [Kibana runs perfectly if started from terminal, refuses connections if started via Runtime.getRuntime().exec()](https://discuss.elastic.co/t/kibana-runs-perfectly-if-started-from-terminal-refuses-connections-if-started-via-runtime-getruntime-exec/195024)
**Author:** [@mathwin](https://discuss.elastic.co/u/mathwin)\ **Replies:** 10\ **Last updated:** [August 16, 2019, 7:13pm UTC](https://discuss.elastic.co/t/kibana-runs-perfectly-if-started-from-terminal-refuses-connections-if-started-via-runtime-getruntime-exec/195024 "2019-08-16T19:13:41Z")
I'm writing a java application that injects data into Elastic and displays Kibana in an embedded browser window. During initialization, it attempts to start the services for both. The init code for that looks like this… --- ## [Logstash data transit time and possible line loss before elasticsearch](https://discuss.elastic.co/t/logstash-data-transit-time-and-possible-line-loss-before-elasticsearch/195451)
**Author:** [@Igorr](https://discuss.elastic.co/u/Igorr)\ **Replies:** 1\ **Last updated:** [August 16, 2019, 6:34pm UTC](https://discuss.elastic.co/t/logstash-data-transit-time-and-possible-line-loss-before-elasticsearch/195451 "2019-08-16T18:34:49Z")
Data on time leaves logstash (tracked by tcpdump) and is delayed in kibana. What monitoring tools are best used to track at what stage data is delayed? There are no errors in logstash logs. To check for possible loss o… --- ## [Время прохождения данных через logstash и возможные потери строк до elasticsearch](https://discuss.elastic.co/t/logstash-elasticsearch/195447)
**Author:** [@Igorr](https://discuss.elastic.co/u/Igorr)\ **Replies:** 4\ **Last updated:** [August 16, 2019, 6:32pm UTC](https://discuss.elastic.co/t/logstash-elasticsearch/195447 "2019-08-16T18:32:45Z")
Собственно вопрос, как можно отследить данные от попадания в поле input logstash до их индексации elasicsearch. Есть подозрение, что теряются некоторые строки из sql-запросов. Также большие объемы данных не сразу стано… --- ## [Help wtih KV Plugin](https://discuss.elastic.co/t/help-wtih-kv-plugin/195265)
**Author:** [@uklipse](https://discuss.elastic.co/u/uklipse)\ **Replies:** 6\ **Last updated:** [August 16, 2019, 6:19pm UTC](https://discuss.elastic.co/t/help-wtih-kv-plugin/195265 "2019-08-16T18:19:18Z")
I have a cef log being sent to us but I can't get the kv plugin to work. When I apply this config, I don't get any errors but I don't see any logs from it so it's breaking it somehow. Below is the config I'm giving it an… --- ## [ECE Upgrade Step](https://discuss.elastic.co/t/ece-upgrade-step/195539)
**Author:** [@Ryan\_Downey](https://discuss.elastic.co/u/Ryan_Downey)\ **Replies:** 2\ **Last updated:** [August 16, 2019, 6:14pm UTC](https://discuss.elastic.co/t/ece-upgrade-step/195539 "2019-08-16T18:14:27Z")
ECE 2.2.2 - RPM I've read through the documentation on upgrading ECE but have a few questions. Docs: https://www.elastic.co/guide/en/cloud-enterprise/current/ece-upgrade.html Looking to upgrade from 2.2.2 to 2.3 due t… --- ## [Has 7.3.0 Been Removed?](https://discuss.elastic.co/t/has-7-3-0-been-removed/195502)
**Author:** [@SteveP](https://discuss.elastic.co/u/SteveP)\ **Replies:** 3\ **Last updated:** [August 16, 2019, 6:08pm UTC](https://discuss.elastic.co/t/has-7-3-0-been-removed/195502 "2019-08-16T18:08:57Z")
I no longer can download any of the 7.3.0 components. Should we go back to 7.2.1? --- ## [Need help with basic data table](https://discuss.elastic.co/t/need-help-with-basic-data-table/195538)
**Author:** [@vNoob](https://discuss.elastic.co/u/vNoob)\ **Replies:** 1\ **Last updated:** [August 16, 2019, 5:38pm UTC](https://discuss.elastic.co/t/need-help-with-basic-data-table/195538 "2019-08-16T17:38:52Z")
I am Super new to ELK and I am trying to create a basic data table visualization just to list some performance metrics. My json looks like this... { "MyServer": { "cpu.average": { "2019-05-29 18:00:00+00:00": 193… --- ## [How do I configure logstash for an Ubuntu service?](https://discuss.elastic.co/t/how-do-i-configure-logstash-for-an-ubuntu-service/195518)
**Author:** [@mhare](https://discuss.elastic.co/u/mhare)\ **Replies:** 5\ **Last updated:** [August 16, 2019, 5:34pm UTC](https://discuss.elastic.co/t/how-do-i-configure-logstash-for-an-ubuntu-service/195518 "2019-08-16T17:34:05Z")
Specifically, when I was running logstash as a process I ran it like: bin/logstash -f logstash-simple.conf But I have stopped that madness and want to run it as a service I have the service installed from the debian p… --- ## [What permissions are required for ILM?](https://discuss.elastic.co/t/what-permissions-are-required-for-ilm/194514)
**Author:** [@jbrowe](https://discuss.elastic.co/u/jbrowe)\ **Replies:** 1\ **Last updated:** [August 16, 2019, 5:33pm UTC](https://discuss.elastic.co/t/what-permissions-are-required-for-ilm/194514 "2019-08-16T17:33:49Z")
I am migrating my indices to be managed by ILM. For this, I need to modify my Logstash pipeline outputs. Here's what I'm using now: output { elasticsearch { hosts =\> \["192.168.10.80:9200","192.168.10.81:9200","192… --- ## [Index Life Cycle Policy Not Working on all Indexes](https://discuss.elastic.co/t/index-life-cycle-policy-not-working-on-all-indexes/194394)
**Author:** [@premkumar](https://discuss.elastic.co/u/premkumar)\ **Replies:** 1\ **Last updated:** [August 16, 2019, 5:20pm UTC](https://discuss.elastic.co/t/index-life-cycle-policy-not-working-on-all-indexes/194394 "2019-08-16T17:20:04Z")
Hi Team, I have the following ilm policy setup via logstash output filter. output { if \[path\] == "/media/sf\_ELK/ATG01log.txt" { elasticsearch { hosts =\> \["localhost:9200"\] index =\> "atg" ilm\_rollover\_alias =\> "atg… --- ## [Indice rollower](https://discuss.elastic.co/t/indice-rollower/194448)
**Author:** [@aniaks](https://discuss.elastic.co/u/aniaks)\ **Replies:** 1\ **Last updated:** [August 16, 2019, 5:16pm UTC](https://discuss.elastic.co/t/indice-rollower/194448 "2019-08-16T17:16:52Z")
during the rollover - we notice the document count is already in the old index and when updating during that second the document count gets to the newly created indice as well. is there any way to prevent the duplication… --- ## [I want to add new field and replace the one of the existing field value to the newly added field](https://discuss.elastic.co/t/i-want-to-add-new-field-and-replace-the-one-of-the-existing-field-value-to-the-newly-added-field/195303)
**Author:** [@satyam2593](https://discuss.elastic.co/u/satyam2593)\ **Replies:** 0\ **Last updated:** [August 15, 2019, 6:31am UTC](https://discuss.elastic.co/t/i-want-to-add-new-field-and-replace-the-one-of-the-existing-field-value-to-the-newly-added-field/195303 "2019-08-15T06:31:39Z")
The below is the input for the config file.. Here i want to grep the date from the one of the line and store into a field(called logdate).. Later i want to create the new field(called log\_timestamp) with null value and … --- ## [Change Source for Dashboard? Or VIsualization](https://discuss.elastic.co/t/change-source-for-dashboard-or-visualization/195425)
**Author:** [@Joao\_Correia](https://discuss.elastic.co/u/Joao_Correia)\ **Replies:** 1\ **Last updated:** [August 16, 2019, 4:42pm UTC](https://discuss.elastic.co/t/change-source-for-dashboard-or-visualization/195425 "2019-08-16T16:42:09Z")
Hi fellow ELKs, I've built several visualizations and then applied a filter to the dashboard. But not that I'm sure these are the filters I want to use I would like to make them permanent for this dashboard. Is it poss… --- ## [Parsing log message optional fields](https://discuss.elastic.co/t/parsing-log-message-optional-fields/195516)
**Author:** [@mahmoud\_shiri\_varami](https://discuss.elastic.co/u/mahmoud_shiri_varami)\ **Replies:** 3\ **Last updated:** [August 16, 2019, 4:27pm UTC](https://discuss.elastic.co/t/parsing-log-message-optional-fields/195516 "2019-08-16T16:27:38Z")
I'm supporting an application that generates log messages that contain 65 fields. More than 40 fields are optional that means sometimes according to application logic, optional fields exits on log message and sometimes n… --- ## [Logstash "idle" CPU is 100%](https://discuss.elastic.co/t/logstash-idle-cpu-is-100/195517)
**Author:** [@rugenl](https://discuss.elastic.co/u/rugenl)\ **Replies:** 2\ **Last updated:** [August 16, 2019, 3:46pm UTC](https://discuss.elastic.co/t/logstash-idle-cpu-is-100/195517 "2019-08-16T15:46:43Z")
I've found several similar posts about logstash using "100%" CPU but none seem to be answered unless it was caused by a bad config. I think our several logstash systems are functioning correctly, but all use at least al… --- ## [Get all distincts values of a field ( more than 10k values)](https://discuss.elastic.co/t/get-all-distincts-values-of-a-field-more-than-10k-values/195101)
**Author:** [@humartinez](https://discuss.elastic.co/u/humartinez)\ **Replies:** 3\ **Last updated:** [August 16, 2019, 3:04pm UTC](https://discuss.elastic.co/t/get-all-distincts-values-of-a-field-more-than-10k-values/195101 "2019-08-16T15:04:06Z")
Hi there, Perhaps this question was asked many times but I haven't seen an answer that fits me. Im looking for the best way to get all the distincts values of a field in a group of indices and I manage to create a scrip… --- ## [How to access Records from Elasticsearch using python dynamically](https://discuss.elastic.co/t/how-to-access-records-from-elasticsearch-using-python-dynamically/192248)
**Author:** [@rameshkr1994](https://discuss.elastic.co/u/rameshkr1994)\ **Replies:** 4\ **Last updated:** [August 16, 2019, 3:00pm UTC](https://discuss.elastic.co/t/how-to-access-records-from-elasticsearch-using-python-dynamically/192248 "2019-08-16T15:00:53Z")
Dear all. i have below in python but that one static value passed. but need access the same code from services in dynamic way. Import Elasticsearch package from elasticsearch import Elasticsearch Connect to the elast… --- ## [Help to handle the nested JSON array](https://discuss.elastic.co/t/help-to-handle-the-nested-json-array/195469)
**Author:** [@Robin\_Guo](https://discuss.elastic.co/u/Robin_Guo)\ **Replies:** 3\ **Last updated:** [August 16, 2019, 2:54pm UTC](https://discuss.elastic.co/t/help-to-handle-the-nested-json-array/195469 "2019-08-16T14:54:57Z")
Dear Elastic folks, We have a complex JSON data with multiple nested JSON arrays need to send to elastic search, Basically, we want to split the JSON array. In short, we want to split a single big event with multiple… --- ## [How to enable kibana for Keep-alive to speed up bulk delete (saved objects requests)](https://discuss.elastic.co/t/how-to-enable-kibana-for-keep-alive-to-speed-up-bulk-delete-saved-objects-requests/195223)
**Author:** [@jasswaraich](https://discuss.elastic.co/u/jasswaraich)\ **Replies:** 1\ **Last updated:** [August 16, 2019, 2:46pm UTC](https://discuss.elastic.co/t/how-to-enable-kibana-for-keep-alive-to-speed-up-bulk-delete-saved-objects-requests/195223 "2019-08-16T14:46:13Z")
I am using Kibana (v 6.7) Delete saved objects api to do batch deletion of multiple types (i.e. visualizations,dashboards, index-patterns). I am using python requests library which uses urllib3. It's taking around 1 se… --- ## [Vis Editor "play" button](https://discuss.elastic.co/t/vis-editor-play-button/195238)
**Author:** [@Carlos0](https://discuss.elastic.co/u/Carlos0)\ **Replies:** 1\ **Last updated:** [August 16, 2019, 2:38pm UTC](https://discuss.elastic.co/t/vis-editor-play-button/195238 "2019-08-16T14:38:16Z")
Hello, I've been trying, without much luck, to create a visualization plugin in the latest version (7.3) in React. My question is, how can I control the visualization "play" button, how can I control when it can be cli… --- ## [\[Share\] On mapper \[geoip. location\] of different type, current\_type \[geo\_point\], merged\_type \[ObjectMapper\]the problem of processing](https://discuss.elastic.co/t/share-on-mapper-geoip-location-of-different-type-current-type-geo-point-merged-type-objectmapper-the-problem-of-processing/195512)
**Author:** [@xudahuo](https://discuss.elastic.co/u/xudahuo)\ **Replies:** 0\ **Last updated:** [August 16, 2019, 2:27pm UTC](https://discuss.elastic.co/t/share-on-mapper-geoip-location-of-different-type-current-type-geo-point-merged-type-objectmapper-the-problem-of-processing/195512 "2019-08-16T14:27:55Z")
Today, I use the geop module of logstash\_7.3 to write geographic information to elasticsearch, but I have been unable to write data. The logstash output: mapper \[geoip.location\] of different type, current\_type \[Preform… --- ## [How to import newly added record from sql server to elasticsearch](https://discuss.elastic.co/t/how-to-import-newly-added-record-from-sql-server-to-elasticsearch/195508)
**Author:** [@rameshkr1994](https://discuss.elastic.co/u/rameshkr1994)\ **Replies:** 0\ **Last updated:** [August 16, 2019, 2:02pm UTC](https://discuss.elastic.co/t/how-to-import-newly-added-record-from-sql-server-to-elasticsearch/195508 "2019-08-16T14:02:59Z")
Dear All. Hope doing well. need some help from your side:- Case:-1 i have three different table in sql\_server side and i am using join here based on single column that column is matching with all table records. ca… --- ## [Logstash Filtering client hostname](https://discuss.elastic.co/t/logstash-filtering-client-hostname/195507)
**Author:** [@candre.dabney](https://discuss.elastic.co/u/candre.dabney)\ **Replies:** 0\ **Last updated:** [August 16, 2019, 1:58pm UTC](https://discuss.elastic.co/t/logstash-filtering-client-hostname/195507 "2019-08-16T13:58:54Z")
We have our environment, which is operating off of Centos 7, set up so that client machines forward their syslog data to our elk server. We'd like to know how we can edit the /etc/logstash/conf.d/10-syslog-filter.conf t… [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1954) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1956)