# Latest **URL:** https://discuss.elastic.co/latest.md?page=1334 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1335 --- ## [Logstash S3 input plugin - filter based on time modified](https://discuss.elastic.co/t/logstash-s3-input-plugin-filter-based-on-time-modified/292581)
**Author:** [@kmualem](https://discuss.elastic.co/u/kmualem)\ **Replies:** 9\ **Last updated:** [December 22, 2021, 2:03pm UTC](https://discuss.elastic.co/t/logstash-s3-input-plugin-filter-based-on-time-modified/292581 "2021-12-22T14:03:27Z")
I have a Logstash container that is configured to read objects from S3. The requirement is to filter old objects, let's say objects before 3 months should be dropped. I noticed that I can expose the s3 metadata, so I h… --- ## [How to parse nested json events](https://discuss.elastic.co/t/how-to-parse-nested-json-events/292039)
**Author:** [@Anusha\_Kusanghi](https://discuss.elastic.co/u/Anusha_Kusanghi)\ **Replies:** 3\ **Last updated:** [December 22, 2021, 2:02pm UTC](https://discuss.elastic.co/t/how-to-parse-nested-json-events/292039 "2021-12-22T14:02:10Z")
Hello! I have nested json objects like this : { "\_index": "impe\_logs-2021.11.19-1", "\_type": "\_doc", "\_id": "tyu", "\_version": 1, "\_score": null, "\_source": { "port": 54640, "impe": { "abp": {… --- ## [Count nested elements](https://discuss.elastic.co/t/count-nested-elements/292652)
**Author:** [@mohamed.softparadigm](https://discuss.elastic.co/u/mohamed.softparadigm)\ **Replies:** 1\ **Last updated:** [December 22, 2021, 1:50pm UTC](https://discuss.elastic.co/t/count-nested-elements/292652 "2021-12-22T13:50:34Z")
I want to create a visualization which count the number of orders with orderStatus.code : confirmed. But the problem I faced is that orderStatus is nested field of order. Even with vega I didn't get the solution. Any s… --- ## [Logstash JDBC input metadata is overriding](https://discuss.elastic.co/t/logstash-jdbc-input-metadata-is-overriding/292691)
**Author:** [@Vinayak\_G](https://discuss.elastic.co/u/Vinayak_G)\ **Replies:** 0\ **Last updated:** [December 22, 2021, 1:47pm UTC](https://discuss.elastic.co/t/logstash-jdbc-input-metadata-is-overriding/292691 "2021-12-22T13:47:41Z")
Hey Everybody I am new to ELK I was running logstash 6.8.3 on my machine, I wanted to upgrade to 6.8.21, so I created a new machine and installed logstash 6.8.21, then I pushed my pipeline's and metadata files so that … --- ## [Search.max\_buckets limit error on 7.6.0 even after setting to 10000](https://discuss.elastic.co/t/search-max-buckets-limit-error-on-7-6-0-even-after-setting-to-10000/292688)
**Author:** [@Nipun\_Tulsyan](https://discuss.elastic.co/u/Nipun_Tulsyan)\ **Replies:** 0\ **Last updated:** [December 22, 2021, 1:36pm UTC](https://discuss.elastic.co/t/search-max-buckets-limit-error-on-7-6-0-even-after-setting-to-10000/292688 "2021-12-22T13:36:19Z")
I am using a simple query with aggregation. GET testIndex/\_search { "size": 0, "aggs": { "Name1": { "terms": { "field": "field1.keyword", "size": 10000 } }, "Name2":{ "… --- ## [Using short URL human-readable slugs](https://discuss.elastic.co/t/using-short-url-human-readable-slugs/292649)
**Author:** [@tomhe](https://discuss.elastic.co/u/tomhe)\ **Replies:** 1\ **Last updated:** [December 22, 2021, 1:26pm UTC](https://discuss.elastic.co/t/using-short-url-human-readable-slugs/292649 "2021-12-22T13:26:19Z")
For regular short URLs I can browse to /goto/\ to have Kibana expand the short URL for me, but I can't find any information on how to use the human-readable slugs that the new API can generate, e.g. witty-de… --- ## [European number format not recognised](https://discuss.elastic.co/t/european-number-format-not-recognised/292606)
**Author:** [@mpmass](https://discuss.elastic.co/u/mpmass)\ **Replies:** 3\ **Last updated:** [December 22, 2021, 1:12pm UTC](https://discuss.elastic.co/t/european-number-format-not-recognised/292606 "2021-12-22T13:12:32Z")
Hi, I have just started exploring Elastic and Kibana. When I am trying to upload a .csv file, the type and format isn't recognised properly. It is seen as a string instead of a double. The format of the number of the fi… --- ## [ERROR logstash.inputs.jdbc](https://discuss.elastic.co/t/error-logstash-inputs-jdbc/292610)
**Author:** [@Gabriel\_Munoz](https://discuss.elastic.co/u/Gabriel_Munoz)\ **Replies:** 1\ **Last updated:** [December 22, 2021, 12:21pm UTC](https://discuss.elastic.co/t/error-logstash-inputs-jdbc/292610 "2021-12-22T12:21:58Z")
El controlador no pudo establecer una conexión segura con SQL Server con el cifrado de Capa de sockets seguros (SSL). Error: "No appropriate protocol (protocol is disabled or cipher suites are inappropriate) \[2021-12-21… --- ## [При прохождении beats pipeline теряется часть полей](https://discuss.elastic.co/t/beats-pipeline/292676)
**Author:** [@roonick](https://discuss.elastic.co/u/roonick)\ **Replies:** 0\ **Last updated:** [December 22, 2021, 12:09pm UTC](https://discuss.elastic.co/t/beats-pipeline/292676 "2021-12-22T12:09:46Z")
Здравствуйте! Я только осваиваю ELK стэк. Была поставлена задача создать дополнительное поле в документах, получаемых из модуля filebeat nginx, обрезав ip адрес до первых трёх октетов. Для этого направил документы в от… --- ## [Aggregation issue after upgrading elastic 7.16.2](https://discuss.elastic.co/t/aggregation-issue-after-upgrading-elastic-7-16-2/292645)
**Author:** [@lalchand\_rajak](https://discuss.elastic.co/u/lalchand_rajak)\ **Replies:** 2\ **Last updated:** [December 22, 2021, 11:26am UTC](https://discuss.elastic.co/t/aggregation-issue-after-upgrading-elastic-7-16-2/292645 "2021-12-22T11:26:34Z")
unable to do the aggregation in Kibana for entire time range after the upgrading to new version i.e 7.16.2 . but when i am changing to last value it's working. --- ## [Filters in Visualization](https://discuss.elastic.co/t/filters-in-visualization/292630)
**Author:** [@tharunkumar](https://discuss.elastic.co/u/tharunkumar)\ **Replies:** 1\ **Last updated:** [December 22, 2021, 11:14am UTC](https://discuss.elastic.co/t/filters-in-visualization/292630 "2021-12-22T11:14:21Z")
Hi I am new to kibana dashboard working on a small task where i am getting logs data from logstash to kibana dashboard for understanding the logs .here in kibana dashboard were we can create our own visualization with e… --- ## [Logstash S3 output plugin, how do we get logging?](https://discuss.elastic.co/t/logstash-s3-output-plugin-how-do-we-get-logging/292615)
**Author:** [@Colin\_K](https://discuss.elastic.co/u/Colin_K)\ **Replies:** 6\ **Last updated:** [December 22, 2021, 11:07am UTC](https://discuss.elastic.co/t/logstash-s3-output-plugin-how-do-we-get-logging/292615 "2021-12-22T11:07:16Z")
When I use the file output plugin I see INFO log lines that we are opening and closing a file to write to. But when using the s3 output plugin I get writes but no logging. log4j2.properties status = debug name = Logst… --- ## [Mapping conflict but no way to resolve anymore](https://discuss.elastic.co/t/mapping-conflict-but-no-way-to-resolve-anymore/292617)
**Author:** [@seanziee](https://discuss.elastic.co/u/seanziee)\ **Replies:** 1\ **Last updated:** [December 22, 2021, 10:56am UTC](https://discuss.elastic.co/t/mapping-conflict-but-no-way-to-resolve-anymore/292617 "2021-12-22T10:56:01Z")
In the past, you could click on the conflict field and see which indices are causing the conflict but for some reason you have removed that functionality. Is there some way to see which index is causing the conflict? --- ## [Problem with configuring https x-pack](https://discuss.elastic.co/t/problem-with-configuring-https-x-pack/292509)
**Author:** [@awbait](https://discuss.elastic.co/u/awbait)\ **Replies:** 1\ **Last updated:** [December 22, 2021, 10:50am UTC](https://discuss.elastic.co/t/problem-with-configuring-https-x-pack/292509 "2021-12-22T10:50:13Z")
Hello everyone. I'm trying to set up security. So that users can log in through kibana using their username / password. Faced a x-pack config issue. My file values.yaml: replicas: 2 resources: requests: c… --- ## [Waiting for elected master node in Rolling upgrade](https://discuss.elastic.co/t/waiting-for-elected-master-node-in-rolling-upgrade/292576)
**Author:** [@maadhav](https://discuss.elastic.co/u/maadhav)\ **Replies:** 4\ **Last updated:** [December 22, 2021, 10:45am UTC](https://discuss.elastic.co/t/waiting-for-elected-master-node-in-rolling-upgrade/292576 "2021-12-22T10:45:38Z")
Hi Team We upgraded Elasticsearch cluster from version 7.13.3 to version 7.16.1 using Rolling upgrade. We upgraded each node one by one, considering non-master nodes first and master nodes in last. The cluster got upgr… --- ## [Log4j Vulnerability: JVM Options not picked from location mentioned in %ES\_PATH\_CONF%](https://discuss.elastic.co/t/log4j-vulnerability-jvm-options-not-picked-from-location-mentioned-in-es-path-conf/292516)
**Author:** [@nikhilagrawaldotnet](https://discuss.elastic.co/u/nikhilagrawaldotnet)\ **Replies:** 3\ **Last updated:** [December 22, 2021, 9:52am UTC](https://discuss.elastic.co/t/log4j-vulnerability-jvm-options-not-picked-from-location-mentioned-in-es-path-conf/292516 "2021-12-22T09:52:47Z")
Does anyone know why setting option -Dlog4j2.formatMsgNoLookups=true in jvm.options file does not work? Elasticsearch version (bin/elasticsearch --version): 7.5.1 Plugins installed: None JVM version (java -version): … --- ## [Linear increase cpu/memory utilization on auditbeat 7.15.0 or later](https://discuss.elastic.co/t/linear-increase-cpu-memory-utilization-on-auditbeat-7-15-0-or-later/292653)
**Author:** [@samuel.john](https://discuss.elastic.co/u/samuel.john)\ **Replies:** 0\ **Last updated:** [December 22, 2021, 8:40am UTC](https://discuss.elastic.co/t/linear-increase-cpu-memory-utilization-on-auditbeat-7-15-0-or-later/292653 "2021-12-22T08:40:00Z")
Hello, I've got running many auditbeat on linux. Recently, I've upgrade from auditbeat version 7.5.x to 7.15.2 But unexpected some server error occurred in this version. When "auditd" error continues to occur, the CP… --- ## [No shard is getting assigned on one of the data node](https://discuss.elastic.co/t/no-shard-is-getting-assigned-on-one-of-the-data-node/292575)
**Author:** [@pratiksha](https://discuss.elastic.co/u/pratiksha)\ **Replies:** 7\ **Last updated:** [December 22, 2021, 8:24am UTC](https://discuss.elastic.co/t/no-shard-is-getting-assigned-on-one-of-the-data-node/292575 "2021-12-22T08:24:17Z")
I have a cluster running with 10 data, 3 master and 3 client nodes. I am facing issue on one of data node where no shard is able to get assign on it. \_cluster/allocation/explain is giving below message: { "node\_i… --- ## [Elasticsearch clusterstate data](https://discuss.elastic.co/t/elasticsearch-clusterstate-data/292392)
**Author:** [@qixian](https://discuss.elastic.co/u/qixian)\ **Replies:** 11\ **Last updated:** [December 22, 2021, 8:22am UTC](https://discuss.elastic.co/t/elasticsearch-clusterstate-data/292392 "2021-12-22T08:22:03Z")
hello,I have a question need to have a answer，which is if my master es nodes have multi datapaths,the clusterstate data will be saved Multiple and which is Exactly the same --- ## [Elasticsearch log4j 2.17.0 replace](https://discuss.elastic.co/t/elasticsearch-log4j-2-17-0-replace/292644)
**Author:** [@qixian](https://discuss.elastic.co/u/qixian)\ **Replies:** 2\ **Last updated:** [December 22, 2021, 7:00am UTC](https://discuss.elastic.co/t/elasticsearch-log4j-2-17-0-replace/292644 "2021-12-22T07:00:07Z")
hello，I want to know whether all the Elasticsearch release version has been installed could replace the log4j 2.17.0 then rolling restart --- ## [How to process csv data from multiple folders using file beat and create separate index and move it to elastic search](https://discuss.elastic.co/t/how-to-process-csv-data-from-multiple-folders-using-file-beat-and-create-separate-index-and-move-it-to-elastic-search/292641)
**Author:** [@data123](https://discuss.elastic.co/u/data123)\ **Replies:** 1\ **Last updated:** [December 22, 2021, 6:52am UTC](https://discuss.elastic.co/t/how-to-process-csv-data-from-multiple-folders-using-file-beat-and-create-separate-index-and-move-it-to-elastic-search/292641 "2021-12-22T06:52:49Z")
Hi Team, Our requirement is like this... we have log files stored in different folders under master folder as csv format. we want to send this to Elasticsearch using file beats as a part of automation. we cant find s… --- ## [Urgent - Incomplete fix for Apache Log4j vulnerability v2.15.0](https://discuss.elastic.co/t/urgent-incomplete-fix-for-apache-log4j-vulnerability-v2-15-0/291893)
**Author:** [@ppafford](https://discuss.elastic.co/u/ppafford)\ **Replies:** 2\ **Last updated:** [December 22, 2021, 4:58am UTC](https://discuss.elastic.co/t/urgent-incomplete-fix-for-apache-log4j-vulnerability-v2-15-0/291893 "2021-12-22T04:58:48Z")
Looks like there is another issue and another fix And the release of Logstash 7.16.1 Release Notes | Logstash Reference \[7.16\] | Elastic has the incomplete fix. When can this be addressed? --- ## [How to make a plugin for elasticsearch 5.6.16?](https://discuss.elastic.co/t/how-to-make-a-plugin-for-elasticsearch-5-6-16/292561)
**Author:** [@dishant](https://discuss.elastic.co/u/dishant)\ **Replies:** 2\ **Last updated:** [December 22, 2021, 4:44am UTC](https://discuss.elastic.co/t/how-to-make-a-plugin-for-elasticsearch-5-6-16/292561 "2021-12-22T04:44:15Z")
I tried a lot finding about it on the internet but not getting anything that works. I have been able to build a plugin for Elasticsearch 7.11.1 and used gradle 6.8.2 for that. But not able to make the same for Elasticsea… --- ## [Displaying the application log data in Kibana - Log file content field is missing in Elasticsearch](https://discuss.elastic.co/t/displaying-the-application-log-data-in-kibana-log-file-content-field-is-missing-in-elasticsearch/292448)
**Author:** [@online](https://discuss.elastic.co/u/online)\ **Replies:** 1\ **Last updated:** [December 22, 2021, 2:58am UTC](https://discuss.elastic.co/t/displaying-the-application-log-data-in-kibana-log-file-content-field-is-missing-in-elasticsearch/292448 "2021-12-22T02:58:50Z")
Hello Friends, I am trying to setup an Elasticsearch index to display log contents from an application using Kibana. I setup the Filebeat on my application server and it created an index with 25 fields in Elasticsearch.… --- ## [Metricbeat sql module with dynamic database values](https://discuss.elastic.co/t/metricbeat-sql-module-with-dynamic-database-values/292623)
**Author:** [@nsharath](https://discuss.elastic.co/u/nsharath)\ **Replies:** 0\ **Last updated:** [December 22, 2021, 12:29am UTC](https://discuss.elastic.co/t/metricbeat-sql-module-with-dynamic-database-values/292623 "2021-12-22T00:29:32Z")
I am using metricbeat 7.15 version with sql module enabled. I have a huge list of databases and currently my sql module config size is very big. I would like to know how to send the database name (e.g. database1, databa… --- ## [Filter a field](https://discuss.elastic.co/t/filter-a-field/292549)
**Author:** [@scar](https://discuss.elastic.co/u/scar)\ **Replies:** 1\ **Last updated:** [December 21, 2021, 11:59pm UTC](https://discuss.elastic.co/t/filter-a-field/292549 "2021-12-21T23:59:17Z")
I want to filter a field, for example filter an array field by only returning the values I want. i try it using the source filter but don't do what i expected --- ## [ElasticSearch: search\_after with refresh](https://discuss.elastic.co/t/elasticsearch-search-after-with-refresh/292608)
**Author:** [@sag-tobias-frey](https://discuss.elastic.co/u/sag-tobias-frey)\ **Replies:** 1\ **Last updated:** [December 21, 2021, 9:18pm UTC](https://discuss.elastic.co/t/elasticsearch-search-after-with-refresh/292608 "2021-12-21T21:18:17Z")
Hello, I have searched for quite some time but did not find an answer yet. I'm currently looking into doing some pagination over my data. I have stumbled across the search\_after functionality. The queries work quite nic… --- ## [Multi-level graphs with Kibana](https://discuss.elastic.co/t/multi-level-graphs-with-kibana/292599)
**Author:** [@muneebishfaq](https://discuss.elastic.co/u/muneebishfaq)\ **Replies:** 1\ **Last updated:** [December 21, 2021, 9:14pm UTC](https://discuss.elastic.co/t/multi-level-graphs-with-kibana/292599 "2021-12-21T21:14:39Z")
Hello, I was just wondering if Kibana has the ability to create graphs with multiple levels? I want to visualize the data using graphs in a way where I would have as nodes (vertices) the different branches of a company. … --- ## [Unable to migrate from 7.6.1](https://discuss.elastic.co/t/unable-to-migrate-from-7-6-1/292605)
**Author:** [@rhawleyswiss](https://discuss.elastic.co/u/rhawleyswiss)\ **Replies:** 1\ **Last updated:** [December 21, 2021, 9:13pm UTC](https://discuss.elastic.co/t/unable-to-migrate-from-7-6-1/292605 "2021-12-21T21:13:31Z")
How can I find a dashboard by uuid? is there a way? I'm trying to upgrade our stack but getting: \< /\> Trying to open the dashboard via URL displays an empty frame with no controls, all just blank --- ## [Elasticsearch get all unique Ids](https://discuss.elastic.co/t/elasticsearch-get-all-unique-ids/292589)
**Author:** [@iamtheschmitzer](https://discuss.elastic.co/u/iamtheschmitzer)\ **Replies:** 5\ **Last updated:** [December 21, 2021, 9:08pm UTC](https://discuss.elastic.co/t/elasticsearch-get-all-unique-ids/292589 "2021-12-21T21:08:12Z")
Thanks to all who read this for your help. Background: I have a job that when executing inserts a document. The job can fail and run again, inserting a second document. Both have the same linkId- so I know there is o… [Previous page](https://discuss.elastic.co/latest.md?page=1333) [Next page](https://discuss.elastic.co/latest.md?page=1335)