# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1286 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1287 --- ## [CEPH Storage For Elasticsearch](https://discuss.elastic.co/t/ceph-storage-for-elasticsearch/280775)
**Author:** [@Ankita\_Pachauri](https://discuss.elastic.co/u/Ankita_Pachauri)\ **Replies:** 4\ **Last updated:** [August 11, 2021, 11:59am UTC](https://discuss.elastic.co/t/ceph-storage-for-elasticsearch/280775 "2021-08-11T11:59:09Z")
We are planning to create an Elasticsearch cluster over Kubernetes, and for this CEPH distributed file system would be used as Storage, I understand that elastic recommends using local storage, however are there any know… --- ## [How to Map dynamic columns of a class in Elastic](https://discuss.elastic.co/t/how-to-map-dynamic-columns-of-a-class-in-elastic/281042)
**Author:** [@SUSANTA\_PRADHAN](https://discuss.elastic.co/u/SUSANTA_PRADHAN)\ **Replies:** 0\ **Last updated:** [August 11, 2021, 11:02am UTC](https://discuss.elastic.co/t/how-to-map-dynamic-columns-of-a-class-in-elastic/281042 "2021-08-11T11:02:11Z")
I have a class say Employee having two columns like Key and Value. I get response from one api response like (the response has key value pairs like key1: value1 and the response is dynamic in nature) { "notes":\[ "title… --- ## [Parsing query part from Apache log](https://discuss.elastic.co/t/parsing-query-part-from-apache-log/281048)
**Author:** [@Greg\_R](https://discuss.elastic.co/u/Greg_R)\ **Replies:** 0\ **Last updated:** [August 11, 2021, 11:22am UTC](https://discuss.elastic.co/t/parsing-query-part-from-apache-log/281048 "2021-08-11T11:22:14Z")
Greetings I'm completly new to Elastic ; I've set up Apache to send logs to ElasticSearch through FileBeat (I'm not using LogStash). I can see the logs entries in Kibana. Now I'd like to use the parameters from the que… --- ## [Kafka-Elastic search sink connector showing high CPU usage](https://discuss.elastic.co/t/kafka-elastic-search-sink-connector-showing-high-cpu-usage/281043)
**Author:** [@kushaq\_flier](https://discuss.elastic.co/u/kushaq_flier)\ **Replies:** 0\ **Last updated:** [August 11, 2021, 11:06am UTC](https://discuss.elastic.co/t/kafka-elastic-search-sink-connector-showing-high-cpu-usage/281043 "2021-08-11T11:06:20Z")
I am using elastic search sink connector in distributed mode(2 instance). With task of 8 and about 20 to 25 topics to be sink’ed to elastic search. Even when there are no records to sink, the worker java process is show… --- ## [Logstash SSL configuration invalid SecretKeyFactory not available](https://discuss.elastic.co/t/logstash-ssl-configuration-invalid-secretkeyfactory-not-available/280939)
**Author:** [@Kosodrom](https://discuss.elastic.co/u/Kosodrom)\ **Replies:** 2\ **Last updated:** [August 11, 2021, 11:02am UTC](https://discuss.elastic.co/t/logstash-ssl-configuration-invalid-secretkeyfactory-not-available/280939 "2021-08-11T11:02:46Z")
Hi folks, I am facing following error and I am out of options to fix it: \[2021-08-10T14:43:44,743\]\[ERROR\]\[logstash.inputs.beats \]\[test\_pipeline\] SSL configuration invalid {:exception=\>Java::JavaLang::IllegalArgument… --- ## [Query\_string not match with Should Condions](https://discuss.elastic.co/t/query-string-not-match-with-should-condions/281038)
**Author:** [@enrico.bellanti](https://discuss.elastic.co/u/enrico.bellanti)\ **Replies:** 1\ **Last updated:** [August 11, 2021, 11:00am UTC](https://discuss.elastic.co/t/query-string-not-match-with-should-condions/281038 "2021-08-11T11:00:43Z")
My intention is to find a word in all documents which have this condions: ("type" =\> "Faq") OR ("type" =\> "NormativeDoc") OR ("type" =\> "Document" AND "profile\_id\_document" =\> X). I tried this but it doesn't work: $pa… --- ## [Counting Files in Folders](https://discuss.elastic.co/t/counting-files-in-folders/281023)
**Author:** [@tractor\_boy](https://discuss.elastic.co/u/tractor_boy)\ **Replies:** 2\ **Last updated:** [August 11, 2021, 10:51am UTC](https://discuss.elastic.co/t/counting-files-in-folders/281023 "2021-08-11T10:51:38Z")
Hi, Is there a way to capture the number of files that exist in a folder where the file has not been modified for a period of time? I have a requirement to capture this information, and then build alarms of the back of… --- ## [Bar chart Visualisation](https://discuss.elastic.co/t/bar-chart-visualisation/280799)
**Author:** [@Krunal](https://discuss.elastic.co/u/Krunal)\ **Replies:** 2\ **Last updated:** [August 11, 2021, 10:25am UTC](https://discuss.elastic.co/t/bar-chart-visualisation/280799 "2021-08-11T10:25:30Z")
{ "aggs": { "3": { "terms": { "field": "Client.keyword", "order": { "\_key": "asc" }, "size": 2000 }, "aggs": { "2": { "date\_histogram": … --- ## [Filtering for wildcard domains](https://discuss.elastic.co/t/filtering-for-wildcard-domains/280834)
**Author:** [@YvorL](https://discuss.elastic.co/u/YvorL)\ **Replies:** 3\ **Last updated:** [August 11, 2021, 10:08am UTC](https://discuss.elastic.co/t/filtering-for-wildcard-domains/280834 "2021-08-11T10:08:38Z")
Hi there, I have to write a query that has to find documents where one of the fields (type: text, also available: keyword) matches a list of wildcard domains. I know that it's sub-optimal but that's what I have to work … --- ## [8.x prerelease, yum error](https://discuss.elastic.co/t/8-x-prerelease-yum-error/281016)
**Author:** [@stsm](https://discuss.elastic.co/u/stsm)\ **Replies:** 0\ **Last updated:** [August 11, 2021, 8:40am UTC](https://discuss.elastic.co/t/8-x-prerelease-yum-error/281016 "2021-08-11T08:40:22Z")
https://artifacts.elastic.co/packages/8.x-prerelease/yum/repodata/repomd.xml: \[E rrno 14\] HTTPS Error 404 - Not Found .repo file content \[kibana-8.x\] … --- ## [Logstash Ruby Script - Access Fields While Avoiding Concurrency Issues](https://discuss.elastic.co/t/logstash-ruby-script-access-fields-while-avoiding-concurrency-issues/280956)
**Author:** [@panagiss](https://discuss.elastic.co/u/panagiss)\ **Replies:** 4\ **Last updated:** [August 11, 2021, 9:43am UTC](https://discuss.elastic.co/t/logstash-ruby-script-access-fields-while-avoiding-concurrency-issues/280956 "2021-08-11T09:43:27Z")
I have a CSV file and what im trying to do is after filtering a bit the data, to output them in a another csv file but i have to check that im not writing SAME info. So i have a Ruby script to check for if a KEY is alrea… --- ## [Match entities where field with specific value does not exists](https://discuss.elastic.co/t/match-entities-where-field-with-specific-value-does-not-exists/280902)
**Author:** [@farkasaba](https://discuss.elastic.co/u/farkasaba)\ **Replies:** 7\ **Last updated:** [August 11, 2021, 9:18am UTC](https://discuss.elastic.co/t/match-entities-where-field-with-specific-value-does-not-exists/280902 "2021-08-11T09:18:44Z")
Hello there, I have my documents indexed in the following format: { ... "special\_id"=1, "phase"="create" }, { ... "special\_id"=1, "phase"="update" }, { ... "special\_id"=2, "phase"="update" }, { ... "special\_id"=3, "pha… --- ## [Unable to retrieve version information from Elasticsearch nodes. unable to get local issuer certificate](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes-unable-to-get-local-issuer-certificate/281008)
**Author:** [@auasad](https://discuss.elastic.co/u/auasad)\ **Replies:** 0\ **Last updated:** [August 11, 2021, 7:44am UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes-unable-to-get-local-issuer-certificate/281008 "2021-08-11T07:44:16Z")
Hello community, I have setup an elk stack following the URL; Run in Docker with TLS enabled everything setup successfully with elastic default settings, but I want to configure Letsencrypt SSL for http instead of es0… --- ## [How to get all closed indicies?](https://discuss.elastic.co/t/how-to-get-all-closed-indicies/281004)
**Author:** [@grrkaan](https://discuss.elastic.co/u/grrkaan)\ **Replies:** 0\ **Last updated:** [August 11, 2021, 7:20am UTC](https://discuss.elastic.co/t/how-to-get-all-closed-indicies/281004 "2021-08-11T07:20:11Z")
I have a cluseter and a few open and closed indexes inside.I want to get only closed indexes. GET \_cat/indices?v&s=status this query getting all indicies. I need a GET \_cat/indices?v&s=status:'close' like this query. I… --- ## [Enriching data from nested field query](https://discuss.elastic.co/t/enriching-data-from-nested-field-query/280993)
**Author:** [@amamdouh](https://discuss.elastic.co/u/amamdouh)\ **Replies:** 0\ **Last updated:** [August 11, 2021, 6:39am UTC](https://discuss.elastic.co/t/enriching-data-from-nested-field-query/280993 "2021-08-11T06:39:35Z")
Hi there.., I'm trying to setup an enrich policy that matches a nested field and then returns the parent object, but couldn't find a way so far.. My index mapping looks like this: { "lkp\_persons": { "mappings… --- ## [Logstash jdbc plugin for windows authentication using kerberos in linux](https://discuss.elastic.co/t/logstash-jdbc-plugin-for-windows-authentication-using-kerberos-in-linux/280991)
**Author:** [@akshaybhuradia](https://discuss.elastic.co/u/akshaybhuradia)\ **Replies:** 0\ **Last updated:** [August 11, 2021, 6:23am UTC](https://discuss.elastic.co/t/logstash-jdbc-plugin-for-windows-authentication-using-kerberos-in-linux/280991 "2021-08-11T06:23:55Z")
For kerberos authentication username and password is not required. But plugin make username as required parameter. I have tried diiferent ways but not able to connect to MS Sql Server OS Version : RHEL 8.3 with x64 L… --- ## [Monitoring the logstash postfix queue](https://discuss.elastic.co/t/monitoring-the-logstash-postfix-queue/280986)
**Author:** [@KaPBaJIOJI](https://discuss.elastic.co/u/KaPBaJIOJI)\ **Replies:** 0\ **Last updated:** [August 11, 2021, 5:16am UTC](https://discuss.elastic.co/t/monitoring-the-logstash-postfix-queue/280986 "2021-08-11T05:16:30Z")
Hi all, mb its stupid idei, but i want monitoring postfix queue . I write in file "data", "hostname", "count", how can I transfer this data to elastic? at the moment, i am parse postfix logs, thanks to GitHub - whyscre… --- ## [Upgrade elk from 6.3.2 to 7.14](https://discuss.elastic.co/t/upgrade-elk-from-6-3-2-to-7-14/280982)
**Author:** [@praseeb\_kdas](https://discuss.elastic.co/u/praseeb_kdas)\ **Replies:** 3\ **Last updated:** [August 11, 2021, 5:27am UTC](https://discuss.elastic.co/t/upgrade-elk-from-6-3-2-to-7-14/280982 "2021-08-11T05:27:41Z")
We are planning to upgrade our ELK 6.3.2 to 7.14,can we know the steps which we need to perform so there wont any data loss for us. --- ## [New nodes failing to join cluster](https://discuss.elastic.co/t/new-nodes-failing-to-join-cluster/280980)
**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\ **Replies:** 2\ **Last updated:** [August 11, 2021, 5:11am UTC](https://discuss.elastic.co/t/new-nodes-failing-to-join-cluster/280980 "2021-08-11T05:11:39Z")
I have two nodes that have been out of the cluster for some time and I have just tried to bring them back in. Both fail in the same manner: connection timed out. Tcpdump running on one of the cluster members shows the … --- ## [Auditbeat not updating usernames and process data in file\_integrity module](https://discuss.elastic.co/t/auditbeat-not-updating-usernames-and-process-data-in-file-integrity-module/280983)
**Author:** [@Stud21](https://discuss.elastic.co/u/Stud21)\ **Replies:** 0\ **Last updated:** [August 11, 2021, 4:54am UTC](https://discuss.elastic.co/t/auditbeat-not-updating-usernames-and-process-data-in-file-integrity-module/280983 "2021-08-11T04:54:13Z")
Hi, I have installed Auditbeat which is working fine. However, when I try to query data related to user creating, deleting files which uses the file\_integrity module, it shows records/documents without the user.names in… --- ## [How to specify pipelines.yml file path](https://discuss.elastic.co/t/how-to-specify-pipelines-yml-file-path/280923)
**Author:** [@GitSpree23](https://discuss.elastic.co/u/GitSpree23)\ **Replies:** 7\ **Last updated:** [August 11, 2021, 3:20am UTC](https://discuss.elastic.co/t/how-to-specify-pipelines-yml-file-path/280923 "2021-08-11T03:20:18Z")
I'm working on Logstash setup in a legacy system with no owners in the organisation. Using ps, i found the process executing the logstash service: /usr/bin/java -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -Djava.awt.headl… --- ## [How to import CSV files, where couple of fields have multiline content](https://discuss.elastic.co/t/how-to-import-csv-files-where-couple-of-fields-have-multiline-content/280453)
**Author:** [@itokai](https://discuss.elastic.co/u/itokai)\ **Replies:** 5\ **Last updated:** [August 11, 2021, 2:00am UTC](https://discuss.elastic.co/t/how-to-import-csv-files-where-couple-of-fields-have-multiline-content/280453 "2021-08-11T02:00:43Z")
Hello, how to accurately import CSV where lines contain fields with multiline content? Default separator is comma, but multiline content is surrounded with double-quotes. For example: Summary,Issue key,Issue id,Parent … --- ## [How to change color for bar chart](https://discuss.elastic.co/t/how-to-change-color-for-bar-chart/280809)
**Author:** [@HuongCV](https://discuss.elastic.co/u/HuongCV)\ **Replies:** 2\ **Last updated:** [August 10, 2021, 2:00am UTC](https://discuss.elastic.co/t/how-to-change-color-for-bar-chart/280809 "2021-08-10T02:00:48Z")
Hi team, I want to change the color for each column a color code As image : I used kibana ver 7.13 Thanks --- ## [Logstash http poller - PKIX path building failed](https://discuss.elastic.co/t/logstash-http-poller-pkix-path-building-failed/280966)
**Author:** [@gutierrezfj](https://discuss.elastic.co/u/gutierrezfj)\ **Replies:** 2\ **Last updated:** [August 11, 2021, 1:38am UTC](https://discuss.elastic.co/t/logstash-http-poller-pkix-path-building-failed/280966 "2021-08-11T01:38:09Z")
Hello community. I need your help again! I'm using http poller plugin requesting an url https but have the error: "pkix path building failed sun.security.provider.certpath.suncertpathbuilderexception: unable to find va… --- ## [Exception: Key found in event is not documented!](https://discuss.elastic.co/t/exception-key-found-in-event-is-not-documented/280658)
**Author:** [@Jerry\_Tian](https://discuss.elastic.co/u/Jerry_Tian)\ **Replies:** 1\ **Last updated:** [August 10, 2021, 11:36pm UTC](https://discuss.elastic.co/t/exception-key-found-in-event-is-not-documented/280658 "2021-08-10T23:36:35Z")
I am at step 5 of the testing phase in creating a custom filebeat module as detailed here Creating a New Filebeat Module | Beats Developer Guide \[master\] | Elastic. However, I failed the test with the following short te… --- ## [Adding modules to Fleet agent](https://discuss.elastic.co/t/adding-modules-to-fleet-agent/280721)
**Author:** [@ajhstn](https://discuss.elastic.co/u/ajhstn)\ **Replies:** 4\ **Last updated:** [August 10, 2021, 11:30pm UTC](https://discuss.elastic.co/t/adding-modules-to-fleet-agent/280721 "2021-08-10T23:30:43Z")
Hi, I have Elastic Cloud 7.14.0, using Fleet and an Agent on a Centos 7 server. Works great. I want to enable modules that aren't necessarily a click-and-configure in the Fleet UI. Can i modify some file locally on th… --- ## [Help! I can't filter out docs with bad ids in reindex](https://discuss.elastic.co/t/help-i-cant-filter-out-docs-with-bad-ids-in-reindex/280968)
**Author:** [@tasslehawf](https://discuss.elastic.co/u/tasslehawf)\ **Replies:** 1\ **Last updated:** [August 10, 2021, 11:28pm UTC](https://discuss.elastic.co/t/help-i-cant-filter-out-docs-with-bad-ids-in-reindex/280968 "2021-08-10T23:28:40Z")
Our index has a number of docs with bad ids. They were set by this script during a previous reindex: def lowerCaseAuthor = ctx.author\_string != null ? ctx.author\_string.toLowerCase() : null; def lowerCasePub = ctx.publi… --- ## [Questions On Setting Up A Production Ready Elastic Stack](https://discuss.elastic.co/t/questions-on-setting-up-a-production-ready-elastic-stack/280973)
**Author:** [@Jared9922](https://discuss.elastic.co/u/Jared9922)\ **Replies:** 1\ **Last updated:** [August 10, 2021, 11:17pm UTC](https://discuss.elastic.co/t/questions-on-setting-up-a-production-ready-elastic-stack/280973 "2021-08-10T23:17:23Z")
Hello, After working with the elastic stack as a proof of concept and setting it up accordingly our business is ready to move onto a production level stack. We just had some questions before making the jump. We are hop… --- ## [Create ILM Rollover on existing index](https://discuss.elastic.co/t/create-ilm-rollover-on-existing-index/280814)
**Author:** [@Baygon](https://discuss.elastic.co/u/Baygon)\ **Replies:** 5\ **Last updated:** [August 10, 2021, 11:02pm UTC](https://discuss.elastic.co/t/create-ilm-rollover-on-existing-index/280814 "2021-08-10T23:02:52Z")
Hi, I have an existing index that grows too big and I see perf going down (the index is 85Gb for the moment). I created an IL policy, and now trying to create an index template to apply the policy on. Given the existi… --- ## [Logstash filter: aggregate nested arrays](https://discuss.elastic.co/t/logstash-filter-aggregate-nested-arrays/280965)
**Author:** [@me.mohammed](https://discuss.elastic.co/u/me.mohammed)\ **Replies:** 7\ **Last updated:** [August 10, 2021, 10:47pm UTC](https://discuss.elastic.co/t/logstash-filter-aggregate-nested-arrays/280965 "2021-08-10T22:47:50Z")
I'm trying to fetch data from MySQL and push it to ElasticSearch using LogStash, although I'm having trouble creating a config file for LogStash that suits my need I'm trying to achieve this result { "products":\[ … [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1285) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1287)