# Latest **URL:** https://discuss.elastic.co/latest.md?page=1718 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1719 --- ## [How do we get logstash to process a gzip file as input?](https://discuss.elastic.co/t/how-do-we-get-logstash-to-process-a-gzip-file-as-input/270934)
**Author:** [@Shreesh\_Narayanan](https://discuss.elastic.co/u/Shreesh_Narayanan)\ **Replies:** 1\ **Last updated:** [April 22, 2021, 1:49pm UTC](https://discuss.elastic.co/t/how-do-we-get-logstash-to-process-a-gzip-file-as-input/270934 "2021-04-22T13:49:47Z")
I have trouble getting logstash to process gzip file . i have installed the gzip codec and referenced it in the code as well . During execution , logstash says " Error: not in gzip format" even the file is gzip . This ex… --- ## [After transforming multiple indexes I need to display the status as text value](https://discuss.elastic.co/t/after-transforming-multiple-indexes-i-need-to-display-the-status-as-text-value/270772)
**Author:** [@ajaay\_kannan\_Vr](https://discuss.elastic.co/u/ajaay_kannan_Vr)\ **Replies:** 1\ **Last updated:** [April 22, 2021, 1:47pm UTC](https://discuss.elastic.co/t/after-transforming-multiple-indexes-i-need-to-display-the-status-as-text-value/270772 "2021-04-22T13:47:40Z")
There are 3 different indexes which will collect data from different system. To consolidate to one view pivot option used and to display the latest status instead of text I created as Number format so while doing pivot t… --- ## [File Data Visualizer... Structure Cannot Be Determined?](https://discuss.elastic.co/t/file-data-visualizer-structure-cannot-be-determined/270747)
**Author:** [@Marcus007](https://discuss.elastic.co/u/Marcus007)\ **Replies:** 1\ **Last updated:** [April 22, 2021, 1:45pm UTC](https://discuss.elastic.co/t/file-data-visualizer-structure-cannot-be-determined/270747 "2021-04-22T13:45:33Z")
Hello all, I am trying to upload a JSON file, which consists of around 1000 objects and 2MB total size. But for whatever reason, the Data Visualizer is returning the following errors: File structure cannot be determine… --- ## [Route search request by using the date in index name](https://discuss.elastic.co/t/route-search-request-by-using-the-date-in-index-name/269533)
**Author:** [@india](https://discuss.elastic.co/u/india)\ **Replies:** 10\ **Last updated:** [April 22, 2021, 1:43pm UTC](https://discuss.elastic.co/t/route-search-request-by-using-the-date-in-index-name/269533 "2021-04-22T13:43:08Z")
Hi, I am testing ILM, this is my configuration: ILM Policy: PUT \_ilm/policy/test\_policy { "policy": { "phases": { "hot": { "actions": { "rollover": { "max\_… --- ## [\[null-valued setting found for key \[xpack.security.authc.realms.active\_directory\]](https://discuss.elastic.co/t/null-valued-setting-found-for-key-xpack-security-authc-realms-active-directory/270309)
**Author:** [@hubertn](https://discuss.elastic.co/u/hubertn)\ **Replies:** 2\ **Last updated:** [April 22, 2021, 1:41pm UTC](https://discuss.elastic.co/t/null-valued-setting-found-for-key-xpack-security-authc-realms-active-directory/270309 "2021-04-22T13:41:39Z")
set active\_directory security in elasticsearch.yml. After setting up xpack configuration in the yml file, Elastic service did not start anymore, it indicates that the \[null-valued setting found for the active\_director… --- ## [Kibana Discover will not load index, bsearch being called repeatedly in js console network tab](https://discuss.elastic.co/t/kibana-discover-will-not-load-index-bsearch-being-called-repeatedly-in-js-console-network-tab/270150)
**Author:** [@Daniel\_Kozlowski](https://discuss.elastic.co/u/Daniel_Kozlowski)\ **Replies:** 1\ **Last updated:** [April 22, 2021, 1:36pm UTC](https://discuss.elastic.co/t/kibana-discover-will-not-load-index-bsearch-being-called-repeatedly-in-js-console-network-tab/270150 "2021-04-22T13:36:32Z")
Kibana fetch streaming loop When I go to a certain indexes Discovery tab in Kibana the system goes into a loop where its calling a bsearch stream, then calls it again, then does a delete post, then back to a bsearch. T… --- ## [Composite Aggregation - Too many buckets](https://discuss.elastic.co/t/composite-aggregation-too-many-buckets/270962)
**Author:** [@vands](https://discuss.elastic.co/u/vands)\ **Replies:** 1\ **Last updated:** [April 22, 2021, 1:26pm UTC](https://discuss.elastic.co/t/composite-aggregation-too-many-buckets/270962 "2021-04-22T13:26:58Z")
Hi All , Facing the below issue while using composite aggregation and get buckets data \[Elasticsearch exception \[type=too\_many\_buckets\_exception, reason=Trying to create too many buckets. Must be less than or equal to:… --- ## [Dashboard Kibana "save as" overwrite the data](https://discuss.elastic.co/t/dashboard-kibana-save-as-overwrite-the-data/270942)
**Author:** [@Arethusa](https://discuss.elastic.co/u/Arethusa)\ **Replies:** 2\ **Last updated:** [April 22, 2021, 1:21pm UTC](https://discuss.elastic.co/t/dashboard-kibana-save-as-overwrite-the-data/270942 "2021-04-22T13:21:50Z")
Hello, If I have a Dashboard named "test1", and if want to do some test without destroy it, I want to do "save as" "test2". however, when I do "save as", the "test1" is overwite by "test2" (like rename). Is it the nor… --- ## [\[Metrics\] Error when trying to fetch data](https://discuss.elastic.co/t/metrics-error-when-trying-to-fetch-data/270804)
**Author:** [@Dzious](https://discuss.elastic.co/u/Dzious)\ **Replies:** 5\ **Last updated:** [April 22, 2021, 1:21pm UTC](https://discuss.elastic.co/t/metrics-error-when-trying-to-fetch-data/270804 "2021-04-22T13:21:27Z")
Hi, Thanks to one of my co-workers, I've recently discovered the Observability tab. Unfortunately i can't manage to make it work properly. When i'm on the Observability page the only thing that i see is Metrics tellin… --- ## [Elasticsearch Transform not triggering](https://discuss.elastic.co/t/elasticsearch-transform-not-triggering/270897)
**Author:** [@jplonghi](https://discuss.elastic.co/u/jplonghi)\ **Replies:** 5\ **Last updated:** [April 22, 2021, 12:40pm UTC](https://discuss.elastic.co/t/elasticsearch-transform-not-triggering/270897 "2021-04-22T12:40:32Z")
Hello, hope you can help me with a transform issue. I already created a very simple transform to test, set the frequency to 5s, and then used the \_transform/mytransform/\_start. The stats said the transform is started and… --- ## [Filebeat not working on a particular path](https://discuss.elastic.co/t/filebeat-not-working-on-a-particular-path/270845)
**Author:** [@ashu\_29516](https://discuss.elastic.co/u/ashu_29516)\ **Replies:** 3\ **Last updated:** [April 22, 2021, 12:21pm UTC](https://discuss.elastic.co/t/filebeat-not-working-on-a-particular-path/270845 "2021-04-22T12:21:38Z")
Hi Everyone, I'm new to Elasticsearch and have been facing an issue with filebeats where I've been observing that logs from certain paths do not seem to get picked when the file in that path is updated. Running filebeat… --- ## [Does Logstash support wilcards for multiple empty fields](https://discuss.elastic.co/t/does-logstash-support-wilcards-for-multiple-empty-fields/270948)
**Author:** [@stillfreem](https://discuss.elastic.co/u/stillfreem)\ **Replies:** 2\ **Last updated:** [April 22, 2021, 12:20pm UTC](https://discuss.elastic.co/t/does-logstash-support-wilcards-for-multiple-empty-fields/270948 "2021-04-22T12:20:17Z")
Hello, I know that in Logstash I can check if a field is empty with the following if !\[myfield\] { do something } Having said that I though that wildcards will match all fields that are empty but that was not the case. … --- ## [Filebeat to logstash multiline issue with network](https://discuss.elastic.co/t/filebeat-to-logstash-multiline-issue-with-network/270693)
**Author:** [@Ahmed\_Abdulaleem](https://discuss.elastic.co/u/Ahmed_Abdulaleem)\ **Replies:** 3\ **Last updated:** [April 22, 2021, 12:11pm UTC](https://discuss.elastic.co/t/filebeat-to-logstash-multiline-issue-with-network/270693 "2021-04-22T12:11:35Z")
Greetings, I installed file beat 7.12 with multiline pattern and the output is log stash 7.12 the problem is when file beat be in same network subnet the multiline shipped correctly otherwise with a different network… --- ## [ConnectionClosedException: When trying to connect to Elasticsearch using Java High Level Client](https://discuss.elastic.co/t/connectionclosedexception-when-trying-to-connect-to-elasticsearch-using-java-high-level-client/270661)
**Author:** [@Jenisha\_Ramanathan](https://discuss.elastic.co/u/Jenisha_Ramanathan)\ **Replies:** 1\ **Last updated:** [April 22, 2021, 12:07pm UTC](https://discuss.elastic.co/t/connectionclosedexception-when-trying-to-connect-to-elasticsearch-using-java-high-level-client/270661 "2021-04-22T12:07:54Z")
Hi Team, I'm trying to connect Java to https Elasticsearch using Java High Level Client. Getting ConnectionClosedException when trying to check for existing index that are available in elasticsearch. And the elasticsea… --- ## [Elasticsearch changes encoding through "import geojson"](https://discuss.elastic.co/t/elasticsearch-changes-encoding-through-import-geojson/270817)
**Author:** [@sieczaa](https://discuss.elastic.co/u/sieczaa)\ **Replies:** 3\ **Last updated:** [April 22, 2021, 11:57am UTC](https://discuss.elastic.co/t/elasticsearch-changes-encoding-through-import-geojson/270817 "2021-04-22T11:57:54Z")
Hello, we've got elasticsearch 7.8.1, when I import geojson file with coordinates of polish counties, elasticsearch creates index, but changes encoding of polish characters like "ę,ś,ć,ź,ń,ą,ł". I imported sth like th… --- ## [Enabling Authentication and Licensing](https://discuss.elastic.co/t/enabling-authentication-and-licensing/270738)
**Author:** [@Antonio\_Marques](https://discuss.elastic.co/u/Antonio_Marques)\ **Replies:** 5\ **Last updated:** [April 22, 2021, 11:53am UTC](https://discuss.elastic.co/t/enabling-authentication-and-licensing/270738 "2021-04-22T11:53:26Z")
Hi Guys from Elastic. Could you help me to understand Objective: Use the security (X-pack) to connect Kibana with our G-SUITE users and inherit groups We did a test using elastic and kibana ketstore and works fine \[b… --- ## [Logstash file Input Plugin to read all files from a directory where log files gets rotated every hour](https://discuss.elastic.co/t/logstash-file-input-plugin-to-read-all-files-from-a-directory-where-log-files-gets-rotated-every-hour/270806)
**Author:** [@shadu88](https://discuss.elastic.co/u/shadu88)\ **Replies:** 4\ **Last updated:** [April 22, 2021, 11:40am UTC](https://discuss.elastic.co/t/logstash-file-input-plugin-to-read-all-files-from-a-directory-where-log-files-gets-rotated-every-hour/270806 "2021-04-22T11:40:45Z")
Hello Dear ELkan's Hope all are doing good!!. here are details of my query: Logstash version7.10 on Centos7.8 Using File input plugin to read files and forward logs to other components Issue Statement : How can i rea… --- ## [Is there any tool that only show kibana's dashboard](https://discuss.elastic.co/t/is-there-any-tool-that-only-show-kibanas-dashboard/270954)
**Author:** [@rknd](https://discuss.elastic.co/u/rknd)\ **Replies:** 1\ **Last updated:** [April 22, 2021, 11:07am UTC](https://discuss.elastic.co/t/is-there-any-tool-that-only-show-kibanas-dashboard/270954 "2021-04-22T11:07:23Z")
I want to ask that is there any tool that only shows kibana's dashboard. I don't want all features of kibana, I want to have only dashboards option. Can someone give suggestion ? Thanks for answering --- ## [Elasticsearch health turns red when kibana is started and indices are in red state](https://discuss.elastic.co/t/elasticsearch-health-turns-red-when-kibana-is-started-and-indices-are-in-red-state/270645)
**Author:** [@AkhilR](https://discuss.elastic.co/u/AkhilR)\ **Replies:** 4\ **Last updated:** [April 22, 2021, 10:45am UTC](https://discuss.elastic.co/t/elasticsearch-health-turns-red-when-kibana-is-started-and-indices-are-in-red-state/270645 "2021-04-22T10:45:27Z")
Hi We are installing 1 Master and 2 Data Node Setup. While setting up master node the elasticsearch gets installed fine and health is green. But when kibana is setup and started, the health of elasticsearch turns red w… --- ## [Zipping huge snapshot and unzipping to restore to cluster on demand](https://discuss.elastic.co/t/zipping-huge-snapshot-and-unzipping-to-restore-to-cluster-on-demand/270951)
**Author:** [@Pratik\_Gangan](https://discuss.elastic.co/u/Pratik_Gangan)\ **Replies:** 0\ **Last updated:** [April 22, 2021, 10:43am UTC](https://discuss.elastic.co/t/zipping-huge-snapshot-and-unzipping-to-restore-to-cluster-on-demand/270951 "2021-04-22T10:43:21Z")
My use case is, We have almost 500 gb of logs everyday. We have cluster size in TBs. We want to keep logs on cluster for 7 days after that I want to zip and store it to other storage. Whenever particular date's log is r… --- ## [How to enable searchable snapshot](https://discuss.elastic.co/t/how-to-enable-searchable-snapshot/270506)
**Author:** [@Rohit\_Kumbhar](https://discuss.elastic.co/u/Rohit_Kumbhar)\ **Replies:** 3\ **Last updated:** [April 22, 2021, 10:23am UTC](https://discuss.elastic.co/t/how-to-enable-searchable-snapshot/270506 "2021-04-22T10:23:02Z")
Hi, I want to know how we can enable searchable snapshot in the cluster --- ## ["reason"=\>"failed to parse field \[host.name\] of type \[text\] in document with id](https://discuss.elastic.co/t/reason-failed-to-parse-field-host-name-of-type-text-in-document-with-id/270923)
**Author:** [@BlackCat](https://discuss.elastic.co/u/BlackCat)\ **Replies:** 2\ **Last updated:** [April 22, 2021, 10:18am UTC](https://discuss.elastic.co/t/reason-failed-to-parse-field-host-name-of-type-text-in-document-with-id/270923 "2021-04-22T10:18:04Z")
Logstash outputs below error log. \[2021-04-22T15:00:43,643\]\[WARN \]\[logstash.outputs.elasticsearch\]\[＜pipeline id＞\] Could not index event to Elasticsearch. {:status=\>400, :action=\>\["index", {:\_id=\>nil, :\_index=\>"＜index na… --- ## [Change AppSearch Query](https://discuss.elastic.co/t/change-appsearch-query/268413)
**Author:** [@ylasri](https://discuss.elastic.co/u/ylasri)\ **Replies:** 9\ **Last updated:** [April 22, 2021, 10:09am UTC](https://discuss.elastic.co/t/change-appsearch-query/268413 "2021-04-22T10:09:33Z")
Hello I am using Appsearch to power search for an application, I know that App search take care of the mapping & analyzer, and also the search query, when doing some inspection, i could see the kind of the search query … --- ## [Python client send data to Elastic cloud refused](https://discuss.elastic.co/t/python-client-send-data-to-elastic-cloud-refused/270853)
**Author:** [@erwan22](https://discuss.elastic.co/u/erwan22)\ **Replies:** 2\ **Last updated:** [April 22, 2021, 9:27am UTC](https://discuss.elastic.co/t/python-client-send-data-to-elastic-cloud-refused/270853 "2021-04-22T09:27:09Z")
Hello, I have been sending data to my localhost (elastic 7.12) easily with Python. I'm trying to do the same with elastic cloud with the following command : es = Elasticsearch( cloud\_id='my\_cloud\_id\_from\_https://cloud… --- ## [Does elastic have data other than the indices data](https://discuss.elastic.co/t/does-elastic-have-data-other-than-the-indices-data/270672)
**Author:** [@lstoneir](https://discuss.elastic.co/u/lstoneir)\ **Replies:** 5\ **Last updated:** [April 22, 2021, 9:11am UTC](https://discuss.elastic.co/t/does-elastic-have-data-other-than-the-indices-data/270672 "2021-04-22T09:11:56Z")
this is kibana stack monitoring area: when i run du -ha /var | sort -rh | head -40 see this : 1.7T /var 1.5T /var/lib/elasticsearch/nodes/0/indices 1.5T /var/lib/elasticsearch/nodes/0 1.5T /var/lib/elasticsearch/node… --- ## [ElasticAPM Unknown Field Mapping](https://discuss.elastic.co/t/elasticapm-unknown-field-mapping/270580)
**Author:** [@happyinteger](https://discuss.elastic.co/u/happyinteger)\ **Replies:** 2\ **Last updated:** [April 22, 2021, 8:18am UTC](https://discuss.elastic.co/t/elasticapm-unknown-field-mapping/270580 "2021-04-22T08:18:20Z")
Kibana version: 7.11.1 Elasticsearch version: 7.11.1 APM Server version: 7.9.1 APM Agent language and version: rum-js 5.6.3 Browser version: Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko)… --- ## [Can't find terms that are not ".keyword" and the "something.keyword" terms are empty](https://discuss.elastic.co/t/cant-find-terms-that-are-not-keyword-and-the-something-keyword-terms-are-empty/269998)
**Author:** [@Jose\_E](https://discuss.elastic.co/u/Jose_E)\ **Replies:** 2\ **Last updated:** [April 22, 2021, 8:17am UTC](https://discuss.elastic.co/t/cant-find-terms-that-are-not-keyword-and-the-something-keyword-terms-are-empty/269998 "2021-04-22T08:17:13Z")
Hi, I've been playing a little bit with mappings and index templates lately, and that actually helped me make the SIEM work and see a lot of improvement. However, many of my visualizations just stopped working, mainly be… --- ## [Added multiple config files in a directory and edited pipelines.yml. yet only one of the config file is being processed](https://discuss.elastic.co/t/added-multiple-config-files-in-a-directory-and-edited-pipelines-yml-yet-only-one-of-the-config-file-is-being-processed/270607)
**Author:** [@Shreesh\_Narayanan](https://discuss.elastic.co/u/Shreesh_Narayanan)\ **Replies:** 2\ **Last updated:** [April 22, 2021, 8:09am UTC](https://discuss.elastic.co/t/added-multiple-config-files-in-a-directory-and-edited-pipelines-yml-yet-only-one-of-the-config-file-is-being-processed/270607 "2021-04-22T08:09:12Z")
I'm running logstash on a MAC , i got two config file, which run fine when executed on their own . However i moved them to a custom directory and added the path onto the pipelines.yml, while execution via "logstash -f /… --- ## [How to run more nodes in cluster as service in Centos](https://discuss.elastic.co/t/how-to-run-more-nodes-in-cluster-as-service-in-centos/270549)
**Author:** [@rknd](https://discuss.elastic.co/u/rknd)\ **Replies:** 7\ **Last updated:** [April 22, 2021, 8:00am UTC](https://discuss.elastic.co/t/how-to-run-more-nodes-in-cluster-as-service-in-centos/270549 "2021-04-22T08:00:41Z")
I have downloaded elasticsearch tar.gz for every nodes. I have modified elasticsearch.yml for each node. I made a script for running each nodes. Script is like below : sh ../node1/bin/elasticsearch sh ../node2/bin/ela… --- ## [Plugin installation on local ElasticSearch](https://discuss.elastic.co/t/plugin-installation-on-local-elasticsearch/270729)
**Author:** [@Lukas\_Smilek](https://discuss.elastic.co/u/Lukas_Smilek)\ **Replies:** 10\ **Last updated:** [April 22, 2021, 7:55am UTC](https://discuss.elastic.co/t/plugin-installation-on-local-elasticsearch/270729 "2021-04-22T07:55:13Z")
Hello, I was able to successfully install ElasticSearch 7.12.0 on my Mac and also work with it (mapping and indexing first objects via non local network). I want to install a plugin, but I can't get pass this error: \*\*\*… [Previous page](https://discuss.elastic.co/latest.md?page=1717) [Next page](https://discuss.elastic.co/latest.md?page=1719)