# \#none **URL:** https://discuss.elastic.co/tag/none.md?page=1563 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1564 --- ## [How to remove field in logstash output](https://discuss.elastic.co/t/how-to-remove-field-in-logstash-output/224055)
**Author:** [@neal1991](https://discuss.elastic.co/u/neal1991)\ **Replies:** 3\ **Last updated:** [March 19, 2020, 5:12am UTC](https://discuss.elastic.co/t/how-to-remove-field-in-logstash-output/224055 "2020-03-19T05:12:25Z")
I have set up an ELK stack. For the logstash instance, it has two output including Kafka and elasticsearch. For the output of elasticsearch, I want to keep the field @timestamp. For the output of Kafka, I want to remove… --- ## [Understanding Elasticsearch TF/IDF score in 6.8](https://discuss.elastic.co/t/understanding-elasticsearch-tf-idf-score-in-6-8/224009)
**Author:** [@AV7](https://discuss.elastic.co/u/AV7)\ **Replies:** 3\ **Last updated:** [March 19, 2020, 3:59am UTC](https://discuss.elastic.co/t/understanding-elasticsearch-tf-idf-score-in-6-8/224009 "2020-03-19T03:59:22Z")
Hi, I was looking at the lucene TF/IDF practical scoring function vs what is reported in the ES explain API. For ES 6.8, it used lucence 7.x for calculating the TF/IDF score which has a squared IDF term However, when… --- ## [Extract SNMP table from "SNMP input plugin" with key-value or Split filter](https://discuss.elastic.co/t/extract-snmp-table-from-snmp-input-plugin-with-key-value-or-split-filter/223991)
**Author:** [@piellick](https://discuss.elastic.co/u/piellick)\ **Replies:** 1\ **Last updated:** [March 19, 2020, 3:26am UTC](https://discuss.elastic.co/t/extract-snmp-table-from-snmp-input-plugin-with-key-value-or-split-filter/223991 "2020-03-19T03:26:29Z")
Hello everyone, SNMP input plugin doesn't include (for the moment) an option to split SNMP table : indexed documents looks like this : { "\_index": "XXXX-2020.03.17", "\_type": "doc", "\_id": "Puby6XABeaR9KJCdhk0… --- ## [Filebeatで作成されるインデックスについて](https://discuss.elastic.co/t/filebeat/224017)
**Author:** [@111142](https://discuss.elastic.co/u/111142)\ **Replies:** 4\ **Last updated:** [March 19, 2020, 3:00am UTC](https://discuss.elastic.co/t/filebeat/224017 "2020-03-19T03:00:36Z")
filebeatの設定を下記のように行いモジュールごとにインデックスを分けてログを取り込んでいます。 output.elasticsearch: hosts: \["localhost:9200"\] indices: - index: "paloalto-%{+yyyy.MM.dd}" when.equals: event.module: "panw" - index: "elasti… --- ## [Delete unused templates](https://discuss.elastic.co/t/delete-unused-templates/224198)
**Author:** [@ashokm](https://discuss.elastic.co/u/ashokm)\ **Replies:** 3\ **Last updated:** [March 19, 2020, 1:42am UTC](https://discuss.elastic.co/t/delete-unused-templates/224198 "2020-03-19T01:42:50Z")
We are on ES version 6.8.0. Due to an issue in our software, we ended up having 30k unused templates on a 3 node cluster. Deleting these one by one is really slow like each one is taking upto 2 minutes and some are timin… --- ## [Can I aggregate multiple indexes with different schemas?](https://discuss.elastic.co/t/can-i-aggregate-multiple-indexes-with-different-schemas/224206)
**Author:** [@Yungyoung\_Ok](https://discuss.elastic.co/u/Yungyoung_Ok)\ **Replies:** 1\ **Last updated:** [March 19, 2020, 1:34am UTC](https://discuss.elastic.co/t/can-i-aggregate-multiple-indexes-with-different-schemas/224206 "2020-03-19T01:34:21Z")
I am trying to get statistics using the log of the homepage user. There are three types of logs: login log, user action log (search, click), and video enrollment information. I want to store these logs in three Indexes… --- ## [Logstash on Docker: how to run a pipeline?](https://discuss.elastic.co/t/logstash-on-docker-how-to-run-a-pipeline/224204)
**Author:** [@fdbatista](https://discuss.elastic.co/u/fdbatista)\ **Replies:** 0\ **Last updated:** [March 19, 2020, 12:42am UTC](https://discuss.elastic.co/t/logstash-on-docker-how-to-run-a-pipeline/224204 "2020-03-19T00:42:58Z")
Hello, community. I have started digging around Logstash and I am trying to use docker image for it. The thing is that every tutorial I have seen just shows how to integrate all components within a docker-compose file,… --- ## [Date\_nanos](https://discuss.elastic.co/t/date-nanos/224197)
**Author:** [@sentient](https://discuss.elastic.co/u/sentient)\ **Replies:** 0\ **Last updated:** [March 18, 2020, 10:45pm UTC](https://discuss.elastic.co/t/date-nanos/224197 "2020-03-18T22:45:54Z")
never mind (unable to delete) --- ## [Elasticsearch input missing \[@metadata\]\[\_index\]](https://discuss.elastic.co/t/elasticsearch-input-missing-metadata-index/223594)
**Author:** [@joaociocca](https://discuss.elastic.co/u/joaociocca)\ **Replies:** 13\ **Last updated:** [March 18, 2020, 11:13pm UTC](https://discuss.elastic.co/t/elasticsearch-input-missing-metadata-index/223594 "2020-03-18T23:13:29Z")
I'm doing some work with ES-input, ES-filter for lookup and ES-output into a new index... but the lookup uses \[@metadata\]\[\_index\] information. And I've been noticing a HUGE load of errors on LS log for missing that. Any … --- ## [Logstash Output to Apache Flume](https://discuss.elastic.co/t/logstash-output-to-apache-flume/224194)
**Author:** [@vpayala](https://discuss.elastic.co/u/vpayala)\ **Replies:** 0\ **Last updated:** [March 18, 2020, 10:20pm UTC](https://discuss.elastic.co/t/logstash-output-to-apache-flume/224194 "2020-03-18T22:20:41Z")
Hello, Our current logstash filters and sends information to Elasticsearch, but we have a new requirement to ship raw application logs to our partners' Apache Flume endpoint (avro source). Which logstash output plugin … --- ## [How do we do row level security in Kibana for eg:-Row Level Security allows two users viewing the same dashboard to see only the data they are allowed to see](https://discuss.elastic.co/t/how-do-we-do-row-level-security-in-kibana-for-eg-row-level-security-allows-two-users-viewing-the-same-dashboard-to-see-only-the-data-they-are-allowed-to-see/221681)
**Author:** [@Jayashree\_Teggi](https://discuss.elastic.co/u/Jayashree_Teggi)\ **Replies:** 1\ **Last updated:** [March 18, 2020, 9:51pm UTC](https://discuss.elastic.co/t/how-do-we-do-row-level-security-in-kibana-for-eg-row-level-security-allows-two-users-viewing-the-same-dashboard-to-see-only-the-data-they-are-allowed-to-see/221681 "2020-03-18T21:51:24Z")
Do we require X Pack for row level security to be done in kibana --- ## [Set end date with Kibana's time range](https://discuss.elastic.co/t/set-end-date-with-kibanas-time-range/224073)
**Author:** [@bryan\_rasmussen](https://discuss.elastic.co/u/bryan_rasmussen)\ **Replies:** 1\ **Last updated:** [March 18, 2020, 9:40pm UTC](https://discuss.elastic.co/t/set-end-date-with-kibanas-time-range/224073 "2020-03-18T21:40:20Z")
In the kibana time range settings you can set different ranges from the documentation Choose one of the following: Quick select to use a recent time range, then use the back and forward arrows to move through the t… --- ## [Connecting Elastic search cloud with Jupiter notebook](https://discuss.elastic.co/t/connecting-elastic-search-cloud-with-jupiter-notebook/224004)
**Author:** [@Vasuji](https://discuss.elastic.co/u/Vasuji)\ **Replies:** 2\ **Last updated:** [March 18, 2020, 9:31pm UTC](https://discuss.elastic.co/t/connecting-elastic-search-cloud-with-jupiter-notebook/224004 "2020-03-18T21:31:04Z")
Hi all, I am getting trouble with connecting to the elastic cloud with the following code through Jupyter notebook: es = Elasticsearch(\["https://xxxxxxxxxxxxxxxx.us-west-1.aws.found.io:9243/"\]) es.info(pretty=True) =\> … --- ## [Kibana scripted fields update by elasticsearch query](https://discuss.elastic.co/t/kibana-scripted-fields-update-by-elasticsearch-query/224136)
**Author:** [@zozo6015](https://discuss.elastic.co/u/zozo6015)\ **Replies:** 2\ **Last updated:** [March 18, 2020, 8:50pm UTC](https://discuss.elastic.co/t/kibana-scripted-fields-update-by-elasticsearch-query/224136 "2020-03-18T20:50:16Z")
Hello, I am wondering if it's possible to create a scripted field by subtracting a field value from the resulted from an elasticsearch query. Regards, Peter --- ## [Is there any way to know how much data are we pushing to an Index monthly?](https://discuss.elastic.co/t/is-there-any-way-to-know-how-much-data-are-we-pushing-to-an-index-monthly/223783)
**Author:** [@Chop](https://discuss.elastic.co/u/Chop)\ **Replies:** 4\ **Last updated:** [March 18, 2020, 8:32pm UTC](https://discuss.elastic.co/t/is-there-any-way-to-know-how-much-data-are-we-pushing-to-an-index-monthly/223783 "2020-03-18T20:32:37Z")
I wonder if there is any way to monitor how much data are we pushing to a specific index. i can see some information on the monitoring section but i dont think i can pull off the information i am looking for from there. … --- ## [Cluster flooded with random date index](https://discuss.elastic.co/t/cluster-flooded-with-random-date-index/222677)
**Author:** [@stack](https://discuss.elastic.co/u/stack)\ **Replies:** 6\ **Last updated:** [March 18, 2020, 8:30pm UTC](https://discuss.elastic.co/t/cluster-flooded-with-random-date-index/222677 "2020-03-18T20:30:48Z")
Hello, I've been deploying winlogbeat on many servers at the same time lately and it seem like one or more of them if provoking a bug that create lot of indexs with differents date stamp (my index defined as winlogbeat-… --- ## [Misconfigured instance or proxy (302 redirect loop)](https://discuss.elastic.co/t/misconfigured-instance-or-proxy-302-redirect-loop/221126)
**Author:** [@jbpratt](https://discuss.elastic.co/u/jbpratt)\ **Replies:** 11\ **Last updated:** [March 18, 2020, 7:49pm UTC](https://discuss.elastic.co/t/misconfigured-instance-or-proxy-302-redirect-loop/221126 "2020-03-18T19:49:57Z")
Hi! I am running into issues with my Kibana instance behind an Nginx reverse proxy. I have a very minimal Kibana config which could be an issue though it seems like I have what I need. That being said, I am quite sure … --- ## [Automating Upgrades for Agents/Clients](https://discuss.elastic.co/t/automating-upgrades-for-agents-clients/224183)
**Author:** [@bberesna](https://discuss.elastic.co/u/bberesna)\ **Replies:** 0\ **Last updated:** [March 18, 2020, 7:55pm UTC](https://discuss.elastic.co/t/automating-upgrades-for-agents-clients/224183 "2020-03-18T19:55:03Z")
I'm just wondering if there is some way to query for all attached agents. I'd like to generate a list of agents/servers for ansible so I can upgrade them all to their latest version. Or if someone has a better solution… --- ## [How to limited Result of Search in discoveory](https://discuss.elastic.co/t/how-to-limited-result-of-search-in-discoveory/220083)
**Author:** [@maddog](https://discuss.elastic.co/u/maddog)\ **Replies:** 1\ **Last updated:** [March 18, 2020, 7:30pm UTC](https://discuss.elastic.co/t/how-to-limited-result-of-search-in-discoveory/220083 "2020-03-18T19:30:03Z")
Hi All. In Kibana Version 7.4.1 i try to search data in discovery tab. i got the results but i need show it to dashboard but i have some problem. because i need to lock the result per pages in discovery display on dash… --- ## [Best practices: TransportError(429, 'circuit\_breaking\_exception', '\[parent\] Data too large, data for \[\\]](https://discuss.elastic.co/t/best-practices-transporterror-429-circuit-breaking-exception-parent-data-too-large-data-for-transport-request/224177)
**Author:** [@Rysiu](https://discuss.elastic.co/u/Rysiu)\ **Replies:** 0\ **Last updated:** [March 18, 2020, 7:24pm UTC](https://discuss.elastic.co/t/best-practices-transporterror-429-circuit-breaking-exception-parent-data-too-large-data-for-transport-request/224177 "2020-03-18T19:24:06Z")
Hi! With time, an error occurs more and more often on my server: elasticsearch.exceptions.TransportError: TransportError(429, 'circuit\_breaking\_exception', '\[parent\] Data too large, data for \[\\] woul… --- ## [Order of endpoints provided in the elasticsearch.hosts parameter](https://discuss.elastic.co/t/order-of-endpoints-provided-in-the-elasticsearch-hosts-parameter/220662)
**Author:** [@lcanas](https://discuss.elastic.co/u/lcanas)\ **Replies:** 1\ **Last updated:** [March 18, 2020, 7:09pm UTC](https://discuss.elastic.co/t/order-of-endpoints-provided-in-the-elasticsearch-hosts-parameter/220662 "2020-03-18T19:09:35Z")
Hi all, in order to have high availability in a small cluster we are deploying two nodes with Kibana in front of a 3 master/data nodes ES cluster. My plan is to add the three of them to the elasticsearch.hosts parameter… --- ## [No data has been received from this module yet](https://discuss.elastic.co/t/no-data-has-been-received-from-this-module-yet/221372)
**Author:** [@vijay.nageswaran](https://discuss.elastic.co/u/vijay.nageswaran)\ **Replies:** 2\ **Last updated:** [March 18, 2020, 6:52pm UTC](https://discuss.elastic.co/t/no-data-has-been-received-from-this-module-yet/221372 "2020-03-18T18:52:13Z")
Team, I have installed and configured Elasticsearch, Kibana, logstash, Filebeat in centos 7.7. I have configured the reverse proxy to load the kibana dashboard. The configurations which is showed in the logging for ngi… --- ## [Percolator Performance (ES 5.6)](https://discuss.elastic.co/t/percolator-performance-es-5-6/224173)
**Author:** [@dolphorama](https://discuss.elastic.co/u/dolphorama)\ **Replies:** 0\ **Last updated:** [March 18, 2020, 6:44pm UTC](https://discuss.elastic.co/t/percolator-performance-es-5-6/224173 "2020-03-18T18:44:13Z")
Hi, Since moving from 2.x to 5.6 we have seen a drastic increase in overall query time, and one the biggest culprits is percolation. After some research, I've been looking at the "query.extraction\_result" : "failed" co… --- ## [Правильная конфигурация кластера](https://discuss.elastic.co/t/topic/224144)
**Author:** [@vmatviichuk](https://discuss.elastic.co/u/vmatviichuk)\ **Replies:** 1\ **Last updated:** [March 18, 2020, 6:30pm UTC](https://discuss.elastic.co/t/topic/224144 "2020-03-18T18:30:06Z")
Всем привет. Имеется кластер elasticsearch с 9 дата нодами и 3 мастер ноды. Все они крутятся в кубернетесе. Последнее время начались проблемы с производительностью. имеется данных порядка 5 терабайт. Мой вопрос, как … --- ## [Logstash logging behind in consuming data from kinesis stream](https://discuss.elastic.co/t/logstash-logging-behind-in-consuming-data-from-kinesis-stream/224171)
**Author:** [@asrinivasan](https://discuss.elastic.co/u/asrinivasan)\ **Replies:** 0\ **Last updated:** [March 18, 2020, 6:26pm UTC](https://discuss.elastic.co/t/logstash-logging-behind-in-consuming-data-from-kinesis-stream/224171 "2020-03-18T18:26:24Z")
Hi I have a setup with 4 logstash servers , they are configured with kinesis input plugin, I wanted to check if i can have multiple conf's on each logstash for the same kinesis stream. so lets say 2 per logstash so will… --- ## [Parsing json nested in json from log firehose](https://discuss.elastic.co/t/parsing-json-nested-in-json-from-log-firehose/223593)
**Author:** [@Drob](https://discuss.elastic.co/u/Drob)\ **Replies:** 2\ **Last updated:** [March 18, 2020, 6:22pm UTC](https://discuss.elastic.co/t/parsing-json-nested-in-json-from-log-firehose/223593 "2020-03-18T18:22:04Z")
Example Log: \<6\> 2020-03-13T21:20:46Z aea1b92e-07fe-4e21-7684-7f94 doppler\[17\]: {"cf\_app\_id":"174545fd-aee6-4d7c-819c-6c94cdf3b68c", "cf\_app\_name":"cobra-inbound-read-api", "cf\_org\_id":"eb84d2e9-e049-45c3-9a08-a776662b… --- ## [An election requires a node with id \[STALE\_STATE\_CONFIG\]](https://discuss.elastic.co/t/an-election-requires-a-node-with-id-stale-state-config/224146)
**Author:** [@admidelu](https://discuss.elastic.co/u/admidelu)\ **Replies:** 1\ **Last updated:** [March 18, 2020, 6:19pm UTC](https://discuss.elastic.co/t/an-election-requires-a-node-with-id-stale-state-config/224146 "2020-03-18T18:19:00Z")
Hey, can't seem to form a cluster using defaults, logs: {"type": "server", "timestamp": "2020-03-18T14:54:03,323Z", "level": "WARN", "component": "o.e.c.c.ClusterFormationFailureHelper", "cluster.name": "ig-cluster", "n… --- ## [Kibana - Method not Allowed](https://discuss.elastic.co/t/kibana-method-not-allowed/220443)
**Author:** [@andreluizpr](https://discuss.elastic.co/u/andreluizpr)\ **Replies:** 2\ **Last updated:** [March 18, 2020, 6:18pm UTC](https://discuss.elastic.co/t/kibana-method-not-allowed/220443 "2020-03-18T18:18:19Z")
Hello everyone I'm starting now with ELK. I installed my environment on a lightsail server on AWS and it has the following configuration: CentOS 7.7.1908 Elasticsearch 7.6.0 - Release 1 Kibana 7.6.0 - Release 1 Logs… --- ## [Search all fields in elastic 7.x from 5.x](https://discuss.elastic.co/t/search-all-fields-in-elastic-7-x-from-5-x/224167)
**Author:** [@Sundeep\_Dangol](https://discuss.elastic.co/u/Sundeep_Dangol)\ **Replies:** 0\ **Last updated:** [March 18, 2020, 6:10pm UTC](https://discuss.elastic.co/t/search-all-fields-in-elastic-7-x-from-5-x/224167 "2020-03-18T18:10:23Z")
Hi we are migrating from Elastic 5.x to 7.x. And one of the breaking changes is the removal of \_all field in match query. Previous query looks like below where its doing search on all fields. v 5.x GET /my\_index/\_s… --- ## [Not able to create index pattern in Kibana](https://discuss.elastic.co/t/not-able-to-create-index-pattern-in-kibana/222326)
**Author:** [@Natarajan](https://discuss.elastic.co/u/Natarajan)\ **Replies:** 2\ **Last updated:** [March 18, 2020, 6:03pm UTC](https://discuss.elastic.co/t/not-able-to-create-index-pattern-in-kibana/222326 "2020-03-18T18:03:23Z")
I am able to see the indices created in EL with 'Index Management' menu in Kibana. But I am not able to see the indices in 'Create Index Pattern'. Elastic Version = 6.8.6 Kibana version = 6.8.6 [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1562) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1564)