# Latest **URL:** https://discuss.elastic.co/latest.md?page=1403 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1404 --- ## [Filebeat isn't keeping up with our logs](https://discuss.elastic.co/t/filebeat-isnt-keeping-up-with-our-logs/288398)
**Author:** [@mikewillis](https://discuss.elastic.co/u/mikewillis)\ **Replies:** 0\ **Last updated:** [November 4, 2021, 11:03am UTC](https://discuss.elastic.co/t/filebeat-isnt-keeping-up-with-our-logs/288398 "2021-11-04T11:03:33Z")
Filebeat 6.8.20 running on CentOS 7.9 We're using Filebeat to send some logs to our Elasticsearch cluster (by way of Logstash and a Kafka layer which provides retention in case of cluster downtime) and as the data volum… --- ## [Problème : Logs reçus, mais ne s'affichent pas dans le dashboard](https://discuss.elastic.co/t/probleme-logs-recus-mais-ne-saffichent-pas-dans-le-dashboard/288310)
**Author:** [@PapyMouzzo](https://discuss.elastic.co/u/PapyMouzzo)\ **Replies:** 4\ **Last updated:** [November 4, 2021, 10:57am UTC](https://discuss.elastic.co/t/probleme-logs-recus-mais-ne-saffichent-pas-dans-le-dashboard/288310 "2021-11-04T10:57:00Z")
Bonjour, Alors voici mon problème, j'ai une machine "serveur" hébergeant Elasticsearch, Kibana ainsi que Filebeat. Je reçois bien les logs de cette dernière et j'arrive à exploiter les logs dans un dashboard. Je souha… --- ## [EQL Sequence and elapsed time calculation](https://discuss.elastic.co/t/eql-sequence-and-elapsed-time-calculation/288101)
**Author:** [@Iriana\_Arguedas](https://discuss.elastic.co/u/Iriana_Arguedas)\ **Replies:** 1\ **Last updated:** [November 4, 2021, 10:39am UTC](https://discuss.elastic.co/t/eql-sequence-and-elapsed-time-calculation/288101 "2021-11-04T10:39:20Z")
With EQL is easy to identify when a process was executed/started and when it did finish. Is there a way to calculate the elapsed time of the execution inside the EQL query? Or is it better to use an external tool to pr… --- ## [Collapse performance with heavy operations](https://discuss.elastic.co/t/collapse-performance-with-heavy-operations/288085)
**Author:** [@DrParanoia](https://discuss.elastic.co/u/DrParanoia)\ **Replies:** 11\ **Last updated:** [November 4, 2021, 10:11am UTC](https://discuss.elastic.co/t/collapse-performance-with-heavy-operations/288085 "2021-11-04T10:11:30Z")
DISCLAIMER: I am relatively new to Elasticsearch, so I apologize in case my question is too "basic" or falls into "everybody should know this" category :smile: Hi! I have a performance question. Let's say, we have this … --- ## [Elasticsearch log "level": "WARN" "component": "r.suppressed" "message": "path: /\_prometheus/metrics, params: {}"](https://discuss.elastic.co/t/elasticsearch-log-level-warn-component-r-suppressed-message-path-prometheus-metrics-params/288394)
**Author:** [@Farzad\_Ebrahimi](https://discuss.elastic.co/u/Farzad_Ebrahimi)\ **Replies:** 0\ **Last updated:** [November 4, 2021, 9:04am UTC](https://discuss.elastic.co/t/elasticsearch-log-level-warn-component-r-suppressed-message-path-prometheus-metrics-params/288394 "2021-11-04T09:04:11Z")
Hi everyone, i have one node Elasticsearch:7.12.0 in docker with this configs: environment: - bootstrap.memory\_lock=true - "ES\_JAVA\_OPTS=-Xms31G -Xmx31G" - cluster.routing.allocation.disk.threshold\_enabled=… --- ## [Manually import data from indices folder](https://discuss.elastic.co/t/manually-import-data-from-indices-folder/288388)
**Author:** [@Tojo\_Rakotoarimanana](https://discuss.elastic.co/u/Tojo_Rakotoarimanana)\ **Replies:** 5\ **Last updated:** [November 4, 2021, 8:59am UTC](https://discuss.elastic.co/t/manually-import-data-from-indices-folder/288388 "2021-11-04T08:59:35Z")
Hello all, For unknown reason, our index was deleted automatically. we have a backup but just the folder in path.data, no snapshot. is there any tricky method to import index from this backup? thanks --- ## [Adding a new translation to Kibana and distribute it](https://discuss.elastic.co/t/adding-a-new-translation-to-kibana-and-distribute-it/287185)
**Author:** [@nkatsaounos](https://discuss.elastic.co/u/nkatsaounos)\ **Replies:** 2\ **Last updated:** [November 4, 2021, 8:52am UTC](https://discuss.elastic.co/t/adding-a-new-translation-to-kibana-and-distribute-it/287185 "2021-11-04T08:52:05Z")
Hello, I have started localization Kibana to greek language. I made my experiments in an Ubuntu20.04 system. I made the following changes after cloning development code from kibana repo: extracted en.json file via no… --- ## [How to filter with pipeline aggregations in all aggregated results](https://discuss.elastic.co/t/how-to-filter-with-pipeline-aggregations-in-all-aggregated-results/288340)
**Author:** [@elina](https://discuss.elastic.co/u/elina)\ **Replies:** 0\ **Last updated:** [November 3, 2021, 3:12pm UTC](https://discuss.elastic.co/t/how-to-filter-with-pipeline-aggregations-in-all-aggregated-results/288340 "2021-11-03T15:12:52Z")
Hi! I'm working on a project with elasticseach. I'am stuck with the below problem. I can't figure this out no matter what I have tried so far. Firstly, I would like to group by "keyword" in buckets using the terms aggre… --- ## [Elastic 2.4 Compatibility matrix](https://discuss.elastic.co/t/elastic-2-4-compatibility-matrix/288307)
**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\ **Replies:** 4\ **Last updated:** [November 4, 2021, 8:20am UTC](https://discuss.elastic.co/t/elastic-2-4-compatibility-matrix/288307 "2021-11-04T08:20:40Z")
hey there, is there a link to a compatibility matrix related to Elasticsearch 2.4? I know its EOL, I would like to know any compatibility with Java, OS and so on.... thanks --- ## [Importing data to elasticsearch from multiple dynamic databases](https://discuss.elastic.co/t/importing-data-to-elasticsearch-from-multiple-dynamic-databases/288317)
**Author:** [@enricog84](https://discuss.elastic.co/u/enricog84)\ **Replies:** 2\ **Last updated:** [November 4, 2021, 8:31am UTC](https://discuss.elastic.co/t/importing-data-to-elasticsearch-from-multiple-dynamic-databases/288317 "2021-11-04T08:31:37Z")
Hi, I am currently evaluating (and have no further experience so far) the ELK stack. I am wondering if it would be possible to import data from multiple dynamic created MariaDB databases into Elasticsearch. Short back… --- ## [Technicality on throughput-based cluster sizing](https://discuss.elastic.co/t/technicality-on-throughput-based-cluster-sizing/288346)
**Author:** [@AlessandroKP](https://discuss.elastic.co/u/AlessandroKP)\ **Replies:** 2\ **Last updated:** [November 4, 2021, 8:27am UTC](https://discuss.elastic.co/t/technicality-on-throughput-based-cluster-sizing/288346 "2021-11-04T08:27:26Z")
Hello, I have a question about sizing an Elasticsearch cluster based on throughput. I'm following this webinar: Elasticsearch sizing and capacity planning. If I understood correctly, the throughput-based sizing method… --- ## [Metricbeat Logstash module payload size](https://discuss.elastic.co/t/metricbeat-logstash-module-payload-size/287247)
**Author:** [@admlko](https://discuss.elastic.co/u/admlko)\ **Replies:** 1\ **Last updated:** [November 4, 2021, 7:49am UTC](https://discuss.elastic.co/t/metricbeat-logstash-module-payload-size/287247 "2021-11-04T07:49:57Z")
Hi, I opened a ticket about this issue in the github, but it got closed and the issue was redirected here: https://github.com/elastic/beats/issues/28569 It is my understanding that the Logstash UDP output plugin doesn'… --- ## [Permite vega imagenes en base64](https://discuss.elastic.co/t/permite-vega-imagenes-en-base64/287936)
**Author:** [@EduardoM](https://discuss.elastic.co/u/EduardoM)\ **Replies:** 2\ **Last updated:** [November 4, 2021, 7:47am UTC](https://discuss.elastic.co/t/permite-vega-imagenes-en-base64/287936 "2021-11-04T07:47:30Z")
Hola a todos, seria muy valoroso si alguien me puediera ayudar con vega, he visto que funciona de cierta manera al utilizar imagenes codificadas en base64, vega realamente lo permite. tengo un ejemplo pero no veo nngun… --- ## [ElasticSearch relational data](https://discuss.elastic.co/t/elasticsearch-relational-data/288387)
**Author:** [@muhammadahmad](https://discuss.elastic.co/u/muhammadahmad)\ **Replies:** 0\ **Last updated:** [November 4, 2021, 7:31am UTC](https://discuss.elastic.co/t/elasticsearch-relational-data/288387 "2021-11-04T07:31:11Z")
Hello , I need some help in managing following data, for example , I have five entities A, B, C, D ,E A has one to many relation with B, B has one to many relation with C, C has One to many relation with D, D has … --- ## [How to access logstash keystore in jvm.options?](https://discuss.elastic.co/t/how-to-access-logstash-keystore-in-jvm-options/287906)
**Author:** [@bhargaviaaa](https://discuss.elastic.co/u/bhargaviaaa)\ **Replies:** 4\ **Last updated:** [November 4, 2021, 5:31am UTC](https://discuss.elastic.co/t/how-to-access-logstash-keystore-in-jvm-options/287906 "2021-11-04T05:31:38Z")
Please provide example to access logstash keystore in jvm.options. --- ## [Warm indices is not compressed](https://discuss.elastic.co/t/warm-indices-is-not-compressed/288288)
**Author:** [@alfianaf](https://discuss.elastic.co/u/alfianaf)\ **Replies:** 18\ **Last updated:** [November 4, 2021, 4:59am UTC](https://discuss.elastic.co/t/warm-indices-is-not-compressed/288288 "2021-11-04T04:59:44Z")
I read on elastic documentation that warm phase could reduce index size, but it didn't state clearly how much index will be compressed on warm phase. It is stated that warm phase also have shrink and force merge featur… --- ## [(Issue) Logstash JDBC Input Plugin seems to be changing datetime column value's at output](https://discuss.elastic.co/t/issue-logstash-jdbc-input-plugin-seems-to-be-changing-datetime-column-values-at-output/288353)
**Author:** [@GPartenza](https://discuss.elastic.co/u/GPartenza)\ **Replies:** 4\ **Last updated:** [November 4, 2021, 3:20am UTC](https://discuss.elastic.co/t/issue-logstash-jdbc-input-plugin-seems-to-be-changing-datetime-column-values-at-output/288353 "2021-11-04T03:20:48Z")
Hello, I have an SQLite database where new data is written every second. Currently, I am using Logstash and its JDBC plugin to read the data in real-time and ship it to Elasticsearch for visualization. Everything is wor… --- ## [How to identify the errors reported by logstash?](https://discuss.elastic.co/t/how-to-identify-the-errors-reported-by-logstash/288283)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 5\ **Last updated:** [November 4, 2021, 3:05am UTC](https://discuss.elastic.co/t/how-to-identify-the-errors-reported-by-logstash/288283 "2021-11-04T03:05:33Z")
I can't understand where is the error? Who can share how to quickly identify the specific location of the error? input { elasticsearch { hosts =\> \["192.168.10.141:9200"\] index =\> "apm-\*-error-\*" query =\> '{ "query… --- ## [Cluster restore with security on - with what users..?](https://discuss.elastic.co/t/cluster-restore-with-security-on-with-what-users/288292)
**Author:** [@raulk89](https://discuss.elastic.co/u/raulk89)\ **Replies:** 2\ **Last updated:** [November 4, 2021, 1:14am UTC](https://discuss.elastic.co/t/cluster-restore-with-security-on-with-what-users/288292 "2021-11-04T01:14:34Z")
Hi Elastic 7.15 My question is. When security is on, whenever I need to restore data to a new cluster, then how I am supposed to do that..? I mean, I install necessary packages, replace all the configuration files, th… --- ## [Gz file handling by interaction as XML files](https://discuss.elastic.co/t/gz-file-handling-by-interaction-as-xml-files/288002)
**Author:** [@INS](https://discuss.elastic.co/u/INS)\ **Replies:** 6\ **Last updated:** [November 4, 2021, 1:09am UTC](https://discuss.elastic.co/t/gz-file-handling-by-interaction-as-xml-files/288002 "2021-11-04T01:09:42Z")
Hi How Can I configure input for reading per only one file. It is very important that logstash reads one file at a time as soon as it finishes parsing it and reads another one. This is related to the xml structure. I h… --- ## [Protecting Kibana on the Internet](https://discuss.elastic.co/t/protecting-kibana-on-the-internet/288308)
**Author:** [@tsousahs](https://discuss.elastic.co/u/tsousahs)\ **Replies:** 2\ **Last updated:** [November 4, 2021, 12:45am UTC](https://discuss.elastic.co/t/protecting-kibana-on-the-internet/288308 "2021-11-04T00:45:37Z")
Hello, We are thinking in putting our Kibana instance publicly, base on client IP Address, on the Internet to give access to it to our customers. Is Kibana sufficiently secure to be putted on the Internet? Do you recom… --- ## [Clone index API vs. Scan and Scroll API](https://discuss.elastic.co/t/clone-index-api-vs-scan-and-scroll-api/288311)
**Author:** [@madshov](https://discuss.elastic.co/u/madshov)\ **Replies:** 1\ **Last updated:** [November 4, 2021, 12:13am UTC](https://discuss.elastic.co/t/clone-index-api-vs-scan-and-scroll-api/288311 "2021-11-04T00:13:12Z")
Hi, What's the better way to create a clone of my index for reindex purposes? Use the clone API or the scroll API and then bulk index? What are the pro and cons of each method? --- ## [Access from the Local Network](https://discuss.elastic.co/t/access-from-the-local-network/288351)
**Author:** [@SteveP](https://discuss.elastic.co/u/SteveP)\ **Replies:** 5\ **Last updated:** [November 4, 2021, 12:10am UTC](https://discuss.elastic.co/t/access-from-the-local-network/288351 "2021-11-04T00:10:29Z")
I have a one node Elasticsearch server that is sitting on 192.168.30.6. I would like a number of devices, on different local subnets to be able to hit this server on port 9200. I have my Elasticsearch.yml configured so t… --- ## [Old Elasticsearch Plugin location](https://discuss.elastic.co/t/old-elasticsearch-plugin-location/288368)
**Author:** [@Edgar1](https://discuss.elastic.co/u/Edgar1)\ **Replies:** 2\ **Last updated:** [November 4, 2021, 12:06am UTC](https://discuss.elastic.co/t/old-elasticsearch-plugin-location/288368 "2021-11-04T00:06:10Z")
I'm trying to find old plugins for the 2.x.x version of Elasticsearch. Specifically I'm looking for the repository-s3 plugin. I tried using the command sudo bin/elasticsearch-plugin install repository-s3 and sudo bin/plu… --- ## [Kibana dashboard table without aggregation](https://discuss.elastic.co/t/kibana-dashboard-table-without-aggregation/287968)
**Author:** [@111505](https://discuss.elastic.co/u/111505)\ **Replies:** 5\ **Last updated:** [November 3, 2021, 4:54am UTC](https://discuss.elastic.co/t/kibana-dashboard-table-without-aggregation/287968 "2021-11-03T04:54:09Z")
Hello. I want to create a Data Table similar to Discover Tab in Kibana's Dashobard, but I can not find a way. Do not have a way to create a table that only shows Data without aggregation? --- ## [Elastic Agents 7.15 - Not sending data](https://discuss.elastic.co/t/elastic-agents-7-15-not-sending-data/288342)
**Author:** [@Trinity\_Rolling](https://discuss.elastic.co/u/Trinity_Rolling)\ **Replies:** 0\ **Last updated:** [November 3, 2021, 3:29pm UTC](https://discuss.elastic.co/t/elastic-agents-7-15-not-sending-data/288342 "2021-11-03T15:29:28Z")
Initial installation and setup of the server and agents was successful. I was troubleshooting some issues with the APM Agents not sending data to the server and broke all Fleet and agents. I attempt to undo what I had … --- ## [No data has been received from Functionbeat yet](https://discuss.elastic.co/t/no-data-has-been-received-from-functionbeat-yet/288378)
**Author:** [@spo](https://discuss.elastic.co/u/spo)\ **Replies:** 0\ **Last updated:** [November 3, 2021, 11:52pm UTC](https://discuss.elastic.co/t/no-data-has-been-received-from-functionbeat-yet/288378 "2021-11-03T23:52:56Z")
Hi, I have installed and configured functionbeat on the elk server. Installation and configuration was successful but unable to pull logs on kibana. functionbeat.yml : functionbeat.provider.aws.endpoint: "s3.amazona… --- ## ["all shards failed"](https://discuss.elastic.co/t/all-shards-failed/288230)
**Author:** [@mmuzammil45](https://discuss.elastic.co/u/mmuzammil45)\ **Replies:** 3\ **Last updated:** [November 3, 2021, 11:44pm UTC](https://discuss.elastic.co/t/all-shards-failed/288230 "2021-11-03T23:44:14Z")
I am indexing nested JSON object. The issue is when the number of fields in the object approached to 1200, it started giving the error "all shards failed". I have tried multiple solutions but nothing has worked so far.… --- ## [Add a field from one grok match to another](https://discuss.elastic.co/t/add-a-field-from-one-grok-match-to-another/288246)
**Author:** [@mwas](https://discuss.elastic.co/u/mwas)\ **Replies:** 2\ **Last updated:** [November 3, 2021, 11:38pm UTC](https://discuss.elastic.co/t/add-a-field-from-one-grok-match-to-another/288246 "2021-11-03T23:38:14Z")
I've got log that starts with a jobid on our build cluster live following: "Job \<7073381\> is submitted to queue " I'd like to extract the job id from that line and add it to all other matched lines that look like this: … --- ## [Dependencies don't show up in APM](https://discuss.elastic.co/t/dependencies-dont-show-up-in-apm/288244)
**Author:** [@Willie\_Abrams](https://discuss.elastic.co/u/Willie_Abrams)\ **Replies:** 5\ **Last updated:** [November 3, 2021, 11:15pm UTC](https://discuss.elastic.co/t/dependencies-dont-show-up-in-apm/288244 "2021-11-03T23:15:42Z")
I have an app running in Cloud Run that I am profiling with Elastic APM. I get transaction level data, all the normal APM stuff you see on the Overview page. Transactions are populated. I get Trace samples. I click on a … [Previous page](https://discuss.elastic.co/latest.md?page=1402) [Next page](https://discuss.elastic.co/latest.md?page=1404)