# Latest **URL:** https://discuss.elastic.co/latest.md?page=1620 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1621 --- ## [Filebeat \> Kafka \> ES \> Kibana](https://discuss.elastic.co/t/filebeat-kafka-es-kibana/275995)
**Author:** [@Robsen\_Inc](https://discuss.elastic.co/u/Robsen_Inc)\ **Replies:** 3\ **Last updated:** [June 16, 2021, 9:05am UTC](https://discuss.elastic.co/t/filebeat-kafka-es-kibana/275995 "2021-06-16T09:05:39Z")
Hi folks, I have a question regarding the Filebeat configuration. Because if I send the syslog data (with the syslog module) directly from Filebeat to Elasticsearch, the ready dashboard works (from the tutorial, see pic… --- ## [How to create autoincremented Id (integer) in Elasticsearch?](https://discuss.elastic.co/t/how-to-create-autoincremented-id-integer-in-elasticsearch/276108)
**Author:** [@zeusfsx](https://discuss.elastic.co/u/zeusfsx)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 8:53am UTC](https://discuss.elastic.co/t/how-to-create-autoincremented-id-integer-in-elasticsearch/276108 "2021-06-16T08:53:06Z")
Hi, I\`m interested in how to create autoincremented Id (integer) in Elasticsearch, or maybe someone knows how to create autoincrement field with the script when added a new document into the index? --- ## [Jdbc\_streaming parameters on From](https://discuss.elastic.co/t/jdbc-streaming-parameters-on-from/276104)
**Author:** [@charles97](https://discuss.elastic.co/u/charles97)\ **Replies:** 0\ **Last updated:** [June 16, 2021, 8:29am UTC](https://discuss.elastic.co/t/jdbc-streaming-parameters-on-from/276104 "2021-06-16T08:29:37Z")
I've seen documentation about using parameters as statement =\> "select \* from WORLD.COUNTRY WHERE Code = :code" parameters =\> { "code" =\> "country\_code"} But I'm in situation where I have 9 different cases and … --- ## [CSV reports](https://discuss.elastic.co/t/csv-reports/275796)
**Author:** [@Andrejs\_G](https://discuss.elastic.co/u/Andrejs_G)\ **Replies:** 2\ **Last updated:** [June 16, 2021, 8:15am UTC](https://discuss.elastic.co/t/csv-reports/275796 "2021-06-16T08:15:57Z")
Hi, I'm new in Elasticsearch, don't know if it is some kind bug or just need to enable something. Problem is that when I generate CSV file it always contains only one row, doesn't mater if I want to export search with 20… --- ## [Filebeat - Saving what files Filebeat has Processed in ES](https://discuss.elastic.co/t/filebeat-saving-what-files-filebeat-has-processed-in-es/276097)
**Author:** [@scott\_stash](https://discuss.elastic.co/u/scott_stash)\ **Replies:** 0\ **Last updated:** [June 16, 2021, 8:03am UTC](https://discuss.elastic.co/t/filebeat-saving-what-files-filebeat-has-processed-in-es/276097 "2021-06-16T08:03:25Z")
I have a system setup where log files in a folder are processed by FB-\> LS -ES, once they are processed some reports/scripts are ran for the data in ES and the output is sent to a user. To accomplish this I have written… --- ## [Logstash filter jdbc\_streaming : JDBC:AdapterNotFound: Could not load jdbc/mssql adapter: adapter class not registered in ADAPTER\_MAP\>](https://discuss.elastic.co/t/logstash-filter-jdbc-streaming-jdbc-could-not-load-jdbc-mssql-adapter-adapter-class-not-registered-in-adapter-map/275546)
**Author:** [@charles97](https://discuss.elastic.co/u/charles97)\ **Replies:** 7\ **Last updated:** [June 16, 2021, 8:00am UTC](https://discuss.elastic.co/t/logstash-filter-jdbc-streaming-jdbc-could-not-load-jdbc-mssql-adapter-adapter-class-not-registered-in-adapter-map/275546 "2021-06-16T08:00:13Z")
I'm trying to use logstash filter plugin jdbc\_streaming, my logstash version is 7.13 OS centos 7 openjdk 11.0.11 2021-04-20 LTS jdbc 6.0 : "/home/jdbc/sqljdbc\_6.0/enu/jre7/sqljdbc41.jar" my logstash config input {… --- ## [Auditbeat Process Dashboard](https://discuss.elastic.co/t/auditbeat-process-dashboard/276077)
**Author:** [@yango](https://discuss.elastic.co/u/yango)\ **Replies:** 0\ **Last updated:** [June 16, 2021, 4:22am UTC](https://discuss.elastic.co/t/auditbeat-process-dashboard/276077 "2021-06-16T04:22:46Z")
I am using auditbeat 7.10.2 OSS, only modules included in auditbeat.yml are audited and file\_integrity. I need to analyze processes and login events, is it possible to add other modules? If yes, how? --- ## [How to export a scripted field in the elasticsearch-output-plugin](https://discuss.elastic.co/t/how-to-export-a-scripted-field-in-the-elasticsearch-output-plugin/276091)
**Author:** [@fidsamurai](https://discuss.elastic.co/u/fidsamurai)\ **Replies:** 0\ **Last updated:** [June 16, 2021, 7:12am UTC](https://discuss.elastic.co/t/how-to-export-a-scripted-field-in-the-elasticsearch-output-plugin/276091 "2021-06-16T07:12:42Z")
I've written a scripted field to standardise and create a shorthand for URLs. However from what I understood in the docs we can't use it as a keyword field, also it works only on Kibana and not if I try and get data dir… --- ## [Kibana upgrade from 7.12.0 to 7.13.1 is failing](https://discuss.elastic.co/t/kibana-upgrade-from-7-12-0-to-7-13-1-is-failing/275680)
**Author:** [@Vincent\_Uribe](https://discuss.elastic.co/u/Vincent_Uribe)\ **Replies:** 8\ **Last updated:** [June 16, 2021, 6:19am UTC](https://discuss.elastic.co/t/kibana-upgrade-from-7-12-0-to-7-13-1-is-failing/275680 "2021-06-16T06:19:01Z")
Hi, I have been trying to upgrade kibana for a few days ow and it does not work. I have the following error : {"type":"log","@timestamp":"2021-06-11T10:10:39+00:00","tags":\["info","savedobjects-service"\],"pid":27709,"m… --- ## [Exception in pipelineworker, the pipeline stopped processing new events, please check your filter configuration and restart Logstash. {:pipeline\_id=\>"main", "exception"=\>"no implicit conversion to rational from nil"](https://discuss.elastic.co/t/exception-in-pipelineworker-the-pipeline-stopped-processing-new-events-please-check-your-filter-configuration-and-restart-logstash-pipeline-id-main-exception-no-implicit-conversion-to-rational-from-nil/275370)
**Author:** [@AmitC](https://discuss.elastic.co/u/AmitC)\ **Replies:** 6\ **Last updated:** [June 16, 2021, 6:00am UTC](https://discuss.elastic.co/t/exception-in-pipelineworker-the-pipeline-stopped-processing-new-events-please-check-your-filter-configuration-and-restart-logstash-pipeline-id-main-exception-no-implicit-conversion-to-rational-from-nil/275370 "2021-06-16T06:00:14Z")
Logstash Version : 6.1.1 Exception in pipelineworker, the pipeline stopped processing new events, please check your filter configuration and restart Logstash. {:pipeline\_id=\>"main", "exception"=\>"no implicit conversion… --- ## [Using Windows AD Authentication With NEST](https://discuss.elastic.co/t/using-windows-ad-authentication-with-nest/276085)
**Author:** [@abushokry](https://discuss.elastic.co/u/abushokry)\ **Replies:** 0\ **Last updated:** [June 16, 2021, 5:58am UTC](https://discuss.elastic.co/t/using-windows-ad-authentication-with-nest/276085 "2021-06-16T05:58:26Z")
Hi All, I'm trying to use the NEST .net Client to connect to elastic search using the identity of the App Pool account. i.e. without Basic Auth nor API Keys. I'm unable to find a way to get that done. Generally, when de… --- ## [One configuration file (single pipeline) or mutiple configuration files (various pipelines)?](https://discuss.elastic.co/t/one-configuration-file-single-pipeline-or-mutiple-configuration-files-various-pipelines/276080)
**Author:** [@riahc3](https://discuss.elastic.co/u/riahc3)\ **Replies:** 0\ **Last updated:** [June 16, 2021, 5:40am UTC](https://discuss.elastic.co/t/one-configuration-file-single-pipeline-or-mutiple-configuration-files-various-pipelines/276080 "2021-06-16T05:40:06Z")
Hello Currently I have multiple configuration files, each listening on their own port and with their filters. Would it be better to merge it all in one and using conditionals, filter out, do transformations needed and … --- ## [Sort doesn't work with delete by query](https://discuss.elastic.co/t/sort-doesnt-work-with-delete-by-query/276074)
**Author:** [@Deepti](https://discuss.elastic.co/u/Deepti)\ **Replies:** 2\ **Last updated:** [June 16, 2021, 5:33am UTC](https://discuss.elastic.co/t/sort-doesnt-work-with-delete-by-query/276074 "2021-06-16T05:33:01Z")
Iam trying to delete the oldest document in the alias by using sort ,but this deletes all the documents that matches the query. Is sort not supported by delete by query? Is there any other option to use in the delete by… --- ## [Kibana shows sometimes 503 license not available (due to timeout after 30000ms)](https://discuss.elastic.co/t/kibana-shows-sometimes-503-license-not-available-due-to-timeout-after-30000ms/274726)
**Author:** [@Anatolij](https://discuss.elastic.co/u/Anatolij)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 5:24am UTC](https://discuss.elastic.co/t/kibana-shows-sometimes-503-license-not-available-due-to-timeout-after-30000ms/274726 "2021-06-16T05:24:06Z")
Hello, I already saw a few errors about 503 license not available. But none of these matched my error. I only see the 503 license not available randomly on a few requests. Sometimes i have to wait the 30000ms loading t… --- ## [Error Loading Data - Authorization Exception (Kibana dashboard)](https://discuss.elastic.co/t/error-loading-data-authorization-exception-kibana-dashboard/274916)
**Author:** [@Sandun\_Akalanka](https://discuss.elastic.co/u/Sandun_Akalanka)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 5:07am UTC](https://discuss.elastic.co/t/error-loading-data-authorization-exception-kibana-dashboard/274916 "2021-06-16T05:07:26Z")
I have a Kibana dashboard inside an AWS ElasticSearch domain (which includes both ES and Kibana). It used to work fine, until a few days ago. I have been receiving this warning message whenever I try to view data on Kiba… --- ## [When I set up the template file and used logstash to create the index, I got an error](https://discuss.elastic.co/t/when-i-set-up-the-template-file-and-used-logstash-to-create-the-index-i-got-an-error/275913)
**Author:** [@Masanori\_Mishima](https://discuss.elastic.co/u/Masanori_Mishima)\ **Replies:** 6\ **Last updated:** [June 16, 2021, 4:25am UTC](https://discuss.elastic.co/t/when-i-set-up-the-template-file-and-used-logstash-to-create-the-index-i-got-an-error/275913 "2021-06-16T04:25:11Z")
The execution environment is shown below. I would like to create an index by specifying mapping in a json file with index template set from logstash. How can I do this? logstash-7.13.0 Settings in the conf file inpu… --- ## [Delete from read indexes](https://discuss.elastic.co/t/delete-from-read-indexes/275919)
**Author:** [@Deepti](https://discuss.elastic.co/u/Deepti)\ **Replies:** 11\ **Last updated:** [June 16, 2021, 3:45am UTC](https://discuss.elastic.co/t/delete-from-read-indexes/275919 "2021-06-16T03:45:30Z")
Hello, I have a current write index and multiple read indexes .Is it possible to delete the documents from only the read indexes? Document with same ID will be present in both read and write index but I want the documen… --- ## [Decrease query delay time in ML jobs](https://discuss.elastic.co/t/decrease-query-delay-time-in-ml-jobs/276058)
**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\ **Replies:** 2\ **Last updated:** [June 16, 2021, 2:13am UTC](https://discuss.elastic.co/t/decrease-query-delay-time-in-ml-jobs/276058 "2021-06-16T02:13:40Z")
Hi, I get data from a database using logstash every 5 minutes. my bucket span is 15 minutes, and, because I was missing documents in the datafeed of the job, my query delay is 23 minutes. What would you recomend to decr… --- ## [Just tried out ELK stack v7.13 but found two issues](https://discuss.elastic.co/t/just-tried-out-elk-stack-v7-13-but-found-two-issues/276068)
**Author:** [@vincetai](https://discuss.elastic.co/u/vincetai)\ **Replies:** 7\ **Last updated:** [June 16, 2021, 1:57am UTC](https://discuss.elastic.co/t/just-tried-out-elk-stack-v7-13-but-found-two-issues/276068 "2021-06-16T01:57:13Z")
I moved from ELK v6.8.16 to ELK v7.13.2 and found the following issues: - In v6.8.16, when I removed a namespace, Kibana could show such event but it is not happening in v7.13.2 The navigation on Kibana web is faster i… --- ## [Will adding filters make visualizations more responsive?](https://discuss.elastic.co/t/will-adding-filters-make-visualizations-more-responsive/276067)
**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\ **Replies:** 2\ **Last updated:** [June 16, 2021, 1:21am UTC](https://discuss.elastic.co/t/will-adding-filters-make-visualizations-more-responsive/276067 "2021-06-16T01:21:57Z")
We have a visualization where we are using the term aggregation. Suppose there are 10000 records in the source index and out of that 1000 records have the field on which we will be doing term aggregration. I am just won… --- ## [Snapshot Repository Error](https://discuss.elastic.co/t/snapshot-repository-error/275618)
**Author:** [@leemase004](https://discuss.elastic.co/u/leemase004)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 12:36am UTC](https://discuss.elastic.co/t/snapshot-repository-error/275618 "2021-06-16T00:36:11Z")
We are attempting to run a snapshot (and/or view the snapshots of the repo) and we keep getting an error. The error reads as follow: Could not read repository data because the contents of the repository do not match its… --- ## [Apply an ILM policy to all indices in cluster](https://discuss.elastic.co/t/apply-an-ilm-policy-to-all-indices-in-cluster/275553)
**Author:** [@elk11](https://discuss.elastic.co/u/elk11)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 12:35am UTC](https://discuss.elastic.co/t/apply-an-ilm-policy-to-all-indices-in-cluster/275553 "2021-06-16T00:35:51Z")
Elasticsearch and Kibana version: 7.3.1 We host and provide elasticsearch cluster to other teams within our org. We want to delete indices in that cluster after certain days. For that matter we created a policy which ta… --- ## [Frozen Tier index querying off of id implementation](https://discuss.elastic.co/t/frozen-tier-index-querying-off-of-id-implementation/275725)
**Author:** [@tyler-3](https://discuss.elastic.co/u/tyler-3)\ **Replies:** 0\ **Last updated:** [June 11, 2021, 11:22pm UTC](https://discuss.elastic.co/t/frozen-tier-index-querying-off-of-id-implementation/275725 "2021-06-11T23:22:28Z")
I'm looking at using frozen tier on S3 for around 1-2 TB of an index but this data will mostly be accessed using an id field (with the occasional alternative query). The ILM lifecycle is very convenient operationally as… --- ## [Elasticsearch s3 snapshot](https://discuss.elastic.co/t/elasticsearch-s3-snapshot/275639)
**Author:** [@drewkrrb](https://discuss.elastic.co/u/drewkrrb)\ **Replies:** 3\ **Last updated:** [June 16, 2021, 12:25am UTC](https://discuss.elastic.co/t/elasticsearch-s3-snapshot/275639 "2021-06-16T00:25:47Z")
Hi Good people of elastic Am trying to upload snapshot through s3. Our elastic cluster is on top of our kubernetes cluster currently we have two Elasticsearch pod running and I already enable the s3 plugin in the image.… --- ## [How to show max count of last three days with 1 hour time bucket?](https://discuss.elastic.co/t/how-to-show-max-count-of-last-three-days-with-1-hour-time-bucket/275891)
**Author:** [@baragonte](https://discuss.elastic.co/u/baragonte)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 12:22am UTC](https://discuss.elastic.co/t/how-to-show-max-count-of-last-three-days-with-1-hour-time-bucket/275891 "2021-06-16T00:22:49Z")
I have to create a visualization where I want the peak of the number of docs by hour every day for the last 3 days. I was able to show the peak but I can't show the correct timestamp. Is there any way I can show the time… --- ## [Invalid snapshot name snapshot with the same name already in-progress Elasticsearch](https://discuss.elastic.co/t/invalid-snapshot-name-snapshot-with-the-same-name-already-in-progress-elasticsearch/275981)
**Author:** [@rknd](https://discuss.elastic.co/u/rknd)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 12:19am UTC](https://discuss.elastic.co/t/invalid-snapshot-name-snapshot-with-the-same-name-already-in-progress-elasticsearch/275981 "2021-06-16T00:19:25Z")
I am trying to get snapshot of my Elasticsearch Cluster with below commands. PUT \_snapshot/backups { "type": "fs", "settings": { "compress": true, "location": "/backup\_path" } } The above returns ok. But … --- ## [Unable to lock JVM after failed Snapshot](https://discuss.elastic.co/t/unable-to-lock-jvm-after-failed-snapshot/276019)
**Author:** [@Junebee](https://discuss.elastic.co/u/Junebee)\ **Replies:** 1\ **Last updated:** [June 15, 2021, 11:21pm UTC](https://discuss.elastic.co/t/unable-to-lock-jvm-after-failed-snapshot/276019 "2021-06-15T23:21:54Z")
I have a three data node and one ingest node cluster. I recently had a node fail during a snapshot and it brought down my entire stack which had been running well for almost 6 months. When I went to restart the failed n… --- ## [Elastic search not loading](https://discuss.elastic.co/t/elastic-search-not-loading/275997)
**Author:** [@dorcas](https://discuss.elastic.co/u/dorcas)\ **Replies:** 1\ **Last updated:** [June 15, 2021, 10:45pm UTC](https://discuss.elastic.co/t/elastic-search-not-loading/275997 "2021-06-15T22:45:13Z")
Dear Team, I mistakenly deleted some indices folders inside data.nodes in elasticsearch. Now I have restarted the service but unable to access Kibana. Please find below the error logs. policy \[ilm-history-ilm-policy-7da… --- ## [Archive data elastic stack](https://discuss.elastic.co/t/archive-data-elastic-stack/276034)
**Author:** [@ima](https://discuss.elastic.co/u/ima)\ **Replies:** 5\ **Last updated:** [June 15, 2021, 10:36pm UTC](https://discuss.elastic.co/t/archive-data-elastic-stack/276034 "2021-06-15T22:36:33Z")
hello everybody can anyone please help me i need to know if it is possible to archive the ELK logs to an external storage off the current platform, and the data will still be searchable. and does anybody know of a method… --- ## [Executing a command from Elasticsearch/kibana](https://discuss.elastic.co/t/executing-a-command-from-elasticsearch-kibana/275920)
**Author:** [@T1330](https://discuss.elastic.co/u/T1330)\ **Replies:** 10\ **Last updated:** [June 15, 2021, 10:08pm UTC](https://discuss.elastic.co/t/executing-a-command-from-elasticsearch-kibana/275920 "2021-06-15T22:08:16Z")
Could you please have any example that executing a command from Elasticsearch to another server etc. i.e. moving from file "C:/aaa/a111.txt" to "C:/bbb/a111.txt" or displaying a pop-up by command Elasticsearch-kibana … [Previous page](https://discuss.elastic.co/latest.md?page=1619) [Next page](https://discuss.elastic.co/latest.md?page=1621)