# Latest **URL:** https://discuss.elastic.co/latest.md?page=1491 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1492 --- ## [Client SSL and Server SSL - ES Java Client](https://discuss.elastic.co/t/client-ssl-and-server-ssl-es-java-client/283507)
**Author:** [@Muthukumaran\_Kothand](https://discuss.elastic.co/u/Muthukumaran_Kothand)\ **Replies:** 0\ **Last updated:** [September 7, 2021, 8:40am UTC](https://discuss.elastic.co/t/client-ssl-and-server-ssl-es-java-client/283507 "2021-09-07T08:40:59Z")
Initial excuse - we are still using TransportClient ( PreBuiltXPackTransportClient). Migrating to High Level Rest Client is in progress. This question would still be relevant for High Level Rest Client Meta: Elasticse… --- ## [Rate\_1min keeps dropping for my kafka to s3 batching on logstash](https://discuss.elastic.co/t/rate-1min-keeps-dropping-for-my-kafka-to-s3-batching-on-logstash/283508)
**Author:** [@Varsha1](https://discuss.elastic.co/u/Varsha1)\ **Replies:** 0\ **Last updated:** [September 7, 2021, 8:45am UTC](https://discuss.elastic.co/t/rate-1min-keeps-dropping-for-my-kafka-to-s3-batching-on-logstash/283508 "2021-09-07T08:45:22Z")
I'm trying to transfer data from kafka to s3, without any data transformation filters. I added metrics filter plugin to calculate the rate of transfer, which keeps falling from ~16k to as low as ~3k. Is this expected an… --- ## [How do I use Elasticsearch aggregation using python elasticsearch\_dsl library?](https://discuss.elastic.co/t/how-do-i-use-elasticsearch-aggregation-using-python-elasticsearch-dsl-library/283345)
**Author:** [@rafiqul](https://discuss.elastic.co/u/rafiqul)\ **Replies:** 3\ **Last updated:** [September 7, 2021, 8:42am UTC](https://discuss.elastic.co/t/how-do-i-use-elasticsearch-aggregation-using-python-elasticsearch-dsl-library/283345 "2021-09-07T08:42:13Z")
I have a python model that creates the index as class Telemetry(DocType): id = Keyword() imei = Keyword() location = field.GeoPoint() timestamp = Date() I would like to query distinct count of imei. Wha… --- ## [Kibana 7.10 searching with special characters and wildcard](https://discuss.elastic.co/t/kibana-7-10-searching-with-special-characters-and-wildcard/283397)
**Author:** [@cps598](https://discuss.elastic.co/u/cps598)\ **Replies:** 6\ **Last updated:** [September 7, 2021, 8:40am UTC](https://discuss.elastic.co/t/kibana-7-10-searching-with-special-characters-and-wildcard/283397 "2021-09-07T08:40:48Z")
I want to use \* with some special characters. e.g. url.path: "/apis/aa.bb.io/v1/checking"\* and user: "system"\* keep getting the error messages: KQLSyntaxError: Expected AND, OR, end of input, whitespace but "" found. … --- ## [Compare/Merge 2 type of dataset](https://discuss.elastic.co/t/compare-merge-2-type-of-dataset/282624)
**Author:** [@Peter\_Ch](https://discuss.elastic.co/u/Peter_Ch)\ **Replies:** 4\ **Last updated:** [September 7, 2021, 8:22am UTC](https://discuss.elastic.co/t/compare-merge-2-type-of-dataset/282624 "2021-09-07T08:22:37Z")
Dear All, I user winlogbeat to collet my window log which include username. And I have a csv file which contain the username and user department. May I know is it possible to compare those datasets username field, if th… --- ## [MIgrate ELK setup from cloud to on-prem](https://discuss.elastic.co/t/migrate-elk-setup-from-cloud-to-on-prem/283503)
**Author:** [@Bryce\_Fernandes](https://discuss.elastic.co/u/Bryce_Fernandes)\ **Replies:** 1\ **Last updated:** [September 7, 2021, 8:09am UTC](https://discuss.elastic.co/t/migrate-elk-setup-from-cloud-to-on-prem/283503 "2021-09-07T08:09:33Z")
Hi, I currently have elk setup on cloud and want to replicate it on onprem and remove cloud setup. I want to migrate development part like dashboards, index-patterns, users created etc. Will vm snapshot backup restore… --- ## [Logstash udp input listen on port 5044 but doesn't receive syslog messages](https://discuss.elastic.co/t/logstash-udp-input-listen-on-port-5044-but-doesnt-receive-syslog-messages/283496)
**Author:** [@kiran80511](https://discuss.elastic.co/u/kiran80511)\ **Replies:** 0\ **Last updated:** [September 7, 2021, 7:17am UTC](https://discuss.elastic.co/t/logstash-udp-input-listen-on-port-5044-but-doesnt-receive-syslog-messages/283496 "2021-09-07T07:17:57Z")
I have tried with this command tcpdump -vvv -A -i any port 5044 It receive the syslog messages 12:41:34.438831 IP (tos 0x0, ttl 128, id 37582, offset 0, flags \[none\], proto UDP (17), length 374) gateway.lxi-evntsv… --- ## [Search performance difference between from&size and search&after](https://discuss.elastic.co/t/search-performance-difference-between-from-size-and-search-after/283400)
**Author:** [@MarvinLiu](https://discuss.elastic.co/u/MarvinLiu)\ **Replies:** 6\ **Last updated:** [September 7, 2021, 7:16am UTC](https://discuss.elastic.co/t/search-performance-difference-between-from-size-and-search-after/283400 "2021-09-07T07:16:43Z")
There are hundreds of millions of documents in my index. When I search, I find that search&after is much slower than from&size。 Use from&size，search is quick，took several ms return，but use search after，it took 20 seconds… --- ## [Misplaced codec footer keystore](https://discuss.elastic.co/t/misplaced-codec-footer-keystore/283493)
**Author:** [@itslogesh](https://discuss.elastic.co/u/itslogesh)\ **Replies:** 1\ **Last updated:** [September 7, 2021, 6:59am UTC](https://discuss.elastic.co/t/misplaced-codec-footer-keystore/283493 "2021-09-07T06:59:12Z")
org.apache.lucene.index.CorruptIndexException: misplaced codec footer (file extended?): remaining=17, expected=16, fp=183 (resource=BufferedChecksumIndexInput(SimpleFSIndexInput(path="/etc/elasticsearch/elasticsearch.key… --- ## [Auditbeat PATH](https://discuss.elastic.co/t/auditbeat-path/283471)
**Author:** [@jam\_mahmoudi](https://discuss.elastic.co/u/jam_mahmoudi)\ **Replies:** 3\ **Last updated:** [September 7, 2021, 5:21am UTC](https://discuss.elastic.co/t/auditbeat-path/283471 "2021-09-07T05:21:22Z")
Hi guys I have installed and configured َAuditbeat to check a series of specific files and folders in Windows َServer Auditbeat works and Running But when I add the D and E drives to Auditbeat.yml file , the servi… --- ## [Elasticsearch data to mysql](https://discuss.elastic.co/t/elasticsearch-data-to-mysql/283488)
**Author:** [@zhyp](https://discuss.elastic.co/u/zhyp)\ **Replies:** 0\ **Last updated:** [September 7, 2021, 5:13am UTC](https://discuss.elastic.co/t/elasticsearch-data-to-mysql/283488 "2021-09-07T05:13:35Z")
Hi :grinning: My data is in elasticsearch. I want to use logstash to synchronize to MySQL, or use other tools. What can I do to achieve it？ --- ## [How to use api/shorten\_url?](https://discuss.elastic.co/t/how-to-use-api-shorten-url/283423)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 2\ **Last updated:** [September 7, 2021, 5:06am UTC](https://discuss.elastic.co/t/how-to-use-api-shorten-url/283423 "2021-09-07T05:06:21Z")
Examples in the documentation: # curl -H "kbn-xsrf: reporting" -XPOST http://192.168.10.148:5601/api/shorten\_url -d ' \> { \> "url": "/app/kibana#/dashboard?\_g=()&\_a=(description:'',filters:!(),fullScreenMode:!f,option… --- ## [Add large attachments from S3 to Elastic Search](https://discuss.elastic.co/t/add-large-attachments-from-s3-to-elastic-search/283452)
**Author:** [@Reghu\_Shanker](https://discuss.elastic.co/u/Reghu_Shanker)\ **Replies:** 5\ **Last updated:** [September 7, 2021, 3:37am UTC](https://discuss.elastic.co/t/add-large-attachments-from-s3-to-elastic-search/283452 "2021-09-07T03:37:42Z")
Hi, I have large pdf files which are located in AWS S3 which needs to be indexed and searchable. I want to upload these files to elastic search. The files need to be uploaded as single documents. How can I do this from… --- ## [Mock RestHighLevelClient for elasticsearch](https://discuss.elastic.co/t/mock-resthighlevelclient-for-elasticsearch/283465)
**Author:** [@romeoopk](https://discuss.elastic.co/u/romeoopk)\ **Replies:** 1\ **Last updated:** [September 7, 2021, 3:35am UTC](https://discuss.elastic.co/t/mock-resthighlevelclient-for-elasticsearch/283465 "2021-09-07T03:35:06Z")
HI I would like to test my rest api in quarkus which internally calls elasticsearch using RestHighLevelClient. My problem is that the RestHighLevelClient is not mockable and hence I cannot execute my unit test to test … --- ## [Cannot create ingest pipeline(iis, nginx) \[Filebeat 7.14.0 + Elasticsearch 7.8.1\]](https://discuss.elastic.co/t/cannot-create-ingest-pipeline-iis-nginx-filebeat-7-14-0-elasticsearch-7-8-1/283394)
**Author:** [@Bingu\_Shim](https://discuss.elastic.co/u/Bingu_Shim)\ **Replies:** 2\ **Last updated:** [September 7, 2021, 3:15am UTC](https://discuss.elastic.co/t/cannot-create-ingest-pipeline-iis-nginx-filebeat-7-14-0-elasticsearch-7-8-1/283394 "2021-09-07T03:15:39Z")
Hi I was using filebeat 7.7.1 with Elasticsearch 7.8.1 and had no problem with collecting iis and nginx logs. But, when I upgraded filebeat from 7.7.1 to 7.14.0 I got these errors logs from Elasticsearch. {"type": "se… --- ## [Kibana 7.14 - Canvas var\_set no longer accepts input context](https://discuss.elastic.co/t/kibana-7-14-canvas-var-set-no-longer-accepts-input-context/281420)
**Author:** [@markbyrnegkc](https://discuss.elastic.co/u/markbyrnegkc)\ **Replies:** 3\ **Last updated:** [September 7, 2021, 2:41am UTC](https://discuss.elastic.co/t/kibana-7-14-canvas-var-set-no-longer-accepts-input-context/281420 "2021-09-07T02:41:23Z")
In 7.14 the var\_set function in- Canvas no longer accepts the input context as the value. One needs to explicitly set the value now. Trying to run this expression: date | var\_set "mydate" | var "mydate" | render as="de… --- ## [Boost score on token order over proximity](https://discuss.elastic.co/t/boost-score-on-token-order-over-proximity/283126)
**Author:** [@Dahea\_Moon](https://discuss.elastic.co/u/Dahea_Moon)\ **Replies:** 2\ **Last updated:** [September 7, 2021, 1:21am UTC](https://discuss.elastic.co/t/boost-score-on-token-order-over-proximity/283126 "2021-09-07T01:21:55Z")
Hello, elastic team. Is there way to adjust score between proximity and order? I want to search by "any word in order with some slop". I found out that most of DSLs that matters with proximity and in order option cann… --- ## [Force shards to single node when changing phases](https://discuss.elastic.co/t/force-shards-to-single-node-when-changing-phases/283476)
**Author:** [@rschwa2](https://discuss.elastic.co/u/rschwa2)\ **Replies:** 5\ **Last updated:** [September 6, 2021, 11:52pm UTC](https://discuss.elastic.co/t/force-shards-to-single-node-when-changing-phases/283476 "2021-09-06T23:52:45Z")
We have 2 warm data nodes in our cluster, and 6 shards configured for each index. When an index migrates from hot to warm, the shards are evenly distributed across both warm nodes. However we also have a shrink action … --- ## [ILM - Warm phase index is showing up in Hot phase](https://discuss.elastic.co/t/ilm-warm-phase-index-is-showing-up-in-hot-phase/282788)
**Author:** [@Music91](https://discuss.elastic.co/u/Music91)\ **Replies:** 11\ **Last updated:** [September 6, 2021, 11:11pm UTC](https://discuss.elastic.co/t/ilm-warm-phase-index-is-showing-up-in-hot-phase/282788 "2021-09-06T23:11:48Z")
Team, One of the index i have created with routing policy set to warm but under the Lifecycle status the index is showing up under Hot. Any idea why it is showing in Hot when it is expected to show only in Warm. Please a… --- ## [Is it possible?](https://discuss.elastic.co/t/is-it-possible/281197)
**Author:** [@ailengcon](https://discuss.elastic.co/u/ailengcon)\ **Replies:** 9\ **Last updated:** [September 6, 2021, 11:07pm UTC](https://discuss.elastic.co/t/is-it-possible/281197 "2021-09-06T23:07:33Z")
Can someone answer me this. I have a database with several configurations, and each configuration can be linked to the same serial\_number. To be able to analyze the data correctly, I need to filter så that each serial\_n… --- ## [To retrieve complete metricbeat data from the elasticsearch](https://discuss.elastic.co/t/to-retrieve-complete-metricbeat-data-from-the-elasticsearch/283112)
**Author:** [@nehasinha1807](https://discuss.elastic.co/u/nehasinha1807)\ **Replies:** 4\ **Last updated:** [September 6, 2021, 11:01pm UTC](https://discuss.elastic.co/t/to-retrieve-complete-metricbeat-data-from-the-elasticsearch/283112 "2021-09-06T23:01:46Z")
I want to get full metricbeat data from elasticsearch in json through API. I tried with - /metricbeat\*/\_search but it is not giving complete data. Please suggest. --- ## [Logstash OSS License after 7.10 version](https://discuss.elastic.co/t/logstash-oss-license-after-7-10-version/283429)
**Author:** [@YashC](https://discuss.elastic.co/u/YashC)\ **Replies:** 3\ **Last updated:** [September 6, 2021, 10:57pm UTC](https://discuss.elastic.co/t/logstash-oss-license-after-7-10-version/283429 "2021-09-06T22:57:07Z")
Hello, I am using logstash-oss docker image version 7.10.2, as it is based on Apache 2.0 license. Since Jan 2021 Elastic introduced a different license model starting from versions 7.11. However, there are still logst… --- ## [Filtering API logs](https://discuss.elastic.co/t/filtering-api-logs/283399)
**Author:** [@Jeremy\_Scott](https://discuss.elastic.co/u/Jeremy_Scott)\ **Replies:** 2\ **Last updated:** [September 6, 2021, 8:13pm UTC](https://discuss.elastic.co/t/filtering-api-logs/283399 "2021-09-06T20:13:30Z")
Hi there. AppSearch logs all the API requests and responses. Most of the time it returns a 200 status code - even where there have been errors ingesting the payload. Thats fine, because I get that the request was succes… --- ## [Joining aggregation results to the original documents](https://discuss.elastic.co/t/joining-aggregation-results-to-the-original-documents/282547)
**Author:** [@lyubimtsev](https://discuss.elastic.co/u/lyubimtsev)\ **Replies:** 4\ **Last updated:** [September 6, 2021, 5:20pm UTC](https://discuss.elastic.co/t/joining-aggregation-results-to-the-original-documents/282547 "2021-09-06T17:20:21Z")
Hi I need help to create a query that creates metrics aggregations, merge created metrics to original documents and then filters documents using these metrics. Let's consider following dataset with managers' sales: … --- ## [Kibana Duplicate data](https://discuss.elastic.co/t/kibana-duplicate-data/283299)
**Author:** [@rp346](https://discuss.elastic.co/u/rp346)\ **Replies:** 1\ **Last updated:** [September 6, 2021, 4:07pm UTC](https://discuss.elastic.co/t/kibana-duplicate-data/283299 "2021-09-06T16:07:34Z")
I have ELSK Steup to aggregate Kubernetes logs. But in Kibana I see all logs appearing twice, here is the sample 10:43:02.416 \[2021-09-03 14:43:02,414\] \[INFO\] - Encoding password to hash! 10:43:02.416 \[2021-09-03 14:43:… --- ## [Elastic App Search and Spring Boot](https://discuss.elastic.co/t/elastic-app-search-and-spring-boot/282359)
**Author:** [@mirko.romstadt](https://discuss.elastic.co/u/mirko.romstadt)\ **Replies:** 4\ **Last updated:** [September 6, 2021, 3:39pm UTC](https://discuss.elastic.co/t/elastic-app-search-and-spring-boot/282359 "2021-09-06T15:39:38Z")
Hi, we are running a Spring Boot application that is using spring-data-elasticsearch to index its models in an elasticsearch instance. This is working fine, we can index the models via ElasticsearchOperations.index(...).… --- ## [Accessing the Results array, not individual results](https://discuss.elastic.co/t/accessing-the-results-array-not-individual-results/283460)
**Author:** [@learning\_bear](https://discuss.elastic.co/u/learning_bear)\ **Replies:** 1\ **Last updated:** [September 6, 2021, 3:36pm UTC](https://discuss.elastic.co/t/accessing-the-results-array-not-individual-results/283460 "2021-09-06T15:36:45Z")
Sorry for this noob question. Learning JS, React and Elastic all in one go is not that easy. Would appreciate some help here. I have set up an index in a local Enterprise Search cluster and I can connect to it using a s… --- ## [Index rollover with date and time](https://discuss.elastic.co/t/index-rollover-with-date-and-time/283458)
**Author:** [@Felipe\_Fuller](https://discuss.elastic.co/u/Felipe_Fuller)\ **Replies:** 4\ **Last updated:** [September 6, 2021, 3:33pm UTC](https://discuss.elastic.co/t/index-rollover-with-date-and-time/283458 "2021-09-06T15:33:40Z")
Hi Community! I'm trying to create an index rollover with the date and hour when the new index is created because I set up the rollover every hour during the day. Having this in consideration, the format of the new inde… --- ## [Fleet Server - Error - x509: certificate signed by unknown authority](https://discuss.elastic.co/t/fleet-server-error-x509-certificate-signed-by-unknown-authority/283168)
**Author:** [@JimG](https://discuss.elastic.co/u/JimG)\ **Replies:** 1\ **Last updated:** [September 6, 2021, 1:52pm UTC](https://discuss.elastic.co/t/fleet-server-error-x509-certificate-signed-by-unknown-authority/283168 "2021-09-06T13:52:13Z")
Hi everyone :slight\_smile: Im trying to make a test setup with a Ubuntu 20.04 , running with docker. I use docker-compose to make elastic agent/fleet server, but i cant make it work with a self signed certificate for f… --- ## [Edit custom labels on Kibana Visualizations](https://discuss.elastic.co/t/edit-custom-labels-on-kibana-visualizations/283272)
**Author:** [@pavank](https://discuss.elastic.co/u/pavank)\ **Replies:** 6\ **Last updated:** [September 6, 2021, 1:41pm UTC](https://discuss.elastic.co/t/edit-custom-labels-on-kibana-visualizations/283272 "2021-09-06T13:41:28Z")
Kibana version 7.9.3 I'm trying to create a visualization of type Metric, and I see the visualization as attached in the screenshot. How do I get the label to read only Confirm Shipment - PORTUGAL and not Confirm Shipm… [Previous page](https://discuss.elastic.co/latest.md?page=1490) [Next page](https://discuss.elastic.co/latest.md?page=1492)