# \#none **URL:** https://discuss.elastic.co/tag/none.md?page=1853 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1854 --- ## [Help me understand shard allocation](https://discuss.elastic.co/t/help-me-understand-shard-allocation/202584)
**Author:** [@mdavidson\_bt](https://discuss.elastic.co/u/mdavidson_bt)\ **Replies:** 5\ **Last updated:** [October 8, 2019, 2:02pm UTC](https://discuss.elastic.co/t/help-me-understand-shard-allocation/202584 "2019-10-08T14:02:19Z")
I have 8 physical nodes in a hot warm configuration. Hot, yellow below. 2 Nodes, 800GB NVMe storage Warm, Red/Not Highlighted, 6 nodes, 5.5TB spinning disk Both Hot and Warm nodes are divided into two 'racks' (they ar… --- ## [Azure IOT Hub data to Elasticsearch cluster](https://discuss.elastic.co/t/azure-iot-hub-data-to-elasticsearch-cluster/202173)
**Author:** [@bhupal](https://discuss.elastic.co/u/bhupal)\ **Replies:** 1\ **Last updated:** [October 8, 2019, 1:48pm UTC](https://discuss.elastic.co/t/azure-iot-hub-data-to-elasticsearch-cluster/202173 "2019-10-08T13:48:37Z")
I'm looking for recommended path/option to insert the data (messages/file upload) received on azure IOT hub to elastic search cluster for reporting/analytics purpose. Gone thru the steps/approach mentioned here however … --- ## [Elasticsearch document bug: elasticsearch 7.2 plainless script bug](https://discuss.elastic.co/t/elasticsearch-document-bug-elasticsearch-7-2-plainless-script-bug/202452)
**Author:** [@laoyang360](https://discuss.elastic.co/u/laoyang360)\ **Replies:** 4\ **Last updated:** [October 8, 2019, 1:18pm UTC](https://discuss.elastic.co/t/elasticsearch-document-bug-elasticsearch-7-2-plainless-script-bug/202452 "2019-10-08T13:18:54Z")
elasticsearch 7.2 plainless script bug \`POST \_scripts/calculate-score { "script": { "lang": "painless", "source": "Math.log(\_score \* 2) + params.my\_modifier" } } GET \_scripts/calculate-score GET \_search { … --- ## [When run logstash using the service command it fail to send data to aws elasticsearch](https://discuss.elastic.co/t/when-run-logstash-using-the-service-command-it-fail-to-send-data-to-aws-elasticsearch/202387)
**Author:** [@Marcos\_Silva](https://discuss.elastic.co/u/Marcos_Silva)\ **Replies:** 1\ **Last updated:** [October 8, 2019, 1:17pm UTC](https://discuss.elastic.co/t/when-run-logstash-using-the-service-command-it-fail-to-send-data-to-aws-elasticsearch/202387 "2019-10-08T13:17:11Z")
Hello, I'm having this issue: When I run: sudo /usr/share/logstash/bin/logstash -f /etc/logstash/conf.d/apache.conf works perfectly and logstash send logs to AWS ES. When I run as a service using sudo initctl logsta… --- ## [Java API for distance\_feature in Elastic Search](https://discuss.elastic.co/t/java-api-for-distance-feature-in-elastic-search/202615)
**Author:** [@sgTextSearch](https://discuss.elastic.co/u/sgTextSearch)\ **Replies:** 1\ **Last updated:** [October 8, 2019, 12:33pm UTC](https://discuss.elastic.co/t/java-api-for-distance-feature-in-elastic-search/202615 "2019-10-08T12:33:40Z")
I am trying to implement a relevance boost for date and geo-location fields using elastic search distance\_feature. What Java API corresponds to distance\_feature query? Using decay function does not solve my use case Th… --- ## [OEM for using Elastic stack basic subscription](https://discuss.elastic.co/t/oem-for-using-elastic-stack-basic-subscription/202665)
**Author:** [@pcanand1990](https://discuss.elastic.co/u/pcanand1990)\ **Replies:** 0\ **Last updated:** [October 8, 2019, 12:15pm UTC](https://discuss.elastic.co/t/oem-for-using-elastic-stack-basic-subscription/202665 "2019-10-08T12:15:48Z")
I am using Basic subscription of elastic and planning to deploy the same on customer tools with basic license. Should I become an OEM partner with elastic if I have to deploy or distribute elastic components with basic… --- ## [Can i "Filter" certain logs into a Special Index?](https://discuss.elastic.co/t/can-i-filter-certain-logs-into-a-special-index/202639)
**Author:** [@Moritz\_Kiesewetter](https://discuss.elastic.co/u/Moritz_Kiesewetter)\ **Replies:** 1\ **Last updated:** [October 8, 2019, 12:15pm UTC](https://discuss.elastic.co/t/can-i-filter-certain-logs-into-a-special-index/202639 "2019-10-08T12:15:14Z")
Hey guys, since i still pretty new to this topic, i wanted to know if the following would be Possible: I've got a costumer who has different retention periods for different logs. In this case, the logs concerning the … --- ## [Merge indexes in elasticseach from reindex api](https://discuss.elastic.co/t/merge-indexes-in-elasticseach-from-reindex-api/202663)
**Author:** [@namali](https://discuss.elastic.co/u/namali)\ **Replies:** 0\ **Last updated:** [October 8, 2019, 12:06pm UTC](https://discuss.elastic.co/t/merge-indexes-in-elasticseach-from-reindex-api/202663 "2019-10-08T12:06:54Z")
how can I merge two indexes eg: wanted to merger index1 and index 2 and make one index index1 hotelcode hotelname citycode index2 citycode cityname --- ## [ElasticSearch orderby length of field](https://discuss.elastic.co/t/elasticsearch-orderby-length-of-field/202644)
**Author:** [@Sanjay\_Agnani](https://discuss.elastic.co/u/Sanjay_Agnani)\ **Replies:** 1\ **Last updated:** [October 8, 2019, 12:06pm UTC](https://discuss.elastic.co/t/elasticsearch-orderby-length-of-field/202644 "2019-10-08T12:06:27Z")
Hello there , i have any elasticSearch Index with an requirement where field needs to be sorted based on it's length. Have used below aggregate: { "size": 0, "aggs": { "groupByMake": { "terms": { … --- ## [Merge and transform more than one json files to elasticsearch from logstash](https://discuss.elastic.co/t/merge-and-transform-more-than-one-json-files-to-elasticsearch-from-logstash/202660)
**Author:** [@namali](https://discuss.elastic.co/u/namali)\ **Replies:** 0\ **Last updated:** [October 8, 2019, 12:01pm UTC](https://discuss.elastic.co/t/merge-and-transform-more-than-one-json-files-to-elasticsearch-from-logstash/202660 "2019-10-08T12:01:27Z")
I try from translate plugin, but didnt work. translate { destination =\> "\[@metadata\]\[city\]" dictionary\_path =\> "/home/namalie/elk/hotelspro\_v2/city.json" field =\> "citycode" } dissect { mapping =\> { "\[@metadata\]\[de… --- ## [Multiline codec in elasticsearch](https://discuss.elastic.co/t/multiline-codec-in-elasticsearch/202646)
**Author:** [@Vijayakumar\_Kannan](https://discuss.elastic.co/u/Vijayakumar_Kannan)\ **Replies:** 0\ **Last updated:** [October 8, 2019, 10:06am UTC](https://discuss.elastic.co/t/multiline-codec-in-elasticsearch/202646 "2019-10-08T10:06:27Z")
From filebeat multiline are sent as follows . Wed Feb 01 17:54:00 2017 ORA-xxxx: message ORA-xxxx: message This ORA line can be any numbers ( no definite) how do i use the ingest grok processor pattern? --- ## [Auditbeatからファイル作成日時の取得について](https://discuss.elastic.co/t/auditbeat/201716)
**Author:** [@devdevdev](https://discuss.elastic.co/u/devdevdev)\ **Replies:** 2\ **Last updated:** [October 8, 2019, 9:47am UTC](https://discuss.elastic.co/t/auditbeat/201716 "2019-10-08T09:47:01Z")
表題の件 auditbeatからファイル作成日時を取得したいのです。 公式docをみるとファイルの日付データとして file.ctime file.mtime があります。 kibanaにてデータを見ると file.ctime に古い日時が埋め込まれています。 恐らくファイル作成日時はfile.ctimeを参照したらよいとは思いますが、認識あってますでしょうか？ また、ファイル作成日時を調べるにあたり条件などを加味し… --- ## [Winlogbeat to logstash : vérifier la remontée des logs](https://discuss.elastic.co/t/winlogbeat-to-logstash-verifier-la-remontee-des-logs/202587)
**Author:** [@Newt](https://discuss.elastic.co/u/Newt)\ **Replies:** 1\ **Last updated:** [October 8, 2019, 8:31am UTC](https://discuss.elastic.co/t/winlogbeat-to-logstash-verifier-la-remontee-des-logs/202587 "2019-10-08T08:31:37Z")
Bonjour, J'ai installé Winlogbeat sur un poste windows ayant pour output \> logstash. J'ai faits un fichier de conf basique sous logstash ayant comme output \> elasticsearch Je ne compte pas utiliser Kibana. Est-ce qu'… --- ## [\[How To\] Plugin JDBC mysql](https://discuss.elastic.co/t/how-to-plugin-jdbc-mysql/202485)
**Author:** [@Djo\_Mobil](https://discuss.elastic.co/u/Djo_Mobil)\ **Replies:** 2\ **Last updated:** [October 8, 2019, 8:22am UTC](https://discuss.elastic.co/t/how-to-plugin-jdbc-mysql/202485 "2019-10-08T08:22:09Z")
Bonjour, ES version : 7.4.0 Cela fais plusieurs jours que je cherches comment mettre en place le plugin jdbc importer de : jprante Pour mettre a jour mon cluster ES à chaque insert dans ma BDD, pour synchroniser les 2… --- ## [How to index file have content json with FSCrawler](https://discuss.elastic.co/t/how-to-index-file-have-content-json-with-fscrawler/202607)
**Author:** [@Vo\_Van\_Huy](https://discuss.elastic.co/u/Vo_Van_Huy)\ **Replies:** 2\ **Last updated:** [October 8, 2019, 8:19am UTC](https://discuss.elastic.co/t/how-to-index-file-have-content-json-with-fscrawler/202607 "2019-10-08T08:19:41Z")
I have file json(/tmp/es/ecep\_elib\_table\_books.json) with content: I config file /\_default/6/\_settings.json I config file \_settings.json into my job When I run bin/fscrawler --config\_dir ./demo\_01 demo\_01 --rest… --- ## [Why is my Elasticsearch index using so much disk space?](https://discuss.elastic.co/t/why-is-my-elasticsearch-index-using-so-much-disk-space/202117)
**Author:** [@Bart\_de\_Man](https://discuss.elastic.co/u/Bart_de_Man)\ **Replies:** 13\ **Last updated:** [October 8, 2019, 8:10am UTC](https://discuss.elastic.co/t/why-is-my-elasticsearch-index-using-so-much-disk-space/202117 "2019-10-08T08:10:21Z")
Elasticsearch version (bin/elasticsearch --version): 5.6.11 Plugins installed: JVM version (java -version): openjdk version "1.8.0\_222" OpenJDK Runtime Environment (build 1.8.0\_222-8u222-b10-1ubuntu1~16.04.1-b10) … --- ## [Elastic login with Smart Card - Parsing certificate fields (Elasticsearch 7.4)](https://discuss.elastic.co/t/elastic-login-with-smart-card-parsing-certificate-fields-elasticsearch-7-4/202616)
**Author:** [@KenK73](https://discuss.elastic.co/u/KenK73)\ **Replies:** 0\ **Last updated:** [October 8, 2019, 5:47am UTC](https://discuss.elastic.co/t/elastic-login-with-smart-card-parsing-certificate-fields-elasticsearch-7-4/202616 "2019-10-08T05:47:40Z")
Hello, We recently upgraded to v7.4 so we could utilize the new support for smartcard authentication. It works in general, but it's not going to work in our environment because of the formatting of our Active Directory … --- ## [Having multiple parsing (dissect) conditions chained](https://discuss.elastic.co/t/having-multiple-parsing-dissect-conditions-chained/202570)
**Author:** [@Vincent\_Maury](https://discuss.elastic.co/u/Vincent_Maury)\ **Replies:** 2\ **Last updated:** [October 8, 2019, 6:47am UTC](https://discuss.elastic.co/t/having-multiple-parsing-dissect-conditions-chained/202570 "2019-10-08T06:47:15Z")
Hi I'm using Logstash 7.4. I would like to try dissecting my logs (in this example apache logs) with multiple patterns, each having possibly its own mutations (renaming, formatting, etc). I thought about the configura… --- ## [Es cant show the lastest message](https://discuss.elastic.co/t/es-cant-show-the-lastest-message/201601)
**Author:** [@kin122](https://discuss.elastic.co/u/kin122)\ **Replies:** 2\ **Last updated:** [October 8, 2019, 4:51am UTC](https://discuss.elastic.co/t/es-cant-show-the-lastest-message/201601 "2019-10-08T04:51:40Z")
hi why elk7.0 cant show the latest message. as the picture shows,the timestamp cant match the logs. system date is right. How do I locate the problem？3ks --- ## [Fields out of \_source](https://discuss.elastic.co/t/fields-out-of-source/202598)
**Author:** [@maicoldv159](https://discuss.elastic.co/u/maicoldv159)\ **Replies:** 1\ **Last updated:** [October 8, 2019, 4:38am UTC](https://discuss.elastic.co/t/fields-out-of-source/202598 "2019-10-08T04:38:18Z")
I have a customer that want to create an index with stored fields out of the \_source, in the same place than "\_index", "\_type", "\_score", "\_id". It should be something like { "\_index" : "MyIndex", "\_type" : "doc", "\_… --- ## [Kibana visualization how to customize the mapping？](https://discuss.elastic.co/t/kibana-visualization-how-to-customize-the-mapping/198589)
**Author:** [@lin\_hiro1](https://discuss.elastic.co/u/lin_hiro1)\ **Replies:** 3\ **Last updated:** [October 8, 2019, 3:27am UTC](https://discuss.elastic.co/t/kibana-visualization-how-to-customize-the-mapping/198589 "2019-10-08T03:27:39Z")
like this. the legend display 5000 or 1, but I want to display "success number or failed number"? --- ## [SQS Plugin](https://discuss.elastic.co/t/sqs-plugin/202604)
**Author:** [@Rahul\_Kumar4](https://discuss.elastic.co/u/Rahul_Kumar4)\ **Replies:** 0\ **Last updated:** [October 8, 2019, 12:14am UTC](https://discuss.elastic.co/t/sqs-plugin/202604 "2019-10-08T00:14:35Z")
Hi, Does the Logstash SQS Plugin automatically deletes the message in the queue after consuming it? Where can this behavior (if it exits) be changed? Thanks Rahul --- ## [Shipping Postfix Logs to Elasticsearch V7.3](https://discuss.elastic.co/t/shipping-postfix-logs-to-elasticsearch-v7-3/202602)
**Author:** [@a.gavric](https://discuss.elastic.co/u/a.gavric)\ **Replies:** 0\ **Last updated:** [October 7, 2019, 11:23pm UTC](https://discuss.elastic.co/t/shipping-postfix-logs-to-elasticsearch-v7-3/202602 "2019-10-07T23:23:25Z")
Hello Everyone, we have been trying to find a solution to ship and parse postfix logs with Elastic stack 7.3, and have attempted several solutions in the last few days and have ran out of options. Solutions attempted: … --- ## [Vizulization from exact match](https://discuss.elastic.co/t/vizulization-from-exact-match/202352)
**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\ **Replies:** 6\ **Last updated:** [October 7, 2019, 9:19pm UTC](https://discuss.elastic.co/t/vizulization-from-exact-match/202352 "2019-10-07T21:19:40Z")
This is what I have in record user direct\_manager managers foo bar bar tame tutu barf tame tame tutu jams tame tame tutu I want tw… --- ## [Bulk api consuming new tcp port for every write which happens periodically every 1m](https://discuss.elastic.co/t/bulk-api-consuming-new-tcp-port-for-every-write-which-happens-periodically-every-1m/202436)
**Author:** [@singamsundeep](https://discuss.elastic.co/u/singamsundeep)\ **Replies:** 7\ **Last updated:** [October 7, 2019, 9:08pm UTC](https://discuss.elastic.co/t/bulk-api-consuming-new-tcp-port-for-every-write-which-happens-periodically-every-1m/202436 "2019-10-07T21:08:06Z")
Hi, I'm using elastic java highclientrestclient and bulk processor, when writing data periodically every 1m, noticed new tcp port is used and old port remains in established state, after a while noticed lot of tcp connec… --- ## [Cluster turning into green state takes long time](https://discuss.elastic.co/t/cluster-turning-into-green-state-takes-long-time/202440)
**Author:** [@AKSHAY\_ARDAK](https://discuss.elastic.co/u/AKSHAY_ARDAK)\ **Replies:** 8\ **Last updated:** [October 7, 2019, 8:59pm UTC](https://discuss.elastic.co/t/cluster-turning-into-green-state-takes-long-time/202440 "2019-10-07T20:59:10Z")
Hi Folks, Currently facing issue in the elasticsearch cluster During the upgrade/restart of the nodes in the cluster ,it takes long time to turn the cluster into green state from yellow. I am following the below steps… --- ## [ES - xpack & https](https://discuss.elastic.co/t/es-xpack-https/202581)
**Author:** [@NewmazN24](https://discuss.elastic.co/u/NewmazN24)\ **Replies:** 1\ **Last updated:** [October 7, 2019, 7:30pm UTC](https://discuss.elastic.co/t/es-xpack-https/202581 "2019-10-07T19:30:44Z")
Hello folks, Once again I am turning to you. My SSL/TLS works. However when I add my HTTPS, it fails. I have added my certificate password with the command from the link below. I use the same cert for my TLS & HTTPS. E… --- ## [Create Kibana vizualiation based on keywords matched from message column](https://discuss.elastic.co/t/create-kibana-vizualiation-based-on-keywords-matched-from-message-column/202145)
**Author:** [@O\_K](https://discuss.elastic.co/u/O_K)\ **Replies:** 7\ **Last updated:** [October 7, 2019, 6:45pm UTC](https://discuss.elastic.co/t/create-kibana-vizualiation-based-on-keywords-matched-from-message-column/202145 "2019-10-07T18:45:25Z")
I know it's very easy to create visualizations based on predefined columns, but I wonder what is the proper way to create visualization based on some words from messages? Please share any useful guidance or tip about thi… --- ## [User impersonation UserA/UserB/Mgmt](https://discuss.elastic.co/t/user-impersonation-usera-userb-mgmt/202190)
**Author:** [@j\_a\_griffiths](https://discuss.elastic.co/u/j_a_griffiths)\ **Replies:** 3\ **Last updated:** [October 7, 2019, 6:39pm UTC](https://discuss.elastic.co/t/user-impersonation-usera-userb-mgmt/202190 "2019-10-07T18:39:14Z")
I have 2 users (userA and userB) these are setup with roles that only allow them to see information within indexes specific to themselves. the dashboards and widgets are the same whichever the user is logged in but as th… --- ## [S3 output uploading failed BadDigest using gzip encoding](https://discuss.elastic.co/t/s3-output-uploading-failed-baddigest-using-gzip-encoding/201433)
**Author:** [@tomleb](https://discuss.elastic.co/u/tomleb)\ **Replies:** 1\ **Last updated:** [October 7, 2019, 6:21pm UTC](https://discuss.elastic.co/t/s3-output-uploading-failed-baddigest-using-gzip-encoding/201433 "2019-10-07T18:21:06Z")
Hi, I am trying to setup a logstash output using the s3 output plugin. I am getting the following error: \[2019-09-27T13:55:57,651\]\[DEBUG\]\[logstash.outputs.s3 \] Periodic check for stale files \[2019-09-27T13:56:05,… [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1852) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1854)