# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=190 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 191 --- ## [Natural language to Query DSL building](https://discuss.elastic.co/t/natural-language-to-query-dsl-building/364586)
**Author:** [@Souvik\_Das](https://discuss.elastic.co/u/Souvik_Das)\ **Replies:** 0\ **Last updated:** [August 8, 2024, 8:26am UTC](https://discuss.elastic.co/t/natural-language-to-query-dsl-building/364586 "2024-08-08T08:26:39Z")
Hi Folks, I want to build an app that converts natural language query to elasticsearch query DSL. I have gone through How to use Elasticsearch to prompt ChatGPT with natural language | Elastic Blog Are there any refere… --- ## [Using Azure integration without Azure storage](https://discuss.elastic.co/t/using-azure-integration-without-azure-storage/363848)
**Author:** [@Rihards](https://discuss.elastic.co/u/Rihards)\ **Replies:** 2\ **Last updated:** [August 8, 2024, 8:04am UTC](https://discuss.elastic.co/t/using-azure-integration-without-azure-storage/363848 "2024-08-08T08:04:39Z")
As per Azure Logs | Documentation , setting up Azure integration requires Azure storage for state registry to share it between agents. Is it possible to skip Azure storage and use local state registry (single agent or s… --- ## [Elasticsearch - es rejected execution exception](https://discuss.elastic.co/t/elasticsearch-es-rejected-execution-exception/364577)
**Author:** [@Dylan\_Juan](https://discuss.elastic.co/u/Dylan_Juan)\ **Replies:** 0\ **Last updated:** [August 8, 2024, 6:49am UTC](https://discuss.elastic.co/t/elasticsearch-es-rejected-execution-exception/364577 "2024-08-08T06:49:17Z")
Hi everyone, currently i'm facing an issue with my elasticsearch cluster. The version is very old which is ES 5.6.2, the logs is coming from Oracle SOA cluster which is collected using GELF and then into rabbitmq queue, … --- ## [Elastic-agent Custom UDP Logs Log Parsing Field Mapping Issue](https://discuss.elastic.co/t/elastic-agent-custom-udp-logs-log-parsing-field-mapping-issue/364523)
**Author:** [@wangsubo](https://discuss.elastic.co/u/wangsubo)\ **Replies:** 3\ **Last updated:** [August 8, 2024, 4:00am UTC](https://discuss.elastic.co/t/elastic-agent-custom-udp-logs-log-parsing-field-mapping-issue/364523 "2024-08-08T04:00:27Z")
I am currently using Elastic-agent to transmit log data to Elasticsearch through Logstash. I have two integrations configured: one for Fortigate and another for Custom UDP Logs. During the integration with Fortigate,… --- ## [How to remove expired SSL certificate](https://discuss.elastic.co/t/how-to-remove-expired-ssl-certificate/364280)
**Author:** [@Chuck\_Reynolds](https://discuss.elastic.co/u/Chuck_Reynolds)\ **Replies:** 6\ **Last updated:** [August 8, 2024, 1:28am UTC](https://discuss.elastic.co/t/how-to-remove-expired-ssl-certificate/364280 "2024-08-08T01:28:00Z")
I have a ssl cert that our webops team created for me a year ago and now it has expired. I've added copied the new ssl cert to each server and pointed this line to in the elasticsearch.yml file xpack.security.http.ssl.… --- ## [How to convert hex value into decimal in painless language](https://discuss.elastic.co/t/how-to-convert-hex-value-into-decimal-in-painless-language/364554)
**Author:** [@nabeel1](https://discuss.elastic.co/u/nabeel1)\ **Replies:** 1\ **Last updated:** [August 7, 2024, 6:34pm UTC](https://discuss.elastic.co/t/how-to-convert-hex-value-into-decimal-in-painless-language/364554 "2024-08-07T18:34:17Z")
Can anyone inform the syntax to convert a value from hex to decimal for a bucket index .. e.g. i want to convert this substring which is the IP in hex to a IP in decimal .. so, from string need to convert to hex and t… --- ## [Autosuggestion service](https://discuss.elastic.co/t/autosuggestion-service/364547)
**Author:** [@kosyakla](https://discuss.elastic.co/u/kosyakla)\ **Replies:** 0\ **Last updated:** [August 7, 2024, 3:17pm UTC](https://discuss.elastic.co/t/autosuggestion-service/364547 "2024-08-07T15:17:46Z")
Hello everyone, I'm thinking of building a suggestion service, similar to what you can see in google for example, so trying to wrap my head around Elasticsearch. Let's say we have a steam of users data which we can tok… --- ## [Logstash ARM64 Docker Image issue](https://discuss.elastic.co/t/logstash-arm64-docker-image-issue/364544)
**Author:** [@kfarr](https://discuss.elastic.co/u/kfarr)\ **Replies:** 0\ **Last updated:** [August 7, 2024, 2:43pm UTC](https://discuss.elastic.co/t/logstash-arm64-docker-image-issue/364544 "2024-08-07T14:43:15Z")
Pulling down version 7.17.23, 7.17.22,7.17.21 docker images for Logstash noticing the container will fail on ARM64 due to env2yaml being not being built for arm64. Checking Elastic Git, I pull down the env2yaml and runni… --- ## [\[bug\] Syslog RFC 5424 parser does not properly handle escaped characters in structured data](https://discuss.elastic.co/t/bug-syslog-rfc-5424-parser-does-not-properly-handle-escaped-characters-in-structured-data/364483)
**Author:** [@pcollardez](https://discuss.elastic.co/u/pcollardez)\ **Replies:** 4\ **Last updated:** [August 7, 2024, 2:16pm UTC](https://discuss.elastic.co/t/bug-syslog-rfc-5424-parser-does-not-properly-handle-escaped-characters-in-structured-data/364483 "2024-08-07T14:16:16Z")
Hello, I'm trying to collect logs from different appliances by using an Elastic Agent 8.14.3 with the Custom UDP Logs integration 1.19.1. One of the appliance is sending RFC 5424 formatted logs, with a structured data … --- ## [Elastic Search( Store XML data as just a string)](https://discuss.elastic.co/t/elastic-search-store-xml-data-as-just-a-string/364386)
**Author:** [@apoorvleo](https://discuss.elastic.co/u/apoorvleo)\ **Replies:** 3\ **Last updated:** [August 7, 2024, 1:12pm UTC](https://discuss.elastic.co/t/elastic-search-store-xml-data-as-just-a-string/364386 "2024-08-07T13:12:27Z")
Hi Team, I am using kibana and ES versions 8.14. I am sending a json through Java Bulk call API {"uuid": string type instance: string type inputJson : JsonNode type xmlmxmessage: xmlbutinStringformat } this is th… --- ## [Suggest query issue](https://discuss.elastic.co/t/suggest-query-issue/364514)
**Author:** [@jahedi](https://discuss.elastic.co/u/jahedi)\ **Replies:** 2\ **Last updated:** [August 7, 2024, 1:05pm UTC](https://discuss.elastic.co/t/suggest-query-issue/364514 "2024-08-07T13:05:16Z")
Hi, I am using Suggest query for a Did-you-mean functionality based on this tutorial Create a simple “did you mean” — ElasticSearch but there is an issue. If a typo happens in the middle of a word, the suggest query r… --- ## [Filebeat from type "log" to "filestream" duplicated events](https://discuss.elastic.co/t/filebeat-from-type-log-to-filestream-duplicated-events/364268)
**Author:** [@t.h](https://discuss.elastic.co/u/t.h)\ **Replies:** 3\ **Last updated:** [August 7, 2024, 11:24am UTC](https://discuss.elastic.co/t/filebeat-from-type-log-to-filestream-duplicated-events/364268 "2024-08-07T11:24:59Z")
Hello, we are changing from the filebeat type "log" to "filesteam" Since we are changed, we have duplicates events in our logstash. Looks like this was the reason of my other problem with the logstash throttle and max\_… --- ## [Continuos warning throwing up in fresh installation of a 3 node elk cluster's 1st node. Please help to sort out](https://discuss.elastic.co/t/continuos-warning-throwing-up-in-fresh-installation-of-a-3-node-elk-clusters-1st-node-please-help-to-sort-out/364481)
**Author:** [@martianzz](https://discuss.elastic.co/u/martianzz)\ **Replies:** 2\ **Last updated:** [August 7, 2024, 11:10am UTC](https://discuss.elastic.co/t/continuos-warning-throwing-up-in-fresh-installation-of-a-3-node-elk-clusters-1st-node-please-help-to-sort-out/364481 "2024-08-07T11:10:52Z")
Kindly tell me why this error is shown in a fresh 3 node cluster of elk stack \*2024-08-06T19:47:07,586\]\[WARN \]\[o.e.h.AbstractHttpServerTransport\] \[elk-stack-node1.kseb.in\] caught exception while handling client http tra… --- ## [Arabic and special characters](https://discuss.elastic.co/t/arabic-and-special-characters/363613)
**Author:** [@abdullah144](https://discuss.elastic.co/u/abdullah144)\ **Replies:** 4\ **Last updated:** [August 7, 2024, 10:28am UTC](https://discuss.elastic.co/t/arabic-and-special-characters/363613 "2024-08-07T10:28:34Z")
Dear Team, kindly note that when we stashing to Logstash with data contains Arabic or Special characters , it showing to HTML encoded text , Example : Ma’aden (original text) ----\>Ma’aden (elastic log) الرياض … --- ## [How to use input plugins with multiple Logstash hosts?](https://discuss.elastic.co/t/how-to-use-input-plugins-with-multiple-logstash-hosts/364486)
**Author:** [@gueri](https://discuss.elastic.co/u/gueri)\ **Replies:** 4\ **Last updated:** [August 7, 2024, 9:54am UTC](https://discuss.elastic.co/t/how-to-use-input-plugins-with-multiple-logstash-hosts/364486 "2024-08-07T09:54:57Z")
Hi, I mainly use Logstash with Kafka input without any issue. But now I want to read some logs from elastic and write them to Kafka. So I used the elasticsearch input plugin. But what a surprise to see many logs in my… --- ## [Pdf Parsing Issues when using FS crawler](https://discuss.elastic.co/t/pdf-parsing-issues-when-using-fs-crawler/364488)
**Author:** [@saifstech26](https://discuss.elastic.co/u/saifstech26)\ **Replies:** 4\ **Last updated:** [August 7, 2024, 9:07am UTC](https://discuss.elastic.co/t/pdf-parsing-issues-when-using-fs-crawler/364488 "2024-08-07T09:07:28Z")
Hi @dadoonet, I have started using FS crawler recently. We have a requirement to crawl all files on the local file system, most of which are PDFs along with other doc formats. The thing with these PDFs is that all PDFs … --- ## [gce plugin with private access](https://discuss.elastic.co/t/gce-plugin-with-private-access/364492)
**Author:** [@vaboston](https://discuss.elastic.co/u/vaboston)\ **Replies:** 2\ **Last updated:** [August 7, 2024, 8:44am UTC](https://discuss.elastic.co/t/gce-plugin-with-private-access/364492 "2024-08-07T08:44:15Z")
Hello, I'm using GCE discovery plugin on GCP VM, and i don't have nat gateway to join metadata.google.internal. I activated private access on my subnet and now i can use private.googleapis.com to ask metadata. But gce-d… --- ## [More Index Latency with add\_id proc in Filebeat](https://discuss.elastic.co/t/more-index-latency-with-add-id-proc-in-filebeat/364518)
**Author:** [@demudrol](https://discuss.elastic.co/u/demudrol)\ **Replies:** 1\ **Last updated:** [August 7, 2024, 8:21am UTC](https://discuss.elastic.co/t/more-index-latency-with-add-id-proc-in-filebeat/364518 "2024-08-07T08:21:58Z")
Hi! We have logging structure like with: Application -\> docker json -\> Filebeat file harvester -\> Kafka Topic -\> Filebeat retranslator from Topic to Elasticsearch. Sometimes there is a lot of event deduplication in Ela… --- ## [WHERE condition in logstash](https://discuss.elastic.co/t/where-condition-in-logstash/364516)
**Author:** [@Danyal\_Danish](https://discuss.elastic.co/u/Danyal_Danish)\ **Replies:** 0\ **Last updated:** [August 7, 2024, 7:29am UTC](https://discuss.elastic.co/t/where-condition-in-logstash/364516 "2024-08-07T07:29:28Z")
Hi, I'm trying to run this query in the logstash jdbc but I'm facing this syntax error everytime. I tried multiple variations of single and double quotations but each time I'm getting the same error. Query: jdbc\_stre… --- ## [Your connector has not connected to Search](https://discuss.elastic.co/t/your-connector-has-not-connected-to-search/364499)
**Author:** [@Dedicated\_Server](https://discuss.elastic.co/u/Dedicated_Server)\ **Replies:** 6\ **Last updated:** [August 7, 2024, 7:24am UTC](https://discuss.elastic.co/t/your-connector-has-not-connected-to-search/364499 "2024-08-07T07:24:13Z")
I am running mongo, elastic, kibana, and elastic-connectors in docker containers with docker-compose. I setup the connector and config, and it even connects in docker logs. \[FMWK\]\[21:01:02\]\[INFO\] Running connector serv… --- ## [Unable to get local issuer certificate (\_ssl.c:1007)))](https://discuss.elastic.co/t/unable-to-get-local-issuer-certificate-ssl-c-1007/364462)
**Author:** [@SaraS](https://discuss.elastic.co/u/SaraS)\ **Replies:** 2\ **Last updated:** [August 7, 2024, 6:46am UTC](https://discuss.elastic.co/t/unable-to-get-local-issuer-certificate-ssl-c-1007/364462 "2024-08-07T06:46:41Z")
Hello. I run my elasticsearch via docker compose and i set ssl security for it and now i want to connect Elasticsearch from remote server when i curl -X GET -u user:pass -k https://serverIP:9200/\_cat/indices i can see… --- ## [Output after a health check for destination?](https://discuss.elastic.co/t/output-after-a-health-check-for-destination/364445)
**Author:** [@Big-Edd](https://discuss.elastic.co/u/Big-Edd)\ **Replies:** 4\ **Last updated:** [August 7, 2024, 5:35am UTC](https://discuss.elastic.co/t/output-after-a-health-check-for-destination/364445 "2024-08-07T05:35:53Z")
Hello Everyone, When the output destination container is slower to start or unavailable, the message dequeued from RabbitMQ input is lost by Logstash. Is it possible to have the Logstash wait for a health check to be O… --- ## [Remote reindex No route to host error despite remote cluster returning \_cluster/health info](https://discuss.elastic.co/t/remote-reindex-no-route-to-host-error-despite-remote-cluster-returning-cluster-health-info/364187)
**Author:** [@fidsamuraiCrelio](https://discuss.elastic.co/u/fidsamuraiCrelio)\ **Replies:** 7\ **Last updated:** [August 7, 2024, 4:11am UTC](https://discuss.elastic.co/t/remote-reindex-no-route-to-host-error-despite-remote-cluster-returning-cluster-health-info/364187 "2024-08-07T04:11:59Z")
Hi All! We use Elasticsearch 6.8.0 as a search engine for our application logs. Unfortunately our cluster crashed and some indices were unrecoverable. Since the cluster was in red state we spun up a new cluster so tha… --- ## [Adding remark on data](https://discuss.elastic.co/t/adding-remark-on-data/364508)
**Author:** [@avocadojj](https://discuss.elastic.co/u/avocadojj)\ **Replies:** 0\ **Last updated:** [August 7, 2024, 3:45am UTC](https://discuss.elastic.co/t/adding-remark-on-data/364508 "2024-08-07T03:45:06Z")
Hi, I am currently working on a project to create rules that trigger alerts in Elasticsearch. After receiving an alert, I want to know if it's possible to add a new column of data through the Kibana UI, specifically vi… --- ## [Elastic mapping flattened vs field wise](https://discuss.elastic.co/t/elastic-mapping-flattened-vs-field-wise/362151)
**Author:** [@Moni\_Hazarika](https://discuss.elastic.co/u/Moni_Hazarika)\ **Replies:** 9\ **Last updated:** [August 7, 2024, 3:20am UTC](https://discuss.elastic.co/t/elastic-mapping-flattened-vs-field-wise/362151 "2024-08-07T03:20:14Z")
In our MongoDB if we have a collection where we have multiple field types like array, multi-level object, strings, numbers, dates etc. sample of a nested field/object is like - "ValuesDocument ":{"field1":"Value1","fiel… --- ## [How to get match count in string field for one document?](https://discuss.elastic.co/t/how-to-get-match-count-in-string-field-for-one-document/364501)
**Author:** [@karaagacylmaz](https://discuss.elastic.co/u/karaagacylmaz)\ **Replies:** 0\ **Last updated:** [August 6, 2024, 9:47pm UTC](https://discuss.elastic.co/t/how-to-get-match-count-in-string-field-for-one-document/364501 "2024-08-06T21:47:44Z")
Here is my ex document: { "categoryId" : 8, "productId" : 12, "starLevel" : 4.2, "reviewList" : \[ "foo", "bar", "foo bar", "foo bar f… --- ## [Counting Terms In Text Field](https://discuss.elastic.co/t/counting-terms-in-text-field/363790)
**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\ **Replies:** 3\ **Last updated:** [August 6, 2024, 8:40pm UTC](https://discuss.elastic.co/t/counting-terms-in-text-field/363790 "2024-08-06T20:40:11Z")
I'm using Logstash's RSS input to pull data into Elastic. I've configured the field title as a multi-type field, one as text, the other as a keyword. I want to count the frequency of words that appear in titles across … --- ## [Assistance with pruning Syslog plugin output](https://discuss.elastic.co/t/assistance-with-pruning-syslog-plugin-output/364497)
**Author:** [@L0rdV0ld3m0rt](https://discuss.elastic.co/u/L0rdV0ld3m0rt)\ **Replies:** 0\ **Last updated:** [August 6, 2024, 8:25pm UTC](https://discuss.elastic.co/t/assistance-with-pruning-syslog-plugin-output/364497 "2024-08-06T20:25:43Z")
First time trying to configure a Security Onion server to forward alerts on to a SIEM using the logstash syslog plugin. Have spent the better part of a day reading documentation and still at a loss. The config below is r… --- ## [Index \[.security-profile-8\] is unavailable","error":{"message":"unavailable\_shards\_exception](https://discuss.elastic.co/t/index-security-profile-8-is-unavailable-error-message-unavailable-shards-exception/364470)
**Author:** [@Raghav\_Gaur](https://discuss.elastic.co/u/Raghav_Gaur)\ **Replies:** 1\ **Last updated:** [August 6, 2024, 7:55pm UTC](https://discuss.elastic.co/t/index-security-profile-8-is-unavailable-error-message-unavailable-shards-exception/364470 "2024-08-06T19:55:45Z")
I am not able to login to kibana because of the error index \[.security-profile-8\] is unavailable","error":{"message":"unavailable\_shards\_exception. Primary and replica both shards are not available because the node havi… --- ## [Comparing different methods of rolling back database changes in pytest tests for SQLAlchemy](https://discuss.elastic.co/t/comparing-different-methods-of-rolling-back-database-changes-in-pytest-tests-for-sqlalchemy/364354)
**Author:** [@vivan](https://discuss.elastic.co/u/vivan)\ **Replies:** 1\ **Last updated:** [August 6, 2024, 7:51pm UTC](https://discuss.elastic.co/t/comparing-different-methods-of-rolling-back-database-changes-in-pytest-tests-for-sqlalchemy/364354 "2024-08-06T19:51:37Z")
I'm working on a project that uses FastAPI and SQL Alchemy asynchronously. I've written pytest tests for this project and have successfully implemented database rollback after each test run. I've found two different im… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=189) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=191)