# \#none **URL:** https://discuss.elastic.co/tag/none.md?no_tags=true&page=899 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 900 --- ## [Problem parsing date with date filter](https://discuss.elastic.co/t/problem-parsing-date-with-date-filter/277329)
**Author:** [@Neelu\_Chandrasekhar](https://discuss.elastic.co/u/Neelu_Chandrasekhar)\ **Replies:** 0\ **Last updated:** [June 29, 2021, 9:47am UTC](https://discuss.elastic.co/t/problem-parsing-date-with-date-filter/277329 "2021-06-29T09:47:49Z")
I have a log like this {"log":"{\\"@timestamp\\":\\"2021-06-01T02:08:25.7387857-04:00\\",\\"level\\":\\"Information\\",\\"messageTemplate\\":\\"Got patients request\\",\\"message\\":\\"Got patients request I am trying to parse date w… --- ## [Performance impact of changing number\_of\_replicas on a live index](https://discuss.elastic.co/t/performance-impact-of-changing-number-of-replicas-on-a-live-index/277191)
**Author:** [@ghallas](https://discuss.elastic.co/u/ghallas)\ **Replies:** 1\ **Last updated:** [June 29, 2021, 9:21am UTC](https://discuss.elastic.co/t/performance-impact-of-changing-number-of-replicas-on-a-live-index/277191 "2021-06-29T09:21:12Z")
Hello, I have a cluster with 3 master nodes and 9 data nodes. My main index has 3 shards, and number\_of\_replicas:1 . It also has some 5 million documents, and receives around 30 requests per second. Data node CPU util… --- ## [ECE Firewall /communication patterns](https://discuss.elastic.co/t/ece-firewall-communication-patterns/277324)
**Author:** [@Mats](https://discuss.elastic.co/u/Mats)\ **Replies:** 0\ **Last updated:** [June 29, 2021, 8:51am UTC](https://discuss.elastic.co/t/ece-firewall-communication-patterns/277324 "2021-06-29T08:51:03Z")
Standard disclaimer: I'm new to ECE so I might be missing something. I'm trying to learn the communication patterns in ECE to be able to create a good set of firewall rules. I have seen Networking prerequisites | Elast… --- ## [Kibana Query Language (KQL) library to convert KQL to ElasticSearch Query](https://discuss.elastic.co/t/kibana-query-language-kql-library-to-convert-kql-to-elasticsearch-query/276722)
**Author:** [@Saurabh\_Kumar](https://discuss.elastic.co/u/Saurabh_Kumar)\ **Replies:** 3\ **Last updated:** [June 29, 2021, 8:31am UTC](https://discuss.elastic.co/t/kibana-query-language-kql-library-to-convert-kql-to-elasticsearch-query/276722 "2021-06-29T08:31:02Z")
Hello Experts, I am trying to create DataQueryInterface (API Layer) which is independent from backend Datasource. Current I am thinking to have ElasticSearch as my datasource but in future if I want to move out of Elast… --- ## [Unable to get new logstash data after using DELETE /logstash](https://discuss.elastic.co/t/unable-to-get-new-logstash-data-after-using-delete-logstash/277309)
**Author:** [@vikram.sablok](https://discuss.elastic.co/u/vikram.sablok)\ **Replies:** 0\ **Last updated:** [June 29, 2021, 7:41am UTC](https://discuss.elastic.co/t/unable-to-get-new-logstash-data-after-using-delete-logstash/277309 "2021-06-29T07:41:13Z")
Unable to get new logstash data after using DELETE /logstash. The data is fetched from logstash using JDBC to logstash however this is not visible in Kibana --- ## [Elasticsearch mapping](https://discuss.elastic.co/t/elasticsearch-mapping/277303)
**Author:** [@kanchan\_thakur](https://discuss.elastic.co/u/kanchan_thakur)\ **Replies:** 0\ **Last updated:** [June 29, 2021, 7:32am UTC](https://discuss.elastic.co/t/elasticsearch-mapping/277303 "2021-06-29T07:32:03Z")
Hi, I am using User dictionary rules in Kuromoji tokenizer in ES mapping. When I am feeding my data to Elasticsearch cluster it mapped some of the keywords strangely like keyword 禰󠄀豆子. I got that ES normalizes the … --- ## [Logstash stucks if Index is not available](https://discuss.elastic.co/t/logstash-stucks-if-index-is-not-available/277173)
**Author:** [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\ **Replies:** 1\ **Last updated:** [June 29, 2021, 7:23am UTC](https://discuss.elastic.co/t/logstash-stucks-if-index-is-not-available/277173 "2021-06-29T07:23:08Z")
Hello Team I am using Elasticsearch version 7.8.0 and Logstash 7.8.0. I am trying to extract data from Elasticsearch index to csv file. I am using a script to perform the activity for various different indexes created… --- ## [Use Office 365 module in Logstash?](https://discuss.elastic.co/t/use-office-365-module-in-logstash/276528)
**Author:** [@riahc3](https://discuss.elastic.co/u/riahc3)\ **Replies:** 3\ **Last updated:** [June 29, 2021, 7:21am UTC](https://discuss.elastic.co/t/use-office-365-module-in-logstash/276528 "2021-06-29T07:21:00Z")
Hello Is it possible to use the Office 365 module with Logstash? Thanks --- ## [I can't figure out How to create a histogram that's sorted wrt it's corresponding value](https://discuss.elastic.co/t/i-cant-figure-out-how-to-create-a-histogram-thats-sorted-wrt-its-corresponding-value/277168)
**Author:** [@Dhruv\_Makwana](https://discuss.elastic.co/u/Dhruv_Makwana)\ **Replies:** 3\ **Last updated:** [June 29, 2021, 7:09am UTC](https://discuss.elastic.co/t/i-cant-figure-out-how-to-create-a-histogram-thats-sorted-wrt-its-corresponding-value/277168 "2021-06-29T07:09:44Z")
My graph looks something like this. I want the bars to sorted wrt the request time. I've tried "Order by" field. But it's not giving me the result I desire. Maybe I'm missing something. Please help me out. --- ## [L32sv2 vs DS5v2 on Azure](https://discuss.elastic.co/t/l32sv2-vs-ds5v2-on-azure/277083)
**Author:** [@porscheme](https://discuss.elastic.co/u/porscheme)\ **Replies:** 6\ **Last updated:** [June 29, 2021, 6:31am UTC](https://discuss.elastic.co/t/l32sv2-vs-ds5v2-on-azure/277083 "2021-06-29T06:31:15Z")
For deploying huge Elasticsearch which Azure VM SKU is better? DS5v2 – Intel Xeon processor RAM: 56 GB vCPU(s): 16 Managed Disk: Premium SSD L32s v2: AMD EPYC 7551 processor RAM: 256 GB vCPU(s): 32 Local NVMe pre… --- ## [How can I sort String with has\_parent in ElasticSearch](https://discuss.elastic.co/t/how-can-i-sort-string-with-has-parent-in-elasticsearch/277289)
**Author:** [@ryo](https://discuss.elastic.co/u/ryo)\ **Replies:** 0\ **Last updated:** [June 29, 2021, 6:07am UTC](https://discuss.elastic.co/t/how-can-i-sort-string-with-has-parent-in-elasticsearch/277289 "2021-06-29T06:07:17Z")
I use has\_parent for query data, but I want to sort this data follow some parent field which is a String . I tried to find solutions, I found how to sort in ElasticSearch documents "query": { "has\_parent" : { … --- ## [How can we add URL links in data table to different dashboards](https://discuss.elastic.co/t/how-can-we-add-url-links-in-data-table-to-different-dashboards/276901)
**Author:** [@Prasanth\_V](https://discuss.elastic.co/u/Prasanth_V)\ **Replies:** 4\ **Last updated:** [June 29, 2021, 5:42am UTC](https://discuss.elastic.co/t/how-can-we-add-url-links-in-data-table-to-different-dashboards/276901 "2021-06-29T05:42:24Z")
I need create a table, having some links in each row for different dashboards --- ## [File input doesn t read incoming Json file from web application but when modified everythnig is fine](https://discuss.elastic.co/t/file-input-doesn-t-read-incoming-json-file-from-web-application-but-when-modified-everythnig-is-fine/277284)
**Author:** [@hadii](https://discuss.elastic.co/u/hadii)\ **Replies:** 0\ **Last updated:** [June 29, 2021, 4:56am UTC](https://discuss.elastic.co/t/file-input-doesn-t-read-incoming-json-file-from-web-application-but-when-modified-everythnig-is-fine/277284 "2021-06-29T04:56:27Z")
I have to project in rails which have huge logs, I want to parse them in logstash and kibana, the problem is when logs do from web application logstash could not pars them but after modified them even very unused change … --- ## [InnerHitBuilder field query](https://discuss.elastic.co/t/innerhitbuilder-field-query/277280)
**Author:** [@111487](https://discuss.elastic.co/u/111487)\ **Replies:** 0\ **Last updated:** [June 29, 2021, 3:56am UTC](https://discuss.elastic.co/t/innerhitbuilder-field-query/277280 "2021-06-29T03:56:27Z")
I have some questions.in the InnerHitBuilder field query , Can I support custom queries for Innerhitbuilder field queries? --- ## [Get datetime from logs](https://discuss.elastic.co/t/get-datetime-from-logs/277175)
**Author:** [@Rashmika\_Gamage](https://discuss.elastic.co/u/Rashmika_Gamage)\ **Replies:** 2\ **Last updated:** [June 29, 2021, 3:45am UTC](https://discuss.elastic.co/t/get-datetime-from-logs/277175 "2021-06-29T03:45:10Z")
I am trying to get logs to Kibana using logstash and filebeats. However kibana doesn't take data and time (which in the logs) as datetime. Instead in takes as string and cannot change format as well . Appreciate your he… --- ## [Planned total network page - how will the cluster react?](https://discuss.elastic.co/t/planned-total-network-page-how-will-the-cluster-react/277235)
**Author:** [@ankh](https://discuss.elastic.co/u/ankh)\ **Replies:** 4\ **Last updated:** [June 29, 2021, 3:10am UTC](https://discuss.elastic.co/t/planned-total-network-page-how-will-the-cluster-react/277235 "2021-06-29T03:10:07Z")
We have a planned network outage for 8 hours that will stop communication between all hosts, including between nodes in our elastic cluster. We have 3 master nodes and 2 minimum master nodes set. Using logstash to write… --- ## [Endpoints not showing up in Security Administration](https://discuss.elastic.co/t/endpoints-not-showing-up-in-security-administration/276878)
**Author:** [@Jukocross](https://discuss.elastic.co/u/Jukocross)\ **Replies:** 4\ **Last updated:** [June 29, 2021, 2:10am UTC](https://discuss.elastic.co/t/endpoints-not-showing-up-in-security-administration/276878 "2021-06-29T02:10:35Z")
Security administration unable to detect any host despite able to enroll the host with elastic agent (Status: Healthy). Installed version 7.13.2 ELK stack with self signed certificates. Setup fleet server and able to… --- ## [How to make elasticsearch returns products from stores that deliver to the user's region?](https://discuss.elastic.co/t/how-to-make-elasticsearch-returns-products-from-stores-that-deliver-to-the-users-region/277234)
**Author:** [@ironzep](https://discuss.elastic.co/u/ironzep)\ **Replies:** 1\ **Last updated:** [June 29, 2021, 2:01am UTC](https://discuss.elastic.co/t/how-to-make-elasticsearch-returns-products-from-stores-that-deliver-to-the-users-region/277234 "2021-06-29T02:01:06Z")
I am struggling with this for a time. The scenario is the following: I have an elasticsearch index which has products and each product has a store. The store has fields that store its latitude, longitude and the max dist… --- ## [Shard Allocation Failures After 5 Retries](https://discuss.elastic.co/t/shard-allocation-failures-after-5-retries/276969)
**Author:** [@xianhechen](https://discuss.elastic.co/u/xianhechen)\ **Replies:** 2\ **Last updated:** [June 28, 2021, 11:54pm UTC](https://discuss.elastic.co/t/shard-allocation-failures-after-5-retries/276969 "2021-06-28T23:54:03Z")
Hi, We have a 23 nodes cluster with 5 master nodes, 3 coordinator nodes, and 15 data nodes. Our index has a total of 30 primary shards and 3 replicas. Size of the index is around 800Gb. Earlier this week we found that t… --- ## [Figure out shard size from size before creating Elasticsearch index in python](https://discuss.elastic.co/t/figure-out-shard-size-from-size-before-creating-elasticsearch-index-in-python/276302)
**Author:** [@NLSVTN](https://discuss.elastic.co/u/NLSVTN)\ **Replies:** 3\ **Last updated:** [June 28, 2021, 9:45pm UTC](https://discuss.elastic.co/t/figure-out-shard-size-from-size-before-creating-elasticsearch-index-in-python/276302 "2021-06-28T21:45:32Z")
Hi, We need to know the size of each shard before creating an index in ES. We are using Hail python library, and have MatrixTable that we convert to Table, and then write to Elasticsearch: mt = mt.rows() # Converts ne… --- ## [Logstash Create new field from existing field and remove character from new field](https://discuss.elastic.co/t/logstash-create-new-field-from-existing-field-and-remove-character-from-new-field/277268)
**Author:** [@Annette1](https://discuss.elastic.co/u/Annette1)\ **Replies:** 4\ **Last updated:** [June 28, 2021, 9:16pm UTC](https://discuss.elastic.co/t/logstash-create-new-field-from-existing-field-and-remove-character-from-new-field/277268 "2021-06-28T21:16:45Z")
I have a simple request but seem unable to be able execute it correctly. I have a field named logname that has several name forms. For instance are logname-app, logname-os, logname-access, and logname. The logname is … --- ## [Setting the default route for Kibana](https://discuss.elastic.co/t/setting-the-default-route-for-kibana/277270)
**Author:** [@Rafael\_Ribeiro](https://discuss.elastic.co/u/Rafael_Ribeiro)\ **Replies:** 1\ **Last updated:** [June 28, 2021, 9:15pm UTC](https://discuss.elastic.co/t/setting-the-default-route-for-kibana/277270 "2021-06-28T21:15:50Z")
Hello, I am trying to change the default route for Kibana on Stack Management \> Advanced Settings to /app/discover. But every time I log into Kibana, I am redirected to /app/home. I am using Elasticsearch 7.10 (AWS man… --- ## [Which node to connect to](https://discuss.elastic.co/t/which-node-to-connect-to/276408)
**Author:** [@Bo-Wyatt](https://discuss.elastic.co/u/Bo-Wyatt)\ **Replies:** 3\ **Last updated:** [June 28, 2021, 7:55pm UTC](https://discuss.elastic.co/t/which-node-to-connect-to/276408 "2021-06-28T19:55:55Z")
Hello, this is a dum question. But I have two nodes on my cluster (One is master). And I always use the master IP (or URL) to fetch for Info, for example in my Grafana data source I use the Node1 URL to Connect. Is alwa… --- ## [High system load during search when total index size is large](https://discuss.elastic.co/t/high-system-load-during-search-when-total-index-size-is-large/274439)
**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\ **Replies:** 8\ **Last updated:** [June 28, 2021, 6:56pm UTC](https://discuss.elastic.co/t/high-system-load-during-search-when-total-index-size-is-large/274439 "2021-06-28T18:56:56Z")
I have a cluster setup where some nodes can experience high system load for a specific index. Index The index is time-based, and is named as such: index-2021.03 index-2021.04 index-2021.05 In other words, I begin a n… --- ## [Output Using CEF codec and to Kafka Server](https://discuss.elastic.co/t/output-using-cef-codec-and-to-kafka-server/277243)
**Author:** [@Wilks](https://discuss.elastic.co/u/Wilks)\ **Replies:** 4\ **Last updated:** [June 28, 2021, 6:34pm UTC](https://discuss.elastic.co/t/output-using-cef-codec-and-to-kafka-server/277243 "2021-06-28T18:34:01Z")
Hi, Is there a way to nest the Output statement so that I can first output using the CEF codec and then Output to a Kafka topic. The requirement is that I have to covert the data to CEF and then send to a Kafka topic. … --- ## [How to build a plugin for a not yet released version?](https://discuss.elastic.co/t/how-to-build-a-plugin-for-a-not-yet-released-version/276833)
**Author:** [@rafis](https://discuss.elastic.co/u/rafis)\ **Replies:** 6\ **Last updated:** [June 28, 2021, 6:21pm UTC](https://discuss.elastic.co/t/how-to-build-a-plugin-for-a-not-yet-released-version/276833 "2021-06-28T18:21:04Z")
Hello, I need to test a fix for elasticsearch 7.14.0 code with my plugin installed. The plugin version must match to be installed, but the latest publicly available build-tools is 7.13.2. I can build elasticsearch-7.14.… --- ## [Find newly added Event that have a unique ID](https://discuss.elastic.co/t/find-newly-added-event-that-have-a-unique-id/276690)
**Author:** [@Zentas](https://discuss.elastic.co/u/Zentas)\ **Replies:** 5\ **Last updated:** [June 28, 2021, 6:10pm UTC](https://discuss.elastic.co/t/find-newly-added-event-that-have-a-unique-id/276690 "2021-06-28T18:10:29Z")
Hello, is there any existing feature or way to do this? I need to see Data that has been newly added (fresh ID) in a specific time frame. Example: Time 12:00 Data: Ex 1 - ID: 1 - Name: ... Ex 2 - ID: 2 - Name: ... … --- ## [Can not purge Logstash](https://discuss.elastic.co/t/can-not-purge-logstash/277225)
**Author:** [@Vladimir](https://discuss.elastic.co/u/Vladimir)\ **Replies:** 2\ **Last updated:** [June 28, 2021, 5:44pm UTC](https://discuss.elastic.co/t/can-not-purge-logstash/277225 "2021-06-28T17:44:17Z")
Hi, can somebody help me please to remove logstash from Ubuntu? I had a broken Elastic + Kibana + Logstash + Filebeat installtion so I decided to remove it completely and start installation again. All packages are gone … --- ## [Alphabetically sort name field](https://discuss.elastic.co/t/alphabetically-sort-name-field/276505)
**Author:** [@gautamz07](https://discuss.elastic.co/u/gautamz07)\ **Replies:** 2\ **Last updated:** [June 28, 2021, 5:26pm UTC](https://discuss.elastic.co/t/alphabetically-sort-name-field/276505 "2021-06-28T17:26:13Z")
I have the following definition for the name field "name": { "type": "text", "fields": { "keyword": { "type": "keyword", "ignore\_above": 256 } } }, How do i sort this alphabetically ? I am tr… --- ## [Elastic Agent filling up disk space with logs, disaster](https://discuss.elastic.co/t/elastic-agent-filling-up-disk-space-with-logs-disaster/276668)
**Author:** [@Achilleas](https://discuss.elastic.co/u/Achilleas)\ **Replies:** 6\ **Last updated:** [June 28, 2021, 5:03pm UTC](https://discuss.elastic.co/t/elastic-agent-filling-up-disk-space-with-logs-disaster/276668 "2021-06-28T17:03:52Z")
We had a meltdown on one of our servers, where the elastic agent filled up the disk space with logs (36GB of text logfiles, in 2 months), from a trial we had on the Elastic Cloud. I know I am to blame for installing an … [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=898) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=900)