# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1248 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1249 --- ## [No valid shards](https://discuss.elastic.co/t/no-valid-shards/282344)
**Author:** [@\_bugc4t](https://discuss.elastic.co/u/_bugc4t)\ **Replies:** 9\ **Last updated:** [September 8, 2021, 12:05pm UTC](https://discuss.elastic.co/t/no-valid-shards/282344 "2021-09-08T12:05:20Z")
I'm having some issues with my index where it won't allocate any shards so I can't create an Index Pattern. I've looked into the Stats on the Index Management page, which gets: "\_shards": { "total": 2, "succes… --- ## [Ranking Evaluation API Inquiry](https://discuss.elastic.co/t/ranking-evaluation-api-inquiry/283648)
**Author:** [@Ahmed\_Elsheikh](https://discuss.elastic.co/u/Ahmed_Elsheikh)\ **Replies:** 0\ **Last updated:** [September 8, 2021, 11:24am UTC](https://discuss.elastic.co/t/ranking-evaluation-api-inquiry/283648 "2021-09-08T11:24:26Z")
After reading about Ranking Evaluation API, and I am planning to use it in my search engine project, however, the following points were not clear to me Does it enhance search results as per query per user (set of users… --- ## [Connecting React to elasticsearch API without using AppSearch (Enterprise Search)](https://discuss.elastic.co/t/connecting-react-to-elasticsearch-api-without-using-appsearch-enterprise-search/283472)
**Author:** [@juslin03](https://discuss.elastic.co/u/juslin03)\ **Replies:** 2\ **Last updated:** [September 8, 2021, 11:06am UTC](https://discuss.elastic.co/t/connecting-react-to-elasticsearch-api-without-using-appsearch-enterprise-search/283472 "2021-09-08T11:06:19Z")
Hello everyone. I'm working on a feature that my boss asked me to do but I'm having some trouble. The goal is to connect our React application (generated with Search UI) directly with ElasticSearch without going throug… --- ## [Yum Repo not working?](https://discuss.elastic.co/t/yum-repo-not-working/283639)
**Author:** [@Marco\_Lazzarotto](https://discuss.elastic.co/u/Marco_Lazzarotto)\ **Replies:** 0\ **Last updated:** [September 8, 2021, 9:38am UTC](https://discuss.elastic.co/t/yum-repo-not-working/283639 "2021-09-08T09:38:22Z")
I have a Spacewalk running on CentOS which I have to replace with Katello. I've added https://artifacts.elastic.co/packages/7.x/yum as a repo to Katello (exactly as on Spacewalk), but when I try to sync with that reposi… --- ## [Sending logs to ElasticSearch directly](https://discuss.elastic.co/t/sending-logs-to-elasticsearch-directly/283640)
**Author:** [@adm3](https://discuss.elastic.co/u/adm3)\ **Replies:** 1\ **Last updated:** [September 8, 2021, 9:42am UTC](https://discuss.elastic.co/t/sending-logs-to-elasticsearch-directly/283640 "2021-09-08T09:42:38Z")
I'm trying to send logs directly to elasticsearch from Velocirpator, but I'm getting the below error when enabled xpack security features. below is my elastic config file ---------------------------------- Security -----… --- ## [Host details](https://discuss.elastic.co/t/host-details/283616)
**Author:** [@vijay\_kaali](https://discuss.elastic.co/u/vijay_kaali)\ **Replies:** 0\ **Last updated:** [September 8, 2021, 7:08am UTC](https://discuss.elastic.co/t/host-details/283616 "2021-09-08T07:08:50Z")
Hi i am using 6.8 metricbeat and server is 7.12 . a. add host metricset and got error , so enable add\_host\_metadata : ~ b . as per documentation . add\_host\_metadata it should collect "host":{ "architecture":"x86… --- ## [ES and KIBANA not keeping up with Suricata logs](https://discuss.elastic.co/t/es-and-kibana-not-keeping-up-with-suricata-logs/283636)
**Author:** [@nunex\_17](https://discuss.elastic.co/u/nunex_17)\ **Replies:** 0\ **Last updated:** [September 8, 2021, 9:29am UTC](https://discuss.elastic.co/t/es-and-kibana-not-keeping-up-with-suricata-logs/283636 "2021-09-08T09:29:31Z")
Hi. I implemented a Suricata server with Filebeat to send logs to elasticsearch. The logs are then displayed in Kibana via the Filebeat Suricata module. My problem is when I enable flow logging in the meericata log fil… --- ## [Filebeat Hints based not grabbing logs](https://discuss.elastic.co/t/filebeat-hints-based-not-grabbing-logs/283634)
**Author:** [@WookWook](https://discuss.elastic.co/u/WookWook)\ **Replies:** 0\ **Last updated:** [September 8, 2021, 9:02am UTC](https://discuss.elastic.co/t/filebeat-hints-based-not-grabbing-logs/283634 "2021-09-08T09:02:13Z")
Hello I set up Elastic Cloud on Kubernetes on a Managed Azure Redhat Openshift Cluster 4.6 My initial configuration with hints based autodiscover and a default config was working fine. It grabbed all logs and I could d… --- ## [Elastic can't connect remote cluster](https://discuss.elastic.co/t/elastic-cant-connect-remote-cluster/283003)
**Author:** [@lisiyu](https://discuss.elastic.co/u/lisiyu)\ **Replies:** 4\ **Last updated:** [September 8, 2021, 8:47am UTC](https://discuss.elastic.co/t/elastic-cant-connect-remote-cluster/283003 "2021-09-08T08:47:09Z")
Verison elasticsearch: 7.13.1 cluster-one and cluster-two have same config. apiVersion: apps/v1 kind: StatefulSet metadata: name: elasticsearch labels: app: elasticsearch spec: selector: matchLabels: … --- ## [Updation and deletion of fields from ingest attachment arrays](https://discuss.elastic.co/t/updation-and-deletion-of-fields-from-ingest-attachment-arrays/283619)
**Author:** [@Reghu\_Shanker](https://discuss.elastic.co/u/Reghu_Shanker)\ **Replies:** 1\ **Last updated:** [September 8, 2021, 8:06am UTC](https://discuss.elastic.co/t/updation-and-deletion-of-fields-from-ingest-attachment-arrays/283619 "2021-09-08T08:06:01Z")
Hi, I have documents with multiple attachments in each of them. I am using ingest attachment processor to extract data and store it in elastic search document. These attachments are stored in ingest attachment arrays.… --- ## [Pie Chart with Filters Aggregation ..what is my path (Sorry, I really haven't got a clue)?](https://discuss.elastic.co/t/pie-chart-with-filters-aggregation-what-is-my-path-sorry-i-really-havent-got-a-clue/282246)
**Author:** [@ChrizK](https://discuss.elastic.co/u/ChrizK)\ **Replies:** 9\ **Last updated:** [September 8, 2021, 7:35am UTC](https://discuss.elastic.co/t/pie-chart-with-filters-aggregation-what-is-my-path-sorry-i-really-havent-got-a-clue/282246 "2021-09-08T07:35:43Z")
The Test area within my organisation has implemented ELK. The main purpose is to capture, analyse and visualise logs produced by an in-house load tool. There are also other 'applications' which feed logs. I have mainl… --- ## [Help with complex DSL query/filter/grouping](https://discuss.elastic.co/t/help-with-complex-dsl-query-filter-grouping/282608)
**Author:** [@Bryan\_Hamilton](https://discuss.elastic.co/u/Bryan_Hamilton)\ **Replies:** 2\ **Last updated:** [September 8, 2021, 7:31am UTC](https://discuss.elastic.co/t/help-with-complex-dsl-query-filter-grouping/282608 "2021-09-08T07:31:47Z")
Hi all, I have 2 seperate queries and am trying to find a way to filter and only return documents matching both queries. Query01 = event.provider : "Microsoft-Windows-Sysmon" and event.code:"3" and destination.port:(… --- ## [How to load apm metrics data in Observability Metrics UI?](https://discuss.elastic.co/t/how-to-load-apm-metrics-data-in-observability-metrics-ui/283617)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 0\ **Last updated:** [September 8, 2021, 7:16am UTC](https://discuss.elastic.co/t/how-to-load-apm-metrics-data-in-observability-metrics-ui/283617 "2021-09-08T07:16:39Z")
I saw that kibana provides metrics, but it only loads metricsbeat index by default. I am a little curious. Since the apm server also collects metrics, how can I generate graphics from this part of the data? --- ## [Disk space not reducing after snapshot deletion](https://discuss.elastic.co/t/disk-space-not-reducing-after-snapshot-deletion/283301)
**Author:** [@arun\_sharma2](https://discuss.elastic.co/u/arun_sharma2)\ **Replies:** 7\ **Last updated:** [September 8, 2021, 6:59am UTC](https://discuss.elastic.co/t/disk-space-not-reducing-after-snapshot-deletion/283301 "2021-09-08T06:59:01Z")
Deleted snapshot of the indices but still the disk space is not reducing . --- ## [Property mapping elasticsearch](https://discuss.elastic.co/t/property-mapping-elasticsearch/283580)
**Author:** [@woal\_idal](https://discuss.elastic.co/u/woal_idal)\ **Replies:** 1\ **Last updated:** [September 8, 2021, 6:57am UTC](https://discuss.elastic.co/t/property-mapping-elasticsearch/283580 "2021-09-08T06:57:52Z")
When trying to read certain fields from ElasticSearch, I noticed that if I do not include a text attribute then it will not map the variable name to the field. It will read null for that specific field. Lets say I have a… --- ## [Unable to setup Beats on my local system](https://discuss.elastic.co/t/unable-to-setup-beats-on-my-local-system/283614)
**Author:** [@Adhi](https://discuss.elastic.co/u/Adhi)\ **Replies:** 2\ **Last updated:** [September 8, 2021, 6:51am UTC](https://discuss.elastic.co/t/unable-to-setup-beats-on-my-local-system/283614 "2021-09-08T06:51:09Z")
Hello, I'm having trouble seting up both filebeat and metricbeat agent in my local system. Im currently using the 14 days free cloud trail version, I have followed the steps given. So whenever I ran setup command, im … --- ## [Combine separated JSON logs in k8s](https://discuss.elastic.co/t/combine-separated-json-logs-in-k8s/283510)
**Author:** [@Dennis\_Haseloff](https://discuss.elastic.co/u/Dennis_Haseloff)\ **Replies:** 1\ **Last updated:** [September 8, 2021, 6:49am UTC](https://discuss.elastic.co/t/combine-separated-json-logs-in-k8s/283510 "2021-09-08T06:49:01Z")
Hi all, We are using a filebeat daemon set with autodisocover to scrape all container logs which are all in the JSON logstash format. Using docker container runtime, the docker json-file driver splits bigger logs into 1… --- ## [Add output kafka Idempotent](https://discuss.elastic.co/t/add-output-kafka-idempotent/283594)
**Author:** [@Icedroid](https://discuss.elastic.co/u/Icedroid)\ **Replies:** 1\ **Last updated:** [September 8, 2021, 6:30am UTC](https://discuss.elastic.co/t/add-output-kafka-idempotent/283594 "2021-09-08T06:30:11Z")
I need output to kafka for at most once . Can I create a pull request to beats output kafka as follow: if config.Idempotent { k.Producer.Idempotent = config.Idempotent k.Net.MaxOpenRequests = 1 k.Producer.Require… --- ## [Wrong result in tsvb](https://discuss.elastic.co/t/wrong-result-in-tsvb/283552)
**Author:** [@vijay\_kaali](https://discuss.elastic.co/u/vijay_kaali)\ **Replies:** 2\ **Last updated:** [September 8, 2021, 6:29am UTC](https://discuss.elastic.co/t/wrong-result-in-tsvb/283552 "2021-09-08T06:29:02Z")
i am trying to get uptime . i have created Gauge TSVB aggregation and it shows - days but i can see data , if i have same in data table attached is the screen shot --- ## [Change snapshot directory](https://discuss.elastic.co/t/change-snapshot-directory/283055)
**Author:** [@Cihan\_Tunali](https://discuss.elastic.co/u/Cihan_Tunali)\ **Replies:** 1\ **Last updated:** [September 8, 2021, 6:22am UTC](https://discuss.elastic.co/t/change-snapshot-directory/283055 "2021-09-08T06:22:40Z")
Hello I am using a shared folder to store snapshots which is a nfs. I need to change NFS directory but I dont want to lose existing backups. I copied existing data to new folder and added that new folder as new reposito… --- ## [Updating Logstash Keystore Key-Values Externally](https://discuss.elastic.co/t/updating-logstash-keystore-key-values-externally/283611)
**Author:** [@nitvakhare](https://discuss.elastic.co/u/nitvakhare)\ **Replies:** 0\ **Last updated:** [September 8, 2021, 5:52am UTC](https://discuss.elastic.co/t/updating-logstash-keystore-key-values-externally/283611 "2021-09-08T05:52:43Z")
Hi, I wanted to know that if there is any option to update the existing key-value pair in the Logstash keystore externally. I am storing 'username' and 'password' fields in this keystore manually for now. But, I want to… --- ## [Corrupted Kibana Saved Object](https://discuss.elastic.co/t/corrupted-kibana-saved-object/283521)
**Author:** [@msszafar](https://discuss.elastic.co/u/msszafar)\ **Replies:** 4\ **Last updated:** [September 8, 2021, 5:27am UTC](https://discuss.elastic.co/t/corrupted-kibana-saved-object/283521 "2021-09-08T05:27:43Z")
Hey, Can anyone please tell me how to check the corrupted saved object of kibana? Context: I'm intended to upgrade kibana. If any kibana saved object is corrupt then upgrade fails, so its workaround is to manually find … --- ## [Error in Netty pipeline: java.io.IOException: Connection reset by peer](https://discuss.elastic.co/t/error-in-netty-pipeline-java-io-ioexception-connection-reset-by-peer/283606)
**Author:** [@smm](https://discuss.elastic.co/u/smm)\ **Replies:** 0\ **Last updated:** [September 8, 2021, 5:04am UTC](https://discuss.elastic.co/t/error-in-netty-pipeline-java-io-ioexception-connection-reset-by-peer/283606 "2021-09-08T05:04:23Z")
Dear community, in my logstash 7.8.1 logs I get this error message quite a lot: \[2021-09-07T08:36:56,031\]\[ERROR\]\[logstash.inputs.tcp \]\[main\] Error in Netty pipeline: java.io.IOException: Connection reset by peer It on… --- ## [Filter to change the field name to be more user friendly](https://discuss.elastic.co/t/filter-to-change-the-field-name-to-be-more-user-friendly/283543)
**Author:** [@Shreesh\_Narayanan](https://discuss.elastic.co/u/Shreesh_Narayanan)\ **Replies:** 2\ **Last updated:** [September 8, 2021, 4:38am UTC](https://discuss.elastic.co/t/filter-to-change-the-field-name-to-be-more-user-friendly/283543 "2021-09-08T04:38:16Z")
Hello, I have a log line for diskusage such as disk-usage: \[1\]=76% \[2\]=26% \[3\]=26% \[4\]=24% \[5\]=24% \[6\]=28% i used dissect and kv to get the values as needed . { "@timestamp" =\> 2021-09-06T08:22:46.944Z, … --- ## [Configure Email using watcher](https://discuss.elastic.co/t/configure-email-using-watcher/283498)
**Author:** [@Bryce\_Fernandes](https://discuss.elastic.co/u/Bryce_Fernandes)\ **Replies:** 4\ **Last updated:** [September 8, 2021, 3:37am UTC](https://discuss.elastic.co/t/configure-email-using-watcher/283498 "2021-09-08T03:37:19Z")
Hi, I want to setup email alerting on cluster using watcher. I have done this before on single node cluster and worked fine. Have query regarding the setup on multi node cluster. Do i have to update the email settings … --- ## [Clarify behavior of FunctionScoreQuery when there are more than \`size\` matches to the \`query\`](https://discuss.elastic.co/t/clarify-behavior-of-functionscorequery-when-there-are-more-than-size-matches-to-the-query/283596)
**Author:** [@alexklibisz](https://discuss.elastic.co/u/alexklibisz)\ **Replies:** 0\ **Last updated:** [September 8, 2021, 2:25am UTC](https://discuss.elastic.co/t/clarify-behavior-of-functionscorequery-when-there-are-more-than-size-matches-to-the-query/283596 "2021-09-08T02:25:21Z")
I'm running into an issue with the FunctionScoreQuery and would appreciate some clarification of the query behavior. Say I'm running a function\_score query with size=100. The actual query matches 101 documents. How many… --- ## [How to seed a dashboard png via webhook weekly?](https://discuss.elastic.co/t/how-to-seed-a-dashboard-png-via-webhook-weekly/283557)
**Author:** [@Liangliang\_Qiu](https://discuss.elastic.co/u/Liangliang_Qiu)\ **Replies:** 2\ **Last updated:** [September 8, 2021, 1:27am UTC](https://discuss.elastic.co/t/how-to-seed-a-dashboard-png-via-webhook-weekly/283557 "2021-09-08T01:27:21Z")
Here we want to use watcher to send a weekly png report into a group such Wechat etc, which is produced from dashboard periodically. Email report is able to use attachment, while webhook doesn't have this parameter. I u… --- ## [Log kernel messages](https://discuss.elastic.co/t/log-kernel-messages/283593)
**Author:** [@jmcclelland](https://discuss.elastic.co/u/jmcclelland)\ **Replies:** 0\ **Last updated:** [September 8, 2021, 1:21am UTC](https://discuss.elastic.co/t/log-kernel-messages/283593 "2021-09-08T01:21:17Z")
In my journalbeat.yml file I'm using include\_matches under journalbeat.inputs to restrict the logs shipped to elasticsearch by systemd.units. But... how do I also include the output I get via journalctl -k (kernel messag… --- ## [Best way to index human names?](https://discuss.elastic.co/t/best-way-to-index-human-names/283591)
**Author:** [@rdate](https://discuss.elastic.co/u/rdate)\ **Replies:** 0\ **Last updated:** [September 8, 2021, 12:30am UTC](https://discuss.elastic.co/t/best-way-to-index-human-names/283591 "2021-09-08T00:30:07Z")
Hello! I am building an index that includes personal names and after a bunch of searching around I haven't been able to find the best way to index these names to allow for the large amount of variation in name constructi… --- ## [Validation\_exception: Validation Failed: 1: this action would add \[2\] total shards, but this cluster currently has \[2000\]/\[2000\] maximum shards open;](https://discuss.elastic.co/t/validation-exception-validation-failed-1-this-action-would-add-2-total-shards-but-this-cluster-currently-has-2000-2000-maximum-shards-open/283462)
**Author:** [@Danilo\_Camargo](https://discuss.elastic.co/u/Danilo_Camargo)\ **Replies:** 7\ **Last updated:** [September 7, 2021, 11:53pm UTC](https://discuss.elastic.co/t/validation-exception-validation-failed-1-this-action-would-add-2-total-shards-but-this-cluster-currently-has-2000-2000-maximum-shards-open/283462 "2021-09-07T23:53:23Z")
Hi everyone. I know this is a similar topic to others, but so far it seems odd to me still. I have the message above on my instance, however when I query for \_cluster/stats I have this: "cluster\_name" : "docker-cluster"… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1247) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1249)