# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1202 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1203 --- ## [Kibana shows internal server error after implementing Authentication](https://discuss.elastic.co/t/kibana-shows-internal-server-error-after-implementing-authentication/286308)
**Author:** [@Apoorv\_Singh](https://discuss.elastic.co/u/Apoorv_Singh)\ **Replies:** 2\ **Last updated:** [October 14, 2021, 5:16am UTC](https://discuss.elastic.co/t/kibana-shows-internal-server-error-after-implementing-authentication/286308 "2021-10-14T05:16:21Z")
I am trying to integrate my kibana dashboard into my website without password. To secure it I am using the auth\_request module of Nginx. But I am stuck at this error - Version: 7.14.1 Build: 42892 Error: Internal Server… --- ## [Filebeat not send logs to logstash on kubernetes](https://discuss.elastic.co/t/filebeat-not-send-logs-to-logstash-on-kubernetes/286671)
**Author:** [@dhody\_rhmd](https://discuss.elastic.co/u/dhody_rhmd)\ **Replies:** 0\ **Last updated:** [October 14, 2021, 4:32am UTC](https://discuss.elastic.co/t/filebeat-not-send-logs-to-logstash-on-kubernetes/286671 "2021-10-14T04:32:45Z")
Hello, I'm trying to send kubernetes logs with Filebeat and Logstash. I do have some deployment on the same namespace. I tried the suggested configuration for filebeat.yml from elastic in this \[link\].(https://raw.github… --- ## [Constant API Key Failures in Logs after enabling security](https://discuss.elastic.co/t/constant-api-key-failures-in-logs-after-enabling-security/286668)
**Author:** [@Heroj04](https://discuss.elastic.co/u/Heroj04)\ **Replies:** 1\ **Last updated:** [October 14, 2021, 4:16am UTC](https://discuss.elastic.co/t/constant-api-key-failures-in-logs-after-enabling-security/286668 "2021-10-14T04:16:38Z")
Just recently set up an Elasticsearch server. after enabling security and SSL I am seeing just constant apikey errors in the logs. Even if I shut down all other parts of the system (kibana/beats/fleet) they are still co… --- ## [Run logstash on ram](https://discuss.elastic.co/t/run-logstash-on-ram/286615)
**Author:** [@hatuli](https://discuss.elastic.co/u/hatuli)\ **Replies:** 1\ **Last updated:** [October 13, 2021, 10:09pm UTC](https://discuss.elastic.co/t/run-logstash-on-ram/286615 "2021-10-13T22:09:29Z")
Hi, im working with fluentbit to export the logs from my k8s env, then to kafka, logstash and in the end to elasticearch, the massages are indexing inside ES but after a while they stop to index, i conf heap to 8G, but s… --- ## [Drilldown on Kibana Scripted Fields](https://discuss.elastic.co/t/drilldown-on-kibana-scripted-fields/285520)
**Author:** [@mightykat](https://discuss.elastic.co/u/mightykat)\ **Replies:** 2\ **Last updated:** [October 13, 2021, 8:32pm UTC](https://discuss.elastic.co/t/drilldown-on-kibana-scripted-fields/285520 "2021-10-13T20:32:18Z")
Kibana: 7.1.1 Background: I created a few Scripted Fields in Kibana using painless to parse a list of key/value pairs. I use different scripts to produce data formats to enable various visualizations. For example: P… --- ## [Istio with Elastic Stack for Observability](https://discuss.elastic.co/t/istio-with-elastic-stack-for-observability/286607)
**Author:** [@denukak2000](https://discuss.elastic.co/u/denukak2000)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 10:42am UTC](https://discuss.elastic.co/t/istio-with-elastic-stack-for-observability/286607 "2021-10-13T10:42:55Z")
I am currently using Istio as service mesh with Kubernetes (On Prem). I want to implement observability infrastructure with Elastic Stack , I know Istio is supported for jaeger and Prometheus, But I have to capture dist… --- ## [Fleet Kibana Integration -\> To enable this usage, set xpack.enabled: true on the package config](https://discuss.elastic.co/t/fleet-kibana-integration-to-enable-this-usage-set-xpack-enabled-true-on-the-package-config/286660)
**Author:** [@zx8086](https://discuss.elastic.co/u/zx8086)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 8:19pm UTC](https://discuss.elastic.co/t/fleet-kibana-integration-to-enable-this-usage-set-xpack-enabled-true-on-the-package-config/286660 "2021-10-13T20:19:26Z")
Hi, How is this done with a Fleet Managed Setup ? xpack.enabled: true Would like to see the Kibana Stats in Stack Monitoring --- ## [How to perform natural sort on a field in Elasticsearch?](https://discuss.elastic.co/t/how-to-perform-natural-sort-on-a-field-in-elasticsearch/285854)
**Author:** [@tranindigo](https://discuss.elastic.co/u/tranindigo)\ **Replies:** 1\ **Last updated:** [October 13, 2021, 8:04pm UTC](https://discuss.elastic.co/t/how-to-perform-natural-sort-on-a-field-in-elasticsearch/285854 "2021-10-13T20:04:02Z")
I have an Elasticsearch keyword field called LocationNumber that I want to sort "alphanumerically" (or "naturally") so that it is easy for users to read. I have been researching this for days and couldn't find any real d… --- ## [How to work with Query Results in Vega](https://discuss.elastic.co/t/how-to-work-with-query-results-in-vega/286643)
**Author:** [@nsimi](https://discuss.elastic.co/u/nsimi)\ **Replies:** 9\ **Last updated:** [October 13, 2021, 7:47pm UTC](https://discuss.elastic.co/t/how-to-work-with-query-results-in-vega/286643 "2021-10-13T19:47:10Z")
Hello all, I am directly querying elasticseach from my vega visualization, and I am looking for some education on how to access the results of my query. Can anyone provide an example or point me at something that shows/… --- ## [What is the grok pattern that can match variable length documents from a single log file?](https://discuss.elastic.co/t/what-is-the-grok-pattern-that-can-match-variable-length-documents-from-a-single-log-file/285338)
**Author:** [@shi](https://discuss.elastic.co/u/shi)\ **Replies:** 8\ **Last updated:** [October 13, 2021, 7:41pm UTC](https://discuss.elastic.co/t/what-is-the-grok-pattern-that-can-match-variable-length-documents-from-a-single-log-file/285338 "2021-10-13T19:41:38Z")
I am having records/documents of variable lengths, say 3 types of logs coming in a single log fie. What is the grok pattern that can match variable length documents from a single log file? This grok pattern can be used… --- ## [Some Fields of index not listed in kibana - discover- under avilable fields , , eventhough shown in in index using GET command](https://discuss.elastic.co/t/some-fields-of-index-not-listed-in-kibana-discover-under-avilable-fields-eventhough-shown-in-in-index-using-get-command/286545)
**Author:** [@shi](https://discuss.elastic.co/u/shi)\ **Replies:** 2\ **Last updated:** [October 13, 2021, 6:43pm UTC](https://discuss.elastic.co/t/some-fields-of-index-not-listed-in-kibana-discover-under-avilable-fields-eventhough-shown-in-in-index-using-get-command/286545 "2021-10-13T18:43:07Z")
Following log entries are put in index 2021-09-27T03:35:53.263029+05:30 \_gateway devname="PPFW01" 2021-09-27T03:42:22.549689+05:30 \_gateway devname="PPFW02" 2021-09-27T04:02:36.089881+05:30 \_gateway devname="PPFW03" … --- ## [Adding sort to ES query returns inaccurate results?](https://discuss.elastic.co/t/adding-sort-to-es-query-returns-inaccurate-results/286549)
**Author:** [@bensalerno](https://discuss.elastic.co/u/bensalerno)\ **Replies:** 4\ **Last updated:** [October 13, 2021, 6:25pm UTC](https://discuss.elastic.co/t/adding-sort-to-es-query-returns-inaccurate-results/286549 "2021-10-13T18:25:38Z")
My queries are successfully returning the exact results that I am looking for. { "size":100, "from":0, "query":{ "bool":{ "must":\[ { "bool":{ "should"… --- ## [Does it make sense to add timestamp in "index sorting"?](https://discuss.elastic.co/t/does-it-make-sense-to-add-timestamp-in-index-sorting/286551)
**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\ **Replies:** 2\ **Last updated:** [October 13, 2021, 6:05pm UTC](https://discuss.elastic.co/t/does-it-make-sense-to-add-timestamp-in-index-sorting/286551 "2021-10-13T18:05:05Z")
The documentation suggests using low cardinality field(s) for index sorting. We often search documents with some low cardinality ID (like site or org) and then with timestamp. Does it make sense to include timestamp in… --- ## [Can I disable replicas in when index is getting data from logstash?](https://discuss.elastic.co/t/can-i-disable-replicas-in-when-index-is-getting-data-from-logstash/286647)
**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\ **Replies:** 2\ **Last updated:** [October 13, 2021, 5:10pm UTC](https://discuss.elastic.co/t/can-i-disable-replicas-in-when-index-is-getting-data-from-logstash/286647 "2021-10-13T17:10:15Z")
Hi, I have a large quantity of data being indexed in elastic, is taking a long time to do it, so it is posible to disable replicas when data is being indexed to Elasticsearch? can this create any problem? it will speed u… --- ## [Grok regex pattern for symbols?](https://discuss.elastic.co/t/grok-regex-pattern-for-symbols/286624)
**Author:** [@helloworld1234](https://discuss.elastic.co/u/helloworld1234)\ **Replies:** 5\ **Last updated:** [October 13, 2021, 4:44pm UTC](https://discuss.elastic.co/t/grok-regex-pattern-for-symbols/286624 "2021-10-13T16:44:24Z")
Lets say I have a string: "petBreed":"dachshund" "petName":"rufus" "petAge":"12" The value is not constant and can vary in length and content. And i want to use grok overwrite to remove rufus from the raw string. So… --- ## [Logstash - how to remove strings within a field (whose content itself a raw string)?](https://discuss.elastic.co/t/logstash-how-to-remove-strings-within-a-field-whose-content-itself-a-raw-string/286561)
**Author:** [@helloworld1234](https://discuss.elastic.co/u/helloworld1234)\ **Replies:** 3\ **Last updated:** [October 13, 2021, 4:22pm UTC](https://discuss.elastic.co/t/logstash-how-to-remove-strings-within-a-field-whose-content-itself-a-raw-string/286561 "2021-10-13T16:22:58Z")
I have a event that consists of various fields, one of which is called "raw\_message". This field's contents is a raw string eg. Input: raw\_message: "Raw user details:: \[location:london name:kris wu id:L3j5k category:vi… --- ## [New to Elasticsearch](https://discuss.elastic.co/t/new-to-elasticsearch/286631)
**Author:** [@Rodo\_Andrade](https://discuss.elastic.co/u/Rodo_Andrade)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 2:01pm UTC](https://discuss.elastic.co/t/new-to-elasticsearch/286631 "2021-10-13T14:01:14Z")
Hello, I'm fairly new to Elasticsearch. I'm using the NEST (7.11.1) to query a document field \[Text(TermVector = TermVectorOption.WithOffsets)\], it's storying large file text. For the sake of this example, I have 2 PDF… --- ## [Help, trying to get force directed vega graph working](https://discuss.elastic.co/t/help-trying-to-get-force-directed-vega-graph-working/285716)
**Author:** [@nsimi](https://discuss.elastic.co/u/nsimi)\ **Replies:** 12\ **Last updated:** [October 13, 2021, 3:35pm UTC](https://discuss.elastic.co/t/help-trying-to-get-force-directed-vega-graph-working/285716 "2021-10-13T15:35:31Z")
Hello All, I am trying to get a force directed graph working with my data in ES and vega, Here is a pastebin link to my vega code because its too long to post here. When I look at the dat with the VEGA\_DEBUG on the co… --- ## [AutoDiscover ServiceMonitor CRD on Kubernetes](https://discuss.elastic.co/t/autodiscover-servicemonitor-crd-on-kubernetes/286642)
**Author:** [@julianxhokaxhiu](https://discuss.elastic.co/u/julianxhokaxhiu)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 3:28pm UTC](https://discuss.elastic.co/t/autodiscover-servicemonitor-crd-on-kubernetes/286642 "2021-10-13T15:28:27Z")
Hi, I have a question about Metricsbeat. I've seen in the official documentation that the service supports AutoDiscovery which is great ( Autodiscover | Metricbeat Reference \[7.15\] | Elastic ). Officially it supports N… --- ## [Mismatch between ECS and Packetbeat 7.1.5 on some fields](https://discuss.elastic.co/t/mismatch-between-ecs-and-packetbeat-7-1-5-on-some-fields/286639)
**Author:** [@Soik](https://discuss.elastic.co/u/Soik)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 2:54pm UTC](https://discuss.elastic.co/t/mismatch-between-ecs-and-packetbeat-7-1-5-on-some-fields/286639 "2021-10-13T14:54:00Z")
There is a mismatch in the following fields between ECS and Packetbeat 7.1.5: dns.answers.ttl (String in packetbeat - Long in ECS Documentation) dns.id (Integer in packetbeat - String/Keyword in ECS Documentation) Is … --- ## [Filebeat daemon set misses last few lines of log on pod crash](https://discuss.elastic.co/t/filebeat-daemon-set-misses-last-few-lines-of-log-on-pod-crash/286640)
**Author:** [@TimWardFS](https://discuss.elastic.co/u/TimWardFS)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 3:14pm UTC](https://discuss.elastic.co/t/filebeat-daemon-set-misses-last-few-lines-of-log-on-pod-crash/286640 "2021-10-13T15:14:30Z")
I have seen a number of posts saying that when a Kubernetes pod crashes Filebeat loses the last few lines of log output, including, of course, the actual error message that tells you why the pod crashed. All the ones I'… --- ## [Scale ingest node based on number of application](https://discuss.elastic.co/t/scale-ingest-node-based-on-number-of-application/286566)
**Author:** [@alfianaf](https://discuss.elastic.co/u/alfianaf)\ **Replies:** 8\ **Last updated:** [October 13, 2021, 2:59pm UTC](https://discuss.elastic.co/t/scale-ingest-node-based-on-number-of-application/286566 "2021-10-13T14:59:16Z")
Hello, I have a plan to use ingest pipeline on my cluster, the plan is: 90 application will hit to elastic server, so I'll make around 200 pipeline on my cluster How can I scale the ingest node I need on my cluster to… --- ## [Remote cluster connect time out](https://discuss.elastic.co/t/remote-cluster-connect-time-out/286638)
**Author:** [@rachelyang](https://discuss.elastic.co/u/rachelyang)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 2:46pm UTC](https://discuss.elastic.co/t/remote-cluster-connect-time-out/286638 "2021-10-13T14:46:11Z")
I have two clusters; the remote cluster is single node on AWS. I have set up the same CA on both clusters, but they cannot connect due to time-out issue. Here is the error in log: \[2021-10-13T14:16:49,749\]\[WARN \]\[o.e.t.… --- ## [Filebeat 7.13.4 + Kubernetes 1.20: Hints-Based Autodiscover](https://discuss.elastic.co/t/filebeat-7-13-4-kubernetes-1-20-hints-based-autodiscover/286421)
**Author:** [@DougR](https://discuss.elastic.co/u/DougR)\ **Replies:** 2\ **Last updated:** [October 13, 2021, 2:40pm UTC](https://discuss.elastic.co/t/filebeat-7-13-4-kubernetes-1-20-hints-based-autodiscover/286421 "2021-10-13T14:40:54Z")
We just upgraded our Kubernetes cluster to 1.20 (current version of filebeat is 7.13.4). Of course, this means that Kubernetes logs are no longer in the same place they were under 1.19, and instead are in the following l… --- ## [ElasticSearch Search-as-you-type field type field with partial search](https://discuss.elastic.co/t/elasticsearch-search-as-you-type-field-type-field-with-partial-search/286635)
**Author:** [@Jacques\_du\_Plessis](https://discuss.elastic.co/u/Jacques_du_Plessis)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 2:34pm UTC](https://discuss.elastic.co/t/elasticsearch-search-as-you-type-field-type-field-with-partial-search/286635 "2021-10-13T14:34:40Z")
I recently updating my ngram implementation settings to use Search-as-you-type field type. Search-as-you-type field type | Elasticsearch Guide \[7.x\] | Elastic This worked great but I noticed that partial searching do… --- ## [Stack Monitoring fails to load logstash pipelines](https://discuss.elastic.co/t/stack-monitoring-fails-to-load-logstash-pipelines/281209)
**Author:** [@radovan](https://discuss.elastic.co/u/radovan)\ **Replies:** 26\ **Last updated:** [October 13, 2021, 2:29pm UTC](https://discuss.elastic.co/t/stack-monitoring-fails-to-load-logstash-pipelines/281209 "2021-10-13T14:29:46Z")
Hi, I decided to create a monitoring cluster and after a few problems at the start all is running now. There are metricbeat clients on the logstash nodes with only logstash-xpack module enabled. Logs are flowing onto th… --- ## [Displaying time lag data as an average over time using TSVB](https://discuss.elastic.co/t/displaying-time-lag-data-as-an-average-over-time-using-tsvb/286536)
**Author:** [@IceKing](https://discuss.elastic.co/u/IceKing)\ **Replies:** 1\ **Last updated:** [October 13, 2021, 2:18pm UTC](https://discuss.elastic.co/t/displaying-time-lag-data-as-an-average-over-time-using-tsvb/286536 "2021-10-13T14:18:24Z")
Hi, I would like some assistance please. I'm using Amazon OpenSearch Service (successor to Amazon Elasticsearch Service). Currently I have set of documents in my index that have following date/time fields "CreatedDa… --- ## [Kibana Query Question](https://discuss.elastic.co/t/kibana-query-question/285997)
**Author:** [@vladik22](https://discuss.elastic.co/u/vladik22)\ **Replies:** 4\ **Last updated:** [October 13, 2021, 2:09pm UTC](https://discuss.elastic.co/t/kibana-query-question/285997 "2021-10-13T14:09:32Z")
Hello guys Is it possible and how can I to filter documents from one index according to values from another index? For example I have 2 indexes Logs and Activities I want to see in visualisation documents from index… --- ## [Kibana showing incorrect timestamp](https://discuss.elastic.co/t/kibana-showing-incorrect-timestamp/286619)
**Author:** [@Sn4cK](https://discuss.elastic.co/u/Sn4cK)\ **Replies:** 1\ **Last updated:** [October 13, 2021, 1:22pm UTC](https://discuss.elastic.co/t/kibana-showing-incorrect-timestamp/286619 "2021-10-13T13:22:07Z")
Hello, I am having issue with how Kibana shows timestamps of my documents indexed in Elasticsearch. I have a document looking like: { "\_index": "speedtest", "\_type": "\_doc", "\_id": "1-nldXwBFYKxSrUSopKs", "\_ve… --- ## [Pipeline question](https://discuss.elastic.co/t/pipeline-question/286494)
**Author:** [@Worlock](https://discuss.elastic.co/u/Worlock)\ **Replies:** 13\ **Last updated:** [October 13, 2021, 1:00pm UTC](https://discuss.elastic.co/t/pipeline-question/286494 "2021-10-13T13:00:10Z")
Hi all, I have a field in my index that is named "Severity". The values can be either 2, 1 or 0. I want to rename those values to Critical, Warning or Informational. I looked into pipelines and also read the documentat… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1201) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1203)