# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=819

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 820

---

## [Elasticsearch fleet error](https://discuss.elastic.co/t/elasticsearch-fleet-error/312117)

<div class="topic-metadata">

**Author:** [@alex\_96](https://discuss.elastic.co/u/alex_96)\
**Replies:** 4\
**Last updated:** [August 24, 2022, 11:23pm UTC](https://discuss.elastic.co/t/elasticsearch-fleet-error/312117 "2022-08-24T23:23:29Z")

</div>

Good evening, I use elastic 7.17.5 and fleet 7.17, on Sunday after 18:00 notifications to Microsoft 365 integration stopped coming, or rather they do, but a strictly fixed amount in a period of time, the error is as foll…

---

## [API: UpdateRequest question](https://discuss.elastic.co/t/api-updaterequest-question/312843)

<div class="topic-metadata">

**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\
**Replies:** 0\
**Last updated:** [August 24, 2022, 10:32pm UTC](https://discuss.elastic.co/t/api-updaterequest-question/312843 "2022-08-24T22:32:36Z")

</div>

bulkRequest.add(new UpdateRequest(index, id).doc(asMap).upsert(asMap)); Can somebody please point me to an explanation on when to use ".doc()" and ".upsert()"? My above example works, but java memory analyzer shows the…

---

## [How to custom sort](https://discuss.elastic.co/t/how-to-custom-sort/312838)

<div class="topic-metadata">

**Author:** [@Guilherme\_Mello](https://discuss.elastic.co/u/Guilherme_Mello)\
**Replies:** 1\
**Last updated:** [August 24, 2022, 10:30pm UTC](https://discuss.elastic.co/t/how-to-custom-sort/312838 "2022-08-24T22:30:25Z")

</div>

Hello. I'm building a retail search. This search needs to give priority to products from certain stores (they pay to be more relevant). The roducts from these stores need to appear more frequently in the search. I'm …

---

## [Failed to stop elasticsearch.service: Unit elasticsearch.service not loaded](https://discuss.elastic.co/t/failed-to-stop-elasticsearch-service-unit-elasticsearch-service-not-loaded/312824)

<div class="topic-metadata">

**Author:** [@Boodle](https://discuss.elastic.co/u/Boodle)\
**Replies:** 2\
**Last updated:** [August 24, 2022, 10:21pm UTC](https://discuss.elastic.co/t/failed-to-stop-elasticsearch-service-unit-elasticsearch-service-not-loaded/312824 "2022-08-24T22:21:35Z")

</div>

Following this to upgrade Elasticsearch. When shutting down the single node with 'sudo service elasticsearch stop' gets error: "Failed to stop elasticsearch.service: Unit elasticsearch.service not loaded." Upgrading El…

---

## [Is it possible to let elasticsearch choose the index to ingest](https://discuss.elastic.co/t/is-it-possible-to-let-elasticsearch-choose-the-index-to-ingest/312343)

<div class="topic-metadata">

**Author:** [@asp](https://discuss.elastic.co/u/asp)\
**Replies:** 3\
**Last updated:** [August 24, 2022, 9:20pm UTC](https://discuss.elastic.co/t/is-it-possible-to-let-elasticsearch-choose-the-index-to-ingest/312343 "2022-08-24T21:20:04Z")

</div>

Hi, we want to distribute / split out data to different indexes, because based on the type of the data we will have different retention times. In my last project I used logstash to parse and enrich log events and calcu…

---

## [How to call variables?](https://discuss.elastic.co/t/how-to-call-variables/312809)

<div class="topic-metadata">

**Author:** [@ToonKnight](https://discuss.elastic.co/u/ToonKnight)\
**Replies:** 0\
**Last updated:** [August 24, 2022, 12:22pm UTC](https://discuss.elastic.co/t/how-to-call-variables/312809 "2022-08-24T12:22:39Z")

</div>

Hey all, I made a script that would create a jew index, as soon as the currently running one reaches a space limit. I can't share the script but basically, I have two variables at the start that is could newindex and r…

---

## [Drop Partial Buckets on Pipeline Aggregations](https://discuss.elastic.co/t/drop-partial-buckets-on-pipeline-aggregations/312841)

<div class="topic-metadata">

**Author:** [@jacksonshoreline](https://discuss.elastic.co/u/jacksonshoreline)\
**Replies:** 1\
**Last updated:** [August 24, 2022, 9:04pm UTC](https://discuss.elastic.co/t/drop-partial-buckets-on-pipeline-aggregations/312841 "2022-08-24T21:04:24Z")

</div>

Elasticsearch Version 7.10, Kibana Version 7.10.2 Hosted on AWS OpenSearch When creating a bucket aggregation, there is an option in Kibana to "Drop Partial Buckets". However, this option does not seem to work for pipe…

---

## [\[warn \]\[logstash.config.source.multilocal\] ignoring the 'pipelines.yml' file because modules or command line options are specified](https://discuss.elastic.co/t/warn-logstash-config-source-multilocal-ignoring-the-pipelines-yml-file-because-modules-or-command-line-options-are-specified/312836)

<div class="topic-metadata">

**Author:** [@Vitoria\_De\_Lara](https://discuss.elastic.co/u/Vitoria_De_Lara)\
**Replies:** 0\
**Last updated:** [August 24, 2022, 6:38pm UTC](https://discuss.elastic.co/t/warn-logstash-config-source-multilocal-ignoring-the-pipelines-yml-file-because-modules-or-command-line-options-are-specified/312836 "2022-08-24T18:38:36Z")

</div>

input { file { path =\> "/tmp/spreadsheet\_data.csv" start\_position =\> "beginning" sincedb\_path =\> "/dev/null" } } filter { csv { separator =\> "," skip\_header =\> "true" columns =\> \['Name','Class','Dorm','Room','…

---

## [Query Option Similar to Vega Flatten Transform](https://discuss.elastic.co/t/query-option-similar-to-vega-flatten-transform/312835)

<div class="topic-metadata">

**Author:** [@LisaJ](https://discuss.elastic.co/u/LisaJ)\
**Replies:** 0\
**Last updated:** [August 24, 2022, 6:08pm UTC](https://discuss.elastic.co/t/query-option-similar-to-vega-flatten-transform/312835 "2022-08-24T18:08:18Z")

</div>

When using the Vega visualization engine to graph data, I use the flatten transform to turn a single document that contains an array of length n into n documents with a single element from the array. From: To: Thi…

---

## [Time intervals on x-axis](https://discuss.elastic.co/t/time-intervals-on-x-axis/312001)

<div class="topic-metadata">

**Author:** [@Sayali\_Gangodak](https://discuss.elastic.co/u/Sayali_Gangodak)\
**Replies:** 3\
**Last updated:** [August 24, 2022, 4:42pm UTC](https://discuss.elastic.co/t/time-intervals-on-x-axis/312001 "2022-08-24T16:42:53Z")

</div>

Hi, I am using elastic ui charts to plot a custom timeline graph. On x-axis I want to display time range which will change dynamically according to to timepicker selected by user on dashboard . I am able to plot time fo…

---

## [Request: Barracuda Essentials Integration](https://discuss.elastic.co/t/request-barracuda-essentials-integration/312828)

<div class="topic-metadata">

**Author:** [@6igwig](https://discuss.elastic.co/u/6igwig)\
**Replies:** 0\
**Last updated:** [August 24, 2022, 3:55pm UTC](https://discuss.elastic.co/t/request-barracuda-essentials-integration/312828 "2022-08-24T15:55:39Z")

</div>

I would like to have an elastic agent integration that helps bring in Barracuda Essential's message log and if possible the audit log as well.

---

## [Configure TLS production environment with own CA](https://discuss.elastic.co/t/configure-tls-production-environment-with-own-ca/310776)

<div class="topic-metadata">

**Author:** [@luca.derugeriis](https://discuss.elastic.co/u/luca.derugeriis)\
**Replies:** 3\
**Last updated:** [August 24, 2022, 3:50pm UTC](https://discuss.elastic.co/t/configure-tls-production-environment-with-own-ca/310776 "2022-08-24T15:50:48Z")

</div>

Hi everyone, I'm having a bit of an hard time configuring TLS in a production environment. I already have TLS running on a test environment (with autoconfiguration, using .deb package). At the end of the procedure it pr…

---

## [Barracuda RMM Integration](https://discuss.elastic.co/t/barracuda-rmm-integration/312826)

<div class="topic-metadata">

**Author:** [@6igwig](https://discuss.elastic.co/u/6igwig)\
**Replies:** 0\
**Last updated:** [August 24, 2022, 3:49pm UTC](https://discuss.elastic.co/t/barracuda-rmm-integration/312826 "2022-08-24T15:49:32Z")

</div>

I would like to use an elastic agent integration to connect to Barracuda RMM's data layer.

---

## [LogStash::ConfigurationError", :message=\>"Expected one of \[ \\\\t\\\\r\\\\n\], \\"#\\", \\"if\\", \[A-Za-z0-9\_-\], '\\"', \\"'\\", \\"}\\"](https://discuss.elastic.co/t/logstash-configurationerror-message-expected-one-of-t-r-n-if-a-za-z0-9/312402)

<div class="topic-metadata">

**Author:** [@Queren\_Santos](https://discuss.elastic.co/u/Queren_Santos)\
**Replies:** 12\
**Last updated:** [August 24, 2022, 3:33pm UTC](https://discuss.elastic.co/t/logstash-configurationerror-message-expected-one-of-t-r-n-if-a-za-z0-9/312402 "2022-08-24T15:33:18Z")

</div>

I'm having trouble understanding my code configuration error. Shows the following message when trying to run the logs and their settings: \[ERROR\]\[logstash.agent\] Failed to execute action {:action=\>LogStash::PipelineActi…

---

## [Elasticsearch nested phrase search within a certain distance](https://discuss.elastic.co/t/elasticsearch-nested-phrase-search-within-a-certain-distance/312757)

<div class="topic-metadata">

**Author:** [@Sumit\_Jha1](https://discuss.elastic.co/u/Sumit_Jha1)\
**Replies:** 0\
**Last updated:** [August 24, 2022, 4:44am UTC](https://discuss.elastic.co/t/elasticsearch-nested-phrase-search-within-a-certain-distance/312757 "2022-08-24T04:44:45Z")

</div>

Sample ES Document { // other properties "transcript" : \[ { "id" : 0, "user\_type" : "A", "phrase" : "hi good afternoon" }, { "id" : 1, "user\_type" : "B"…

---

## [Fleet Server Config via Kibana yaml file](https://discuss.elastic.co/t/fleet-server-config-via-kibana-yaml-file/312821)

<div class="topic-metadata">

**Author:** [@DefensiveDepth](https://discuss.elastic.co/u/DefensiveDepth)\
**Replies:** 0\
**Last updated:** [August 24, 2022, 2:50pm UTC](https://discuss.elastic.co/t/fleet-server-config-via-kibana-yaml-file/312821 "2022-08-24T14:50:41Z")

</div>

According to the docs, we can pre-define Fleet Server integrations & policies via the Kibana config file: Use these settings to pre-define integrations and agent policies that you want Fleet to load up by default. Based…

---

## [MongoDB (5+, json based) : some objects have variable types](https://discuss.elastic.co/t/mongodb-5-json-based-some-objects-have-variable-types/312445)

<div class="topic-metadata">

**Author:** [@LaBonave](https://discuss.elastic.co/u/LaBonave)\
**Replies:** 3\
**Last updated:** [August 24, 2022, 2:30pm UTC](https://discuss.elastic.co/t/mongodb-5-json-based-some-objects-have-variable-types/312445 "2022-08-24T14:30:51Z")

</div>

Hi (new here) I've successfully managed to send all of our mongodb 5 instances (JSON-based) logs, via filebeat, on a Logstash instance. MongoDB 5+ are JSON-based logs (https://www.mongodb.com/docs/manual/reference/log…

---

## [Logstash - Grok Syntax Issues](https://discuss.elastic.co/t/logstash-grok-syntax-issues/312807)

<div class="topic-metadata">

**Author:** [@RaiZiStyle](https://discuss.elastic.co/u/RaiZiStyle)\
**Replies:** 6\
**Last updated:** [August 24, 2022, 2:17pm UTC](https://discuss.elastic.co/t/logstash-grok-syntax-issues/312807 "2022-08-24T14:17:25Z")

</div>

I'm using filebeat to send log to logstash but I'm having issues with grok syntax on Logstash. I used the grok debugger on Kibanna and manager to come to a solution. The problem is that I can't find the same syntax for …

---

## [In Kibana need to graph average of the max value of a fieldA within a group keyed by fieldB over time](https://discuss.elastic.co/t/in-kibana-need-to-graph-average-of-the-max-value-of-a-fielda-within-a-group-keyed-by-fieldb-over-time/312819)

<div class="topic-metadata">

**Author:** [@jenrem](https://discuss.elastic.co/u/jenrem)\
**Replies:** 0\
**Last updated:** [August 24, 2022, 1:50pm UTC](https://discuss.elastic.co/t/in-kibana-need-to-graph-average-of-the-max-value-of-a-fielda-within-a-group-keyed-by-fieldb-over-time/312819 "2022-08-24T13:50:19Z")

</div>

I have an index that includes a field called session and a field called timeOnSite. The data can include several docs for each session. The highest value of timeOnSite for a given session is the session duration. I ha…

---

## [Exclude namespaces from the kubernetes fleet package](https://discuss.elastic.co/t/exclude-namespaces-from-the-kubernetes-fleet-package/311589)

<div class="topic-metadata">

**Author:** [@joepa37](https://discuss.elastic.co/u/joepa37)\
**Replies:** 0\
**Last updated:** [August 7, 2022, 5:21am UTC](https://discuss.elastic.co/t/exclude-namespaces-from-the-kubernetes-fleet-package/311589 "2022-08-07T05:21:09Z")

</div>

Does anybody know how to exclude namespaces from the kubernetes fleet package. I am using this recipe right now: cloud-on-k8s/fleet-kubernetes-integration.yaml at main · elastic/cloud-on-k8s · GitHub I want to exclude …

---

## [Elasticsearch and Kibana 8.3.3 basic setup not working in Azure Kubernetes](https://discuss.elastic.co/t/elasticsearch-and-kibana-8-3-3-basic-setup-not-working-in-azure-kubernetes/312032)

<div class="topic-metadata">

**Author:** [@levitoh123](https://discuss.elastic.co/u/levitoh123)\
**Replies:** 2\
**Last updated:** [August 24, 2022, 12:48pm UTC](https://discuss.elastic.co/t/elasticsearch-and-kibana-8-3-3-basic-setup-not-working-in-azure-kubernetes/312032 "2022-08-24T12:48:53Z")

</div>

Hi, I have installed ECK with the CRDS 2.3.0 (from the main documentation) and proceeded to install elasticsearch and kibana via the manifests provided in the documentation. After deploying the Kibana logs, I am seeing …

---

## [Data split into multiple Documents](https://discuss.elastic.co/t/data-split-into-multiple-documents/312808)

<div class="topic-metadata">

**Author:** [@Maruthappan\_Muthu](https://discuss.elastic.co/u/Maruthappan_Muthu)\
**Replies:** 1\
**Last updated:** [August 24, 2022, 12:24pm UTC](https://discuss.elastic.co/t/data-split-into-multiple-documents/312808 "2022-08-24T12:24:13Z")

</div>

I am writing the Prometheus collected metrics into Elasticsearch for every 2 minutes. I see multiple documents for a single data collection and each documents has different fields. Is this the way Elasticsearch stores th…

---

## [Search as you type with 100k rows, help scoring](https://discuss.elastic.co/t/search-as-you-type-with-100k-rows-help-scoring/312412)

<div class="topic-metadata">

**Author:** [@samtwilliams](https://discuss.elastic.co/u/samtwilliams)\
**Replies:** 2\
**Last updated:** [August 24, 2022, 11:59am UTC](https://discuss.elastic.co/t/search-as-you-type-with-100k-rows-help-scoring/312412 "2022-08-24T11:59:47Z")

</div>

Hi All, I have an index that contains drug names (100k of them),I'm using a react front end to search as you type which is working quite well except the scoring coming back is not what I expect despite endless fiddling. …

---

## [Print arabic characters in logstash](https://discuss.elastic.co/t/print-arabic-characters-in-logstash/312793)

<div class="topic-metadata">

**Author:** [@Didi\_Sisi](https://discuss.elastic.co/u/Didi_Sisi)\
**Replies:** 0\
**Last updated:** [August 24, 2022, 10:31am UTC](https://discuss.elastic.co/t/print-arabic-characters-in-logstash/312793 "2022-08-24T10:31:52Z")

</div>

Hello, I created a python script which gathers tweets using “Tweepy”. Then, I return each tweet in a certain dict format. My tweets may contain arabic and latin caracters. This is my python script: import tweepy impor…

---

## [Add a new field in all the existing documents in ES](https://discuss.elastic.co/t/add-a-new-field-in-all-the-existing-documents-in-es/312739)

<div class="topic-metadata">

**Author:** [@ImranArif](https://discuss.elastic.co/u/ImranArif)\
**Replies:** 2\
**Last updated:** [August 24, 2022, 10:22am UTC](https://discuss.elastic.co/t/add-a-new-field-in-all-the-existing-documents-in-es/312739 "2022-08-24T10:22:25Z")

</div>

Hi, I want to update existing documents by adding a new field, the value of which will be looked up from a csv file hosted on an external path (ftp, probably). I read about the translate filter that can be used to look …

---

## [Restore are 20x slower after migrating from 5.x to 7.x](https://discuss.elastic.co/t/restore-are-20x-slower-after-migrating-from-5-x-to-7-x/312281)

<div class="topic-metadata">

**Author:** [@bqk](https://discuss.elastic.co/u/bqk)\
**Replies:** 2\
**Last updated:** [August 24, 2022, 10:16am UTC](https://discuss.elastic.co/t/restore-are-20x-slower-after-migrating-from-5-x-to-7-x/312281 "2022-08-24T10:16:17Z")

</div>

Hi, Found some related topics but no actual answer. We run daily snapshots in production, and every morning we wipe our test cluster and do a full restore. This way we test our backups and our staff has playground envi…

---

## [Kibana login page logo customization in version 8.x](https://discuss.elastic.co/t/kibana-login-page-logo-customization-in-version-8-x/312789)

<div class="topic-metadata">

**Author:** [@vikas.shirke](https://discuss.elastic.co/u/vikas.shirke)\
**Replies:** 0\
**Last updated:** [August 24, 2022, 10:14am UTC](https://discuss.elastic.co/t/kibana-login-page-logo-customization-in-version-8-x/312789 "2022-08-24T10:14:53Z")

</div>

Hi All, We have developed theme plugin to update login page logo via .css file. It was working fine till 7.17. But when we migrated to 8.2 version, it stopped working as that .css file is no longer available when user i…

---

## [The \_id field deprecated warning in the elasticsearch\_dsl python package](https://discuss.elastic.co/t/the-id-field-deprecated-warning-in-the-elasticsearch-dsl-python-package/312785)

<div class="topic-metadata">

**Author:** [@Ivo\_Tavares](https://discuss.elastic.co/u/Ivo_Tavares)\
**Replies:** 0\
**Last updated:** [August 24, 2022, 9:41am UTC](https://discuss.elastic.co/t/the-id-field-deprecated-warning-in-the-elasticsearch-dsl-python-package/312785 "2022-08-24T09:41:36Z")

</div>

I'm using a python client. There's a Document of the document class, with a data field called id. I've added a document to the default index, without defining a value for that id field. I was expecting ES to auto-popu…

---

## [Kibana crash because \["publicBaseUrl" is not allowed](https://discuss.elastic.co/t/kibana-crash-because-publicbaseurl-is-not-allowed/312786)

<div class="topic-metadata">

**Author:** [@knitehias](https://discuss.elastic.co/u/knitehias)\
**Replies:** 1\
**Last updated:** [August 24, 2022, 9:53am UTC](https://discuss.elastic.co/t/kibana-crash-because-publicbaseurl-is-not-allowed/312786 "2022-08-24T09:53:56Z")

</div>

Hello, I am building my own kibana image from debian. The image looks ok. But when I run my elasticsearch and kibana in kubernetes, kibana crashed due to FATAL ValidationError: child "server" fails because \["publicBa…

---

## [Kibana problem : infinite load time](https://discuss.elastic.co/t/kibana-problem-infinite-load-time/312784)

<div class="topic-metadata">

**Author:** [@meyer1](https://discuss.elastic.co/u/meyer1)\
**Replies:** 0\
**Last updated:** [August 24, 2022, 9:41am UTC](https://discuss.elastic.co/t/kibana-problem-infinite-load-time/312784 "2022-08-24T09:41:03Z")

</div>

Hello everyone I have a problem concerning kibana. When I launch elasticsearch and kibana on my terminal everything is fine. I go to my localhost:5601 and everything seems to work. But when I go on "discovery" or on th…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=818)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=820)
