# Latest **URL:** https://discuss.elastic.co/latest.md?page=1435 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1436 --- ## [Logstash - how to remove strings within a field (whose content itself a raw string)?](https://discuss.elastic.co/t/logstash-how-to-remove-strings-within-a-field-whose-content-itself-a-raw-string/286561)
**Author:** [@helloworld1234](https://discuss.elastic.co/u/helloworld1234)\ **Replies:** 3\ **Last updated:** [October 13, 2021, 4:22pm UTC](https://discuss.elastic.co/t/logstash-how-to-remove-strings-within-a-field-whose-content-itself-a-raw-string/286561 "2021-10-13T16:22:58Z")
I have a event that consists of various fields, one of which is called "raw\_message". This field's contents is a raw string eg. Input: raw\_message: "Raw user details:: \[location:london name:kris wu id:L3j5k category:vi… --- ## [Remove all documents from engine](https://discuss.elastic.co/t/remove-all-documents-from-engine/286444)
**Author:** [@artcups](https://discuss.elastic.co/u/artcups)\ **Replies:** 4\ **Last updated:** [October 13, 2021, 3:44pm UTC](https://discuss.elastic.co/t/remove-all-documents-from-engine/286444 "2021-10-13T15:44:33Z")
Hi We have an e-commerce and our assortment can change externally from the PIM without us knowing about it therefor we have to remove all documents and then add the current articles again. My problem is that i cant fin… --- ## [New to Elasticsearch](https://discuss.elastic.co/t/new-to-elasticsearch/286631)
**Author:** [@Rodo\_Andrade](https://discuss.elastic.co/u/Rodo_Andrade)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 2:01pm UTC](https://discuss.elastic.co/t/new-to-elasticsearch/286631 "2021-10-13T14:01:14Z")
Hello, I'm fairly new to Elasticsearch. I'm using the NEST (7.11.1) to query a document field \[Text(TermVector = TermVectorOption.WithOffsets)\], it's storying large file text. For the sake of this example, I have 2 PDF… --- ## [Help, trying to get force directed vega graph working](https://discuss.elastic.co/t/help-trying-to-get-force-directed-vega-graph-working/285716)
**Author:** [@nsimi](https://discuss.elastic.co/u/nsimi)\ **Replies:** 12\ **Last updated:** [October 13, 2021, 3:35pm UTC](https://discuss.elastic.co/t/help-trying-to-get-force-directed-vega-graph-working/285716 "2021-10-13T15:35:31Z")
Hello All, I am trying to get a force directed graph working with my data in ES and vega, Here is a pastebin link to my vega code because its too long to post here. When I look at the dat with the VEGA\_DEBUG on the co… --- ## [Deduplicating, Stop words removal and Lowercasing for an Appsearch document](https://discuss.elastic.co/t/deduplicating-stop-words-removal-and-lowercasing-for-an-appsearch-document/286591)
**Author:** [@Balaji\_Sudharsanam](https://discuss.elastic.co/u/Balaji_Sudharsanam)\ **Replies:** 4\ **Last updated:** [October 13, 2021, 3:34pm UTC](https://discuss.elastic.co/t/deduplicating-stop-words-removal-and-lowercasing-for-an-appsearch-document/286591 "2021-10-13T15:34:18Z")
Do we have an option/fine-tuning available in Appsearch to achieve the following requirements, on a given document indexed in AppSearch. Deduplicating words in a given document. Stop words removal. Storing everything a… --- ## [Is Network Traffic (Fleet Integration) the new Packetbeat? - Missing Netfow?](https://discuss.elastic.co/t/is-network-traffic-fleet-integration-the-new-packetbeat-missing-netfow/285636)
**Author:** [@zx8086](https://discuss.elastic.co/u/zx8086)\ **Replies:** 6\ **Last updated:** [October 13, 2021, 3:29pm UTC](https://discuss.elastic.co/t/is-network-traffic-fleet-integration-the-new-packetbeat-missing-netfow/285636 "2021-10-13T15:29:53Z")
Hi Guys, I noticed that the integration didn't create the indices for network flow. Is this a bug or missed configuration? {"type":"security\_exception","reason":"action \[indices:admin/auto\_create\] is unauthorized … --- ## [AutoDiscover ServiceMonitor CRD on Kubernetes](https://discuss.elastic.co/t/autodiscover-servicemonitor-crd-on-kubernetes/286642)
**Author:** [@julianxhokaxhiu](https://discuss.elastic.co/u/julianxhokaxhiu)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 3:28pm UTC](https://discuss.elastic.co/t/autodiscover-servicemonitor-crd-on-kubernetes/286642 "2021-10-13T15:28:27Z")
Hi, I have a question about Metricsbeat. I've seen in the official documentation that the service supports AutoDiscovery which is great ( Autodiscover | Metricbeat Reference \[7.15\] | Elastic ). Officially it supports N… --- ## [Mismatch between ECS and Packetbeat 7.1.5 on some fields](https://discuss.elastic.co/t/mismatch-between-ecs-and-packetbeat-7-1-5-on-some-fields/286639)
**Author:** [@Soik](https://discuss.elastic.co/u/Soik)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 2:54pm UTC](https://discuss.elastic.co/t/mismatch-between-ecs-and-packetbeat-7-1-5-on-some-fields/286639 "2021-10-13T14:54:00Z")
There is a mismatch in the following fields between ECS and Packetbeat 7.1.5: dns.answers.ttl (String in packetbeat - Long in ECS Documentation) dns.id (Integer in packetbeat - String/Keyword in ECS Documentation) Is … --- ## [Filebeat daemon set misses last few lines of log on pod crash](https://discuss.elastic.co/t/filebeat-daemon-set-misses-last-few-lines-of-log-on-pod-crash/286640)
**Author:** [@TimWardFS](https://discuss.elastic.co/u/TimWardFS)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 3:14pm UTC](https://discuss.elastic.co/t/filebeat-daemon-set-misses-last-few-lines-of-log-on-pod-crash/286640 "2021-10-13T15:14:30Z")
I have seen a number of posts saying that when a Kubernetes pod crashes Filebeat loses the last few lines of log output, including, of course, the actual error message that tells you why the pod crashed. All the ones I'… --- ## [Scale ingest node based on number of application](https://discuss.elastic.co/t/scale-ingest-node-based-on-number-of-application/286566)
**Author:** [@alfianaf](https://discuss.elastic.co/u/alfianaf)\ **Replies:** 8\ **Last updated:** [October 13, 2021, 2:59pm UTC](https://discuss.elastic.co/t/scale-ingest-node-based-on-number-of-application/286566 "2021-10-13T14:59:16Z")
Hello, I have a plan to use ingest pipeline on my cluster, the plan is: 90 application will hit to elastic server, so I'll make around 200 pipeline on my cluster How can I scale the ingest node I need on my cluster to… --- ## [Remote cluster connect time out](https://discuss.elastic.co/t/remote-cluster-connect-time-out/286638)
**Author:** [@rachelyang](https://discuss.elastic.co/u/rachelyang)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 2:46pm UTC](https://discuss.elastic.co/t/remote-cluster-connect-time-out/286638 "2021-10-13T14:46:11Z")
I have two clusters; the remote cluster is single node on AWS. I have set up the same CA on both clusters, but they cannot connect due to time-out issue. Here is the error in log: \[2021-10-13T14:16:49,749\]\[WARN \]\[o.e.t.… --- ## [Filebeat 7.13.4 + Kubernetes 1.20: Hints-Based Autodiscover](https://discuss.elastic.co/t/filebeat-7-13-4-kubernetes-1-20-hints-based-autodiscover/286421)
**Author:** [@DougR](https://discuss.elastic.co/u/DougR)\ **Replies:** 2\ **Last updated:** [October 13, 2021, 2:40pm UTC](https://discuss.elastic.co/t/filebeat-7-13-4-kubernetes-1-20-hints-based-autodiscover/286421 "2021-10-13T14:40:54Z")
We just upgraded our Kubernetes cluster to 1.20 (current version of filebeat is 7.13.4). Of course, this means that Kubernetes logs are no longer in the same place they were under 1.19, and instead are in the following l… --- ## [ElasticSearch Search-as-you-type field type field with partial search](https://discuss.elastic.co/t/elasticsearch-search-as-you-type-field-type-field-with-partial-search/286635)
**Author:** [@Jacques\_du\_Plessis](https://discuss.elastic.co/u/Jacques_du_Plessis)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 2:34pm UTC](https://discuss.elastic.co/t/elasticsearch-search-as-you-type-field-type-field-with-partial-search/286635 "2021-10-13T14:34:40Z")
I recently updating my ngram implementation settings to use Search-as-you-type field type. Search-as-you-type field type | Elasticsearch Guide \[7.x\] | Elastic This worked great but I noticed that partial searching do… --- ## [Stack Monitoring fails to load logstash pipelines](https://discuss.elastic.co/t/stack-monitoring-fails-to-load-logstash-pipelines/281209)
**Author:** [@radovan](https://discuss.elastic.co/u/radovan)\ **Replies:** 26\ **Last updated:** [October 13, 2021, 2:29pm UTC](https://discuss.elastic.co/t/stack-monitoring-fails-to-load-logstash-pipelines/281209 "2021-10-13T14:29:46Z")
Hi, I decided to create a monitoring cluster and after a few problems at the start all is running now. There are metricbeat clients on the logstash nodes with only logstash-xpack module enabled. Logs are flowing onto th… --- ## [Displaying time lag data as an average over time using TSVB](https://discuss.elastic.co/t/displaying-time-lag-data-as-an-average-over-time-using-tsvb/286536)
**Author:** [@IceKing](https://discuss.elastic.co/u/IceKing)\ **Replies:** 1\ **Last updated:** [October 13, 2021, 2:18pm UTC](https://discuss.elastic.co/t/displaying-time-lag-data-as-an-average-over-time-using-tsvb/286536 "2021-10-13T14:18:24Z")
Hi, I would like some assistance please. I'm using Amazon OpenSearch Service (successor to Amazon Elasticsearch Service). Currently I have set of documents in my index that have following date/time fields "CreatedDa… --- ## [Kibana Query Question](https://discuss.elastic.co/t/kibana-query-question/285997)
**Author:** [@vladik22](https://discuss.elastic.co/u/vladik22)\ **Replies:** 4\ **Last updated:** [October 13, 2021, 2:09pm UTC](https://discuss.elastic.co/t/kibana-query-question/285997 "2021-10-13T14:09:32Z")
Hello guys Is it possible and how can I to filter documents from one index according to values from another index? For example I have 2 indexes Logs and Activities I want to see in visualisation documents from index… --- ## [Kibana showing incorrect timestamp](https://discuss.elastic.co/t/kibana-showing-incorrect-timestamp/286619)
**Author:** [@Sn4cK](https://discuss.elastic.co/u/Sn4cK)\ **Replies:** 1\ **Last updated:** [October 13, 2021, 1:22pm UTC](https://discuss.elastic.co/t/kibana-showing-incorrect-timestamp/286619 "2021-10-13T13:22:07Z")
Hello, I am having issue with how Kibana shows timestamps of my documents indexed in Elasticsearch. I have a document looking like: { "\_index": "speedtest", "\_type": "\_doc", "\_id": "1-nldXwBFYKxSrUSopKs", "\_ve… --- ## [Debugging the elasticsearch-example in search-ui](https://discuss.elastic.co/t/debugging-the-elasticsearch-example-in-search-ui/286594)
**Author:** [@mpjjonker](https://discuss.elastic.co/u/mpjjonker)\ **Replies:** 1\ **Last updated:** [October 13, 2021, 1:15pm UTC](https://discuss.elastic.co/t/debugging-the-elasticsearch-example-in-search-ui/286594 "2021-10-13T13:15:08Z")
Hi, I am getting started with the search-ui components and have the elasticsearch-example from the search-ui up and running in Visual Studio Code. I can create a launch.json to configure the environment for debugging. … --- ## [How to create test users in Workplace search](https://discuss.elastic.co/t/how-to-create-test-users-in-workplace-search/286532)
**Author:** [@Mymail\_Cpn](https://discuss.elastic.co/u/Mymail_Cpn)\ **Replies:** 2\ **Last updated:** [October 13, 2021, 1:11pm UTC](https://discuss.elastic.co/t/how-to-create-test-users-in-workplace-search/286532 "2021-10-13T13:11:57Z")
I would like to try different combinations in Workplace search's Users and Roles. Is there a way to create some sample username and password in elastic cloud Workplace search. Please advice. --- ## [Retrieve the complete document after search](https://discuss.elastic.co/t/retrieve-the-complete-document-after-search/285996)
**Author:** [@A\_Tran](https://discuss.elastic.co/u/A_Tran)\ **Replies:** 6\ **Last updated:** [October 13, 2021, 1:03pm UTC](https://discuss.elastic.co/t/retrieve-the-complete-document-after-search/285996 "2021-10-13T13:03:47Z")
Hi, with appsearch the result field has the limit of 1000 characters. But there is a way to open the complete document after that? Can I open then the whole document with seach-ui? thanks --- ## [Pipeline question](https://discuss.elastic.co/t/pipeline-question/286494)
**Author:** [@Worlock](https://discuss.elastic.co/u/Worlock)\ **Replies:** 13\ **Last updated:** [October 13, 2021, 1:00pm UTC](https://discuss.elastic.co/t/pipeline-question/286494 "2021-10-13T13:00:10Z")
Hi all, I have a field in my index that is named "Severity". The values can be either 2, 1 or 0. I want to rename those values to Critical, Warning or Informational. I looked into pipelines and also read the documentat… --- ## [Parsing tabular data into canvas](https://discuss.elastic.co/t/parsing-tabular-data-into-canvas/286496)
**Author:** [@Kadhem](https://discuss.elastic.co/u/Kadhem)\ **Replies:** 1\ **Last updated:** [October 12, 2021, 10:54pm UTC](https://discuss.elastic.co/t/parsing-tabular-data-into-canvas/286496 "2021-10-12T22:54:34Z")
hi, how can i parse this output of command to push into into a table in Canvas : prec: rqstd, stored, dropped, retried, rtsfail,rtrydrop, psretry, acked,utlisatn,q length,Data Mbits/s,Phy Mbits/s, %air, %effcy (v5… --- ## [ElasticSearch Data Redirection](https://discuss.elastic.co/t/elasticsearch-data-redirection/286036)
**Author:** [@jrpayne30506](https://discuss.elastic.co/u/jrpayne30506)\ **Replies:** 2\ **Last updated:** [October 13, 2021, 12:58pm UTC](https://discuss.elastic.co/t/elasticsearch-data-redirection/286036 "2021-10-13T12:58:02Z")
Hello All, New to Elasticsearch here and having an issue. I have an Ubuntu server (18.04) that I am using to send some security and firewall logs for period of retentions storage. I found an article on how to redirect t… --- ## [One Index is not recovering from the state INITIALIZING and UNASSIGNED](https://discuss.elastic.co/t/one-index-is-not-recovering-from-the-state-initializing-and-unassigned/286468)
**Author:** [@Programmer](https://discuss.elastic.co/u/Programmer)\ **Replies:** 4\ **Last updated:** [October 13, 2021, 12:46pm UTC](https://discuss.elastic.co/t/one-index-is-not-recovering-from-the-state-initializing-and-unassigned/286468 "2021-10-13T12:46:21Z")
curl -XGET http://localhost:9200/\_cat/shards app-all 1 r INITIALIZING 172.16.4.165 viepevrat02 app-all 1 p STARTED 85125705 67gb 172.16.4.164 viepevrat01 app-all 0 p RELOCATING… --- ## [How to run multiple instances of Filebeat for the same input/output?](https://discuss.elastic.co/t/how-to-run-multiple-instances-of-filebeat-for-the-same-input-output/286539)
**Author:** [@ppine7](https://discuss.elastic.co/u/ppine7)\ **Replies:** 5\ **Last updated:** [October 13, 2021, 12:38pm UTC](https://discuss.elastic.co/t/how-to-run-multiple-instances-of-filebeat-for-the-same-input-output/286539 "2021-10-13T12:38:03Z")
Hi, is there a recommended way to run multiple instances if Filebeat, on different physical servers (VMs) that would process data from the same input and into the same output (ES index)? Basically to have an option to … --- ## [Сохранение переменной request.url в filebeat httpjson](https://discuss.elastic.co/t/request-url-filebeat-httpjson/286621)
**Author:** [@vladislav](https://discuss.elastic.co/u/vladislav)\ **Replies:** 0\ **Last updated:** [October 13, 2021, 12:14pm UTC](https://discuss.elastic.co/t/request-url-filebeat-httpjson/286621 "2021-10-13T12:14:12Z")
Добрый день! Возник вопрос, можно ли сохранять последнее полученное значение параметра request.url и в дальнейшем производить чтение из него при запросе? Я использую в качестве input модуля httpjson со следующими настро… --- ## [Combination of filter and range](https://discuss.elastic.co/t/combination-of-filter-and-range/286392)
**Author:** [@smit\_vasava](https://discuss.elastic.co/u/smit_vasava)\ **Replies:** 1\ **Last updated:** [October 13, 2021, 12:13pm UTC](https://discuss.elastic.co/t/combination-of-filter-and-range/286392 "2021-10-13T12:13:39Z")
hello everyone , i am newbie to Elasticsearch , i am having some issue with query searching .. here is my code GET /new\_product/\_search { "query": { "bool" : { "filter": \[ { "term": { "ca… --- ## [Auto Authentication using .net](https://discuss.elastic.co/t/auto-authentication-using-net/286462)
**Author:** [@prabha\_karan](https://discuss.elastic.co/u/prabha_karan)\ **Replies:** 2\ **Last updated:** [October 13, 2021, 12:03pm UTC](https://discuss.elastic.co/t/auto-authentication-using-net/286462 "2021-10-13T12:03:03Z")
Hi ,i want to use dashboard inside in our web application .so, i pasted iframe inside Html.it rendered in browser with kibana login page. but after entered login credentials it again shows the login page.how to rectify t… --- ## [Which architecture is better? Should I collect the logs on the server side using rsyslog?](https://discuss.elastic.co/t/which-architecture-is-better-should-i-collect-the-logs-on-the-server-side-using-rsyslog/286589)
**Author:** [@Sagimb](https://discuss.elastic.co/u/Sagimb)\ **Replies:** 3\ **Last updated:** [October 13, 2021, 9:34am UTC](https://discuss.elastic.co/t/which-architecture-is-better-should-i-collect-the-logs-on-the-server-side-using-rsyslog/286589 "2021-10-13T09:34:35Z")
I am trying to understand which architecture is better for me. I have a few hundreds of instances that I want to send their logs to one central server. Should I got with A (run rsyslog on the central server to collec… --- ## [Moving ML jobs and their data](https://discuss.elastic.co/t/moving-ml-jobs-and-their-data/136635)
**Author:** [@blueren](https://discuss.elastic.co/u/blueren)\ **Replies:** 7\ **Last updated:** [October 13, 2021, 11:38am UTC](https://discuss.elastic.co/t/moving-ml-jobs-and-their-data/136635 "2021-10-13T11:38:55Z")
I have a a few ml jobs saved and running in my local build. I would like to somehow export the same jobs on to another build that is running in a different machine. Is this possible? If so, how? Also, assuming that I've… [Previous page](https://discuss.elastic.co/latest.md?page=1434) [Next page](https://discuss.elastic.co/latest.md?page=1436)