# \#none **URL:** https://discuss.elastic.co/tag/none.md?page=1155 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1156 --- ## [Ingest node pipelines and durability](https://discuss.elastic.co/t/ingest-node-pipelines-and-durability/255187)
**Author:** [@djmcgreal](https://discuss.elastic.co/u/djmcgreal)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 9:51am UTC](https://discuss.elastic.co/t/ingest-node-pipelines-and-durability/255187 "2020-11-12T09:51:33Z")
Hi, I couldn't find in the documentation any guarantees around durability of ingest pipelines. Do nodes acknowledge receipt of the document before or after the pipeline has run to completion? If before, is there any pr… --- ## [Logstash error trying to index filebeat](https://discuss.elastic.co/t/logstash-error-trying-to-index-filebeat/255175)
**Author:** [@Craig2188](https://discuss.elastic.co/u/Craig2188)\ **Replies:** 1\ **Last updated:** [November 12, 2020, 9:32am UTC](https://discuss.elastic.co/t/logstash-error-trying-to-index-filebeat/255175 "2020-11-12T09:32:18Z")
Hi, Logstash log files are being filled up with indexing errors for filebeat: \[2020-11-12T09:06:02,844\]\[WARN \]\[logstash.outputs.elasticsearch\]\[main\]\[28a01e4629fbbc3006822900269029f08bd4f371d6be029377ac4944518e3137\] Cou… --- ## [View alayser created tokens for a field](https://discuss.elastic.co/t/view-alayser-created-tokens-for-a-field/255180)
**Author:** [@Andrew\_Riley](https://discuss.elastic.co/u/Andrew_Riley)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 9:31am UTC](https://discuss.elastic.co/t/view-alayser-created-tokens-for-a-field/255180 "2020-11-12T09:31:53Z")
I'm trialling the use of the English analyser on some test data to better understand its function. I'm getting some unexpected results specifically around the must: term and must\_not : term queries. Is there any way to… --- ## [Split json in string from packetbeat](https://discuss.elastic.co/t/split-json-in-string-from-packetbeat/254874)
**Author:** [@langol93](https://discuss.elastic.co/u/langol93)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 9:22am UTC](https://discuss.elastic.co/t/split-json-in-string-from-packetbeat/254874 "2020-11-12T09:22:19Z")
Hello I passed http request from packetbeat to logstash and now I have json in htttp.request.body.content: How can I split this string to separate fields? I want to have id, timestamp and value field.. I tried usi… --- ## [Is not all heap used?](https://discuss.elastic.co/t/is-not-all-heap-used/255110)
**Author:** [@Tuckson](https://discuss.elastic.co/u/Tuckson)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 6:17pm UTC](https://discuss.elastic.co/t/is-not-all-heap-used/255110 "2020-11-11T18:17:49Z")
Hi, Just wondering. I see this heap graph: I set it to 24GB (Of 48GB total Ram) But it looks like GC is already stepping in at 15 or 16 GB? Is there an alternate setting I need to set? Or is there something else I … --- ## [Index the output of the \_cat API](https://discuss.elastic.co/t/index-the-output-of-the-cat-api/254788)
**Author:** [@soufian.eldouqe](https://discuss.elastic.co/u/soufian.eldouqe)\ **Replies:** 4\ **Last updated:** [November 12, 2020, 8:58am UTC](https://discuss.elastic.co/t/index-the-output-of-the-cat-api/254788 "2020-11-12T08:58:19Z")
Hello, I need to view the top ten list of all my indices sorted by size in Kibana (dashboad) for start, I can get the list of my indices sorted with the following command : GET /\_cat/indices?v&format=json&s=store.size… --- ## [Match a document when user keywords contains all words of a field](https://discuss.elastic.co/t/match-a-document-when-user-keywords-contains-all-words-of-a-field/254934)
**Author:** [@marcmad](https://discuss.elastic.co/u/marcmad)\ **Replies:** 3\ **Last updated:** [November 12, 2020, 8:38am UTC](https://discuss.elastic.co/t/match-a-document-when-user-keywords-contains-all-words-of-a-field/254934 "2020-11-12T08:38:01Z")
Hello everyone, I would like to set up a simple elasticsearch index, to retrieve some documents. I will have a field, named "attributes", which will contains some keywords: "attributes": \[ "Lebron James", "Michael J… --- ## [Reading csv file from dropbox](https://discuss.elastic.co/t/reading-csv-file-from-dropbox/255170)
**Author:** [@byteandbit](https://discuss.elastic.co/u/byteandbit)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 8:37am UTC](https://discuss.elastic.co/t/reading-csv-file-from-dropbox/255170 "2020-11-12T08:37:21Z")
Is there anyway to read csv file from dropbox in logstash? --- ## [Limits on Grok/Split ingest processing](https://discuss.elastic.co/t/limits-on-grok-split-ingest-processing/255168)
**Author:** [@aceggroll](https://discuss.elastic.co/u/aceggroll)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 8:35am UTC](https://discuss.elastic.co/t/limits-on-grok-split-ingest-processing/255168 "2020-11-12T08:35:25Z")
I need some advice on whether I have come to the limits of ingest processing, or maybe there is another option. We're using ES 7.9.3, and receiving logs with winlogbeat. (Logstash is not in play) The logs I'm intereste… --- ## [Upgrade to Elasticsearch 7.10](https://discuss.elastic.co/t/upgrade-to-elasticsearch-7-10/255154)
**Author:** [@Syaiful\_Amin](https://discuss.elastic.co/u/Syaiful_Amin)\ **Replies:** 1\ **Last updated:** [November 12, 2020, 8:13am UTC](https://discuss.elastic.co/t/upgrade-to-elasticsearch-7-10/255154 "2020-11-12T08:13:32Z")
where can i get a writeup to upgrade elasticsseach 7.9 to 7.10 :slight\_smile: --- ## [Painless Script Convert to JSON not HasMap string](https://discuss.elastic.co/t/painless-script-convert-to-json-not-hasmap-string/255162)
**Author:** [@rajat\_j](https://discuss.elastic.co/u/rajat_j)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 8:01am UTC](https://discuss.elastic.co/t/painless-script-convert-to-json-not-hasmap-string/255162 "2020-11-12T08:01:24Z")
I am trying to fetch an array using aggregation. The array is a nested array that contains a list of its own type. example : public class Attribute { public long Id { get; se… --- ## [It seems that require\_field\_match highlight option does not work](https://discuss.elastic.co/t/it-seems-that-require-field-match-highlight-option-does-not-work/255051)
**Author:** [@zdeseb](https://discuss.elastic.co/u/zdeseb)\ **Replies:** 6\ **Last updated:** [November 12, 2020, 7:58am UTC](https://discuss.elastic.co/t/it-seems-that-require-field-match-highlight-option-does-not-work/255051 "2020-11-12T07:58:59Z")
Maybe I've missed something but it seems to me that highlight option require\_field\_match does not work correctly (ES 7.9.3 but I tested it with older versions also). Very simple example follows: Let's have following in… --- ## [ARM support in the age of MAC ARM](https://discuss.elastic.co/t/arm-support-in-the-age-of-mac-arm/255118)
**Author:** [@frankshad](https://discuss.elastic.co/u/frankshad)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 6:25am UTC](https://discuss.elastic.co/t/arm-support-in-the-age-of-mac-arm/255118 "2020-11-12T06:25:20Z")
Now that Mac ARM machines are a thing, is it possible that ElasticSearch can be made to run on ARM architectures without jumping through hoops. It used to work in v6, and it can be made to work on v7 but it takes a signi… --- ## [What is the probable release date for version 7.10?](https://discuss.elastic.co/t/what-is-the-probable-release-date-for-version-7-10/255007)
**Author:** [@Nikit\_Singh](https://discuss.elastic.co/u/Nikit_Singh)\ **Replies:** 4\ **Last updated:** [November 12, 2020, 5:19am UTC](https://discuss.elastic.co/t/what-is-the-probable-release-date-for-version-7-10/255007 "2020-11-12T05:19:03Z")
Hi I wanted to use the new Observability feature of capturing web-vitals logs. It's only available in 7.10 so wanted to know when will it be released? Thanks. --- ## [How to apply sdfc filter in salesforce plugin of logstash](https://discuss.elastic.co/t/how-to-apply-sdfc-filter-in-salesforce-plugin-of-logstash/254736)
**Author:** [@Pavitra\_Poojary](https://discuss.elastic.co/u/Pavitra_Poojary)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 5:07am UTC](https://discuss.elastic.co/t/how-to-apply-sdfc-filter-in-salesforce-plugin-of-logstash/254736 "2020-11-12T05:07:56Z")
Hi Team, We are extracting the logs from Salesforce object. Here is our input configuration with a object name Error\_Log\_\_c. input {​ salesforce {​ use\_test\_sandbox =\> true client\_id =\> 'xxx' client\_secret =\> 'xxx' … --- ## [Suricata logs](https://discuss.elastic.co/t/suricata-logs/254975)
**Author:** [@darrin.hodges](https://discuss.elastic.co/u/darrin.hodges)\ **Replies:** 1\ **Last updated:** [November 12, 2020, 1:23am UTC](https://discuss.elastic.co/t/suricata-logs/254975 "2020-11-12T01:23:03Z")
Hi all, I have a test setup with Kibana/Elasticsearch and elastic-agent. I'm wondering how to correctly ingest suricata logs so it provides useful information? thanks Darrin --- ## [Multiple Pipeline Output](https://discuss.elastic.co/t/multiple-pipeline-output/255140)
**Author:** [@justinainsworth](https://discuss.elastic.co/u/justinainsworth)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 1:05am UTC](https://discuss.elastic.co/t/multiple-pipeline-output/255140 "2020-11-12T01:05:03Z")
Continuing the discussion from Multiple outputs?: According to this post, events can pass to multiple outputs. Is that the case when output is another pipeline? Or more specifically, if all conditionals are met, can a… --- ## [Suggestions which type of filters we can use procees the logs via logstash](https://discuss.elastic.co/t/suggestions-which-type-of-filters-we-can-use-procees-the-logs-via-logstash/255141)
**Author:** [@525125](https://discuss.elastic.co/u/525125)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 12:54am UTC](https://discuss.elastic.co/t/suggestions-which-type-of-filters-we-can-use-procees-the-logs-via-logstash/255141 "2020-11-12T00:54:46Z")
How to process this type of logs via logsatsh to kibana. Any suggestions on filtration. 2020-11-04 00:00:00,038 {abcd23rv6f} \[\] \[INFO \] service - response from 3rd party : \[, , , , , , authentication OK., 1, 0, SafeNet … --- ## [Logstash support for composable templates in elasticsearch output](https://discuss.elastic.co/t/logstash-support-for-composable-templates-in-elasticsearch-output/255137)
**Author:** [@phospodka](https://discuss.elastic.co/u/phospodka)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 10:34pm UTC](https://discuss.elastic.co/t/logstash-support-for-composable-templates-in-elasticsearch-output/255137 "2020-11-11T22:34:57Z")
I am trying to upgrade versions of ELK and I have noticed that templates have changed. There is a legacy way and a new composable way. I currently have logstash supply custom templates for different indices. However, … --- ## [How to add heartbet field to alerts index](https://discuss.elastic.co/t/how-to-add-heartbet-field-to-alerts-index/254697)
**Author:** [@Adriann](https://discuss.elastic.co/u/Adriann)\ **Replies:** 2\ **Last updated:** [November 11, 2020, 9:42pm UTC](https://discuss.elastic.co/t/how-to-add-heartbet-field-to-alerts-index/254697 "2020-11-11T21:42:22Z")
Hello, I want to configure alerting for uptime monitors by the general rule that would apply to any monitor. To be able to connect my code to this I need some filed to knew which host general alert says about. Rig… --- ## [VİSUALİZE LABELS NOT SHOWİNG](https://discuss.elastic.co/t/visualize-labels-not-showing/254983)
**Author:** [@mr\_searchng](https://discuss.elastic.co/u/mr_searchng)\ **Replies:** 4\ **Last updated:** [November 11, 2020, 9:39pm UTC](https://discuss.elastic.co/t/visualize-labels-not-showing/254983 "2020-11-11T21:39:35Z")
visualize labels do not come all As seen in the graph, 1 of them has no arrow and label. --- ## [HOW İS TABLE DATE SORT DESC?](https://discuss.elastic.co/t/how-is-table-date-sort-desc/254981)
**Author:** [@mr\_searchng](https://discuss.elastic.co/u/mr_searchng)\ **Replies:** 2\ **Last updated:** [November 11, 2020, 9:36pm UTC](https://discuss.elastic.co/t/how-is-table-date-sort-desc/254981 "2020-11-11T21:36:40Z")
By default, the table with date columns comes in asc order. I want the tables with date columns to come as desc order. When I create the table, the dates are exactly the opposite. sort the way as desc, not asc. I wa… --- ## [🎉 Elastic Stack 7.10.0 released](https://discuss.elastic.co/t/elastic-stack-7-10-0-released/255130)
**Author:** [@elyssaemrich](https://discuss.elastic.co/u/elyssaemrich)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 9:17pm UTC](https://discuss.elastic.co/t/elastic-stack-7-10-0-released/255130 "2020-11-11T21:17:46Z")
:tada: Elastic Stack 7.10.0 released The journey to searchable S3 begins! Elastic 7.10 introduces the beta of searchable snapshots on low-cost object stores, a new User Experience app to monitor web performance, GA of K… --- ## [Receive from Webhook](https://discuss.elastic.co/t/receive-from-webhook/255128)
**Author:** [@GavinBeattie](https://discuss.elastic.co/u/GavinBeattie)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 9:14pm UTC](https://discuss.elastic.co/t/receive-from-webhook/255128 "2020-11-11T21:14:37Z")
OnePageCRM has the ability to output changes via a webhook. What I would like to know is how can I setup Elasticsearch to receive the post (or more importantly transform it) from the OnePageCRM format to the ES post form… --- ## [Elasticsearch Snapshot](https://discuss.elastic.co/t/elasticsearch-snapshot/254907)
**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\ **Replies:** 13\ **Last updated:** [November 11, 2020, 6:43pm UTC](https://discuss.elastic.co/t/elasticsearch-snapshot/254907 "2020-11-11T18:43:23Z")
Im using Snapshot Lifecycle Mgmt to create nightly snapshots. My questions are I saw this comes under Basic license. But I got confused when I saw XPACK tag in SLM page. Please clarify Since this will be daily snap… --- ## [Cosine-Distance of reduced dense vectors](https://discuss.elastic.co/t/cosine-distance-of-reduced-dense-vectors/255114)
**Author:** [@christiana](https://discuss.elastic.co/u/christiana)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 6:40pm UTC](https://discuss.elastic.co/t/cosine-distance-of-reduced-dense-vectors/255114 "2020-11-11T18:40:40Z")
Hi, i have set up a database containing documents which are having dense vectors for the features and for a binary \[1,0\] mask. I would like to use the script query to the database with a feature vector at runtime. For … --- ## [Automate ingest through a pipeline (ingest attachment processor)](https://discuss.elastic.co/t/automate-ingest-through-a-pipeline-ingest-attachment-processor/255054)
**Author:** [@Fidel\_Perez](https://discuss.elastic.co/u/Fidel_Perez)\ **Replies:** 3\ **Last updated:** [November 11, 2020, 6:38pm UTC](https://discuss.elastic.co/t/automate-ingest-through-a-pipeline-ingest-attachment-processor/255054 "2020-11-11T18:38:32Z")
hello there. Does anyone know if there a tool something like beats to ingest human created files such a pdf or word files (dockx) using my attachment pipeline that processes files with ingest attachment pluing --- ## [Suggestions for Kibana slowness with tens of millions of records](https://discuss.elastic.co/t/suggestions-for-kibana-slowness-with-tens-of-millions-of-records/254996)
**Author:** [@rgeisman](https://discuss.elastic.co/u/rgeisman)\ **Replies:** 2\ **Last updated:** [November 11, 2020, 6:31pm UTC](https://discuss.elastic.co/t/suggestions-for-kibana-slowness-with-tens-of-millions-of-records/254996 "2020-11-11T18:31:55Z")
Hello Elastic Community. I have created an ELK cluster with 5 boxes, and on box 5 one instance of Kibana is running. All 5 boxes are ingesting with one of the nodes being a master node. We have filebeat, auditbeat and… --- ## [Running out of heap memory Elasticsearch](https://discuss.elastic.co/t/running-out-of-heap-memory-elasticsearch/254848)
**Author:** [@yasir\_khatri](https://discuss.elastic.co/u/yasir_khatri)\ **Replies:** 14\ **Last updated:** [November 11, 2020, 6:28pm UTC](https://discuss.elastic.co/t/running-out-of-heap-memory-elasticsearch/254848 "2020-11-11T18:28:16Z")
We are using single node of elasticsearch with 24 gb of heap memory. The rollover size is 75gb with 2 shards per index therefore single shard size is roughly 37.5 gb. We need to archive 8 Tb of data out of which 2 Tb ha… --- ## [Exception when highlighting](https://discuss.elastic.co/t/exception-when-highlighting/255108)
**Author:** [@yansplichal](https://discuss.elastic.co/u/yansplichal)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 6:11pm UTC](https://discuss.elastic.co/t/exception-when-highlighting/255108 "2020-11-11T18:11:24Z")
Hi, In elasticsearch 7.9.2 - when a lot of documents are highlighted by unified highlighter - I am getting an exception. The query used to work in elasticsearch 7.1.0. I try to highlight everything: "highlight": { … [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1154) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1156)