# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1701 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1702 --- ## [Filebeat is unable to send data to Logstash, and very high CPU utilization on filebeat](https://discuss.elastic.co/t/filebeat-is-unable-to-send-data-to-logstash-and-very-high-cpu-utilization-on-filebeat/255161)
**Author:** [@Utkarsh\_Jain](https://discuss.elastic.co/u/Utkarsh_Jain)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 9:52am UTC](https://discuss.elastic.co/t/filebeat-is-unable-to-send-data-to-logstash-and-very-high-cpu-utilization-on-filebeat/255161 "2020-11-12T09:52:25Z")
Hello, Everything was working fine for us but after a security patch update, the CPU utilization is very high on filebeat server and logstash is not recieving data from filebeat. Here are the logs from logstash server. … --- ## [Ingest node pipelines and durability](https://discuss.elastic.co/t/ingest-node-pipelines-and-durability/255187)
**Author:** [@djmcgreal](https://discuss.elastic.co/u/djmcgreal)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 9:51am UTC](https://discuss.elastic.co/t/ingest-node-pipelines-and-durability/255187 "2020-11-12T09:51:33Z")
Hi, I couldn't find in the documentation any guarantees around durability of ingest pipelines. Do nodes acknowledge receipt of the document before or after the pipeline has run to completion? If before, is there any pr… --- ## [Logstash error trying to index filebeat](https://discuss.elastic.co/t/logstash-error-trying-to-index-filebeat/255175)
**Author:** [@Craig2188](https://discuss.elastic.co/u/Craig2188)\ **Replies:** 1\ **Last updated:** [November 12, 2020, 9:32am UTC](https://discuss.elastic.co/t/logstash-error-trying-to-index-filebeat/255175 "2020-11-12T09:32:18Z")
Hi, Logstash log files are being filled up with indexing errors for filebeat: \[2020-11-12T09:06:02,844\]\[WARN \]\[logstash.outputs.elasticsearch\]\[main\]\[28a01e4629fbbc3006822900269029f08bd4f371d6be029377ac4944518e3137\] Cou… --- ## [View alayser created tokens for a field](https://discuss.elastic.co/t/view-alayser-created-tokens-for-a-field/255180)
**Author:** [@Andrew\_Riley](https://discuss.elastic.co/u/Andrew_Riley)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 9:31am UTC](https://discuss.elastic.co/t/view-alayser-created-tokens-for-a-field/255180 "2020-11-12T09:31:53Z")
I'm trialling the use of the English analyser on some test data to better understand its function. I'm getting some unexpected results specifically around the must: term and must\_not : term queries. Is there any way to… --- ## [AWS ELK and metricbeat issue](https://discuss.elastic.co/t/aws-elk-and-metricbeat-issue/255179)
**Author:** [@alfredo.deluca](https://discuss.elastic.co/u/alfredo.deluca)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 9:31am UTC](https://discuss.elastic.co/t/aws-elk-and-metricbeat-issue/255179 "2020-11-12T09:31:49Z")
Hi all. I have AWS Elasticsearch 7.8 and also, for testing purposes, I have a minikube kubernetes where I installed through Helm, metricbeat. When I do metricbeat test config it seems to be ok and test output parse ur… --- ## [Filebeat pipeline Apache log pattern including response time](https://discuss.elastic.co/t/filebeat-pipeline-apache-log-pattern-including-response-time/255090)
**Author:** [@ChrisTB](https://discuss.elastic.co/u/ChrisTB)\ **Replies:** 1\ **Last updated:** [November 12, 2020, 9:31am UTC](https://discuss.elastic.co/t/filebeat-pipeline-apache-log-pattern-including-response-time/255090 "2020-11-12T09:31:25Z")
Hi, In our apache logs we also log response time with the %D parameter. We would also like to add this field to the filebeat logs so we can analyse it in Kibana. I can manage to add an updated grok pattern to the fileb… --- ## [How can alerts be set up on a series of values?](https://discuss.elastic.co/t/how-can-alerts-be-set-up-on-a-series-of-values/255177)
**Author:** [@taabishm2](https://discuss.elastic.co/u/taabishm2)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 9:22am UTC](https://discuss.elastic.co/t/how-can-alerts-be-set-up-on-a-series-of-values/255177 "2020-11-12T09:22:57Z")
I am generating a series of numerical values representing failed calls, grouped by their source application. Here is a basic tabular representation of this data: I am trying to create threshold-based alerts that shou… --- ## [Split json in string from packetbeat](https://discuss.elastic.co/t/split-json-in-string-from-packetbeat/254874)
**Author:** [@langol93](https://discuss.elastic.co/u/langol93)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 9:22am UTC](https://discuss.elastic.co/t/split-json-in-string-from-packetbeat/254874 "2020-11-12T09:22:19Z")
Hello I passed http request from packetbeat to logstash and now I have json in htttp.request.body.content: How can I split this string to separate fields? I want to have id, timestamp and value field.. I tried usi… --- ## [Can EA replace all beats?](https://discuss.elastic.co/t/can-ea-replace-all-beats/253723)
**Author:** [@Tuckson](https://discuss.elastic.co/u/Tuckson)\ **Replies:** 4\ **Last updated:** [November 12, 2020, 9:17am UTC](https://discuss.elastic.co/t/can-ea-replace-all-beats/253723 "2020-11-12T09:17:55Z")
Hi, Topic title says it all. At this moment I am buidling up a new platform based on 7.9.3 . I still need to install filebeat/metricbeat on dozens of servers and am wondering: would Elastic-agent eventually replace tho… --- ## [Is not all heap used?](https://discuss.elastic.co/t/is-not-all-heap-used/255110)
**Author:** [@Tuckson](https://discuss.elastic.co/u/Tuckson)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 6:17pm UTC](https://discuss.elastic.co/t/is-not-all-heap-used/255110 "2020-11-11T18:17:49Z")
Hi, Just wondering. I see this heap graph: I set it to 24GB (Of 48GB total Ram) But it looks like GC is already stepping in at 15 or 16 GB? Is there an alternate setting I need to set? Or is there something else I … --- ## [Logstash Error after setting up TLS on Elastic](https://discuss.elastic.co/t/logstash-error-after-setting-up-tls-on-elastic/255055)
**Author:** [@Craig2188](https://discuss.elastic.co/u/Craig2188)\ **Replies:** 3\ **Last updated:** [November 12, 2020, 9:09am UTC](https://discuss.elastic.co/t/logstash-error-after-setting-up-tls-on-elastic/255055 "2020-11-12T09:09:36Z")
I have enabled security on Elastic and setup HTTP/TLS for communication between Elastic and Kibana. Elastic and Kibana are now up and working fine with those new changes. I have just setup the following for Logstash for… --- ## [Index the output of the \_cat API](https://discuss.elastic.co/t/index-the-output-of-the-cat-api/254788)
**Author:** [@soufian.eldouqe](https://discuss.elastic.co/u/soufian.eldouqe)\ **Replies:** 4\ **Last updated:** [November 12, 2020, 8:58am UTC](https://discuss.elastic.co/t/index-the-output-of-the-cat-api/254788 "2020-11-12T08:58:19Z")
Hello, I need to view the top ten list of all my indices sorted by size in Kibana (dashboad) for start, I can get the list of my indices sorted with the following command : GET /\_cat/indices?v&format=json&s=store.size… --- ## [Match a document when user keywords contains all words of a field](https://discuss.elastic.co/t/match-a-document-when-user-keywords-contains-all-words-of-a-field/254934)
**Author:** [@marcmad](https://discuss.elastic.co/u/marcmad)\ **Replies:** 3\ **Last updated:** [November 12, 2020, 8:38am UTC](https://discuss.elastic.co/t/match-a-document-when-user-keywords-contains-all-words-of-a-field/254934 "2020-11-12T08:38:01Z")
Hello everyone, I would like to set up a simple elasticsearch index, to retrieve some documents. I will have a field, named "attributes", which will contains some keywords: "attributes": \[ "Lebron James", "Michael J… --- ## [Reading csv file from dropbox](https://discuss.elastic.co/t/reading-csv-file-from-dropbox/255170)
**Author:** [@byteandbit](https://discuss.elastic.co/u/byteandbit)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 8:37am UTC](https://discuss.elastic.co/t/reading-csv-file-from-dropbox/255170 "2020-11-12T08:37:21Z")
Is there anyway to read csv file from dropbox in logstash? --- ## [Limits on Grok/Split ingest processing](https://discuss.elastic.co/t/limits-on-grok-split-ingest-processing/255168)
**Author:** [@aceggroll](https://discuss.elastic.co/u/aceggroll)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 8:35am UTC](https://discuss.elastic.co/t/limits-on-grok-split-ingest-processing/255168 "2020-11-12T08:35:25Z")
I need some advice on whether I have come to the limits of ingest processing, or maybe there is another option. We're using ES 7.9.3, and receiving logs with winlogbeat. (Logstash is not in play) The logs I'm intereste… --- ## [How to get all orders without specific status in kibana or elastic search](https://discuss.elastic.co/t/how-to-get-all-orders-without-specific-status-in-kibana-or-elastic-search/255152)
**Author:** [@name\_11111](https://discuss.elastic.co/u/name_11111)\ **Replies:** 1\ **Last updated:** [November 12, 2020, 8:33am UTC](https://discuss.elastic.co/t/how-to-get-all-orders-without-specific-status-in-kibana-or-elastic-search/255152 "2020-11-12T08:33:35Z")
I have a table such type in kibana |id| timestamp|status | |1 |time |created| |1| time |closed | |2 |time |created| How i can get all id which doesnt have status "closed" and they where created ol… --- ## [Upgrade to Elasticsearch 7.10](https://discuss.elastic.co/t/upgrade-to-elasticsearch-7-10/255154)
**Author:** [@Syaiful\_Amin](https://discuss.elastic.co/u/Syaiful_Amin)\ **Replies:** 1\ **Last updated:** [November 12, 2020, 8:13am UTC](https://discuss.elastic.co/t/upgrade-to-elasticsearch-7-10/255154 "2020-11-12T08:13:32Z")
where can i get a writeup to upgrade elasticsseach 7.9 to 7.10 :slight\_smile: --- ## [Painless Script Convert to JSON not HasMap string](https://discuss.elastic.co/t/painless-script-convert-to-json-not-hasmap-string/255162)
**Author:** [@rajat\_j](https://discuss.elastic.co/u/rajat_j)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 8:01am UTC](https://discuss.elastic.co/t/painless-script-convert-to-json-not-hasmap-string/255162 "2020-11-12T08:01:24Z")
I am trying to fetch an array using aggregation. The array is a nested array that contains a list of its own type. example : public class Attribute { public long Id { get; se… --- ## [It seems that require\_field\_match highlight option does not work](https://discuss.elastic.co/t/it-seems-that-require-field-match-highlight-option-does-not-work/255051)
**Author:** [@zdeseb](https://discuss.elastic.co/u/zdeseb)\ **Replies:** 6\ **Last updated:** [November 12, 2020, 7:58am UTC](https://discuss.elastic.co/t/it-seems-that-require-field-match-highlight-option-does-not-work/255051 "2020-11-12T07:58:59Z")
Maybe I've missed something but it seems to me that highlight option require\_field\_match does not work correctly (ES 7.9.3 but I tested it with older versions also). Very simple example follows: Let's have following in… --- ## [Kibana plugin generator](https://discuss.elastic.co/t/kibana-plugin-generator/254021)
**Author:** [@omerf](https://discuss.elastic.co/u/omerf)\ **Replies:** 12\ **Last updated:** [November 12, 2020, 7:44am UTC](https://discuss.elastic.co/t/kibana-plugin-generator/254021 "2020-11-12T07:44:47Z")
I downloaded kibana for development, and using yarn and the - node scripts/generate\_plugin my\_plugin\_name I made a plugin. The files are creates as index.ts and not .js. Is there a way to change to react and not typescr… --- ## [Removing of \\\\\\\\ via filebeat while parsing logs to elastic search](https://discuss.elastic.co/t/removing-of-via-filebeat-while-parsing-logs-to-elastic-search/254589)
**Author:** [@525125](https://discuss.elastic.co/u/525125)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 7:15am UTC](https://discuss.elastic.co/t/removing-of-via-filebeat-while-parsing-logs-to-elastic-search/254589 "2020-11-12T07:15:08Z")
log line: {"log":"{\\"time\\":\\"2019-11-04 18:06:07.+00:00\\",\\"severity\\":\\"Information\\",\\"name\\":\\"\\"45632dc\\"\\",\\"class\\":\\"\\"Middleware\\"\\",\\"mcr\\":\\"\\"\_\_3\\"\\",\\"msg\\":\\"###Request: http url ###Response: 200: {\\\\n \[\\… --- ## [ARM support in the age of MAC ARM](https://discuss.elastic.co/t/arm-support-in-the-age-of-mac-arm/255118)
**Author:** [@frankshad](https://discuss.elastic.co/u/frankshad)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 6:25am UTC](https://discuss.elastic.co/t/arm-support-in-the-age-of-mac-arm/255118 "2020-11-12T06:25:20Z")
Now that Mac ARM machines are a thing, is it possible that ElasticSearch can be made to run on ARM architectures without jumping through hoops. It used to work in v6, and it can be made to work on v7 but it takes a signi… --- ## [Kibana status become RED](https://discuss.elastic.co/t/kibana-status-become-red/254743)
**Author:** [@sarthaksahu](https://discuss.elastic.co/u/sarthaksahu)\ **Replies:** 9\ **Last updated:** [November 12, 2020, 6:20am UTC](https://discuss.elastic.co/t/kibana-status-become-red/254743 "2020-11-12T06:20:53Z")
Hi Kibana status becomes RED. {"type":"log","@timestamp":"2020-11-06T19:59:34Z","tags":\["status","plugin:elasticsearch@undefined","error"\],"pid":10,"state":"red","message":"Status changed from green to red - Request Ti… --- ## [What is the probable release date for version 7.10?](https://discuss.elastic.co/t/what-is-the-probable-release-date-for-version-7-10/255007)
**Author:** [@Nikit\_Singh](https://discuss.elastic.co/u/Nikit_Singh)\ **Replies:** 4\ **Last updated:** [November 12, 2020, 5:19am UTC](https://discuss.elastic.co/t/what-is-the-probable-release-date-for-version-7-10/255007 "2020-11-12T05:19:03Z")
Hi I wanted to use the new Observability feature of capturing web-vitals logs. It's only available in 7.10 so wanted to know when will it be released? Thanks. --- ## [Write ip4 0.0.0.0-\>10.X.X.X: sendto: no buffer space available](https://discuss.elastic.co/t/write-ip4-0-0-0-0-10-x-x-x-sendto-no-buffer-space-available/255050)
**Author:** [@rguptarg](https://discuss.elastic.co/u/rguptarg)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 5:09am UTC](https://discuss.elastic.co/t/write-ip4-0-0-0-0-10-x-x-x-sendto-no-buffer-space-available/255050 "2020-11-12T05:09:40Z")
HI, I am new in heartbeat, I have configured heartbeat-elastic-7.9.3-1.x86\_64 with default configuration. Currently I am using only ICMP monitoring and configured 8K IP's. But I am getting "sendto: no buffer space avai… --- ## [How to apply sdfc filter in salesforce plugin of logstash](https://discuss.elastic.co/t/how-to-apply-sdfc-filter-in-salesforce-plugin-of-logstash/254736)
**Author:** [@Pavitra\_Poojary](https://discuss.elastic.co/u/Pavitra_Poojary)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 5:07am UTC](https://discuss.elastic.co/t/how-to-apply-sdfc-filter-in-salesforce-plugin-of-logstash/254736 "2020-11-12T05:07:56Z")
Hi Team, We are extracting the logs from Salesforce object. Here is our input configuration with a object name Error\_Log\_\_c. input {​ salesforce {​ use\_test\_sandbox =\> true client\_id =\> 'xxx' client\_secret =\> 'xxx' … --- ## [What are the minimum permissions for an application-defined user to ingest data into Elasticsearch?](https://discuss.elastic.co/t/what-are-the-minimum-permissions-for-an-application-defined-user-to-ingest-data-into-elasticsearch/254994)
**Author:** [@deaugur](https://discuss.elastic.co/u/deaugur)\ **Replies:** 3\ **Last updated:** [November 12, 2020, 5:05am UTC](https://discuss.elastic.co/t/what-are-the-minimum-permissions-for-an-application-defined-user-to-ingest-data-into-elasticsearch/254994 "2020-11-12T05:05:55Z")
I'm new to Elastic and am currently enabling SSL/TLS across our cluster. I've currently configured applications that ingest to Elasticsearch to use the built-in superuser 'elastic' for authentication. This is less than i… --- ## [Heartbeat schedule not work when has large number of hosts](https://discuss.elastic.co/t/heartbeat-schedule-not-work-when-has-large-number-of-hosts/253522)
**Author:** [@luckyclue](https://discuss.elastic.co/u/luckyclue)\ **Replies:** 1\ **Last updated:** [November 12, 2020, 2:27am UTC](https://discuss.elastic.co/t/heartbeat-schedule-not-work-when-has-large-number-of-hosts/253522 "2020-11-12T02:27:39Z")
heartbeat icmp monitor not work with large number of hosts with config schedule: '1 \* \* \* \* \* \*' It did not show any error but cannot create index at elasticsearch . not work (under 4096 hosts it is normal) schedule: … --- ## [Multiple Pipeline Output](https://discuss.elastic.co/t/multiple-pipeline-output/255140)
**Author:** [@justinainsworth](https://discuss.elastic.co/u/justinainsworth)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 1:05am UTC](https://discuss.elastic.co/t/multiple-pipeline-output/255140 "2020-11-12T01:05:03Z")
Continuing the discussion from Multiple outputs?: According to this post, events can pass to multiple outputs. Is that the case when output is another pipeline? Or more specifically, if all conditionals are met, can a… --- ## [Suggestions which type of filters we can use procees the logs via logstash](https://discuss.elastic.co/t/suggestions-which-type-of-filters-we-can-use-procees-the-logs-via-logstash/255141)
**Author:** [@525125](https://discuss.elastic.co/u/525125)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 12:54am UTC](https://discuss.elastic.co/t/suggestions-which-type-of-filters-we-can-use-procees-the-logs-via-logstash/255141 "2020-11-12T00:54:46Z")
How to process this type of logs via logsatsh to kibana. Any suggestions on filtration. 2020-11-04 00:00:00,038 {abcd23rv6f} \[\] \[INFO \] service - response from 3rd party : \[, , , , , , authentication OK., 1, 0, SafeNet … [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1700) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1702)