# Top **URL:** https://discuss.elastic.co/top.md?page=720&period=all [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 721 --- ## [Java heapspace issue while running logstash](https://discuss.elastic.co/t/java-heapspace-issue-while-running-logstash/234601)
**Author:** [@Gauti](https://discuss.elastic.co/u/Gauti)\ **Replies:** 4\ **Last updated:** [May 27, 2020, 8:51pm UTC](https://discuss.elastic.co/t/java-heapspace-issue-while-running-logstash/234601 "2020-05-27T20:51:00Z")
Hi All, I'm using logstash to ingest data into elasticsearch, while executing logstash its throwing up java heap space error. There is almost 5450 documents i'm trying to ingest. Any ideas or suggestions where i should… --- ## ['now-1d/d' cannot work correctly](https://discuss.elastic.co/t/now-1d-d-cannot-work-correctly/226806)
**Author:** [@Echo\_yu](https://discuss.elastic.co/u/Echo_yu)\ **Replies:** 4\ **Last updated:** [April 8, 2020, 3:06am UTC](https://discuss.elastic.co/t/now-1d-d-cannot-work-correctly/226806 "2020-04-08T03:06:06Z")
Hi, i used logstash to load data from MSSQL database to Elasticsearch. Since I lost 8 hours each time I imported the time field, I manually added 8 hours, for example: I have a sql in conf file of logstash : dateadd(hh,8… --- ## [How to rename fields](https://discuss.elastic.co/t/how-to-rename-fields/97077)
**Author:** [@mikygee](https://discuss.elastic.co/u/mikygee)\ **Replies:** 3\ **Last updated:** [August 15, 2017, 12:20pm UTC](https://discuss.elastic.co/t/how-to-rename-fields/97077 "2017-08-15T12:20:31Z")
Hello, I have grok rules that work fine to match the OS and user agent filter { if \[program\] == “nginx” { grok { break\_on\_match =\> true match =\> \[ "message", "%{IPORHOST:remote\_addr} - - \\\[%{HTTPD… --- ## [Fuzzy Aggregations](https://discuss.elastic.co/t/fuzzy-aggregations/84067)
**Author:** [@Michael\_Sander](https://discuss.elastic.co/u/Michael_Sander)\ **Replies:** 3\ **Last updated:** [May 2, 2017, 7:06am UTC](https://discuss.elastic.co/t/fuzzy-aggregations/84067 "2017-05-02T07:06:31Z")
Elasticsearch supports fuzzy search queries and term aggregations. I am not aware of any way to do fuzzy aggregations, but it would be a great feature. My database deals with names, misspellings are rampant. It would b… --- ## [Logstash keeps on going down](https://discuss.elastic.co/t/logstash-keeps-on-going-down/77960)
**Author:** [@Raja1](https://discuss.elastic.co/u/Raja1)\ **Replies:** 3\ **Last updated:** [March 10, 2017, 4:50am UTC](https://discuss.elastic.co/t/logstash-keeps-on-going-down/77960 "2017-03-10T04:50:22Z")
Hi All, I have done the setup in my system by using docker image and able to pull the logs from my respective folder for the first time but later on logstash keeps shutting down automatically. Even i forcefully start … --- ## [Topbeat on freebsd](https://discuss.elastic.co/t/topbeat-on-freebsd/45182)
**Author:** [@Sai\_Birada](https://discuss.elastic.co/u/Sai_Birada)\ **Replies:** 5\ **Last updated:** [August 4, 2016, 7:11pm UTC](https://discuss.elastic.co/t/topbeat-on-freebsd/45182 "2016-08-04T19:11:27Z")
I am trying to monitory my freebsd server, Is there any freebsd compatible version for topbeat ?, I could get freebsd compatible binary for filebeat here https://beats-nightlies.s3.amazonaws.com/jenkins/topbeat/313-d5c7f… --- ## [All Index deleting Error](https://discuss.elastic.co/t/all-index-deleting-error/215396)
**Author:** [@eogredici](https://discuss.elastic.co/u/eogredici)\ **Replies:** 8\ **Last updated:** [January 30, 2020, 3:15am UTC](https://discuss.elastic.co/t/all-index-deleting-error/215396 "2020-01-30T03:15:15Z")
Hi, i am using elasticSearch 7.3 version. My All index were deleted even though there was no intervention. Even i checked disk usage, memory usage, gc.log but i found errors. İ attached my elastic log. Could you plea… --- ## [Help for configuring apm-agent in a java application that is started as a service on systemd](https://discuss.elastic.co/t/help-for-configuring-apm-agent-in-a-java-application-that-is-started-as-a-service-on-systemd/186111)
**Author:** [@lmoreira](https://discuss.elastic.co/u/lmoreira)\ **Replies:** 8\ **Last updated:** [June 21, 2019, 2:24pm UTC](https://discuss.elastic.co/t/help-for-configuring-apm-agent-in-a-java-application-that-is-started-as-a-service-on-systemd/186111 "2019-06-21T14:24:36Z")
Dear, how are you? I am using elasticsearch, logastah, kibana and apm-serv in version 6.7.2, in docker containers and apm-agent in version 1.6.1 I need to run the apm-agent in a java application that runs as a service … --- ## [saveToEs Write performance (elasticsearch-spark)](https://discuss.elastic.co/t/savetoes-write-performance-elasticsearch-spark/54947)
**Author:** [@larghir](https://discuss.elastic.co/u/larghir)\ **Replies:** 2\ **Last updated:** [September 22, 2016, 11:25am UTC](https://discuss.elastic.co/t/savetoes-write-performance-elasticsearch-spark/54947 "2016-09-22T11:25:05Z")
Hi, I have a question about parallelism when saving an RDD to Elasticsearch. I have an RDD (created with SparkSQL) with 1000 partitions, and an Elasticsearch index with 5 primary shards. I run my application on a Spark… --- ## [Fluentd doesnt send log to elasticsearch](https://discuss.elastic.co/t/fluentd-doesnt-send-log-to-elasticsearch/337619)
**Author:** [@gurban.suleyman](https://discuss.elastic.co/u/gurban.suleyman)\ **Replies:** 6\ **Last updated:** [July 20, 2023, 5:30am UTC](https://discuss.elastic.co/t/fluentd-doesnt-send-log-to-elasticsearch/337619 "2023-07-20T05:30:48Z")
Hi I have a problem it is about to send logs to elasticsearch. I had configure the conf file ind the server but in elastic i couldnt see any log even in the Discover menu --- ## [Unable to start Metricbeat in OpenShift](https://discuss.elastic.co/t/unable-to-start-metricbeat-in-openshift/128533)
**Author:** [@ralfeus](https://discuss.elastic.co/u/ralfeus)\ **Replies:** 6\ **Last updated:** [April 19, 2018, 10:31am UTC](https://discuss.elastic.co/t/unable-to-start-metricbeat-in-openshift/128533 "2018-04-19T10:31:04Z")
Hi. I'm trying to run Metricbeat in OpenShift: oc v3.9.0-alpha.3+78ddc10 kubernetes v1.9.1+a0ce1bc657 features: Basic-Auth GSSAPI Kerberos SPNEGO Server https://openshift-ph.lan.net:8443 kubernetes v1.6.1+5115d708d7 I… --- ## [Unable to Configure an index pattern (Kibana 4.5.3)](https://discuss.elastic.co/t/unable-to-configure-an-index-pattern-kibana-4-5-3/57015)
**Author:** [@ChrisOnesBroken](https://discuss.elastic.co/u/ChrisOnesBroken)\ **Replies:** 6\ **Last updated:** [March 10, 2017, 10:22pm UTC](https://discuss.elastic.co/t/unable-to-configure-an-index-pattern-kibana-4-5-3/57015 "2017-03-10T22:22:06Z")
I've got a dev server set up running Elastic 2.3.4 with a single node, Marvel 2.3.4 and Kibana 4.5.3. I'm unable to 'Configure an index pattern' in Kibana settings, and I don't have a green 'create' button. I've got… --- ## [Hashing passwords in the Elasticsearch config?](https://discuss.elastic.co/t/hashing-passwords-in-the-elasticsearch-config/38185)
**Author:** [@y2kade](https://discuss.elastic.co/u/y2kade)\ **Replies:** 3\ **Last updated:** [December 30, 2015, 5:30pm UTC](https://discuss.elastic.co/t/hashing-passwords-in-the-elasticsearch-config/38185 "2015-12-30T17:30:09Z")
I've just installed Shield (1.3.3) on my two node Elasticsearch (1.7.2) cluster and was wondering if it was possible to mask/hash the Java KeyStore password in the elasticsearch.yml config file? Thanks in advance. --- ## [Using a variable like an index of an array in logstash pipeline](https://discuss.elastic.co/t/using-a-variable-like-an-index-of-an-array-in-logstash-pipeline/233304)
**Author:** [@Md\_Iburahimsha\_S](https://discuss.elastic.co/u/Md_Iburahimsha_S)\ **Replies:** 4\ **Last updated:** [May 19, 2020, 3:10pm UTC](https://discuss.elastic.co/t/using-a-variable-like-an-index-of-an-array-in-logstash-pipeline/233304 "2020-05-19T15:10:30Z")
filter{ ruby { code =\> 'event.set("patternmatch1", event.get("message").scan(/TEXT.\*?(\\w\[\\w,.\]\*)\\r?$/))' } # Retrieve the length of the array containing all the matches ruby { code =\> 'event.set("number… --- ## [Aggregation filter timeout settings](https://discuss.elastic.co/t/aggregation-filter-timeout-settings/196208)
**Author:** [@jratliff](https://discuss.elastic.co/u/jratliff)\ **Replies:** 4\ **Last updated:** [August 26, 2019, 12:33am UTC](https://discuss.elastic.co/t/aggregation-filter-timeout-settings/196208 "2019-08-26T00:33:00Z")
I'm having some trouble with the logstash aggregate filter. We are trying to combine sflow events together. These events are not sent to logstash in real time. The sensor data is collected and sent to us in a batch on a… --- ## [Need help (re)enabling xpack](https://discuss.elastic.co/t/need-help-re-enabling-xpack/94596)
**Author:** [@yehosef](https://discuss.elastic.co/u/yehosef)\ **Replies:** 4\ **Last updated:** [July 26, 2017, 1:01pm UTC](https://discuss.elastic.co/t/need-help-re-enabling-xpack/94596 "2017-07-26T13:01:57Z")
I installed xpack on my OSX machine to test out the features (ES 5.5). The installation went fine and I saw the x-pack features in the kibana side-menu. I wasn't ready to play with it because I was still importing data… --- ## [ECE Kibana not accessible](https://discuss.elastic.co/t/ece-kibana-not-accessible/244079)
**Author:** [@bharat1](https://discuss.elastic.co/u/bharat1)\ **Replies:** 7\ **Last updated:** [August 11, 2020, 11:49am UTC](https://discuss.elastic.co/t/ece-kibana-not-accessible/244079 "2020-08-11T11:49:58Z")
Dear All, My new ECE cluster is up and running however I am getting below message when I access kibana portal directly on port serverIP:9243. I am able to access the admin console of the cluster but no the kibana. {"ok… --- ## [How to run logstash in background in unix?](https://discuss.elastic.co/t/how-to-run-logstash-in-background-in-unix/180779)
**Author:** [@mandar.raj](https://discuss.elastic.co/u/mandar.raj)\ **Replies:** 7\ **Last updated:** [May 15, 2019, 8:24am UTC](https://discuss.elastic.co/t/how-to-run-logstash-in-background-in-unix/180779 "2019-05-15T08:24:46Z")
How to run logstash in background in unix ? --- ## [GeoIP error after logstash 2.3.4 -\> 2.4.0 update](https://discuss.elastic.co/t/geoip-error-after-logstash-2-3-4-2-4-0-update/61220)
**Author:** [@ppascher](https://discuss.elastic.co/u/ppascher)\ **Replies:** 7\ **Last updated:** [September 23, 2016, 1:32pm UTC](https://discuss.elastic.co/t/geoip-error-after-logstash-2-3-4-2-4-0-update/61220 "2016-09-23T13:32:52Z")
Hello, yesterday I updated Logstash from 2.3.4 to 2.4.0 (as well as kibana 4.5 -\> 4.6) and ever since I noticed GeoIP data is not added anymore. logstash.log shows the following: :message=\>"Unknown error while lookin… --- ## [Multiple Elasticsearch types output for a same log](https://discuss.elastic.co/t/multiple-elasticsearch-types-output-for-a-same-log/49547)
**Author:** [@LetMeR00t](https://discuss.elastic.co/u/LetMeR00t)\ **Replies:** 7\ **Last updated:** [May 10, 2016, 1:09pm UTC](https://discuss.elastic.co/t/multiple-elasticsearch-types-output-for-a-same-log/49547 "2016-05-10T13:09:12Z")
Hello everyone, I'm working on a project using ELK and I would like to know if it's possible for Logstash to store information of a same document but in different Elasticsearch types ? Because my explanation is not v… --- ## [Data Masking ES 7.x](https://discuss.elastic.co/t/data-masking-es-7-x/203259)
**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\ **Replies:** 5\ **Last updated:** [October 21, 2019, 2:06pm UTC](https://discuss.elastic.co/t/data-masking-es-7-x/203259 "2019-10-21T14:06:56Z")
Hi all, can I know what is the current situation regarding any kind of plugin/method for data masking? I mean, if I would like to do it, what should be the best or suggest approach? --- ## [My logs are missing in elasticsearch and kibana](https://discuss.elastic.co/t/my-logs-are-missing-in-elasticsearch-and-kibana/187865)
**Author:** [@irobot678](https://discuss.elastic.co/u/irobot678)\ **Replies:** 3\ **Last updated:** [June 28, 2019, 4:18pm UTC](https://discuss.elastic.co/t/my-logs-are-missing-in-elasticsearch-and-kibana/187865 "2019-06-28T16:18:26Z")
Hi , my log file had exactly 1,573,249 lines/logs/documents, when i run logstash i can see only 1,541,787 documents in kibana . Around 31k logs/documents are missing and this is too bad . Can anyone have any solution t… --- ## [How to know my filebeat is collecting the running container logs or not](https://discuss.elastic.co/t/how-to-know-my-filebeat-is-collecting-the-running-container-logs-or-not/129840)
**Author:** [@siva1](https://discuss.elastic.co/u/siva1)\ **Replies:** 3\ **Last updated:** [May 7, 2018, 8:18pm UTC](https://discuss.elastic.co/t/how-to-know-my-filebeat-is-collecting-the-running-container-logs-or-not/129840 "2018-05-07T20:18:43Z")
Hi guys, can u tell me my filebeat is collecting the running container logs? here is my filebeat output Attaching to customfilebeat\_filebeat\_1 filebeat\_1 | Initializing Filebeat... filebeat\_1 | 2018/04/27 13:56:59.… --- ## [Kibana 6.2.4 won't start - illegal\_argument\_exception](https://discuss.elastic.co/t/kibana-6-2-4-wont-start-illegal-argument-exception/135948)
**Author:** [@alexus](https://discuss.elastic.co/u/alexus)\ **Replies:** 4\ **Last updated:** [July 10, 2018, 4:12pm UTC](https://discuss.elastic.co/t/kibana-6-2-4-wont-start-illegal-argument-exception/135948 "2018-07-10T16:12:59Z")
while trying to start Kibana (6.2.4), I get following error: kibana-xxx-custom | {"type":"error","@timestamp":"2018-06-14T14:54:58Z","tags":\["warning","monitoring-ui","kibana-monitoring"\],"pid":1,"level":"error","error"… --- ## [Using rate() function in Kibana Lenses](https://discuss.elastic.co/t/using-rate-function-in-kibana-lenses/271790)
**Author:** [@Ronaldo\_Lanhellas](https://discuss.elastic.co/u/Ronaldo_Lanhellas)\ **Replies:** 6\ **Last updated:** [April 30, 2021, 7:54pm UTC](https://discuss.elastic.co/t/using-rate-function-in-kibana-lenses/271790 "2021-04-30T19:54:39Z")
I'm collecting metrics from kubernetes nodes using this api: kubectl get --raw /api/v1/nodes/$1/proxy/metrics/cadvisor And this returns the metrics in Prometheus format. So, I'm sending this to Logstash and making some… --- ## [Filebeat and availability](https://discuss.elastic.co/t/filebeat-and-availability/37787)
**Author:** [@mguiwin](https://discuss.elastic.co/u/mguiwin)\ **Replies:** 2\ **Last updated:** [December 23, 2015, 4:20pm UTC](https://discuss.elastic.co/t/filebeat-and-availability/37787 "2015-12-23T16:20:14Z")
Hello, The reasons to use a broker like Redis in the ELK log pipeline are (please correct me if I'm wrong): 1. Offload the shipper's (Filebeat or Logstash) internal queue quickly 2. Prevent the Elasticserch from being … --- ## [Upgrade Assistant - Scripting settings - from 5.6 to 6.x](https://discuss.elastic.co/t/upgrade-assistant-scripting-settings-from-5-6-to-6-x/119277)
**Author:** [@LukeMathWalker](https://discuss.elastic.co/u/LukeMathWalker)\ **Replies:** 7\ **Last updated:** [March 15, 2018, 8:08pm UTC](https://discuss.elastic.co/t/upgrade-assistant-scripting-settings-from-5-6-to-6-x/119277 "2018-03-15T20:08:49Z")
Elasticsearch version: 5.6 Hello! We are trying to upgrade our cluster from ES 5.6 to ES 6.x (currently hosted on ElasticCloud) and we are using the Upgrade Assistant in the Management section of Kibana. We have manag… --- ## [Saving a string from an array of strings as a field](https://discuss.elastic.co/t/saving-a-string-from-an-array-of-strings-as-a-field/114915)
**Author:** [@rjm61](https://discuss.elastic.co/u/rjm61)\ **Replies:** 1\ **Last updated:** [January 11, 2018, 11:47am UTC](https://discuss.elastic.co/t/saving-a-string-from-an-array-of-strings-as-a-field/114915 "2018-01-11T11:47:39Z")
I am using a kv filter to split an event message of comma separated values on the coma character to create a string array fa and saving a specific array element as a field as follows filter { kv { # Split comma separa… --- ## [Avoid Duplicate document](https://discuss.elastic.co/t/avoid-duplicate-document/84803)
**Author:** [@laspal](https://discuss.elastic.co/u/laspal)\ **Replies:** 1\ **Last updated:** [May 6, 2017, 9:20am UTC](https://discuss.elastic.co/t/avoid-duplicate-document/84803 "2017-05-06T09:20:05Z")
Hi, I am using bulk operation to create document. The issue is its duplicate document. actions = \[{ "\_index": index\_name, "\_type": doc\_type, "\_source": doc … --- ## [Metricbeat CPU usage total](https://discuss.elastic.co/t/metricbeat-cpu-usage-total/84260)
**Author:** [@GogLlundain](https://discuss.elastic.co/u/GogLlundain)\ **Replies:** 1\ **Last updated:** [May 3, 2017, 2:41pm UTC](https://discuss.elastic.co/t/metricbeat-cpu-usage-total/84260 "2017-05-03T14:41:25Z")
Hiya, Metricbeat is working nicely for me but what I want to see for my servers are how busy they are. I get the CPU usage in parts (user, system, steal etc) and the idle %, what I want is the total usage as a percenta… --- ## [Dead Letter Queue - Issue](https://discuss.elastic.co/t/dead-letter-queue-issue/134118)
**Author:** [@Karthik\_Ramachandran](https://discuss.elastic.co/u/Karthik_Ramachandran)\ **Replies:** 5\ **Last updated:** [June 7, 2018, 9:24pm UTC](https://discuss.elastic.co/t/dead-letter-queue-issue/134118 "2018-06-07T21:24:19Z")
Environment: Logstash 6.2.4 in docker, multi-pipeline mode Input-Redis to Output-Logstash I have enabled dead letter queue for my pipelines and do see mapping failure data going against appropriate pipelines in dead-l… --- ## [Logstash http output not ignoring ssl](https://discuss.elastic.co/t/logstash-http-output-not-ignoring-ssl/144984)
**Author:** [@saching](https://discuss.elastic.co/u/saching)\ **Replies:** 0\ **Last updated:** [August 18, 2018, 2:09am UTC](https://discuss.elastic.co/t/logstash-http-output-not-ignoring-ssl/144984 "2018-08-18T02:09:35Z")
logstash version 5.6.10 output { http { ssl\_certificate\_validation =\> false url =\> "https://some-test-domain.com" format =\> "json" content\_type =\> "application/json" http\_method =\> "post" headers =\> \["Authorizati… --- ## [Not able to connect the points in kibana](https://discuss.elastic.co/t/not-able-to-connect-the-points-in-kibana/135121)
**Author:** [@Suruchi\_Narang](https://discuss.elastic.co/u/Suruchi_Narang)\ **Replies:** 3\ **Last updated:** [June 19, 2018, 5:15am UTC](https://discuss.elastic.co/t/not-able-to-connect-the-points-in-kibana/135121 "2018-06-19T05:15:55Z")
Hi, I am trying to create a visualization using timelion in kibana. Somehow, I am able to create the points in the graph, but unfortunately not able to join them. Is there any function available where i can connect the … --- ## [Data table rows with zero count](https://discuss.elastic.co/t/data-table-rows-with-zero-count/129305)
**Author:** [@muchypup](https://discuss.elastic.co/u/muchypup)\ **Replies:** 3\ **Last updated:** [April 26, 2018, 2:03pm UTC](https://discuss.elastic.co/t/data-table-rows-with-zero-count/129305 "2018-04-26T14:03:05Z")
I am trying to create a report in Kibana to show all entries with zero count older than 60 days. I can create a filter to get the time range, but Kibana is not showing any records with zero count. I can't find any option… --- ## [APM Server is not working proper its giving error and no data found](https://discuss.elastic.co/t/apm-server-is-not-working-proper-its-giving-error-and-no-data-found/125578)
**Author:** [@Krunal\_kalaria](https://discuss.elastic.co/u/Krunal_kalaria)\ **Replies:** 2\ **Last updated:** [March 27, 2018, 4:38am UTC](https://discuss.elastic.co/t/apm-server-is-not-working-proper-its-giving-error-and-no-data-found/125578 "2018-03-27T04:38:15Z")
Hello Folks, I have an issue in kibana APM. I am using Elastic Stack 6.2 in RHEL 7. When i am running ./apm-server -e command then its giving me this error: Exiting: error loading config file: stat apm-server.yml: no… --- ## [Using mongo connector to sync collections between mongo and ES 7](https://discuss.elastic.co/t/using-mongo-connector-to-sync-collections-between-mongo-and-es-7/216822)
**Author:** [@gidgid](https://discuss.elastic.co/u/gidgid)\ **Replies:** 1\ **Last updated:** [January 30, 2020, 4:51am UTC](https://discuss.elastic.co/t/using-mongo-connector-to-sync-collections-between-mongo-and-es-7/216822 "2020-01-30T04:51:05Z")
Hi, We're been using Mongo 3.4 and ES 2.4 and syncing them using Mongo Connector. We're finally upgrading our ES to 7.5. Reading online it seems that Mongo Connector doesnt work with versions that are higher than 5.x an… --- ## [Logstash 7.14.0 "invalid byte sequence in UTF-8" in logstash.javapipeline](https://discuss.elastic.co/t/logstash-7-14-0-invalid-byte-sequence-in-utf-8-in-logstash-javapipeline/280976)
**Author:** [@cknz](https://discuss.elastic.co/u/cknz)\ **Replies:** 4\ **Last updated:** [August 13, 2021, 10:56am UTC](https://discuss.elastic.co/t/logstash-7-14-0-invalid-byte-sequence-in-utf-8-in-logstash-javapipeline/280976 "2021-08-13T10:56:25Z")
Came into work today and noticed that our Logstash pipeline (on all two hosts) had halted with the following error in the logs. Aug 11 00:22:40 its-elk-p03.uod.otago.ac.nz logstash\[20536\]: \[2021-08-11T00:22:40,141\]\[ERRO… --- ## [Thousands of fields in a mapping type?](https://discuss.elastic.co/t/thousands-of-fields-in-a-mapping-type/7576)
**Author:** [@aaron](https://discuss.elastic.co/u/aaron)\ **Replies:** 4\ **Last updated:** [February 11, 2013, 8:21pm UTC](https://discuss.elastic.co/t/thousands-of-fields-in-a-mapping-type/7576 "2013-02-11T20:21:07Z")
Would it be a bad idea to define a universal type containing thousands, perhaps tens of thousands, of fields within a single elasticsearch Mapping? The documents I store for a given index would use a subset of the f… --- ## [How to Insert 50Million documents per 30sec in elasticsearch cluster?](https://discuss.elastic.co/t/how-to-insert-50million-documents-per-30sec-in-elasticsearch-cluster/342669)
**Author:** [@coldcoder8502](https://discuss.elastic.co/u/coldcoder8502)\ **Replies:** 6\ **Last updated:** [September 10, 2023, 3:52pm UTC](https://discuss.elastic.co/t/how-to-insert-50million-documents-per-30sec-in-elasticsearch-cluster/342669 "2023-09-10T15:52:11Z")
Hi all, Iam facing difficulty to insert 50million documents per 30 sec from source to Elasticsearch cluster. I have 7 sources so total = 350million documents per 30 sec. I have one machine with 500GB Ram, 500Tb storage … --- ## [How to setup a second elastic cluster](https://discuss.elastic.co/t/how-to-setup-a-second-elastic-cluster/239643)
**Author:** [@Kay\_Khan](https://discuss.elastic.co/u/Kay_Khan)\ **Replies:** 6\ **Last updated:** [July 6, 2020, 6:27am UTC](https://discuss.elastic.co/t/how-to-setup-a-second-elastic-cluster/239643 "2020-07-06T06:27:44Z")
Hi, I want to create a second elastic cluster for testing and view the data in Kibana. My end goal is to setup fluentd so i can store the logs in elastic search and view them on kibana. But i think i should do this on … --- ## [Overhead overspend issues](https://discuss.elastic.co/t/overhead-overspend-issues/119513)
**Author:** [@Callahan](https://discuss.elastic.co/u/Callahan)\ **Replies:** 7\ **Last updated:** [February 13, 2018, 7:14pm UTC](https://discuss.elastic.co/t/overhead-overspend-issues/119513 "2018-02-13T19:14:50Z")
I'm having huge problems getting my 3 node ES setup to stay up for more than an hour. Nothing has changed leading up to this although I was seeing issues about JVM running out of heap space. I've upgraded successfully fr… --- ## [Enterprise Search 7.7.0 security update](https://discuss.elastic.co/t/enterprise-search-7-7-0-security-update/232505)
**Author:** [@joshbressers](https://discuss.elastic.co/u/joshbressers)\ **Replies:** 0\ **Last updated:** [May 13, 2020, 7:40pm UTC](https://discuss.elastic.co/t/enterprise-search-7-7-0-security-update/232505 "2020-05-13T19:40:02Z")
Elastic App Search Cross Site Scripting flaw (ESA-2020-04) Elastic App Search versions before 7.7.0 contain a cross site scripting (XSS) flaw when displaying document URLs in the Reference UI. If the Reference UI inject… --- ## [Renaming Nested Objects](https://discuss.elastic.co/t/renaming-nested-objects/176885)
**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\ **Replies:** 3\ **Last updated:** [April 16, 2019, 2:32pm UTC](https://discuss.elastic.co/t/renaming-nested-objects/176885 "2019-04-16T14:32:25Z")
Hi, If I have a field that is a dict-like object such as \`\[field\_1\]\[field\_2\]\[field\_3\]' how can I rename 'field\_1' while leaving the sub-fields unchanged? I have tried: filter { mutate { rename =\> { "\[field\_1… --- ## [Visualization in Kibana not accepting a geo\_point](https://discuss.elastic.co/t/visualization-in-kibana-not-accepting-a-geo-point/166255)
**Author:** [@MindfulMantis](https://discuss.elastic.co/u/MindfulMantis)\ **Replies:** 3\ **Last updated:** [January 31, 2019, 8:20pm UTC](https://discuss.elastic.co/t/visualization-in-kibana-not-accepting-a-geo-point/166255 "2019-01-31T20:20:39Z")
I'm having an issue getting Kibana to generate a coordinate map using a geo\_point variable that I pass in from Logstash. I'm parsing bro logs from a syslog file. Within the filter section of my conf file, I have the fol… --- ## [Quickstart Deploy an Elasticsearch cluster get stuck in unknown Health & ApplyingChanges Phase](https://discuss.elastic.co/t/quickstart-deploy-an-elasticsearch-cluster-get-stuck-in-unknown-health-applyingchanges-phase/264791)
**Author:** [@scollector65](https://discuss.elastic.co/u/scollector65)\ **Replies:** 2\ **Last updated:** [February 22, 2021, 7:21am UTC](https://discuss.elastic.co/t/quickstart-deploy-an-elasticsearch-cluster-get-stuck-in-unknown-health-applyingchanges-phase/264791 "2021-02-22T07:21:14Z")
I just started ECK and I try Quickstart docs. https://www.elastic.co/guide/en/cloud-on-k8s/1.4/k8s-deploy-eck.html https://www.elastic.co/guide/en/cloud-on-k8s/1.4/k8s-deploy-elasticsearch.html but my elasticsearch ge… --- ## [Logstash Flush Logs Explanation](https://discuss.elastic.co/t/logstash-flush-logs-explanation/62751)
**Author:** [@chromechris](https://discuss.elastic.co/u/chromechris)\ **Replies:** 2\ **Last updated:** [October 12, 2016, 3:47pm UTC](https://discuss.elastic.co/t/logstash-flush-logs-explanation/62751 "2016-10-12T15:47:35Z")
Hello Loggers, I was wondering if someone could explain what the logs produced by logstash in "logstash.log" mean when you restart Logstash and there is an event flush after sending the SIGTERM to Logstash. Sample Log: … --- ## [Error while connecting to elasticSearch from HTTPHIghLeavelClient](https://discuss.elastic.co/t/error-while-connecting-to-elasticsearch-from-httphighleavelclient/178160)
**Author:** [@jaya](https://discuss.elastic.co/u/jaya)\ **Replies:** 4\ **Last updated:** [May 8, 2019, 9:21am UTC](https://discuss.elastic.co/t/error-while-connecting-to-elasticsearch-from-httphighleavelclient/178160 "2019-05-08T09:21:42Z")
Hi, I am getting error while connecting to elasticSearch using HighLeavelClient. My elastic Search instance is Running on localhost with bind and publish address 127.0.0.1:9200 and is working fine with Postman (I have… --- ## [Logstash 5.6.0 not starting](https://discuss.elastic.co/t/logstash-5-6-0-not-starting/101241)
**Author:** [@kamalbeg](https://discuss.elastic.co/u/kamalbeg)\ **Replies:** 4\ **Last updated:** [September 21, 2017, 12:26am UTC](https://discuss.elastic.co/t/logstash-5-6-0-not-starting/101241 "2017-09-21T00:26:32Z")
Hello, I have 3 ES server running in cluster. I have x-pack install on all 3 ES, kibana and LS. They all are running ver 5.6.0 I am getting following error \[2017-09-20T17:45:14,760\]\[FATAL\]\[logstash.runner \] A… --- ## [How to configure Filebeat to send logs over UDP (to Graylog)?](https://discuss.elastic.co/t/how-to-configure-filebeat-to-send-logs-over-udp-to-graylog/130822)
**Author:** [@spam](https://discuss.elastic.co/u/spam)\ **Replies:** 1\ **Last updated:** [May 8, 2018, 8:08pm UTC](https://discuss.elastic.co/t/how-to-configure-filebeat-to-send-logs-over-udp-to-graylog/130822 "2018-05-08T20:08:12Z")
How to configure Filebeat to send logs over UDP (to Graylog)? --- ## [Separating Index and Search](https://discuss.elastic.co/t/separating-index-and-search/10798)
**Author:** [@Ophir\_Michaeli](https://discuss.elastic.co/u/Ophir_Michaeli)\ **Replies:** 6\ **Last updated:** [February 24, 2013, 3:55pm UTC](https://discuss.elastic.co/t/separating-index-and-search/10798 "2013-02-24T15:55:26Z")
Hi, My question is about the best practice to divide elasticsearch indexing and search systems. Currently, without elasticsearch (and with lucene), our indexing works on several machines at one location… [Previous page](https://discuss.elastic.co/top.md?page=719&per_page=50&period=all) [Next page](https://discuss.elastic.co/top.md?page=721&per_page=50&period=all)