# Latest **URL:** https://discuss.elastic.co/latest.md?page=1618 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1619 --- ## [How can send large json file (62.5 GO) to elasticsearch using Api?](https://discuss.elastic.co/t/how-can-send-large-json-file-62-5-go-to-elasticsearch-using-api/276111)
**Author:** [@hana\_sk](https://discuss.elastic.co/u/hana_sk)\ **Replies:** 3\ **Last updated:** [June 17, 2021, 1:15am UTC](https://discuss.elastic.co/t/how-can-send-large-json-file-62-5-go-to-elasticsearch-using-api/276111 "2021-06-17T01:15:09Z")
i'm stuck. how can send large json file (62.5 GO) to elasticsearch using Api? --- ## [Threadpool.bulk.size key ignored](https://discuss.elastic.co/t/threadpool-bulk-size-key-ignored/276124)
**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\ **Replies:** 1\ **Last updated:** [June 17, 2021, 1:14am UTC](https://discuss.elastic.co/t/threadpool-bulk-size-key-ignored/276124 "2021-06-17T01:14:34Z")
Hey there, using an old ES version (2.x) I was trying to use a custom configuration regarding threadpool. currently, nodes have 8 processors. This value is correctly recognized by ES but when I try to increase it, noth… --- ## [Elasticsearch upgrade from 7.6 to 7.13](https://discuss.elastic.co/t/elasticsearch-upgrade-from-7-6-to-7-13/276146)
**Author:** [@thewasta](https://discuss.elastic.co/u/thewasta)\ **Replies:** 2\ **Last updated:** [June 17, 2021, 1:09am UTC](https://discuss.elastic.co/t/elasticsearch-upgrade-from-7-6-to-7-13/276146 "2021-06-17T01:09:24Z")
S.O: Ubuntu 18.04 ES: 7.6.1 (Before upgrade) I tried to upgrade my ElasticStack with 3 nodes (1 master, 2 slave). Following the Guide. And all of those steps are only on master. here my steps: curl -XPUT -u elastic:… --- ## [Improvement of Average Response time](https://discuss.elastic.co/t/improvement-of-average-response-time/276163)
**Author:** [@purushothamkdr143](https://discuss.elastic.co/u/purushothamkdr143)\ **Replies:** 1\ **Last updated:** [June 17, 2021, 1:08am UTC](https://discuss.elastic.co/t/improvement-of-average-response-time/276163 "2021-06-17T01:08:25Z")
Hi All, I have setup elasticsearch on k8s using eck operator. Throughput is fine but response time(average response time) is little high. How can I improve it? by allocating more cpu/ram to data nodes will improve it? K… --- ## [Searchable Snapshot ILM ERROR](https://discuss.elastic.co/t/searchable-snapshot-ilm-error/276166)
**Author:** [@egalpin](https://discuss.elastic.co/u/egalpin)\ **Replies:** 0\ **Last updated:** [June 16, 2021, 4:17pm UTC](https://discuss.elastic.co/t/searchable-snapshot-ilm-error/276166 "2021-06-16T16:17:52Z")
Hi there, I'm attempting to make use of the newly GA Frozen phase with searchable\_snapshot enabled. I'm consistently getting the following error at the step mount-snapshot of the frozen phase: index \[restored-my-index\]… --- ## [AWS Managed Kibana not sending alerts to Zenoss (Custom webhook )](https://discuss.elastic.co/t/aws-managed-kibana-not-sending-alerts-to-zenoss-custom-webhook/276106)
**Author:** [@Shaiju\_Sam](https://discuss.elastic.co/u/Shaiju_Sam)\ **Replies:** 1\ **Last updated:** [June 17, 2021, 1:01am UTC](https://discuss.elastic.co/t/aws-managed-kibana-not-sending-alerts-to-zenoss-custom-webhook/276106 "2021-06-17T01:01:37Z")
Hi Team, We are trying to configure alerting from AWS Kibana to the 3rd party URL i.e., to Zenoss to generate alerts. I have selected the "Custom webhook" option and have provided the 3rd party URL - "https://\*\*\*\*\*\*.com… --- ## [Isolate parallel requests to Elasticsearch](https://discuss.elastic.co/t/isolate-parallel-requests-to-elasticsearch/275996)
**Author:** [@daksh0225](https://discuss.elastic.co/u/daksh0225)\ **Replies:** 3\ **Last updated:** [June 17, 2021, 12:51am UTC](https://discuss.elastic.co/t/isolate-parallel-requests-to-elasticsearch/275996 "2021-06-17T00:51:38Z")
Hi all, I want to run a set of test classes for my application in parallel. Inside each of the test class, the functions make calls to elasticsearch. Currently the problem I am facing in running the tests in parallel is… --- ## [Large cluster on vm vs bare metal](https://discuss.elastic.co/t/large-cluster-on-vm-vs-bare-metal/276017)
**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\ **Replies:** 3\ **Last updated:** [June 17, 2021, 12:50am UTC](https://discuss.elastic.co/t/large-cluster-on-vm-vs-bare-metal/276017 "2021-06-17T00:50:44Z")
What would be better run on vm or on bare metal? metricbeat getting large set of data, about billion document a day, 100+ gig data, data will be feed by three logstash spec I was making was 8 data node, three master a… --- ## [Words with some special character arenot displayed well after elasticsearch injection](https://discuss.elastic.co/t/words-with-some-special-character-arenot-displayed-well-after-elasticsearch-injection/276025)
**Author:** [@F\_Abde](https://discuss.elastic.co/u/F_Abde)\ **Replies:** 8\ **Last updated:** [June 16, 2021, 11:49pm UTC](https://discuss.elastic.co/t/words-with-some-special-character-arenot-displayed-well-after-elasticsearch-injection/276025 "2021-06-16T23:49:52Z")
Hello, I need you help, My data looks like this (My json files) {"index": {"\_id":2530}} {"visitor\_id": "4395667", "timestamp": "2020-08-07T10:24:00Z", "station\_id": "Place A"} {"index": {"\_id":2531}} {"visitor\_id": "43… --- ## [Elastic-agent and postfix logs](https://discuss.elastic.co/t/elastic-agent-and-postfix-logs/275872)
**Author:** [@jerrac](https://discuss.elastic.co/u/jerrac)\ **Replies:** 2\ **Last updated:** [June 16, 2021, 10:19pm UTC](https://discuss.elastic.co/t/elastic-agent-and-postfix-logs/275872 "2021-06-16T22:19:02Z")
Has anyone integrated elastic-agent and postfix in a really good way? As in made the agent split the log messages up into useful fields. I've successfully configured the Custom Logs integration to pull in my postfix log… --- ## [Using pre registered search template is not working](https://discuss.elastic.co/t/using-pre-registered-search-template-is-not-working/276063)
**Author:** [@amarga83](https://discuss.elastic.co/u/amarga83)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 10:11pm UTC](https://discuss.elastic.co/t/using-pre-registered-search-template-is-not-working/276063 "2021-06-16T22:11:28Z")
Hi everyone, I created a search template using kibana as follows: Post \_scripts/mytemplateid3 { "script": { "lang": "mustache", "source": { "query": { "match": { "author": "{{query\_s… --- ## [Cannot get Kubernetes Metadata after migrating to Containerd](https://discuss.elastic.co/t/cannot-get-kubernetes-metadata-after-migrating-to-containerd/276203)
**Author:** [@lel\_war](https://discuss.elastic.co/u/lel_war)\ **Replies:** 0\ **Last updated:** [June 16, 2021, 9:56pm UTC](https://discuss.elastic.co/t/cannot-get-kubernetes-metadata-after-migrating-to-containerd/276203 "2021-06-16T21:56:36Z")
Hello, After I migrated my cluster to containerd, logs are no longer on /var/lib/docker but rather in /var/log/pods///.log and symlinks in /var/log/containers/.log. I configured filebeat with the following and although… --- ## [JDBC Input last value overlap](https://discuss.elastic.co/t/jdbc-input-last-value-overlap/276188)
**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\ **Replies:** 4\ **Last updated:** [June 16, 2021, 9:23pm UTC](https://discuss.elastic.co/t/jdbc-input-last-value-overlap/276188 "2021-06-16T21:23:24Z")
Is it possible to set the sql\_last\_value parameter to go back a set amount of time. So something like :sql\_last\_value(-10s) or something like that. I'm querying a db and getting anything that's been updated since the l… --- ## [Top Hit doesnt work in TSVB table](https://discuss.elastic.co/t/top-hit-doesnt-work-in-tsvb-table/275169)
**Author:** [@Harsha\_Mudundi](https://discuss.elastic.co/u/Harsha_Mudundi)\ **Replies:** 3\ **Last updated:** [June 16, 2021, 9:20pm UTC](https://discuss.elastic.co/t/top-hit-doesnt-work-in-tsvb-table/275169 "2021-06-16T21:20:40Z")
Hi, In TSVB table im not able to display any string type data using top hit. In the image below I have 1 user for every job id. --- ## [Cannot download csv file from kibana dashboard](https://discuss.elastic.co/t/cannot-download-csv-file-from-kibana-dashboard/275336)
**Author:** [@Moni\_Kherajani](https://discuss.elastic.co/u/Moni_Kherajani)\ **Replies:** 11\ **Last updated:** [June 16, 2021, 9:17pm UTC](https://discuss.elastic.co/t/cannot-download-csv-file-from-kibana-dashboard/275336 "2021-06-16T21:17:58Z")
I use 7.8.0 version and while downloading csv report from kibana dashboard it says cannot download your report at this moment. I have the proper user and user roles. Any reason!!? --- ## [Scroll or sliced scroll with sorted results](https://discuss.elastic.co/t/scroll-or-sliced-scroll-with-sorted-results/276199)
**Author:** [@jratliff](https://discuss.elastic.co/u/jratliff)\ **Replies:** 0\ **Last updated:** [June 16, 2021, 9:04pm UTC](https://discuss.elastic.co/t/scroll-or-sliced-scroll-with-sorted-results/276199 "2021-06-16T21:04:26Z")
I'm trying to pull results from elasticsearch with a sort. There are millions of records within each time period I'm looking at. It's taking a very long time to fetch all of the results. I'm looking for ways to improve t… --- ## [Curator Configuration / Errors](https://discuss.elastic.co/t/curator-configuration-errors/276051)
**Author:** [@bgreen](https://discuss.elastic.co/u/bgreen)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 8:52pm UTC](https://discuss.elastic.co/t/curator-configuration-errors/276051 "2021-06-16T20:52:30Z")
Hi, Like many folks, my Elasticsearch indices are taking up quite a bit of disk space and I'm trying to use curator to delete/reduce disk usage. However, when I execute the command I get the following error and I'm a b… --- ## [Constant Garbage Collecting](https://discuss.elastic.co/t/constant-garbage-collecting/276180)
**Author:** [@Tim\_Mobley](https://discuss.elastic.co/u/Tim_Mobley)\ **Replies:** 4\ **Last updated:** [June 16, 2021, 8:43pm UTC](https://discuss.elastic.co/t/constant-garbage-collecting/276180 "2021-06-16T20:43:22Z")
I am getting a constant stream of garbage collection logs in my cluster.log of the type shown below: \[2021-06-16T13:33:31,031\]\[WARN\] \[o.e.m.j.JvmGcMonitorService\] \[hot-data.domain.com\] \[gc\] \[255\] overhead, spent \[1.8s… --- ## [How to parse dir command output from txt file and append filenames to directory](https://discuss.elastic.co/t/how-to-parse-dir-command-output-from-txt-file-and-append-filenames-to-directory/276185)
**Author:** [@baileys20055](https://discuss.elastic.co/u/baileys20055)\ **Replies:** 4\ **Last updated:** [June 16, 2021, 8:33pm UTC](https://discuss.elastic.co/t/how-to-parse-dir-command-output-from-txt-file-and-append-filenames-to-directory/276185 "2021-06-16T20:33:46Z")
Hello, I am trying to parse dir command txt files that are formatted as follows: Directory of C:\\Windows\\addins 09/15/2018 02:33 AM \ . 09/15/2018 02:33 AM \ .. 09/15/2018 02:29 AM… --- ## [Establish connection to Filebeat from Logstash](https://discuss.elastic.co/t/establish-connection-to-filebeat-from-logstash/275547)
**Author:** [@cwiechmann](https://discuss.elastic.co/u/cwiechmann)\ **Replies:** 5\ **Last updated:** [June 16, 2021, 8:29pm UTC](https://discuss.elastic.co/t/establish-connection-to-filebeat-from-logstash/275547 "2021-06-16T20:29:18Z")
Hi All, Let's assume an application I would like to monitor is running in a Security-Network-Zone (e.g. DMZ). It should be integrated via Filebeat into the Logstash & Elasticsearch platform running in the internal netwo… --- ## [{{#context.alerts}} not showing up in markdown](https://discuss.elastic.co/t/context-alerts-not-showing-up-in-markdown/276177)
**Author:** [@EvanGertis](https://discuss.elastic.co/u/EvanGertis)\ **Replies:** 2\ **Last updated:** [June 16, 2021, 8:11pm UTC](https://discuss.elastic.co/t/context-alerts-not-showing-up-in-markdown/276177 "2021-06-16T20:11:24Z")
I am trying to create a simple notification based off of the post described here: {{#context.alerts}} - \*Beat Name\*: {noformat}{{beat.name}}{noformat} {{/context.alerts}} However, the context.alerts block is not get… --- ## [How to update index in Elasticsearch](https://discuss.elastic.co/t/how-to-update-index-in-elasticsearch/275773)
**Author:** [@zaeemmasood](https://discuss.elastic.co/u/zaeemmasood)\ **Replies:** 6\ **Last updated:** [June 16, 2021, 7:14pm UTC](https://discuss.elastic.co/t/how-to-update-index-in-elasticsearch/275773 "2021-06-16T19:14:37Z")
Hi All, I have an ELK 7.6.2 stack running in the environment. In my setup logstash is set to ingest file as an input and performs certain operations on it and creates an index in ES. First few lines of the logstash co… --- ## [Monitoring Logstash With Metricbeat](https://discuss.elastic.co/t/monitoring-logstash-with-metricbeat/275637)
**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\ **Replies:** 3\ **Last updated:** [June 16, 2021, 7:12pm UTC](https://discuss.elastic.co/t/monitoring-logstash-with-metricbeat/275637 "2021-06-16T19:12:00Z")
Recently upgraded my Elastic Stack to 7.13 and have installed metricbeat 7.13.1 on the logstash server for monitoring, but I can get this thing to send monitoring data. The logs indicate a successful connection to my mo… --- ## [Kibana Scripted Field URL Template](https://discuss.elastic.co/t/kibana-scripted-field-url-template/275417)
**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 6:56pm UTC](https://discuss.elastic.co/t/kibana-scripted-field-url-template/275417 "2021-06-16T18:56:05Z")
I was using KIbana 7.4.2. At that time I use to fetch scripted field images as below /bundles/src/legacy/ui/public/field\_editor/components/field\_format\_editor/editors/url/icons/{{value}}.png"}. Now we upgraded Kibana t… --- ## [How to reset Fleet / Get a new Service Token?](https://discuss.elastic.co/t/how-to-reset-fleet-get-a-new-service-token/276159)
**Author:** [@maof97](https://discuss.elastic.co/u/maof97)\ **Replies:** 2\ **Last updated:** [June 16, 2021, 6:50pm UTC](https://discuss.elastic.co/t/how-to-reset-fleet-get-a-new-service-token/276159 "2021-06-16T18:50:29Z")
Hello, I kind of crashed my fleet setup and needed to remove all agents (including the one providing the fleet "server"). But now I can't create a new Fleet server like in the beginning where it asked me to enter an IP… --- ## [Painless script arrays](https://discuss.elastic.co/t/painless-script-arrays/276162)
**Author:** [@nickgregz](https://discuss.elastic.co/u/nickgregz)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 6:46pm UTC](https://discuss.elastic.co/t/painless-script-arrays/276162 "2021-06-16T18:46:06Z")
Hello, Is there a way to easily create and empty string array in Painless script, than add a string to it if it doesn't already exist in the array. I can't seem to find proper examples of arrays for Painless script any… --- ## [Bootstrap Error w/ Adding Runner to ECE Platform (v2.6.2) in ECE install script env "HOST\_STORAGE\_DEVICE\_PATH" when using AWS EFS (NFS4) as argument for "--host-storage-path"](https://discuss.elastic.co/t/bootstrap-error-w-adding-runner-to-ece-platform-v2-6-2-in-ece-install-script-env-host-storage-device-path-when-using-aws-efs-nfs4-as-argument-for-host-storage-path/275493)
**Author:** [@zedtran](https://discuss.elastic.co/u/zedtran)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 6:27pm UTC](https://discuss.elastic.co/t/bootstrap-error-w-adding-runner-to-ece-platform-v2-6-2-in-ece-install-script-env-host-storage-device-path-when-using-aws-efs-nfs4-as-argument-for-host-storage-path/275493 "2021-06-16T18:27:08Z")
Hello, first post here. I tried to lookup existing topics, but found none that fit the description I was having. I manually downloaded the ECE script to my runner host and attempted to run the install script to add my ru… --- ## [Jest server API testing](https://discuss.elastic.co/t/jest-server-api-testing/275943)
**Author:** [@adityaPsl](https://discuss.elastic.co/u/adityaPsl)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 5:56pm UTC](https://discuss.elastic.co/t/jest-server-api-testing/275943 "2021-06-16T17:56:47Z")
Hello Team, I am new to the Javascript and Kibana. Based on the discussion on Sonarqube topic, i am trying to write a test case for basic hello-world plugin (generated by plugin generator) I want to achieve something … --- ## [ECS Logger Mapping Logs to ECS Fields](https://discuss.elastic.co/t/ecs-logger-mapping-logs-to-ecs-fields/274932)
**Author:** [@mertayd](https://discuss.elastic.co/u/mertayd)\ **Replies:** 7\ **Last updated:** [June 16, 2021, 5:48pm UTC](https://discuss.elastic.co/t/ecs-logger-mapping-logs-to-ecs-fields/274932 "2021-06-16T17:48:03Z")
I am quite new using Elastic and I have log data from AWS CloudWatch that I have shipped into Elastic Cluster using filebeats however I couldn't understand how I can map my logs into ECS fields. I read a lot of documenta… --- ## [Configure Metricbeat not to report process arguments](https://discuss.elastic.co/t/configure-metricbeat-not-to-report-process-arguments/276047)
**Author:** [@spatar](https://discuss.elastic.co/u/spatar)\ **Replies:** 1\ **Last updated:** [June 16, 2021, 5:27pm UTC](https://discuss.elastic.co/t/configure-metricbeat-not-to-report-process-arguments/276047 "2021-06-16T17:27:49Z")
Is it possible to configure Metricbeat not to include process arguments in the metrics but only process names? [Previous page](https://discuss.elastic.co/latest.md?page=1617) [Next page](https://discuss.elastic.co/latest.md?page=1619)