# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1338 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1339 --- ## [Uncertain if Refresh is needed](https://discuss.elastic.co/t/uncertain-if-refresh-is-needed/277692)
**Author:** [@dude88](https://discuss.elastic.co/u/dude88)\ **Replies:** 4\ **Last updated:** [July 3, 2021, 5:32am UTC](https://discuss.elastic.co/t/uncertain-if-refresh-is-needed/277692 "2021-07-03T05:32:14Z")
Hi I need to run approximately 30,000 updateByQuery's against my index which has about 35 million decently large documents, sequentially. I'm currently setting refresh:true, and the eta for my script to complete all 30,0… --- ## [Vertica connection with ELK](https://discuss.elastic.co/t/vertica-connection-with-elk/277691)
**Author:** [@simran96](https://discuss.elastic.co/u/simran96)\ **Replies:** 0\ **Last updated:** [July 2, 2021, 10:33pm UTC](https://discuss.elastic.co/t/vertica-connection-with-elk/277691 "2021-07-02T22:33:49Z")
hi, im trying to connect Vertica with ELastic search and writing the conf file for the same. input { jdbc { jdbc\_validate\_connection =\> true … --- ## [Convert timestamp to ISO8601](https://discuss.elastic.co/t/convert-timestamp-to-iso8601/277528)
**Author:** [@mostpha456](https://discuss.elastic.co/u/mostpha456)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 9:19pm UTC](https://discuss.elastic.co/t/convert-timestamp-to-iso8601/277528 "2021-07-02T21:19:48Z")
Hello, I am trying to convert the default field @timestamp to ISO8601 format, but i am having a lot of tags: \_grokparsefailure, \_dateparsefailure, ERROR\_ISO8601\_TIMESTAMP\_FIELD. Do you have any idea how to deal with t… --- ## [Tranformate my date to timestamp field](https://discuss.elastic.co/t/tranformate-my-date-to-timestamp-field/276413)
**Author:** [@Denilson-Semedo](https://discuss.elastic.co/u/Denilson-Semedo)\ **Replies:** 2\ **Last updated:** [July 2, 2021, 9:08pm UTC](https://discuss.elastic.co/t/tranformate-my-date-to-timestamp-field/276413 "2021-07-02T21:08:03Z")
Hy I have this json date. {"type":"audit\_entry","created":"5/20/2021, 11:12:42 PM","colaborador\_id":"cf7dc62b-dde9-4980-89d8-96eb5707876e","request\_method":"PUT","ajax":false,"route":"/stock/artigos/8c443bfe-d077-46d2-8… --- ## [Terms list might be incomplete because the request is taking too long](https://discuss.elastic.co/t/terms-list-might-be-incomplete-because-the-request-is-taking-too-long/277491)
**Author:** [@Gaurav2](https://discuss.elastic.co/u/Gaurav2)\ **Replies:** 3\ **Last updated:** [July 2, 2021, 8:13pm UTC](https://discuss.elastic.co/t/terms-list-might-be-incomplete-because-the-request-is-taking-too-long/277491 "2021-07-02T20:13:44Z")
Hi, please we need help on this. we have elasticsearch running with over 2 billion documents (32 GB ram, 4.5 cpu and 16 gb heap) and over 700 shards we tried making these changes but ended up rebuilding kibana as it wa… --- ## [Heartbeat monitor api login](https://discuss.elastic.co/t/heartbeat-monitor-api-login/275900)
**Author:** [@rp346](https://discuss.elastic.co/u/rp346)\ **Replies:** 3\ **Last updated:** [July 2, 2021, 8:12pm UTC](https://discuss.elastic.co/t/heartbeat-monitor-api-login/275900 "2021-07-02T20:12:29Z")
I want to monitor API login endpoint /api/v1/login. When I login using postman I get following response {"id":"###-###-###-###-###","access\_token":"\*\*\*\*","refresh\_token":"\*\*\*\*"} I tried following in heartbeat.yaml refe… --- ## [How to change date format in logstash](https://discuss.elastic.co/t/how-to-change-date-format-in-logstash/277642)
**Author:** [@rknd](https://discuss.elastic.co/u/rknd)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 8:01pm UTC](https://discuss.elastic.co/t/how-to-change-date-format-in-logstash/277642 "2021-07-02T20:01:04Z")
I have a logs like below; 04/12/2020 5:12:56 PM 05/12/2020 6:13:36 AM I want to match this fields and change to this format in below; 2020-12-04 17:12:56 2020-12-04 06:13:36 How can i do this in logstash ? Thanks fo… --- ## [\[bool\] malformed query, expected \[END\_OBJECT\] but found \[FIELD\_NAME\]](https://discuss.elastic.co/t/bool-malformed-query-expected-end-object-but-found-field-name/277676)
**Author:** [@Cherrys](https://discuss.elastic.co/u/Cherrys)\ **Replies:** 0\ **Last updated:** [July 2, 2021, 5:40pm UTC](https://discuss.elastic.co/t/bool-malformed-query-expected-end-object-but-found-field-name/277676 "2021-07-02T17:40:21Z")
\*\*Request\*\* POST customer\_details/\_search { "\_source": { "includes": \[ "globalName", "customerName","type" ,"container.type"\] }, "query": { "bool": { "filter": \[ { "has\_parent": … --- ## [Kibana Pie Chart Replace Value Names](https://discuss.elastic.co/t/kibana-pie-chart-replace-value-names/277659)
**Author:** [@azulgrana](https://discuss.elastic.co/u/azulgrana)\ **Replies:** 2\ **Last updated:** [July 2, 2021, 3:48pm UTC](https://discuss.elastic.co/t/kibana-pie-chart-replace-value-names/277659 "2021-07-02T15:48:50Z")
Hi team!, I have a Pie chart that displays severity values. The values go from 1-3. Would it be possible from within the JSON input to replace the numbered values with names. Say 1 = Low, 2 = Medium, 3 = High Thanks in… --- ## [Elasticsearch 3 nodes cluster not joining with each other](https://discuss.elastic.co/t/elasticsearch-3-nodes-cluster-not-joining-with-each-other/277060)
**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\ **Replies:** 16\ **Last updated:** [July 2, 2021, 3:04pm UTC](https://discuss.elastic.co/t/elasticsearch-3-nodes-cluster-not-joining-with-each-other/277060 "2021-07-02T15:04:44Z")
Hi I have 3 nodes cluster with below config Node 1 :: cluster.name: "as\_elasticsearch" node.name: "node-1" node.data: true path.repo: "/var/elasticsearch/snapshot/" path.data: "/var/lib/elasticsearch" network.… --- ## [Bulk Upload but search cant find all docs](https://discuss.elastic.co/t/bulk-upload-but-search-cant-find-all-docs/277634)
**Author:** [@GaryD](https://discuss.elastic.co/u/GaryD)\ **Replies:** 8\ **Last updated:** [July 2, 2021, 1:44pm UTC](https://discuss.elastic.co/t/bulk-upload-but-search-cant-find-all-docs/277634 "2021-07-02T13:44:44Z")
I have done a bulk upload via the API in python as follows: def to\_bulk\_doc(\_doc): return { # default value: 'index' '\_op\_type': 'index', '\_index': es\_index, '\_id'… --- ## [Structure data for a tree layout](https://discuss.elastic.co/t/structure-data-for-a-tree-layout/277347)
**Author:** [@sonik](https://discuss.elastic.co/u/sonik)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 1:33pm UTC](https://discuss.elastic.co/t/structure-data-for-a-tree-layout/277347 "2021-07-02T13:33:36Z")
Hi everybody, I faced some problems with structuring my data for a tree layout. The data must be structured as follows \[ { "id": 1, "name": "flare" }, { "id": 2, "name": "analytics", "parent"… --- ## [Canvas remove custom time](https://discuss.elastic.co/t/canvas-remove-custom-time/277315)
**Author:** [@venkatesh\_prasanth](https://discuss.elastic.co/u/venkatesh_prasanth)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 1:24pm UTC](https://discuss.elastic.co/t/canvas-remove-custom-time/277315 "2021-07-02T13:24:21Z")
pls someone ans --- ## [HTTP JSON input: one array one document](https://discuss.elastic.co/t/http-json-input-one-array-one-document/277327)
**Author:** [@thopic](https://discuss.elastic.co/u/thopic)\ **Replies:** 6\ **Last updated:** [July 2, 2021, 1:19pm UTC](https://discuss.elastic.co/t/http-json-input-one-array-one-document/277327 "2021-07-02T13:19:18Z")
Hello, I am using the HTTP JSON input of Filebeat to query some APIs and get some metrics. The problem is for some of them to send a JSON array instead of a JSON object. If I want to make a count of a specific metric, I… --- ## [CSV import in KIBANA without timestamp](https://discuss.elastic.co/t/csv-import-in-kibana-without-timestamp/277352)
**Author:** [@AlexM566](https://discuss.elastic.co/u/AlexM566)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 1:15pm UTC](https://discuss.elastic.co/t/csv-import-in-kibana-without-timestamp/277352 "2021-07-02T13:15:07Z")
Hello, I have a problem when I upload a CSV document in kibana. I have a Start time, duration, end time in csv: The cells are formatted dd/mm/yyyy hh:mm And in Discover menu, I do not see the timestamp and the gra… --- ## [Add filter to controls on drilldown](https://discuss.elastic.co/t/add-filter-to-controls-on-drilldown/277630)
**Author:** [@SvenSpudat](https://discuss.elastic.co/u/SvenSpudat)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 12:52pm UTC](https://discuss.elastic.co/t/add-filter-to-controls-on-drilldown/277630 "2021-07-02T12:52:15Z")
Hi, I have one question. In a dashboard I have a drilldown on a pie chart to a dashboard that contains an options control element. The pie chart has buckets for field A (plant) and field B (topic). The controls object … --- ## [How to disable UI metric report API in Kibana?](https://discuss.elastic.co/t/how-to-disable-ui-metric-report-api-in-kibana/277533)
**Author:** [@HemaS](https://discuss.elastic.co/u/HemaS)\ **Replies:** 2\ **Last updated:** [July 2, 2021, 12:44pm UTC](https://discuss.elastic.co/t/how-to-disable-ui-metric-report-api-in-kibana/277533 "2021-07-02T12:44:24Z")
loaded Metric -\> (DashboardPanelVersionInUrl:7.8.0): reporter.js:260 Object { type: "loaded", appName: "DashboardPanelVersionInUrl", eventName: "7.8.0", count: 1 } ​ appName: "DashboardPanelVersionInUrl" ​ count: 1 ​ ev… --- ## [Filebeat has big delay to send log to Kafka](https://discuss.elastic.co/t/filebeat-has-big-delay-to-send-log-to-kafka/277589)
**Author:** [@cpotato](https://discuss.elastic.co/u/cpotato)\ **Replies:** 0\ **Last updated:** [July 1, 2021, 6:43pm UTC](https://discuss.elastic.co/t/filebeat-has-big-delay-to-send-log-to-kafka/277589 "2021-07-01T18:43:03Z")
Hi, We have log server running filebeat to send log data to Kafka. The log file is on NFS mounted filesystem. we do logrotate hourly, the size of the file is ~18G at the peak time. we have log time and the time received… --- ## [Kibana internal Server Error](https://discuss.elastic.co/t/kibana-internal-server-error/277462)
**Author:** [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\ **Replies:** 2\ **Last updated:** [July 2, 2021, 12:03pm UTC](https://discuss.elastic.co/t/kibana-internal-server-error/277462 "2021-07-02T12:03:42Z")
Hello, I build ELK 8.0 from github, on Debian 10 (both elasticsearch nodes and kibana), and when I try to go to index management --\> indices I am getting an internal Error : Kibana Logs: server log \[14:51:03.4… --- ## [Painless Script throws NullPointer exception](https://discuss.elastic.co/t/painless-script-throws-nullpointer-exception/277037)
**Author:** [@pcosic](https://discuss.elastic.co/u/pcosic)\ **Replies:** 5\ **Last updated:** [July 2, 2021, 12:02pm UTC](https://discuss.elastic.co/t/painless-script-throws-nullpointer-exception/277037 "2021-07-02T12:02:00Z")
Hi there, the last days I tried to use a supervised model for DGA detection. As usual, you prepare your index with an ingest pipeline and then use the inference processor to insert a prediction into the event. So far … --- ## [How to use throttle filter to add tag to only one record](https://discuss.elastic.co/t/how-to-use-throttle-filter-to-add-tag-to-only-one-record/277640)
**Author:** [@venkat\_s](https://discuss.elastic.co/u/venkat_s)\ **Replies:** 0\ **Last updated:** [July 2, 2021, 11:13am UTC](https://discuss.elastic.co/t/how-to-use-throttle-filter-to-add-tag-to-only-one-record/277640 "2021-07-02T11:13:29Z")
Hi, I am using Logstash to process a csv file that contains more that one Lakh rows. I want to add a tag to only one record so that I can send email if any record contains this tag. I am trying to use throttle but its… --- ## [ES 1.7.6 Search within root and nested objects](https://discuss.elastic.co/t/es-1-7-6-search-within-root-and-nested-objects/277333)
**Author:** [@ValeryL](https://discuss.elastic.co/u/ValeryL)\ **Replies:** 4\ **Last updated:** [July 2, 2021, 10:18am UTC](https://discuss.elastic.co/t/es-1-7-6-search-within-root-and-nested-objects/277333 "2021-07-02T10:18:05Z")
Hi there, I'm trying to understand, why search within root and nested objects works in ES 1.7 and now it dosn't work in ES 7.13. May be I'm missing something? I use the following index mapping and search requests: ES 1.… --- ## [Kibana how sort logs](https://discuss.elastic.co/t/kibana-how-sort-logs/277595)
**Author:** [@Ilya\_21bA](https://discuss.elastic.co/u/Ilya_21bA)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 9:20am UTC](https://discuss.elastic.co/t/kibana-how-sort-logs/277595 "2021-07-02T09:20:01Z")
Hello everyone Tell me how I can get a certain amount of data for a certain time range. For example, how can I get all the logs for this range. The fact is that I can't know the exact range, and therefore how can I g… --- ## [FileBeat consumes Kafka, every time a FileBeat is started as a consumer, Kafka needs to spend several hours for the rebalancing, and only the first FileBeat will not have the rebalancing](https://discuss.elastic.co/t/filebeat-consumes-kafka-every-time-a-filebeat-is-started-as-a-consumer-kafka-needs-to-spend-several-hours-for-the-rebalancing-and-only-the-first-filebeat-will-not-have-the-rebalancing/277627)
**Author:** [@hadogen](https://discuss.elastic.co/u/hadogen)\ **Replies:** 0\ **Last updated:** [July 2, 2021, 8:56am UTC](https://discuss.elastic.co/t/filebeat-consumes-kafka-every-time-a-filebeat-is-started-as-a-consumer-kafka-needs-to-spend-several-hours-for-the-rebalancing-and-only-the-first-filebeat-will-not-have-the-rebalancing/277627 "2021-07-02T08:56:43Z")
ENV: kafka. 2.12-2.0.1 x 3 filebeat version 7.12.1. x N kafka config file: broker.id=111 listeners=PLAINTEXT://172.30.160.16:9091 advertised.listeners=PLAINTEXT://172.30.160.16:9091 num.network.threads=48 num.io.t… --- ## [Esrally loaddriver configurations](https://discuss.elastic.co/t/esrally-loaddriver-configurations/276803)
**Author:** [@purushothamkdr143](https://discuss.elastic.co/u/purushothamkdr143)\ **Replies:** 2\ **Last updated:** [July 2, 2021, 8:59am UTC](https://discuss.elastic.co/t/esrally-loaddriver-configurations/276803 "2021-07-02T08:59:11Z")
Hi All, I am trying to setup esrally in k8s, As per the Tips and Tricks — Rally 2.2.1 documentation it is good approach or solution to distribute the load to loaddrivers. what would be the better configurations for load… --- ## [Elasticsearch register backup repository with different UID and GID](https://discuss.elastic.co/t/elasticsearch-register-backup-repository-with-different-uid-and-gid/277212)
**Author:** [@KA3AXCTAH](https://discuss.elastic.co/u/KA3AXCTAH)\ **Replies:** 6\ **Last updated:** [July 2, 2021, 8:18am UTC](https://discuss.elastic.co/t/elasticsearch-register-backup-repository-with-different-uid-and-gid/277212 "2021-07-02T08:18:18Z")
I have 2 Elasticsearch clusters they are backed up to the same NFS share, but in different directories and the elasticsearch user on these VMs has different UIDs and GIDs For example, for the corn project, the elasticsea… --- ## [Canvas time filter](https://discuss.elastic.co/t/canvas-time-filter/277420)
**Author:** [@Mik\_a](https://discuss.elastic.co/u/Mik_a)\ **Replies:** 12\ **Last updated:** [July 2, 2021, 7:48am UTC](https://discuss.elastic.co/t/canvas-time-filter/277420 "2021-07-02T07:48:36Z")
I made a Canvas workpad showing one metric. I need dynamic filters and if I import a filter from the dashboard they seem to have no effect. When I add a time filter from canvas "add element" my metric says "Error canno… --- ## [Converting Date-String into Date with Ingest-pipeline not working](https://discuss.elastic.co/t/converting-date-string-into-date-with-ingest-pipeline-not-working/277613)
**Author:** [@adamio](https://discuss.elastic.co/u/adamio)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 6:54am UTC](https://discuss.elastic.co/t/converting-date-string-into-date-with-ingest-pipeline-not-working/277613 "2021-07-02T06:54:18Z")
We have this pipeline: PUT \_ingest/pipeline/j2-e2a-test { "processors": \[ { "grok": { "field": "message", "patterns": \[ "(?m)(?\%{DATE\_EU}\\\\s+%{TIME})\\\\s+(%{WORD:loglevel… --- ## [What are the specifications of your shard configuration or equipment?](https://discuss.elastic.co/t/what-are-the-specifications-of-your-shard-configuration-or-equipment/276155)
**Author:** [@its-ogawa](https://discuss.elastic.co/u/its-ogawa)\ **Replies:** 12\ **Last updated:** [July 2, 2021, 6:46am UTC](https://discuss.elastic.co/t/what-are-the-specifications-of-your-shard-configuration-or-equipment/276155 "2021-07-02T06:46:45Z")
I'm using Filebeat, Logstash and ElasticSearch to collect logs. Today, I encountered the following error. # tail /var/log/logstash/logstash-plain.log \[2021-06-16T10:10:48,509\]\[WARN \]\[logstash.outputs.elasticsearch\]\[mai… --- ## [Mapping file \_settings.json does not exist for elasticsearch version 7](https://discuss.elastic.co/t/mapping-file-settings-json-does-not-exist-for-elasticsearch-version-7/277603)
**Author:** [@dotel](https://discuss.elastic.co/u/dotel)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 5:12am UTC](https://discuss.elastic.co/t/mapping-file-settings-json-does-not-exist-for-elasticsearch-version-7/277603 "2021-07-02T05:12:50Z")
I'm using elastic search 7.13.2 and fscrawler-2.5. When I try to create a new job in fscrawler using bin/fscrawler testjob2 it prompts me to create a new job and creates a new job with config file here /root/.fscrawler/t… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1337) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1339)