# Latest **URL:** https://discuss.elastic.co/latest.md?page=1590 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1591 --- ## [Json @timestamp vs date {}](https://discuss.elastic.co/t/json-timestamp-vs-date/277713)
**Author:** [@danielmotaleite](https://discuss.elastic.co/u/danielmotaleite)\ **Replies:** 2\ **Last updated:** [July 4, 2021, 12:23am UTC](https://discuss.elastic.co/t/json-timestamp-vs-date/277713 "2021-07-04T00:23:14Z")
From what i see, one should use in logstash the date {} to modify the event date, but setting the @timestamp field to seems to also work, at least when using json {}, @timestamp object seems to set the date correctly. I… --- ## [Dynamically Re-Indexing Old Indices After A Long Time](https://discuss.elastic.co/t/dynamically-re-indexing-old-indices-after-a-long-time/275302)
**Author:** [@rknd](https://discuss.elastic.co/u/rknd)\ **Replies:** 1\ **Last updated:** [July 3, 2021, 7:42pm UTC](https://discuss.elastic.co/t/dynamically-re-indexing-old-indices-after-a-long-time/275302 "2021-07-03T19:42:53Z")
I have some indices like below; people\_in\_maribor people\_in\_rome etc. This indices get bigger after a long time. I want to ask how to reindex automatically old indices after a long time. As an example, I mean after… --- ## [Rally benchmarking Elasticsearch with 429 error code](https://discuss.elastic.co/t/rally-benchmarking-elasticsearch-with-429-error-code/276917)
**Author:** [@parallelism](https://discuss.elastic.co/u/parallelism)\ **Replies:** 1\ **Last updated:** [July 3, 2021, 6:11pm UTC](https://discuss.elastic.co/t/rally-benchmarking-elasticsearch-with-429-error-code/276917 "2021-07-03T18:11:18Z")
Hello, We are testing a new Elasticsearch cluster with Rally. The indexing task is getting an error rate greater than zero and we also found that the total number of indexed documents does not match the target number of… --- ## [Elasticsearch high load on some nodes](https://discuss.elastic.co/t/elasticsearch-high-load-on-some-nodes/276907)
**Author:** [@bxl](https://discuss.elastic.co/u/bxl)\ **Replies:** 1\ **Last updated:** [July 3, 2021, 6:08pm UTC](https://discuss.elastic.co/t/elasticsearch-high-load-on-some-nodes/276907 "2021-07-03T18:08:36Z")
os :CentOS Linux release 7.5.1804 (Core) java:1.8.0\_275 elasticsearch:6.8.1 ::: {192.168.1.3\_hot}{r6gbkwdTRDSUUooaLfWZPw}{djXsTjmBS3OM1IBzw4E2hA}{192.168.1.3}{192.168.1.3:9300}{ml.machine\_memory=540476571648, ml.max\_o… --- ## [Remove postfix of indices name on Restore](https://discuss.elastic.co/t/remove-postfix-of-indices-name-on-restore/276937)
**Author:** [@egibrajshori](https://discuss.elastic.co/u/egibrajshori)\ **Replies:** 1\ **Last updated:** [July 3, 2021, 6:05pm UTC](https://discuss.elastic.co/t/remove-postfix-of-indices-name-on-restore/276937 "2021-07-03T18:05:45Z")
I have a snapshot of an Elasticsearch cluster which has a number of indices. I have to restore the cluster on a new Elasticsearch cluster. All the indices have a -reindexed postfix as part of their name. What I need to … --- ## [ElasticSearch Segment merge not happening when deleted documents count is greater than 50%](https://discuss.elastic.co/t/elasticsearch-segment-merge-not-happening-when-deleted-documents-count-is-greater-than-50/277209)
**Author:** [@Vignesh\_Ramesh](https://discuss.elastic.co/u/Vignesh_Ramesh)\ **Replies:** 1\ **Last updated:** [July 3, 2021, 5:54pm UTC](https://discuss.elastic.co/t/elasticsearch-segment-merge-not-happening-when-deleted-documents-count-is-greater-than-50/277209 "2021-07-03T17:54:47Z")
Elasticsearch version: 7.10.0 I have an elasticsearch index with 8 shards in 8 different nodes and with a document count greater than 25 million documents(nested not included). It's an heavy update index. The document s… --- ## ["\_dateparsefailure"](https://discuss.elastic.co/t/dateparsefailure/277700)
**Author:** [@RoteEdition](https://discuss.elastic.co/u/RoteEdition)\ **Replies:** 3\ **Last updated:** [July 3, 2021, 5:12pm UTC](https://discuss.elastic.co/t/dateparsefailure/277700 "2021-07-03T17:12:21Z")
Hi there, i am trying to parse a .CSV file with a pretty horrible date format. I am using the Date filter: date { match =\> \[ "HelperDate", "dMMyyyy", "ddMMyyyy" \] } Some example data: 6112019 -\> … --- ## [Help with Features of Kibana Interactive filters](https://discuss.elastic.co/t/help-with-features-of-kibana-interactive-filters/277587)
**Author:** [@Jason2073](https://discuss.elastic.co/u/Jason2073)\ **Replies:** 2\ **Last updated:** [July 3, 2021, 4:50pm UTC](https://discuss.elastic.co/t/help-with-features-of-kibana-interactive-filters/277587 "2021-07-03T16:50:24Z")
I am working with the kibana controls panels, pictured here And some functionality seems very restrictive. I want to have these drop down options to be put in any order, and for the options under the others to update… --- ## [Logstash split log and insert it separately into elasticsearch](https://discuss.elastic.co/t/logstash-split-log-and-insert-it-separately-into-elasticsearch/277694)
**Author:** [@shifenglim](https://discuss.elastic.co/u/shifenglim)\ **Replies:** 1\ **Last updated:** [July 3, 2021, 4:18pm UTC](https://discuss.elastic.co/t/logstash-split-log-and-insert-it-separately-into-elasticsearch/277694 "2021-07-03T16:18:56Z")
I am writing a logstash config file and a log I am receiving is giving me issues, the team sent me multiple logs merged into one eg. message: \[logitem(aaa=1, bbb=1, ccc=1), logitem(aaa=2, bbb=2, ccc=2), logitem(aaa=3, b… --- ## [Elasticsearch 7.13.2 linux(centos) service - Custom JVM - Doesn't start](https://discuss.elastic.co/t/elasticsearch-7-13-2-linux-centos-service-custom-jvm-doesnt-start/277668)
**Author:** [@Rajnish\_Kumar](https://discuss.elastic.co/u/Rajnish_Kumar)\ **Replies:** 2\ **Last updated:** [July 3, 2021, 2:56pm UTC](https://discuss.elastic.co/t/elasticsearch-7-13-2-linux-centos-service-custom-jvm-doesnt-start/277668 "2021-07-03T14:56:49Z")
It's installed as a linux service. It comes up and works fine using the bundled jdk(16). \[tsadmin@tsmkmslin04 ~\]$ curl -XGET 'http://localhost:9200' { "name" : "tsmkmslin04", "cluster\_name" : "elasticsearch", "clu… --- ## [Removing custom time filter](https://discuss.elastic.co/t/removing-custom-time-filter/276900)
**Author:** [@venkatesh\_prasanth](https://discuss.elastic.co/u/venkatesh_prasanth)\ **Replies:** 2\ **Last updated:** [July 3, 2021, 7:54am UTC](https://discuss.elastic.co/t/removing-custom-time-filter/276900 "2021-07-03T07:54:13Z")
Hi, i have done visualisation in lens but when i import to canvas it comes with time filter, i dont need that to be used. also remove button is disabled --- ## [How to fetch kibana Visualisation data to Powershell automation](https://discuss.elastic.co/t/how-to-fetch-kibana-visualisation-data-to-powershell-automation/277532)
**Author:** [@Sahithi\_V](https://discuss.elastic.co/u/Sahithi_V)\ **Replies:** 2\ **Last updated:** [July 3, 2021, 9:04am UTC](https://discuss.elastic.co/t/how-to-fetch-kibana-visualisation-data-to-powershell-automation/277532 "2021-07-03T09:04:55Z")
Continuing the discussion from Get data from visualize/ dashboard using the API: I tried to get data from visualization present in Dashboard but I am able to navigate till saved objects of visualizatin with its id but d… --- ## [ElasticSearch distinct results by multiple fields with pagination](https://discuss.elastic.co/t/elasticsearch-distinct-results-by-multiple-fields-with-pagination/277455)
**Author:** [@adolbik](https://discuss.elastic.co/u/adolbik)\ **Replies:** 2\ **Last updated:** [July 3, 2021, 7:52am UTC](https://discuss.elastic.co/t/elasticsearch-distinct-results-by-multiple-fields-with-pagination/277455 "2021-07-03T07:52:08Z")
I have index with bunch of events (user viewed page, clicked something and etc.). I have a page in the system where I need to display uniq results (only one row per user + event + itemId). It means if we have 7 rows like… --- ## [Type date\_range formatting v6.8 vs v7.12](https://discuss.elastic.co/t/type-date-range-formatting-v6-8-vs-v7-12/277698)
**Author:** [@elasticfish](https://discuss.elastic.co/u/elasticfish)\ **Replies:** 0\ **Last updated:** [July 3, 2021, 7:38am UTC](https://discuss.elastic.co/t/type-date-range-formatting-v6-8-vs-v7-12/277698 "2021-07-03T07:38:33Z")
Hello, I am upgrading from ES 6.8 to ES 7.12.1 and I have a dynamic template like: "dynamic\_templates": \[ { "ecom\_data": { "mapping": { "type": "date\_range", "f… --- ## [Uncertain if Refresh is needed](https://discuss.elastic.co/t/uncertain-if-refresh-is-needed/277692)
**Author:** [@dude88](https://discuss.elastic.co/u/dude88)\ **Replies:** 4\ **Last updated:** [July 3, 2021, 5:32am UTC](https://discuss.elastic.co/t/uncertain-if-refresh-is-needed/277692 "2021-07-03T05:32:14Z")
Hi I need to run approximately 30,000 updateByQuery's against my index which has about 35 million decently large documents, sequentially. I'm currently setting refresh:true, and the eta for my script to complete all 30,0… --- ## [Setting up http services on ECK](https://discuss.elastic.co/t/setting-up-http-services-on-eck/277497)
**Author:** [@Francisco\_Gomez1](https://discuss.elastic.co/u/Francisco_Gomez1)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 11:59pm UTC](https://discuss.elastic.co/t/setting-up-http-services-on-eck/277497 "2021-07-02T23:59:33Z")
Hi, i currently a development cluster doing some test before setting it up for production, for my use case im currently trying to configure the HTTP services of my cluster using the OpenShift loadbalancer. Following t… --- ## [Vertica connection with ELK](https://discuss.elastic.co/t/vertica-connection-with-elk/277691)
**Author:** [@simran96](https://discuss.elastic.co/u/simran96)\ **Replies:** 0\ **Last updated:** [July 2, 2021, 10:33pm UTC](https://discuss.elastic.co/t/vertica-connection-with-elk/277691 "2021-07-02T22:33:49Z")
hi, im trying to connect Vertica with ELastic search and writing the conf file for the same. input { jdbc { jdbc\_validate\_connection =\> true … --- ## [Convert timestamp to ISO8601](https://discuss.elastic.co/t/convert-timestamp-to-iso8601/277528)
**Author:** [@mostpha456](https://discuss.elastic.co/u/mostpha456)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 9:19pm UTC](https://discuss.elastic.co/t/convert-timestamp-to-iso8601/277528 "2021-07-02T21:19:48Z")
Hello, I am trying to convert the default field @timestamp to ISO8601 format, but i am having a lot of tags: \_grokparsefailure, \_dateparsefailure, ERROR\_ISO8601\_TIMESTAMP\_FIELD. Do you have any idea how to deal with t… --- ## [Tranformate my date to timestamp field](https://discuss.elastic.co/t/tranformate-my-date-to-timestamp-field/276413)
**Author:** [@Denilson-Semedo](https://discuss.elastic.co/u/Denilson-Semedo)\ **Replies:** 2\ **Last updated:** [July 2, 2021, 9:08pm UTC](https://discuss.elastic.co/t/tranformate-my-date-to-timestamp-field/276413 "2021-07-02T21:08:03Z")
Hy I have this json date. {"type":"audit\_entry","created":"5/20/2021, 11:12:42 PM","colaborador\_id":"cf7dc62b-dde9-4980-89d8-96eb5707876e","request\_method":"PUT","ajax":false,"route":"/stock/artigos/8c443bfe-d077-46d2-8… --- ## [Terms list might be incomplete because the request is taking too long](https://discuss.elastic.co/t/terms-list-might-be-incomplete-because-the-request-is-taking-too-long/277491)
**Author:** [@Gaurav2](https://discuss.elastic.co/u/Gaurav2)\ **Replies:** 3\ **Last updated:** [July 2, 2021, 8:13pm UTC](https://discuss.elastic.co/t/terms-list-might-be-incomplete-because-the-request-is-taking-too-long/277491 "2021-07-02T20:13:44Z")
Hi, please we need help on this. we have elasticsearch running with over 2 billion documents (32 GB ram, 4.5 cpu and 16 gb heap) and over 700 shards we tried making these changes but ended up rebuilding kibana as it wa… --- ## [Heartbeat monitor api login](https://discuss.elastic.co/t/heartbeat-monitor-api-login/275900)
**Author:** [@rp346](https://discuss.elastic.co/u/rp346)\ **Replies:** 3\ **Last updated:** [July 2, 2021, 8:12pm UTC](https://discuss.elastic.co/t/heartbeat-monitor-api-login/275900 "2021-07-02T20:12:29Z")
I want to monitor API login endpoint /api/v1/login. When I login using postman I get following response {"id":"###-###-###-###-###","access\_token":"\*\*\*\*","refresh\_token":"\*\*\*\*"} I tried following in heartbeat.yaml refe… --- ## [How to change date format in logstash](https://discuss.elastic.co/t/how-to-change-date-format-in-logstash/277642)
**Author:** [@rknd](https://discuss.elastic.co/u/rknd)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 8:01pm UTC](https://discuss.elastic.co/t/how-to-change-date-format-in-logstash/277642 "2021-07-02T20:01:04Z")
I have a logs like below; 04/12/2020 5:12:56 PM 05/12/2020 6:13:36 AM I want to match this fields and change to this format in below; 2020-12-04 17:12:56 2020-12-04 06:13:36 How can i do this in logstash ? Thanks fo… --- ## [Unable to use User Authentication in Elasticsearch and Elastic-App-Search](https://discuss.elastic.co/t/unable-to-use-user-authentication-in-elasticsearch-and-elastic-app-search/277531)
**Author:** [@shubamraina](https://discuss.elastic.co/u/shubamraina)\ **Replies:** 6\ **Last updated:** [July 2, 2021, 5:47pm UTC](https://discuss.elastic.co/t/unable-to-use-user-authentication-in-elasticsearch-and-elastic-app-search/277531 "2021-07-02T17:47:01Z")
I have installed Elasticsearch and Elastic-App-Search. Currently it is open to public(i.e: Anyone with the url can see the engines. I want to have User Authentication on the url so that it cannot be accessed by anyone. I… --- ## [\[bool\] malformed query, expected \[END\_OBJECT\] but found \[FIELD\_NAME\]](https://discuss.elastic.co/t/bool-malformed-query-expected-end-object-but-found-field-name/277676)
**Author:** [@Cherrys](https://discuss.elastic.co/u/Cherrys)\ **Replies:** 0\ **Last updated:** [July 2, 2021, 5:40pm UTC](https://discuss.elastic.co/t/bool-malformed-query-expected-end-object-but-found-field-name/277676 "2021-07-02T17:40:21Z")
\*\*Request\*\* POST customer\_details/\_search { "\_source": { "includes": \[ "globalName", "customerName","type" ,"container.type"\] }, "query": { "bool": { "filter": \[ { "has\_parent": … --- ## [Kibana Pie Chart Replace Value Names](https://discuss.elastic.co/t/kibana-pie-chart-replace-value-names/277659)
**Author:** [@azulgrana](https://discuss.elastic.co/u/azulgrana)\ **Replies:** 2\ **Last updated:** [July 2, 2021, 3:48pm UTC](https://discuss.elastic.co/t/kibana-pie-chart-replace-value-names/277659 "2021-07-02T15:48:50Z")
Hi team!, I have a Pie chart that displays severity values. The values go from 1-3. Would it be possible from within the JSON input to replace the numbered values with names. Say 1 = Low, 2 = Medium, 3 = High Thanks in… --- ## [Elasticsearch 3 nodes cluster not joining with each other](https://discuss.elastic.co/t/elasticsearch-3-nodes-cluster-not-joining-with-each-other/277060)
**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\ **Replies:** 16\ **Last updated:** [July 2, 2021, 3:04pm UTC](https://discuss.elastic.co/t/elasticsearch-3-nodes-cluster-not-joining-with-each-other/277060 "2021-07-02T15:04:44Z")
Hi I have 3 nodes cluster with below config Node 1 :: cluster.name: "as\_elasticsearch" node.name: "node-1" node.data: true path.repo: "/var/elasticsearch/snapshot/" path.data: "/var/lib/elasticsearch" network.… --- ## [APM Server Not Receiving gRPC traffic but is receiving https traffic](https://discuss.elastic.co/t/apm-server-not-receiving-grpc-traffic-but-is-receiving-https-traffic/277590)
**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 3:01pm UTC](https://discuss.elastic.co/t/apm-server-not-receiving-grpc-traffic-but-is-receiving-https-traffic/277590 "2021-07-02T15:01:04Z")
Kibana version: 7.13.2 Elasticsearch version: 7.13.2 APM Server version: 7.13.2 APM Agent language and version: Golang OTEL v1.0.0-RC1 Browser version: N/A Original install method (e.g. download page, yum, deb,… --- ## [Bulk Upload but search cant find all docs](https://discuss.elastic.co/t/bulk-upload-but-search-cant-find-all-docs/277634)
**Author:** [@GaryD](https://discuss.elastic.co/u/GaryD)\ **Replies:** 8\ **Last updated:** [July 2, 2021, 1:44pm UTC](https://discuss.elastic.co/t/bulk-upload-but-search-cant-find-all-docs/277634 "2021-07-02T13:44:44Z")
I have done a bulk upload via the API in python as follows: def to\_bulk\_doc(\_doc): return { # default value: 'index' '\_op\_type': 'index', '\_index': es\_index, '\_id'… --- ## [Structure data for a tree layout](https://discuss.elastic.co/t/structure-data-for-a-tree-layout/277347)
**Author:** [@sonik](https://discuss.elastic.co/u/sonik)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 1:33pm UTC](https://discuss.elastic.co/t/structure-data-for-a-tree-layout/277347 "2021-07-02T13:33:36Z")
Hi everybody, I faced some problems with structuring my data for a tree layout. The data must be structured as follows \[ { "id": 1, "name": "flare" }, { "id": 2, "name": "analytics", "parent"… --- ## [Canvas remove custom time](https://discuss.elastic.co/t/canvas-remove-custom-time/277315)
**Author:** [@venkatesh\_prasanth](https://discuss.elastic.co/u/venkatesh_prasanth)\ **Replies:** 1\ **Last updated:** [July 2, 2021, 1:24pm UTC](https://discuss.elastic.co/t/canvas-remove-custom-time/277315 "2021-07-02T13:24:21Z")
pls someone ans [Previous page](https://discuss.elastic.co/latest.md?page=1589) [Next page](https://discuss.elastic.co/latest.md?page=1591)