# Latest **URL:** https://discuss.elastic.co/latest.md?page=1916 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1917 --- ## [Create a table from array of objects](https://discuss.elastic.co/t/create-a-table-from-array-of-objects/259519)
**Author:** [@Oscar\_de\_Dios](https://discuss.elastic.co/u/Oscar_de_Dios)\ **Replies:** 4\ **Last updated:** [December 30, 2020, 11:04am UTC](https://discuss.elastic.co/t/create-a-table-from-array-of-objects/259519 "2020-12-30T11:04:40Z")
Hi. I have some logs like this: log1 { someField: \[ { name: 'A', occurrencies: 4}, {name: 'B', occurencies: 10}\] } log2 { someField: \[ { name: 'A', occurrencies: 2}, {name: 'B', occurencies: 12} , name: 'C', occure… --- ## [Logstask nested field problem](https://discuss.elastic.co/t/logstask-nested-field-problem/259781)
**Author:** [@abu.sayeed](https://discuss.elastic.co/u/abu.sayeed)\ **Replies:** 2\ **Last updated:** [December 30, 2020, 10:41am UTC](https://discuss.elastic.co/t/logstask-nested-field-problem/259781 "2020-12-30T10:41:10Z")
Logs message : "message" =\> "Backoff FixedBackOff{interval=0, currentAttempts=10, maxAttempts=9} exhausted " I need field like below: "FixedBackOff" =\> { "interval"=0, "currentAttempts"=10, "maxAttempts"=9 } Than… --- ## [Can't see Exception Stack Trace (APM) in Dark mode](https://discuss.elastic.co/t/cant-see-exception-stack-trace-apm-in-dark-mode/259841)
**Author:** [@rodbil](https://discuss.elastic.co/u/rodbil)\ **Replies:** 1\ **Last updated:** [December 30, 2020, 9:33am UTC](https://discuss.elastic.co/t/cant-see-exception-stack-trace-apm-in-dark-mode/259841 "2020-12-30T09:33:53Z")
Kibana version : 7.8.1 (flavor:default, type:docker) Elasticsearch version : 7.8.1 (flavor:default, type:docker) APM Server version : 7.8.1 (flavor:default, type:docker) Browser version : Google Chrome Version 87.0.42… --- ## [Elastic APM skip transactions and metrics](https://discuss.elastic.co/t/elastic-apm-skip-transactions-and-metrics/259828)
**Author:** [@Nikhil\_Bhaware](https://discuss.elastic.co/u/Nikhil_Bhaware)\ **Replies:** 1\ **Last updated:** [December 30, 2020, 7:59am UTC](https://discuss.elastic.co/t/elastic-apm-skip-transactions-and-metrics/259828 "2020-12-30T07:59:42Z")
Kibana version: kibana-7.10.0 Elasticsearch version: elasticsearch-7.10.0 APM Server version: apm-server-7.10.0 APM Agent language and version: java : 1.19.0 Browser version: chrome 72.0.3626.121 Original install me… --- ## [Why does filebeat register a new broker when inserting data into topic of kafka?](https://discuss.elastic.co/t/why-does-filebeat-register-a-new-broker-when-inserting-data-into-topic-of-kafka/259850)
**Author:** [@bae\_park](https://discuss.elastic.co/u/bae_park)\ **Replies:** 0\ **Last updated:** [December 30, 2020, 5:43am UTC](https://discuss.elastic.co/t/why-does-filebeat-register-a-new-broker-when-inserting-data-into-topic-of-kafka/259850 "2020-12-30T05:43:53Z")
I tried to insert data into the cta\_test topic of kafka using filebeat. However, the topic of cta\_test had no data. So I checked the filebeat log and found a new broker registration part there. I intended to access ka… --- ## [VPC Flow Logs Lagging](https://discuss.elastic.co/t/vpc-flow-logs-lagging/259855)
**Author:** [@jhanvi](https://discuss.elastic.co/u/jhanvi)\ **Replies:** 2\ **Last updated:** [December 30, 2020, 7:10am UTC](https://discuss.elastic.co/t/vpc-flow-logs-lagging/259855 "2020-12-30T07:10:49Z")
Hi, I am trying to take vpc flow logs. They are getting ingested but there is a lag in the logs flowing i.e. for today, logs of yesterday are still being ingested. What could possibly be the reason for the same and how… --- ## [Elasticsearch keystore - question on password protection](https://discuss.elastic.co/t/elasticsearch-keystore-question-on-password-protection/259607)
**Author:** [@Knipmans](https://discuss.elastic.co/u/Knipmans)\ **Replies:** 2\ **Last updated:** [December 30, 2020, 6:01am UTC](https://discuss.elastic.co/t/elasticsearch-keystore-question-on-password-protection/259607 "2020-12-30T06:01:27Z")
Hi Elastic experts! A small question on the Elastic keystore: Is it possible to use —stdin to provide the password? Something like: echo “mySecret” | bin/elasticsearch-keystore passwd —stdin Also, another questio… --- ## [Recovering from crashlooping masters due to exhausted disk capacity (2/3)](https://discuss.elastic.co/t/recovering-from-crashlooping-masters-due-to-exhausted-disk-capacity-2-3/259844)
**Author:** [@John\_Nason](https://discuss.elastic.co/u/John_Nason)\ **Replies:** 0\ **Last updated:** [December 30, 2020, 2:50am UTC](https://discuss.elastic.co/t/recovering-from-crashlooping-masters-due-to-exhausted-disk-capacity-2-3/259844 "2020-12-30T02:50:20Z")
My ECK topology is 3 master nodes, and 4 data/ingest nodes (as specified in the config: stanza). The data nodes all have large volumes attached. Without knowing better, I left the masters at the default, which happens … --- ## [Regular IO peak in Elasticsearch data disk](https://discuss.elastic.co/t/regular-io-peak-in-elasticsearch-data-disk/259771)
**Author:** [@zhiweiv](https://discuss.elastic.co/u/zhiweiv)\ **Replies:** 7\ **Last updated:** [December 30, 2020, 2:47am UTC](https://discuss.elastic.co/t/regular-io-peak-in-elasticsearch-data-disk/259771 "2020-12-30T02:47:44Z")
We observed regular IO peak in Elasticsearch data disk, it is triggered every 10 minutes. How can I find which function triggered this? There is nothing in ES log. --- ## [Date filter plugin not working as expected](https://discuss.elastic.co/t/date-filter-plugin-not-working-as-expected/259835)
**Author:** [@S3l3ct3d](https://discuss.elastic.co/u/S3l3ct3d)\ **Replies:** 8\ **Last updated:** [December 29, 2020, 11:48pm UTC](https://discuss.elastic.co/t/date-filter-plugin-not-working-as-expected/259835 "2020-12-29T23:48:33Z")
Good evening, I have a rather extensive .conf file with a Date filter plugin being used. However it is not actually working. I am sending it to a target of @timestamp, but, I am not seeing the corresponding Original Eve… --- ## [How to Get Disk Usage by Search or Query Terms?](https://discuss.elastic.co/t/how-to-get-disk-usage-by-search-or-query-terms/259836)
**Author:** [@bbek](https://discuss.elastic.co/u/bbek)\ **Replies:** 1\ **Last updated:** [December 29, 2020, 11:07pm UTC](https://discuss.elastic.co/t/how-to-get-disk-usage-by-search-or-query-terms/259836 "2020-12-29T23:07:05Z")
I have multiple systems feeding a single index. What is the best approach to find size on disk, specific to search results? I'm trying to allocate by actual storage to get each 'department' cost. For instance mixing: … --- ## [Help with unassigned shards / CircuitBreakingException / Values less than -1 bytes are not supported](https://discuss.elastic.co/t/help-with-unassigned-shards-circuitbreakingexception-values-less-than-1-bytes-are-not-supported/257441)
**Author:** [@DevFullStack](https://discuss.elastic.co/u/DevFullStack)\ **Replies:** 31\ **Last updated:** [December 29, 2020, 10:04pm UTC](https://discuss.elastic.co/t/help-with-unassigned-shards-circuitbreakingexception-values-less-than-1-bytes-are-not-supported/257441 "2020-12-29T22:04:09Z")
Hi Elasticians, I'm looking for help fixing an issue (or family of issues) that causes a Elasticsearch v7.8.1 cluster to go consistently to yellow state due to unassigned shard(s) that sometimes cannot "auto-heal". This … --- ## [Event Correlation](https://discuss.elastic.co/t/event-correlation/259144)
**Author:** [@escrimaglia](https://discuss.elastic.co/u/escrimaglia)\ **Replies:** 3\ **Last updated:** [December 29, 2020, 9:17pm UTC](https://discuss.elastic.co/t/event-correlation/259144 "2020-12-29T21:17:09Z")
Hi, I’m testing ELK. So far it’s been very well sending logs from different platforms to elastic as well as indexing and creating views or graphs. My interest now is correlate event using all those logs entries. For exa… --- ## [ELastic APM Service name in apache storm](https://discuss.elastic.co/t/elastic-apm-service-name-in-apache-storm/259364)
**Author:** [@Nikhil\_Bhaware](https://discuss.elastic.co/u/Nikhil_Bhaware)\ **Replies:** 1\ **Last updated:** [December 22, 2020, 12:32pm UTC](https://discuss.elastic.co/t/elastic-apm-service-name-in-apache-storm/259364 "2020-12-22T12:32:10Z")
We wants to use elastic APM in apache storm based application. In one storm cluster, we have multiple topologies running which are doing different functions altogether. We wants to give service name for each topology rat… --- ## [Day\_of\_week field does not show data when sent through the index](https://discuss.elastic.co/t/day-of-week-field-does-not-show-data-when-sent-through-the-index/259584)
**Author:** [@Luukv](https://discuss.elastic.co/u/Luukv)\ **Replies:** 1\ **Last updated:** [December 29, 2020, 8:28pm UTC](https://discuss.elastic.co/t/day-of-week-field-does-not-show-data-when-sent-through-the-index/259584 "2020-12-29T20:28:33Z")
We had some scripted field for time values. Think of the day of week values so we can see the average income for the monday over a full year. Same with weeks/months/hour. This was causing some performance issues when com… --- ## [Set custom document ids on bulk insert](https://discuss.elastic.co/t/set-custom-document-ids-on-bulk-insert/258455)
**Author:** [@dmabuada](https://discuss.elastic.co/u/dmabuada)\ **Replies:** 6\ **Last updated:** [December 29, 2020, 8:22pm UTC](https://discuss.elastic.co/t/set-custom-document-ids-on-bulk-insert/258455 "2020-12-29T20:22:53Z")
I'm attempting to bulk insert generated data from the track generator (I created my own custom track), but I'd like to disable auto-generated IDs on insert. I modified my data files to include the \_id prop on each docume… --- ## [Issue Magento 2.4.1 and Elasticsearch](https://discuss.elastic.co/t/issue-magento-2-4-1-and-elasticsearch/259801)
**Author:** [@trotlix](https://discuss.elastic.co/u/trotlix)\ **Replies:** 1\ **Last updated:** [December 29, 2020, 8:12pm UTC](https://discuss.elastic.co/t/issue-magento-2-4-1-and-elasticsearch/259801 "2020-12-29T20:12:01Z")
Hello guys, I am still facing the issue which probably related with Magento 2 (2.4.1) and Elastic search. You can see the error page here: http://mage2.kouzloloutek.cz/loutky-spejbl-hurvinek I read in another discussi… --- ## [Data from ESSQL not available to bubble chart, in Canvas and Vega](https://discuss.elastic.co/t/data-from-essql-not-available-to-bubble-chart-in-canvas-and-vega/259816)
**Author:** [@Hugo\_Pires](https://discuss.elastic.co/u/Hugo_Pires)\ **Replies:** 14\ **Last updated:** [December 29, 2020, 8:07pm UTC](https://discuss.elastic.co/t/data-from-essql-not-available-to-bubble-chart-in-canvas-and-vega/259816 "2020-12-29T20:07:40Z")
Hello I am trying to create a scatter plot from an index (created with a transform). The data is available at the datasource preview of the query but it doesn't show up in the chart. Running the chart in debug mode giv… --- ## [Unsupported script value error in visual](https://discuss.elastic.co/t/unsupported-script-value-error-in-visual/259800)
**Author:** [@Rajesh\_M](https://discuss.elastic.co/u/Rajesh_M)\ **Replies:** 2\ **Last updated:** [December 29, 2020, 7:51pm UTC](https://discuss.elastic.co/t/unsupported-script-value-error-in-visual/259800 "2020-12-29T19:51:52Z")
Hi, I am using ELK 7.6.2. In my index, there are two fields, timestamp and duration (duration is in ms). I have created a new field using painless script to find the start time (timestamp - duration). Below is my scrip… --- ## [Logstash s3 input plugin not deleting files after processing](https://discuss.elastic.co/t/logstash-s3-input-plugin-not-deleting-files-after-processing/259302)
**Author:** [@mcjay](https://discuss.elastic.co/u/mcjay)\ **Replies:** 1\ **Last updated:** [December 29, 2020, 7:48pm UTC](https://discuss.elastic.co/t/logstash-s3-input-plugin-not-deleting-files-after-processing/259302 "2020-12-29T19:48:14Z")
I am using s3 input plugin on logstash to read AWS VPC flow logs from s3 bucket. I have this as my input.conf file input { s3 { bucket =\> "vpc-flow-logs-elk" prefix =\> "AWSLogs/200312345677/vpcflowlogs/us-east-1/" regio… --- ## [Kibana transform timestamp mismatch](https://discuss.elastic.co/t/kibana-transform-timestamp-mismatch/259782)
**Author:** [@Gokul6](https://discuss.elastic.co/u/Gokul6)\ **Replies:** 1\ **Last updated:** [December 29, 2020, 7:39pm UTC](https://discuss.elastic.co/t/kibana-transform-timestamp-mismatch/259782 "2020-12-29T19:39:16Z")
i am creating a transform in kibana and grouping it based on @timestamp field present in my data. while doing so i am getting the data grouped by @ 05:30:00.000. i read that, by default Kibana adjusts timestamps to th… --- ## [Flexible search nested documents](https://discuss.elastic.co/t/flexible-search-nested-documents/259802)
**Author:** [@Maksym1](https://discuss.elastic.co/u/Maksym1)\ **Replies:** 1\ **Last updated:** [December 29, 2020, 6:37pm UTC](https://discuss.elastic.co/t/flexible-search-nested-documents/259802 "2020-12-29T18:37:43Z")
Maybe somebody has implemented such a search in nested documents. Here is my mapping: { "my-index": { "aliases": {}, "mappings": { "properties": { "customer": { … --- ## [Error using Endpoint Security in Linux](https://discuss.elastic.co/t/error-using-endpoint-security-in-linux/259316)
**Author:** [@roh](https://discuss.elastic.co/u/roh)\ **Replies:** 6\ **Last updated:** [December 29, 2020, 6:11pm UTC](https://discuss.elastic.co/t/error-using-endpoint-security-in-linux/259316 "2020-12-29T18:11:10Z")
Hi all I was testing Elastic Agent with Endpoint Security policy. I thought only malware protection doesn't work in linux, but I get this error when I try to use Endpoint Security. I also tried Endpoint Security pol… --- ## [Logstash re-read full log after restart](https://discuss.elastic.co/t/logstash-re-read-full-log-after-restart/259796)
**Author:** [@msk\_76](https://discuss.elastic.co/u/msk_76)\ **Replies:** 5\ **Last updated:** [December 29, 2020, 5:33pm UTC](https://discuss.elastic.co/t/logstash-re-read-full-log-after-restart/259796 "2020-12-29T17:33:03Z")
I am facing an issue with logstash that it read the log from begin even after it has loaded the log file already. It happens only when i restart the logstash. Inside the .sincedb file the contents are : 1149101767 0 38 … --- ## [Ms teams watcher](https://discuss.elastic.co/t/ms-teams-watcher/259548)
**Author:** [@Mohith\_Vegi](https://discuss.elastic.co/u/Mohith_Vegi)\ **Replies:** 3\ **Last updated:** [December 29, 2020, 5:14pm UTC](https://discuss.elastic.co/t/ms-teams-watcher/259548 "2020-12-29T17:14:01Z")
when creating a watcher using webhook for microsoft teams, is there any method to tag a particular person in MS teams? --- ## [Packet Beat does not send any data to elastic search](https://discuss.elastic.co/t/packet-beat-does-not-send-any-data-to-elastic-search/259690)
**Author:** [@bucco1958](https://discuss.elastic.co/u/bucco1958)\ **Replies:** 2\ **Last updated:** [December 29, 2020, 4:23pm UTC](https://discuss.elastic.co/t/packet-beat-does-not-send-any-data-to-elastic-search/259690 "2020-12-29T16:23:58Z")
Hi there I'm running elastic search version 7.8.0 and Kibana 7.8.0 on Win10. I have installed metricbeat and filebeat - both are running fine. I have installed packetbeat and runned packetbeat -setup The index has b… --- ## [Display latest value in a \`Bucket\`](https://discuss.elastic.co/t/display-latest-value-in-a-bucket/259577)
**Author:** [@grra](https://discuss.elastic.co/u/grra)\ **Replies:** 3\ **Last updated:** [December 29, 2020, 4:00pm UTC](https://discuss.elastic.co/t/display-latest-value-in-a-bucket/259577 "2020-12-29T16:00:29Z")
Hey, Let's say I have a set of numbers, and every minute another incremented number appears in my data. Now in Buckets I would like to visualize the highest 20 values of that set of numbers, but in ascending order. That… --- ## [ElasticSearch - Filter Buckets](https://discuss.elastic.co/t/elasticsearch-filter-buckets/259758)
**Author:** [@FuSsA](https://discuss.elastic.co/u/FuSsA)\ **Replies:** 1\ **Last updated:** [December 29, 2020, 3:47pm UTC](https://discuss.elastic.co/t/elasticsearch-filter-buckets/259758 "2020-12-29T15:47:29Z")
Hey ES community, My elasticSearch query is like: { "size": 0, "aggs": { "group\_by\_id": { "terms": { "field": "Infos.InstanceInfo.ID.keyword", "size": 1000 … --- ## [Kibana 7.10 plugin development: Is bundling the new kibana plugin mandatory?](https://discuss.elastic.co/t/kibana-7-10-plugin-development-is-bundling-the-new-kibana-plugin-mandatory/259765)
**Author:** [@Prathibha\_Y](https://discuss.elastic.co/u/Prathibha_Y)\ **Replies:** 1\ **Last updated:** [December 29, 2020, 3:43pm UTC](https://discuss.elastic.co/t/kibana-7-10-plugin-development-is-bundling-the-new-kibana-plugin-mandatory/259765 "2020-12-29T15:43:24Z")
Hi, I am trying to use the custom kibana plugin which was working fine for 7.8 and 7.0 for 7.10, but it just does not work, so wanted know is it mandatory to bundle the plugin? and migrating to new-platform plugin is ve… --- ## [Apm-server monitoring through metricbeat](https://discuss.elastic.co/t/apm-server-monitoring-through-metricbeat/259808)
**Author:** [@Christoph\_Quadt](https://discuss.elastic.co/u/Christoph_Quadt)\ **Replies:** 1\ **Last updated:** [December 29, 2020, 3:42pm UTC](https://discuss.elastic.co/t/apm-server-monitoring-through-metricbeat/259808 "2020-12-29T15:42:20Z")
Hi, as explained in the latest APM server documentation, it is possible to monitor the APM server through metricbeat. The only thing which needs to be done is to add this to the apm-server.yml: http.enabled: true http… [Previous page](https://discuss.elastic.co/latest.md?page=1915) [Next page](https://discuss.elastic.co/latest.md?page=1917)