# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1107 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1108 --- ## [Eland: How to access and filter nested fields in a DataFrame?](https://discuss.elastic.co/t/eland-how-to-access-and-filter-nested-fields-in-a-dataframe/292672)
**Author:** [@Paddyns](https://discuss.elastic.co/u/Paddyns)\ **Replies:** 2\ **Last updated:** [January 4, 2022, 12:10pm UTC](https://discuss.elastic.co/t/eland-how-to-access-and-filter-nested-fields-in-a-dataframe/292672 "2022-01-04T12:10:20Z")
Hi, I'm trying to use the examples from the ELAND docs e.g. this filtering example from github df\[(df.Carrier=="Kibana Airlines") & (df.AvgTicketPrice \> 900.0) & (df.Cancelled == True)\].head() But the fields I have al… --- ## [Filebeat read file from beginning always when restart](https://discuss.elastic.co/t/filebeat-read-file-from-beginning-always-when-restart/293325)
**Author:** [@sc.lai](https://discuss.elastic.co/u/sc.lai)\ **Replies:** 1\ **Last updated:** [January 4, 2022, 11:38am UTC](https://discuss.elastic.co/t/filebeat-read-file-from-beginning-always-when-restart/293325 "2022-01-04T11:38:23Z")
I have a problem with filebeat running on Linux, every time I stop the filebeat and then start it, it always read file from the beginning. The log file uploaded by windows batch every 5 minutes, steps as below: put t… --- ## [After Elasticsearch 7.10-\>7.16 Upgrade Geo Shape Queries Cause Heap Problem ( G1 Humongous Allocation )](https://discuss.elastic.co/t/after-elasticsearch-7-10-7-16-upgrade-geo-shape-queries-cause-heap-problem-g1-humongous-allocation/292912)
**Author:** [@bulent](https://discuss.elastic.co/u/bulent)\ **Replies:** 6\ **Last updated:** [January 4, 2022, 10:03am UTC](https://discuss.elastic.co/t/after-elasticsearch-7-10-7-16-upgrade-geo-shape-queries-cause-heap-problem-g1-humongous-allocation/292912 "2022-01-04T10:03:59Z")
Hi; We have upgraded our ES Cluster from 7.10.0 to 7.16.2 . After upgrade , we have noticed heap usage increased a lot because of G1 Humongous Allocations. ES heap has a lot of Humongous regions. When Heap usage reac… --- ## [Kibana auto login (with security enabled)](https://discuss.elastic.co/t/kibana-auto-login-with-security-enabled/292934)
**Author:** [@borisr84](https://discuss.elastic.co/u/borisr84)\ **Replies:** 4\ **Last updated:** [January 4, 2022, 10:57am UTC](https://discuss.elastic.co/t/kibana-auto-login-with-security-enabled/292934 "2022-01-04T10:57:16Z")
Hi, I've enabled Kibana security with x-pack security and now when I access Kibana UI I need to provide credentials. My preferred behavior is to authenticate users automatically (as my system already has a login screen… --- ## [Running an \_update\_by\_query statement dropped the field in unmatched elements?](https://discuss.elastic.co/t/running-an-update-by-query-statement-dropped-the-field-in-unmatched-elements/293333)
**Author:** [@cdav](https://discuss.elastic.co/u/cdav)\ **Replies:** 3\ **Last updated:** [January 4, 2022, 9:20am UTC](https://discuss.elastic.co/t/running-an-update-by-query-statement-dropped-the-field-in-unmatched-elements/293333 "2022-01-04T09:20:50Z")
I've run the following query: POST hits-\*/\_update\_by\_query { "script": { "source": "ctx.\_source.type = 'se';", "lang": "painless" }, "query": { "match": { "type": "qa" } } } Everything see… --- ## [Data not visibile in Kibana](https://discuss.elastic.co/t/data-not-visibile-in-kibana/293122)
**Author:** [@d6036de2b54af16665f4](https://discuss.elastic.co/u/d6036de2b54af16665f4)\ **Replies:** 9\ **Last updated:** [January 4, 2022, 9:20am UTC](https://discuss.elastic.co/t/data-not-visibile-in-kibana/293122 "2022-01-04T09:20:20Z")
Hello, I ingested data from s3 bucket into Elasticsearch through Logstash pipelines. BUT I AM NOT ABLE TO visualize DATA IN KIBANA . I am only able to see data till october monthsm and after that no data is visible th… --- ## [Calculate total time of a list of documents](https://discuss.elastic.co/t/calculate-total-time-of-a-list-of-documents/293280)
**Author:** [@javidr](https://discuss.elastic.co/u/javidr)\ **Replies:** 3\ **Last updated:** [January 4, 2022, 9:15am UTC](https://discuss.elastic.co/t/calculate-total-time-of-a-list-of-documents/293280 "2022-01-04T09:15:30Z")
Hi I have some documents with a field called "duration", in the format HH:MM:SS. I would like to calculate the sum of the duration of the documents i have filtered by a date. However, when trying to sum the data, since … --- ## [Unable to start Elasticsearch on my local Windows system](https://discuss.elastic.co/t/unable-to-start-elasticsearch-on-my-local-windows-system/293202)
**Author:** [@gauravraje](https://discuss.elastic.co/u/gauravraje)\ **Replies:** 2\ **Last updated:** [January 4, 2022, 8:54am UTC](https://discuss.elastic.co/t/unable-to-start-elasticsearch-on-my-local-windows-system/293202 "2022-01-04T08:54:43Z")
Team, I have downloaded Elasticsearch on my local system but when i am trying to open/start elastic server from bin/Elasticsearch.bat, we are facing below issue plz share possible steps to launch Elasticsearch succes… --- ## [Should I close the older PIT id once it has been replaced by a new PIT id?](https://discuss.elastic.co/t/should-i-close-the-older-pit-id-once-it-has-been-replaced-by-a-new-pit-id/293420)
**Author:** [@pranay\_jain](https://discuss.elastic.co/u/pranay_jain)\ **Replies:** 0\ **Last updated:** [January 4, 2022, 8:51am UTC](https://discuss.elastic.co/t/should-i-close-the-older-pit-id-once-it-has-been-replaced-by-a-new-pit-id/293420 "2022-01-04T08:51:24Z")
I am working on a task in which I have to search a large number of documents in Elasticsearch. I use SearchAPI with SearchAfter and PointInTime as recommended. While fetching the results, I am using the PIT ID returned b… --- ## [How to show "N/A" in a field has null value](https://discuss.elastic.co/t/how-to-show-n-a-in-a-field-has-null-value/293416)
**Author:** [@v.le](https://discuss.elastic.co/u/v.le)\ **Replies:** 1\ **Last updated:** [January 4, 2022, 8:22am UTC](https://discuss.elastic.co/t/how-to-show-n-a-in-a-field-has-null-value/293416 "2022-01-04T08:22:34Z")
Hi, I am new for Elasticsearch! I had imported my data content to Elasticsearch but I cant work out how to show the N/A value of the sales field. Here's the data : country group brand PT date sales Japan… --- ## [Hexadecimal to Decimal](https://discuss.elastic.co/t/hexadecimal-to-decimal/293361)
**Author:** [@dayajamal](https://discuss.elastic.co/u/dayajamal)\ **Replies:** 2\ **Last updated:** [January 4, 2022, 8:16am UTC](https://discuss.elastic.co/t/hexadecimal-to-decimal/293361 "2022-01-04T08:16:42Z")
Hi, I am trying to convert a field in my log from hexadecimal to decimal. I tried with the following log: 2021-07-26T16:49:02.189807+0200 | DEBUG | 910EAB70 | flyscan/core/server.1 | ScanActorTask::handle\_message Usin… --- ## [How to run multiple views of the same log set on same VM](https://discuss.elastic.co/t/how-to-run-multiple-views-of-the-same-log-set-on-same-vm/293417)
**Author:** [@smarajit\_mishra](https://discuss.elastic.co/u/smarajit_mishra)\ **Replies:** 0\ **Last updated:** [January 4, 2022, 8:16am UTC](https://discuss.elastic.co/t/how-to-run-multiple-views-of-the-same-log-set-on-same-vm/293417 "2022-01-04T08:16:41Z")
The requirement here is to create 2 views. 1 with the comprehensive view of all debug logs in like one week or so. And second view to have a job wise view. Where you can filter out logs and errors. The logs in themselv… --- ## [Swagger-4-es (Swagger UI for Key Elasticsearch Endpoints)](https://discuss.elastic.co/t/swagger-4-es-swagger-ui-for-key-elasticsearch-endpoints/293012)
**Author:** [@Johnnycc1](https://discuss.elastic.co/u/Johnnycc1)\ **Replies:** 1\ **Last updated:** [January 4, 2022, 7:42am UTC](https://discuss.elastic.co/t/swagger-4-es-swagger-ui-for-key-elasticsearch-endpoints/293012 "2022-01-04T07:42:45Z")
Hey Elasticsearch community, I have created an openapi schema for the key Elasticsearch endpoints (or at least the ones I think are key). If you don't know what that is, basically when paired with the swagger-ui library… --- ## [In Logstash Log I am receiving Elasticsearch unreachable error](https://discuss.elastic.co/t/in-logstash-log-i-am-receiving-elasticsearch-unreachable-error/293199)
**Author:** [@d6036de2b54af16665f4](https://discuss.elastic.co/u/d6036de2b54af16665f4)\ **Replies:** 11\ **Last updated:** [January 4, 2022, 7:42am UTC](https://discuss.elastic.co/t/in-logstash-log-i-am-receiving-elasticsearch-unreachable-error/293199 "2022-01-04T07:42:15Z")
I am not able to view data in kibana and grafana as well . And also i am getting {:message=\>"Elasticsearch Unreachable: error in logstash log --- ## [Composite aggregation behavior when missing a key, not value](https://discuss.elastic.co/t/composite-aggregation-behavior-when-missing-a-key-not-value/293407)
**Author:** [@lstoneir](https://discuss.elastic.co/u/lstoneir)\ **Replies:** 0\ **Last updated:** [January 4, 2022, 6:17am UTC](https://discuss.elastic.co/t/composite-aggregation-behavior-when-missing-a-key-not-value/293407 "2022-01-04T06:17:01Z")
Hi every body! I'm using composite aggregation to multi terms on my data. some where in docs elastic says: By default documents without a value for a given source are ignored. It is possible to include them in the res… --- ## [How to stop auto index creation](https://discuss.elastic.co/t/how-to-stop-auto-index-creation/293275)
**Author:** [@ken\_kentan](https://discuss.elastic.co/u/ken_kentan)\ **Replies:** 1\ **Last updated:** [January 4, 2022, 5:55am UTC](https://discuss.elastic.co/t/how-to-stop-auto-index-creation/293275 "2022-01-04T05:55:47Z")
I'm using Elasticsearch(7.16.0) with Metricbeat and Filebeat. It will create unused indexes automtically. e.g. dekitateserver-filebeat-7.11.1-\*. Curentlly, Filebeat is using only dekitateserver-filebeat-2021-\*. How to… --- ## [\[16:00:31.383\] \[error\]\[data\]\[elasticsearch\] \[TimeoutError\]: Request timed out](https://discuss.elastic.co/t/1631-383-error-data-elasticsearch-timeouterror-request-timed-out/293277)
**Author:** [@adkyushu](https://discuss.elastic.co/u/adkyushu)\ **Replies:** 1\ **Last updated:** [January 4, 2022, 5:55am UTC](https://discuss.elastic.co/t/1631-383-error-data-elasticsearch-timeouterror-request-timed-out/293277 "2022-01-04T05:55:14Z")
When I start Kibana, it prompts me log \[15:59:26.369\] \[error\]\[data\]\[elasticsearch\] \[TimeoutError\]: Request timed out log \[15:59:26.370\] \[error\]\[data\]\[elasticsearch\] \[TimeoutError\]: Request timed out log \[15:59:26.372\]… --- ## [Query about the Logstash compatibility with ELK 6.7.2](https://discuss.elastic.co/t/query-about-the-logstash-compatibility-with-elk-6-7-2/293301)
**Author:** [@Sunil\_Kumar1](https://discuss.elastic.co/u/Sunil_Kumar1)\ **Replies:** 1\ **Last updated:** [January 4, 2022, 5:54am UTC](https://discuss.elastic.co/t/query-about-the-logstash-compatibility-with-elk-6-7-2/293301 "2022-01-04T05:54:32Z")
Hello Team, We are running the Elastic cluster with 6.7.2 version and we are also using logstash 6.7.2 to ship the application logs from our kubernetes containers to Elasticsearch. Our query is, is logstash 6.8.22 is co… --- ## [Correct way to map HTTP Server logs](https://discuss.elastic.co/t/correct-way-to-map-http-server-logs/293357)
**Author:** [@Jonathan\_Rosenboim](https://discuss.elastic.co/u/Jonathan_Rosenboim)\ **Replies:** 1\ **Last updated:** [January 4, 2022, 5:52am UTC](https://discuss.elastic.co/t/correct-way-to-map-http-server-logs/293357 "2022-01-04T05:52:50Z")
Hi all! I am relatively new with Elasticsearch, and I want to store logs of all HTTP requests made to multiple services, including info like headers, body and params to Elasticsearch, and wish for all this info to be ac… --- ## [BadRequest400Exception latitude must be a number](https://discuss.elastic.co/t/badrequest400exception-latitude-must-be-a-number/293169)
**Author:** [@rayuth](https://discuss.elastic.co/u/rayuth)\ **Replies:** 3\ **Last updated:** [January 4, 2022, 5:48am UTC](https://discuss.elastic.co/t/badrequest400exception-latitude-must-be-a-number/293169 "2022-01-04T05:48:52Z")
Hi All, I got an error: Elasticsearch\\Common\\Exceptions\\BadRequest400Exception: {"error":{"root\_cause":\[{"type":"parse\_exception","reason":"latitude must be a number"}\],"type":"mapper\_parsing\_exception","reason":"faile… --- ## [Kibana Server Is Not Ready Yet](https://discuss.elastic.co/t/kibana-server-is-not-ready-yet/293393)
**Author:** [@Jared9922](https://discuss.elastic.co/u/Jared9922)\ **Replies:** 1\ **Last updated:** [January 4, 2022, 5:46am UTC](https://discuss.elastic.co/t/kibana-server-is-not-ready-yet/293393 "2022-01-04T05:46:11Z")
Hello, I just had a quick question on Kibana and Elasticsearch. I am getting what seems to be a pretty common error. "Kibana server is not ready yet". This happened after I followed this tutorial https://www.elastic.co/… --- ## [Docker - Upgrade elasticsearch from 7.15.2 to 7.16.2](https://discuss.elastic.co/t/docker-upgrade-elasticsearch-from-7-15-2-to-7-16-2/293360)
**Author:** [@aza-zil](https://discuss.elastic.co/u/aza-zil)\ **Replies:** 1\ **Last updated:** [January 4, 2022, 5:37am UTC](https://discuss.elastic.co/t/docker-upgrade-elasticsearch-from-7-15-2-to-7-16-2/293360 "2022-01-04T05:37:17Z")
Hey, I have ES 7.15.2 running in docker, and I want to upgrade it to 7.16.2. How can I do that? The only solution I can see is this Rolling upgrades but I believe it does not work in Docker. --- ## [AWS Beanstalk and Elastic Cloud Filebeat](https://discuss.elastic.co/t/aws-beanstalk-and-elastic-cloud-filebeat/293385)
**Author:** [@tsoeiro](https://discuss.elastic.co/u/tsoeiro)\ **Replies:** 0\ **Last updated:** [January 3, 2022, 9:00pm UTC](https://discuss.elastic.co/t/aws-beanstalk-and-elastic-cloud-filebeat/293385 "2022-01-03T21:00:13Z")
I have a docker container running on AWS Beanstalk. Is it possible to ingest my docker container logs into Elasticsearch (Cloud service) using Filebeats? Could not find a proper Elastic Integration ingest option for Be… --- ## [Age of index incorrect for ILM](https://discuss.elastic.co/t/age-of-index-incorrect-for-ilm/293387)
**Author:** [@seanziee](https://discuss.elastic.co/u/seanziee)\ **Replies:** 2\ **Last updated:** [January 4, 2022, 5:32am UTC](https://discuss.elastic.co/t/age-of-index-incorrect-for-ilm/293387 "2022-01-04T05:32:49Z")
I'm trying out an ILM policy and I'm getting strange results. First, it seems like the indices are reporting the incorrect age. Today is Jan 3, and the index created on Jan 1 has an age of 5.29h. I just now sent off this… --- ## [How to calculate EXCEPT SET from one to another?](https://discuss.elastic.co/t/how-to-calculate-except-set-from-one-to-another/293244)
**Author:** [@hiteny](https://discuss.elastic.co/u/hiteny)\ **Replies:** 2\ **Last updated:** [December 31, 2021, 11:05am UTC](https://discuss.elastic.co/t/how-to-calculate-except-set-from-one-to-another/293244 "2021-12-31T11:05:31Z")
I want to get the keys which only appears in bucket2\>metric2 Here is the code : POST testa/\_search?size=0 { "size": 0, "query": { "term": { "create\_date": { "value": "2021-12-25" } } … --- ## [Generating A Certificate From The CA I Made Through Elasticsearch](https://discuss.elastic.co/t/generating-a-certificate-from-the-ca-i-made-through-elasticsearch/293236)
**Author:** [@Jared9922](https://discuss.elastic.co/u/Jared9922)\ **Replies:** 3\ **Last updated:** [January 4, 2022, 2:53am UTC](https://discuss.elastic.co/t/generating-a-certificate-from-the-ca-i-made-through-elasticsearch/293236 "2022-01-04T02:53:10Z")
Hello, I am about done setting up security going through this tutorial: I am getting stuck here: Send the kibana-server.csr certificate signing request to your internal CA or trusted CA for signing to obtain a signed… --- ## [Exiting: error loading template: failed to load template: couldn't load template: 400 Bad Request:](https://discuss.elastic.co/t/exiting-error-loading-template-failed-to-load-template-couldnt-load-template-400-bad-request/292423)
**Author:** [@mshah](https://discuss.elastic.co/u/mshah)\ **Replies:** 3\ **Last updated:** [January 4, 2022, 12:34am UTC](https://discuss.elastic.co/t/exiting-error-loading-template-failed-to-load-template-couldnt-load-template-400-bad-request/292423 "2022-01-04T00:34:10Z")
Hi All, I am new to Elastic stack and trying out a PoC to get approval but i am unable to get winlogBeat or File beat working. Tried multiple time and looked around online but not sure where i am missing. I get below e… --- ## [Add grok patterns on unformatted message in Kibana visualization](https://discuss.elastic.co/t/add-grok-patterns-on-unformatted-message-in-kibana-visualization/293379)
**Author:** [@vee](https://discuss.elastic.co/u/vee)\ **Replies:** 1\ **Last updated:** [January 3, 2022, 10:11pm UTC](https://discuss.elastic.co/t/add-grok-patterns-on-unformatted-message-in-kibana-visualization/293379 "2022-01-03T22:11:20Z")
Hi there, am trying to create a "metric visualization" to show the count of the "number of instances matching a text pattern", but do not see that field within the list of eligible fields when trying to use. From the ma… --- ## [Can we rename any index?](https://discuss.elastic.co/t/can-we-rename-any-index/293377)
**Author:** [@yash\_196](https://discuss.elastic.co/u/yash_196)\ **Replies:** 3\ **Last updated:** [January 3, 2022, 6:11pm UTC](https://discuss.elastic.co/t/can-we-rename-any-index/293377 "2022-01-03T18:11:46Z")
Is there any way to rename an index without the need of copying data to another index ? --- ## [Alert when a service stops on linux](https://discuss.elastic.co/t/alert-when-a-service-stops-on-linux/293003)
**Author:** [@derek.olds](https://discuss.elastic.co/u/derek.olds)\ **Replies:** 3\ **Last updated:** [January 3, 2022, 5:39pm UTC](https://discuss.elastic.co/t/alert-when-a-service-stops-on-linux/293003 "2022-01-03T17:39:33Z")
I can get a list of processes running on a host, but I don't get a signal when the process stops. Do I need to set something up to track number of records over a given time? Is there an easier way? [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1106) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1108)