# Latest **URL:** https://discuss.elastic.co/latest.md?page=1665 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1666 --- ## [Can't got actual data size and documents](https://discuss.elastic.co/t/cant-got-actual-data-size-and-documents/273714)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 5\ **Last updated:** [May 22, 2021, 3:02pm UTC](https://discuss.elastic.co/t/cant-got-actual-data-size-and-documents/273714 "2021-05-22T15:02:33Z")
I was reindexing one index but while using the reindex api the size of the previous index and new index is not same. source index GET /\_cat/indices/log-test1?v&pretty health status index uuid pri… --- ## [Programmer Needed](https://discuss.elastic.co/t/programmer-needed/273726)
**Author:** [@mikescarb](https://discuss.elastic.co/u/mikescarb)\ **Replies:** 0\ **Last updated:** [May 22, 2021, 2:48pm UTC](https://discuss.elastic.co/t/programmer-needed/273726 "2021-05-22T14:48:37Z")
We have implemented Swiftype search which is working well. I would like to have a custom page to display the results on our ecommerce site. Know anyone that can do this work? Thanks Mike --- ## [Logstash input/ouput elasticsearch plugin capped performances](https://discuss.elastic.co/t/logstash-input-ouput-elasticsearch-plugin-capped-performances/273686)
**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\ **Replies:** 5\ **Last updated:** [May 22, 2021, 11:55am UTC](https://discuss.elastic.co/t/logstash-input-ouput-elasticsearch-plugin-capped-performances/273686 "2021-05-22T11:55:22Z")
Hey There, inside a Logstash pipeline I was using both input and output elasticsearch plugin. Taking a look to Stack monitoring I saw that Event Received Rate (/s) and Event Emitted Rate (/s) are capped to 4000 events/… --- ## [Gradually introducing a portion of traffic to a new logstash configuration](https://discuss.elastic.co/t/gradually-introducing-a-portion-of-traffic-to-a-new-logstash-configuration/273603)
**Author:** [@cknz](https://discuss.elastic.co/u/cknz)\ **Replies:** 2\ **Last updated:** [May 22, 2021, 10:35am UTC](https://discuss.elastic.co/t/gradually-introducing-a-portion-of-traffic-to-a-new-logstash-configuration/273603 "2021-05-22T10:35:04Z")
Hi all, my colleague and I have been working on using the memcached filter plugin. We've got memcached fed with a inventory data about our various network equipment. The goal: I want to label all syslog traffic from our… --- ## [XMLHttpRequest error for flutter web requests (chrome)?](https://discuss.elastic.co/t/xmlhttprequest-error-for-flutter-web-requests-chrome/273715)
**Author:** [@sabetai](https://discuss.elastic.co/u/sabetai)\ **Replies:** 0\ **Last updated:** [May 22, 2021, 5:09am UTC](https://discuss.elastic.co/t/xmlhttprequest-error-for-flutter-web-requests-chrome/273715 "2021-05-22T05:09:07Z")
http requests to elasticsearch work when I debug my app for android/ios, but not for web (through chrome). Are there headers or server-side permissions I'm missing to make http requests through a browser? --- ## [LogStash conf file help](https://discuss.elastic.co/t/logstash-conf-file-help/273705)
**Author:** [@jasieltego](https://discuss.elastic.co/u/jasieltego)\ **Replies:** 6\ **Last updated:** [May 22, 2021, 1:19am UTC](https://discuss.elastic.co/t/logstash-conf-file-help/273705 "2021-05-22T01:19:43Z")
Hi, I have created a logstash conf file. It's just bare bones, trying to get the service up and running so I can practice on my PC. This is what's in the file. \`input { \`stdin {} \`} \`output{ \`elasticsearch { hosts… --- ## [ERROR instance/beat.go:971 Exiting: error initializing processors: unexpected expand\_keys option in processors.1.decode\_json\_fields](https://discuss.elastic.co/t/error-instance-beat-go-971-exiting-error-initializing-processors-unexpected-expand-keys-option-in-processors-1-decode-json-fields/271986)
**Author:** [@NiamhAsura](https://discuss.elastic.co/u/NiamhAsura)\ **Replies:** 4\ **Last updated:** [May 22, 2021, 12:35am UTC](https://discuss.elastic.co/t/error-instance-beat-go-971-exiting-error-initializing-processors-unexpected-expand-keys-option-in-processors-1-decode-json-fields/271986 "2021-05-22T00:35:57Z")
Hi, I am trying to use the expand\_keys option as specified in the configuration for decode\_json\_fields. I am getting the following error: ERROR instance/beat.go:971 Exiting: error initializing processors: unexpec… --- ## [Unable to escape special character ""](https://discuss.elastic.co/t/unable-to-escape-special-character/273474)
**Author:** [@ravi-shanker](https://discuss.elastic.co/u/ravi-shanker)\ **Replies:** 9\ **Last updated:** [May 22, 2021, 12:03am UTC](https://discuss.elastic.co/t/unable-to-escape-special-character/273474 "2021-05-22T00:03:32Z")
I am trying to index my data into elasticsearch cluster through logstash. Currently my data is in aws postgres and i have to move data from postgres to elasticsearch. Below is my logstash config file: input { jdbc { … --- ## [Indexing after merging data from 2 tables from 2 different postgres db](https://discuss.elastic.co/t/indexing-after-merging-data-from-2-tables-from-2-different-postgres-db/273658)
**Author:** [@ravi-shanker](https://discuss.elastic.co/u/ravi-shanker)\ **Replies:** 0\ **Last updated:** [May 21, 2021, 11:48am UTC](https://discuss.elastic.co/t/indexing-after-merging-data-from-2-tables-from-2-different-postgres-db/273658 "2021-05-21T11:48:12Z")
Dear ELK User's Could you please guide me on how to approach the below requirement. -- There are two tables in two different postgres db say db1 (table1) and db2 (table2). -- There is one column in table1 which has 14… --- ## [Heatmap is hiding empty rows](https://discuss.elastic.co/t/heatmap-is-hiding-empty-rows/272938)
**Author:** [@gelfert](https://discuss.elastic.co/u/gelfert)\ **Replies:** 4\ **Last updated:** [May 21, 2021, 10:59pm UTC](https://discuss.elastic.co/t/heatmap-is-hiding-empty-rows/272938 "2021-05-21T22:59:48Z")
I am trying to create a heatmap on a numeric field over some time period, using the aggregation based tool. After selecting "Value: count", I create the y-axis histogram. I select "show empty buckets" and I get a bunch … --- ## [Logstash and filebeat](https://discuss.elastic.co/t/logstash-and-filebeat/273614)
**Author:** [@Francisco\_Ramirez](https://discuss.elastic.co/u/Francisco_Ramirez)\ **Replies:** 1\ **Last updated:** [May 21, 2021, 10:52pm UTC](https://discuss.elastic.co/t/logstash-and-filebeat/273614 "2021-05-21T22:52:50Z")
Hi Folks I configured elasticsearch and kibana for visualizate event from wazuh, now i want see this event into the module siem. best regards --- ## [Updated field using mapping API does not show in index pattern](https://discuss.elastic.co/t/updated-field-using-mapping-api-does-not-show-in-index-pattern/273708)
**Author:** [@Terry\_Tuna](https://discuss.elastic.co/u/Terry_Tuna)\ **Replies:** 0\ **Last updated:** [May 21, 2021, 10:35pm UTC](https://discuss.elastic.co/t/updated-field-using-mapping-api-does-not-show-in-index-pattern/273708 "2021-05-21T22:35:56Z")
Hi, I'm using the mapping API to add a field onto my functionbeat index, named message\_visual, which is shown when I made a GET request of the mapping. But the index doesn't show up when I try to look for it on my i… --- ## [Parse logs](https://discuss.elastic.co/t/parse-logs/273706)
**Author:** [@sergio\_junior](https://discuss.elastic.co/u/sergio_junior)\ **Replies:** 1\ **Last updated:** [May 21, 2021, 10:06pm UTC](https://discuss.elastic.co/t/parse-logs/273706 "2021-05-21T22:06:12Z")
hello guys, i need help. I am trying to separate these values ​​from within the message {"message": "File accessed: \\" / Photos / Readme.md \\ "", "@ version": "1", "tags": \["beats\_input\_codec\_plain\_applied", "\_ jsonpar… --- ## [CSV Input - Some fields are multiline - LR vs CRLF](https://discuss.elastic.co/t/csv-input-some-fields-are-multiline-lr-vs-crlf/273691)
**Author:** [@uklipse](https://discuss.elastic.co/u/uklipse)\ **Replies:** 0\ **Last updated:** [May 21, 2021, 7:28pm UTC](https://discuss.elastic.co/t/csv-input-some-fields-are-multiline-lr-vs-crlf/273691 "2021-05-21T19:28:29Z")
I am trying input a csv file that certain fields can be multiline. When I paste the sample data into Notepad++ and display end of line characters, I can see the actual csv line separates using CRLF but the new lines with… --- ## [Translation EUI in kibana plugin](https://discuss.elastic.co/t/translation-eui-in-kibana-plugin/273682)
**Author:** [@kirienko.m](https://discuss.elastic.co/u/kirienko.m)\ **Replies:** 3\ **Last updated:** [May 21, 2021, 7:26pm UTC](https://discuss.elastic.co/t/translation-eui-in-kibana-plugin/273682 "2021-05-21T19:26:23Z")
Hello! I am created plugin with translations ru-RU. I want to translate the core.euiSuperUpdateButton.refreshButtonLabel, but i translate only in kibana Discover and not in my plugin. The EuiSuperDatePicker translating o… --- ## [Problem with elastic in grafana](https://discuss.elastic.co/t/problem-with-elastic-in-grafana/273578)
**Author:** [@Luis\_Garavatti](https://discuss.elastic.co/u/Luis_Garavatti)\ **Replies:** 2\ **Last updated:** [May 21, 2021, 6:36pm UTC](https://discuss.elastic.co/t/problem-with-elastic-in-grafana/273578 "2021-05-21T18:36:35Z")
Hi guys today I found a problem when adding my elasticsearch to graphana, besides it takes a while to load the reports, several times I get this error message and I need to delete my pod and recreate it, has anyone been … --- ## [Querying API On Input With Variables](https://discuss.elastic.co/t/querying-api-on-input-with-variables/273688)
**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\ **Replies:** 1\ **Last updated:** [May 21, 2021, 5:30pm UTC](https://discuss.elastic.co/t/querying-api-on-input-with-variables/273688 "2021-05-21T17:30:33Z")
I am trying to hit a HTTP API with time constraints included. The API allows you to pull results since a specified time in the format of yyyy-MM-dd'T'HH:mm:ss:SSS z. Is there an input that would allow me to specify thi… --- ## [Maximums for searchAfter (and scroll) size parameter?](https://discuss.elastic.co/t/maximums-for-searchafter-and-scroll-size-parameter/273591)
**Author:** [@elastic\_yogi](https://discuss.elastic.co/u/elastic_yogi)\ **Replies:** 3\ **Last updated:** [May 21, 2021, 5:23pm UTC](https://discuss.elastic.co/t/maximums-for-searchafter-and-scroll-size-parameter/273591 "2021-05-21T17:23:24Z")
Hi, I'm curious about ES 7.12 searchAfter and scroll. Both of these have a size parameter. What's the recommended limit to this parameter? I see none given, so I take it's a function of memory and cluster capacity someho… --- ## [Csv header skip\_header =\> "true" not working](https://discuss.elastic.co/t/csv-header-skip-header-true-not-working/273100)
**Author:** [@Bugsbee](https://discuss.elastic.co/u/Bugsbee)\ **Replies:** 2\ **Last updated:** [May 21, 2021, 4:50pm UTC](https://discuss.elastic.co/t/csv-header-skip-header-true-not-working/273100 "2021-05-21T16:50:31Z")
hello all, Im trying to use skip\_header =\> "true", this is because in kibana/discover the header is also coming out as a value. so i tried to add this parameter and it does not seem to working. In my case, this header… --- ## [Updating index gives number of documents in the index cannot exceed 2147483519](https://discuss.elastic.co/t/updating-index-gives-number-of-documents-in-the-index-cannot-exceed-2147483519/273547)
**Author:** [@NLSVTN](https://discuss.elastic.co/u/NLSVTN)\ **Replies:** 7\ **Last updated:** [May 21, 2021, 4:31pm UTC](https://discuss.elastic.co/t/updating-index-gives-number-of-documents-in-the-index-cannot-exceed-2147483519/273547 "2021-05-21T16:31:28Z")
We are trying to write 42522080 documents into Elasticsearch in python using Hail: mt = hl.import\_vcf(dataset\_path, reference\_genome='GRCh' + genome\_version, force\_bgz=True, min\_partitions=500) mt = hl.split\_mul… --- ## [Logstash keystore error after upgrade](https://discuss.elastic.co/t/logstash-keystore-error-after-upgrade/273683)
**Author:** [@gutierrezfj](https://discuss.elastic.co/u/gutierrezfj)\ **Replies:** 0\ **Last updated:** [May 21, 2021, 3:38pm UTC](https://discuss.elastic.co/t/logstash-keystore-error-after-upgrade/273683 "2021-05-21T15:38:47Z")
Hi, I did a deployment and upgrade, from logstash 7.6.2 deployed binary to logstash 7.10.2 dockerized. I used the same logstash.keystore file (copy and paste .keystore from 7.6.2 to /usr/share/logstash/config inside co… --- ## [Using colour values from within the Document itself](https://discuss.elastic.co/t/using-colour-values-from-within-the-document-itself/273094)
**Author:** [@stexxen](https://discuss.elastic.co/u/stexxen)\ **Replies:** 5\ **Last updated:** [May 21, 2021, 2:47pm UTC](https://discuss.elastic.co/t/using-colour-values-from-within-the-document-itself/273094 "2021-05-21T14:47:50Z")
Hi, I have an index containing multipolygons, it renders very well using Kibana maps. However I would like to colour them. Using the colour-by-value works but only for the first x (based on the color bar chosen. (10 or … --- ## [Help needed i m having the issue failed to perform any bulk index operations: 500 Internal Server Error](https://discuss.elastic.co/t/help-needed-i-m-having-the-issue-failed-to-perform-any-bulk-index-operations-500-internal-server-error/273308)
**Author:** [@khanio99](https://discuss.elastic.co/u/khanio99)\ **Replies:** 5\ **Last updated:** [May 21, 2021, 3:33pm UTC](https://discuss.elastic.co/t/help-needed-i-m-having-the-issue-failed-to-perform-any-bulk-index-operations-500-internal-server-error/273308 "2021-05-21T15:33:58Z")
May 18 10:50:36 debian filebeat\[5663\]: 2021-05-18T10:50:36.145-0400 INFO \[license\] licenser/es\_callback.go:51 Elasticsearch license: Basic May 18 10:50:36 debian filebeat\[5663\]: 2021-05-18T10:… --- ## [Monitoring Snowflake with Elastic (EFK on self managed AWS setup)](https://discuss.elastic.co/t/monitoring-snowflake-with-elastic-efk-on-self-managed-aws-setup/273558)
**Author:** [@maheshe](https://discuss.elastic.co/u/maheshe)\ **Replies:** 1\ **Last updated:** [May 21, 2021, 3:25pm UTC](https://discuss.elastic.co/t/monitoring-snowflake-with-elastic-efk-on-self-managed-aws-setup/273558 "2021-05-21T15:25:15Z")
We have a requirement to monitor Snowflake with Elastic stack. We are using a 7.9 self managed EFK stack on EKS-Kubernetes. Any suggestions and guidance to integrate with snowflake will be helpful. Thanks --- ## [Deployement not getting completed error message 0 of 1 pod is not available,](https://discuss.elastic.co/t/deployement-not-getting-completed-error-message-0-of-1-pod-is-not-available/272794)
**Author:** [@Snehil03](https://discuss.elastic.co/u/Snehil03)\ **Replies:** 4\ **Last updated:** [May 21, 2021, 3:16pm UTC](https://discuss.elastic.co/t/deployement-not-getting-completed-error-message-0-of-1-pod-is-not-available/272794 "2021-05-21T15:16:56Z")
Hello, I am trying to fix the kibana setup but seems to be it's not working , I have updated the module from 7.6.0 to 7.7.0 but after the update pods does not get started. I am using terraform to do these setup . Kind… --- ## [Same input (beats) in multiples config files](https://discuss.elastic.co/t/same-input-beats-in-multiples-config-files/273675)
**Author:** [@mar-ro](https://discuss.elastic.co/u/mar-ro)\ **Replies:** 0\ **Last updated:** [May 21, 2021, 2:48pm UTC](https://discuss.elastic.co/t/same-input-beats-in-multiples-config-files/273675 "2021-05-21T14:48:06Z")
Good afternoon, I understand that in logstash you cannot have more than one file in /etc/logstash/config.d with the same input (filebeat) ...in this case, if you want to have different files that will receive data from f… --- ## [From text da date ingestion pipeline](https://discuss.elastic.co/t/from-text-da-date-ingestion-pipeline/273263)
**Author:** [@accateo](https://discuss.elastic.co/u/accateo)\ **Replies:** 3\ **Last updated:** [May 21, 2021, 2:18pm UTC](https://discuss.elastic.co/t/from-text-da-date-ingestion-pipeline/273263 "2021-05-21T14:18:28Z")
Hi, it's possible to convert a text field in date field, with an ingestion pipeline? Thanks --- ## [Is it possible to upgrade log4j from 2.11.1 to latest non-vul-ner-able version?](https://discuss.elastic.co/t/is-it-possible-to-upgrade-log4j-from-2-11-1-to-latest-non-vul-ner-able-version/273602)
**Author:** [@Elango\_P](https://discuss.elastic.co/u/Elango_P)\ **Replies:** 2\ **Last updated:** [May 21, 2021, 1:03pm UTC](https://discuss.elastic.co/t/is-it-possible-to-upgrade-log4j-from-2-11-1-to-latest-non-vul-ner-able-version/273602 "2021-05-21T13:03:12Z")
Found that ES internally using log4j 2.11.1 which is hitting this NVD - CVE-2020-9488. As we are more concerned about security issues, is there any plan to upgrade this in ES v6.8.x or latest versions of ES ? Or manuall… --- ## [GROK URIPATHPARAM SPLIT](https://discuss.elastic.co/t/grok-uripathparam-split/273662)
**Author:** [@Rahul\_Aggarwal](https://discuss.elastic.co/u/Rahul_Aggarwal)\ **Replies:** 0\ **Last updated:** [May 21, 2021, 12:00pm UTC](https://discuss.elastic.co/t/grok-uripathparam-split/273662 "2021-05-21T12:00:57Z")
I've been searching and reading the documentation but I can't seem to find further split my URIPATH into multiple parts. How this will achieve? My Sample URIPATH's are below: /article/india/13-naxals-were-neutralized-… --- ## [Grok - Value could appear or not. multiple rules?](https://discuss.elastic.co/t/grok-value-could-appear-or-not-multiple-rules/273548)
**Author:** [@legolas\_bilbao](https://discuss.elastic.co/u/legolas_bilbao)\ **Replies:** 2\ **Last updated:** [May 21, 2021, 12:45pm UTC](https://discuss.elastic.co/t/grok-value-could-appear-or-not-multiple-rules/273548 "2021-05-21T12:45:16Z")
I'm working with some logs from squid but one value could appear or not 1621232309.575 1 172.99.6.74 TCP\_MEM\_HIT/206 3096 GET http://storage.googleapis.com/ - HIER\_NONE/- application/octet-stream 1621232309.575 … [Previous page](https://discuss.elastic.co/latest.md?page=1664) [Next page](https://discuss.elastic.co/latest.md?page=1666)