# Top

**URL:** https://discuss.elastic.co/top.md?page=737&period=all

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 738

---

## [Trying to work out the expected JSON format for Varnish logging](https://discuss.elastic.co/t/trying-to-work-out-the-expected-json-format-for-varnish-logging/76185)

<div class="topic-metadata">

**Author:** [@Cylindric](https://discuss.elastic.co/u/Cylindric)\
**Replies:** 4\
**Last updated:** [March 1, 2017, 9:27am UTC](https://discuss.elastic.co/t/trying-to-work-out-the-expected-json-format-for-varnish-logging/76185 "2017-03-01T09:27:06Z")

</div>

I am trying to log data from Varnish, which can be coerced into producing a JSON log file. When I import this using Filebeat, I'm getting a json\_error of Error decoding JSON: invalid character '}' looking for beginn…

---

## [Reading multiline data from third line](https://discuss.elastic.co/t/reading-multiline-data-from-third-line/2510)

<div class="topic-metadata">

**Author:** [@falafel](https://discuss.elastic.co/u/falafel)\
**Replies:** 4\
**Last updated:** [June 15, 2015, 2:13pm UTC](https://discuss.elastic.co/t/reading-multiline-data-from-third-line/2510 "2015-06-15T14:13:55Z")

</div>

I have a log file which contains lines which begin with a timestamp. Optional lines (an uncertain number of them) might follow each such timestamped line: SOMETIMESTAMP some data optional more data 1 2 optional other …

---

## [Marvel + Nginx](https://discuss.elastic.co/t/marvel-nginx/29920)

<div class="topic-metadata">

**Author:** [@tom\_jonge](https://discuss.elastic.co/u/tom_jonge)\
**Replies:** 3\
**Last updated:** [May 3, 2016, 4:45pm UTC](https://discuss.elastic.co/t/marvel-nginx/29920 "2016-05-03T16:45:41Z")

</div>

Hello again, Trying to get Marvel's dashboard working behind Nginx. Everything works if I bypass Nginx by going to http://myserver:9200/\_plugin/marvel/. Going through Nginx by going to http://my-server/marvel/ gives me …

---

## [Timestamp in ElasticSearch and Kibana](https://discuss.elastic.co/t/timestamp-in-elasticsearch-and-kibana/232233)

<div class="topic-metadata">

**Author:** [@Mateusz\_Koper](https://discuss.elastic.co/u/Mateusz_Koper)\
**Replies:** 7\
**Last updated:** [May 15, 2020, 7:15am UTC](https://discuss.elastic.co/t/timestamp-in-elasticsearch-and-kibana/232233 "2020-05-15T07:15:04Z")

</div>

Hello. We have an issue within our organization, with the timestamp in Kibana. Our Orchestrator is connected to ElasticSearch and the whole view of our Robot’s run we have in Kibana. The problem is that log messages f…

---

## [POST https://apm.\<acme\>.com/intake/v2/rum/events net::ERR\_BLOCKED\_BY\_CLIENT](https://discuss.elastic.co/t/post-https-apm-acme-com-intake-v2-rum-events-net-err-blocked-by-client/280820)

<div class="topic-metadata">

**Author:** [@Kay\_Khan](https://discuss.elastic.co/u/Kay_Khan)\
**Replies:** 6\
**Last updated:** [September 14, 2021, 11:26pm UTC](https://discuss.elastic.co/t/post-https-apm-acme-com-intake-v2-rum-events-net-err-blocked-by-client/280820 "2021-09-14T23:26:40Z")

</div>

I have an elastic stack on kubernetes (k8s) using ECK. Kibana version: 7.13.2 Elasticsearch version: 7.13.2 APM Server version: 7.13.2 APM Agent language and version: @elastic/apm-rum - npm - 5.9.1 Browser versi…

---

## [Metricbeat output not in elasticsearch](https://discuss.elastic.co/t/metricbeat-output-not-in-elasticsearch/207678)

<div class="topic-metadata">

**Author:** [@Lieven](https://discuss.elastic.co/u/Lieven)\
**Replies:** 6\
**Last updated:** [November 18, 2019, 10:30am UTC](https://discuss.elastic.co/t/metricbeat-output-not-in-elasticsearch/207678 "2019-11-18T10:30:07Z")

</div>

Hi, I'm trying to setup a metricbeat on a MacBook for test purposes. My ELK Stack is running in docker dontainers (docker-elk) which I updated to 7.4.2. I setup the metricbeat in Kibana, setup the dashboards and the me…

---

## [Recommended disk configuration for reasonable shard reallocation time](https://discuss.elastic.co/t/recommended-disk-configuration-for-reasonable-shard-reallocation-time/71741)

<div class="topic-metadata">

**Author:** [@YuWatanabe](https://discuss.elastic.co/u/YuWatanabe)\
**Replies:** 6\
**Last updated:** [January 20, 2017, 7:40am UTC](https://discuss.elastic.co/t/recommended-disk-configuration-for-reasonable-shard-reallocation-time/71741 "2017-01-20T07:40:54Z")

</div>

I am estimating hardware configuration for customer environment but hesitating how should I configure the disk. My reqirements are 2500 evt/sec (Maximum) 58 TB of logs ( holding for 1year ) 5 shards, 1 replica for e…

---

## [Error fetching fields for index pattern](https://discuss.elastic.co/t/error-fetching-fields-for-index-pattern/273193)

<div class="topic-metadata">

**Author:** [@tabo](https://discuss.elastic.co/u/tabo)\
**Replies:** 8\
**Last updated:** [May 19, 2021, 6:34am UTC](https://discuss.elastic.co/t/error-fetching-fields-for-index-pattern/273193 "2021-05-19T06:34:04Z")

</div>

I've just upgraded a k8s self managed installation of es with Kibana. When it was not secured, I created some indexes and dashboards. When I added xpack, In elasticasearch.yaml file: (xpack.security.enabled: true xp…

---

## [Custom Kibana Canvas Elements](https://discuss.elastic.co/t/custom-kibana-canvas-elements/202632)

<div class="topic-metadata">

**Author:** [@sreed](https://discuss.elastic.co/u/sreed)\
**Replies:** 3\
**Last updated:** [October 14, 2019, 7:47am UTC](https://discuss.elastic.co/t/custom-kibana-canvas-elements/202632 "2019-10-14T07:47:23Z")

</div>

In the intro to canvas webinar, Rashid khan mentions a plugin interface that allows users to add their own custom Canvas Elements. But I couldn't find any documentation for the same. Any pointers to how to develop new Ca…

---

## [How to convert a list of string to a list of date in filter?](https://discuss.elastic.co/t/how-to-convert-a-list-of-string-to-a-list-of-date-in-filter/47886)

<div class="topic-metadata">

**Author:** [@Morriaty](https://discuss.elastic.co/u/Morriaty)\
**Replies:** 3\
**Last updated:** [April 20, 2016, 11:05am UTC](https://discuss.elastic.co/t/how-to-convert-a-list-of-string-to-a-list-of-date-in-filter/47886 "2016-04-20T11:05:41Z")

</div>

The input had a field named valid\_dates which is a string column from mysql(jdbc).It formatted like this "2014-09-10 00:00:00,2014-08-21 17:02:02,2014-06-19 00:00:00,2014-08-20 14:29:09" And the filter was filte…

---

## [Logstash 2.2.0 hangs at "Logstash startup completed" while attempting to ingest CSV](https://discuss.elastic.co/t/logstash-2-2-0-hangs-at-logstash-startup-completed-while-attempting-to-ingest-csv/41639)

<div class="topic-metadata">

**Author:** [@MattW224](https://discuss.elastic.co/u/MattW224)\
**Replies:** 3\
**Last updated:** [March 29, 2016, 1:31am UTC](https://discuss.elastic.co/t/logstash-2-2-0-hangs-at-logstash-startup-completed-while-attempting-to-ingest-csv/41639 "2016-03-29T01:31:31Z")

</div>

I installed the ELK stack from Elastic's repositories, and am encountering problems while attempting to ingest a 1 GB CSV file on an Amazon Linux (AWS) instance. This is my first attempt at ELK, so there's probably somet…

---

## [Java update API marshalling of DateTime](https://discuss.elastic.co/t/java-update-api-marshalling-of-datetime/7537)

<div class="topic-metadata">

**Author:** [@Per](https://discuss.elastic.co/u/Per)\
**Replies:** 3\
**Last updated:** [May 2, 2012, 8:50pm UTC](https://discuss.elastic.co/t/java-update-api-marshalling-of-datetime/7537 "2012-05-02T20:50:14Z")

</div>

If seems like the UpdateRequestBuilder won't accept DateTime (or Date) instances as script params (see stacktrace below). DateTime works fine for the index api. A workaround is to manually (toString) convert the DateT…

---

## [Reading existing files with S3 Logstash Input Plugin](https://discuss.elastic.co/t/reading-existing-files-with-s3-logstash-input-plugin/170702)

<div class="topic-metadata">

**Author:** [@febrezo](https://discuss.elastic.co/u/febrezo)\
**Replies:** 4\
**Last updated:** [March 5, 2019, 10:08am UTC](https://discuss.elastic.co/t/reading-existing-files-with-s3-logstash-input-plugin/170702 "2019-03-05T10:08:29Z")

</div>

Hi! I'm trying to reach some files we have in a S3 instance with Logstash. My .conf file looks like this: input { s3 { "access\_key\_id" =\> "my\_key" "secret\_access\_key" =\> my\_secret\_key" "bucket" =\> "my\_buc…

---

## [Painless unit testing](https://discuss.elastic.co/t/painless-unit-testing/83317)

<div class="topic-metadata">

**Author:** [@jillesvangurp](https://discuss.elastic.co/u/jillesvangurp)\
**Replies:** 4\
**Last updated:** [November 26, 2018, 8:38pm UTC](https://discuss.elastic.co/t/painless-unit-testing/83317 "2018-11-26T20:38:01Z")

</div>

I spent way more time last week than I would have liked to getting a few lines of painless script to work (not quite as painless as advertised). A lot of my pain came from having to relaunch our integration tests repeate…

---

## [Get element from xml](https://discuss.elastic.co/t/get-element-from-xml/92632)

<div class="topic-metadata">

**Author:** [@mohammed\_cherif](https://discuss.elastic.co/u/mohammed_cherif)\
**Replies:** 4\
**Last updated:** [July 12, 2017, 2:10pm UTC](https://discuss.elastic.co/t/get-element-from-xml/92632 "2017-07-12T14:10:13Z")

</div>

I have the following logstash conf file: input { jdbc { jdbc\_connection\_string =\> "jdbc:oracle:thin:@host:1521:sid" jdbc\_user =\> "admin" jdbc\_password =\> "admin" jdbc\_validate\_connection =\>…

---

## [JDBC, Putting result of SQL query into one field](https://discuss.elastic.co/t/jdbc-putting-result-of-sql-query-into-one-field/73817)

<div class="topic-metadata">

**Author:** [@Alexander1](https://discuss.elastic.co/u/Alexander1)\
**Replies:** 4\
**Last updated:** [February 4, 2017, 10:56am UTC](https://discuss.elastic.co/t/jdbc-putting-result-of-sql-query-into-one-field/73817 "2017-02-04T10:56:46Z")

</div>

Hello everyone! I have a problem with configuring the logstash 5.2. I use jdbc-input plugin, And I want to put the result of the SQL-query in to the one field called "query\_result". But I don't know how. Can you help m…

---

## [Elastic search fetch limit on each doc type](https://discuss.elastic.co/t/elastic-search-fetch-limit-on-each-doc-type/71366)

<div class="topic-metadata">

**Author:** [@sstest](https://discuss.elastic.co/u/sstest)\
**Replies:** 4\
**Last updated:** [January 13, 2017, 9:15am UTC](https://discuss.elastic.co/t/elastic-search-fetch-limit-on-each-doc-type/71366 "2017-01-13T09:15:34Z")

</div>

Hi, I am new to Elastic search and trying to retrieve documents across the document types stored in the same index. However what i really need to find is there a way to apply the fetch limit on each type instead of the …

---

## [Failed to send event to Redis. IOError](https://discuss.elastic.co/t/failed-to-send-event-to-redis-ioerror/46349)

<div class="topic-metadata">

**Author:** [@diwertowski](https://discuss.elastic.co/u/diwertowski)\
**Replies:** 4\
**Last updated:** [April 5, 2016, 9:28am UTC](https://discuss.elastic.co/t/failed-to-send-event-to-redis-ioerror/46349 "2016-04-05T09:28:51Z")

</div>

Hi, today I got an Error, that I can not fix. My Setup (everything is on one local machine, so I can easily test it): Its a windows server with 16GB, 64-Bit Logstash Version 2.2.0 Kibana Version 4.4.1 Elasticsearch Vers…

---

## [Any possibility calculate Average Duration in HH:mm:ss format](https://discuss.elastic.co/t/any-possibility-calculate-average-duration-in-hhss-format/176365)

<div class="topic-metadata">

**Author:** [@kovas6](https://discuss.elastic.co/u/kovas6)\
**Replies:** 5\
**Last updated:** [April 18, 2019, 6:15am UTC](https://discuss.elastic.co/t/any-possibility-calculate-average-duration-in-hhss-format/176365 "2019-04-18T06:15:55Z")

</div>

Hi, I have Average calculation for job execution Duration in Kibana on one number field. The problem is that number field provides view in number format like 3,43 min or in Human Readable format which is not accurate …

---

## [Show empty diagram in Visualize](https://discuss.elastic.co/t/show-empty-diagram-in-visualize/103549)

<div class="topic-metadata">

**Author:** [@phia](https://discuss.elastic.co/u/phia)\
**Replies:** 5\
**Last updated:** [October 16, 2017, 9:29am UTC](https://discuss.elastic.co/t/show-empty-diagram-in-visualize/103549 "2017-10-16T09:29:22Z")

</div>

Hi guys, I'm new in the Elasticsearch and Kibana topic. Currently I'm creating statistics for my company and I'd like to show the currently running processes of that. My problem is that our system sometimes doesn't s…

---

## [Is it possible to apply a timezone to a date in a scripted field?](https://discuss.elastic.co/t/is-it-possible-to-apply-a-timezone-to-a-date-in-a-scripted-field/65372)

<div class="topic-metadata">

**Author:** [@ols](https://discuss.elastic.co/u/ols)\
**Replies:** 1\
**Last updated:** [November 24, 2016, 10:48am UTC](https://discuss.elastic.co/t/is-it-possible-to-apply-a-timezone-to-a-date-in-a-scripted-field/65372 "2016-11-24T10:48:47Z")

</div>

In the aggregation below I need the bucketing to take account of a passed in timezone. How do I do this? Painless is java based, no? So is it possible to import some sort of timezone module and use that? aggs: { …

---

## [Sizing the ELK stack](https://discuss.elastic.co/t/sizing-the-elk-stack/102224)

<div class="topic-metadata">

**Author:** [@ericd](https://discuss.elastic.co/u/ericd)\
**Replies:** 6\
**Last updated:** [September 29, 2017, 10:31am UTC](https://discuss.elastic.co/t/sizing-the-elk-stack/102224 "2017-09-29T10:31:42Z")

</div>

Hello to everyone, I have a need to design a ELK stack and two not-heavy web applications (served by nginx). Ingress rate for logstash will be around 1000EPS (later maybe up to 2000EPS). How i can monitor this rate wi…

---

## [Elasticsearch mapper\_parsing\_exception for field appearing both in text and object form](https://discuss.elastic.co/t/elasticsearch-mapper-parsing-exception-for-field-appearing-both-in-text-and-object-form/296875)

<div class="topic-metadata">

**Author:** [@dory](https://discuss.elastic.co/u/dory)\
**Replies:** 2\
**Last updated:** [February 14, 2022, 9:53am UTC](https://discuss.elastic.co/t/elasticsearch-mapper-parsing-exception-for-field-appearing-both-in-text-and-object-form/296875 "2022-02-14T09:53:56Z")

</div>

Hello, I'm quite new to Elasticsearch and I'm trying since a few days to fix some indexing problems we have in our indices. The cause of this errors is that we have multiple applications logging data which finally ends …

---

## [Elasticsearch high CPU Utilization](https://discuss.elastic.co/t/elasticsearch-high-cpu-utilization/203881)

<div class="topic-metadata">

**Author:** [@Jayabal\_K](https://discuss.elastic.co/u/Jayabal_K)\
**Replies:** 3\
**Last updated:** [October 17, 2019, 5:31am UTC](https://discuss.elastic.co/t/elasticsearch-high-cpu-utilization/203881 "2019-10-17T05:31:50Z")

</div>

Hi, I have a elastic setup which consists of 5 datanode, 1 master and 1 client node. Each datanode consists of 1.5 vCPU, and 4GB Memory. My indexing rate is 10K logs per second. During the indexing time the CPU usage …

---

## [Vector knn search with more than 1024 dimensions](https://discuss.elastic.co/t/vector-knn-search-with-more-than-1024-dimensions/332819)

<div class="topic-metadata">

**Author:** [@sbruinsje](https://discuss.elastic.co/u/sbruinsje)\
**Replies:** 4\
**Last updated:** [May 10, 2023, 1:35pm UTC](https://discuss.elastic.co/t/vector-knn-search-with-more-than-1024-dimensions/332819 "2023-05-10T13:35:26Z")

</div>

If I understood correctly, from version 8.8 elasticsearch will support knn search for vectors over 1024 dimensions. Is there any indication when this will be released? I'm trying to work with openai embeddings (2nd gener…

---

## [Transform datetime to @timestamp](https://discuss.elastic.co/t/transform-datetime-to-timestamp/201062)

<div class="topic-metadata">

**Author:** [@fernrguez](https://discuss.elastic.co/u/fernrguez)\
**Replies:** 4\
**Last updated:** [September 25, 2019, 3:22pm UTC](https://discuss.elastic.co/t/transform-datetime-to-timestamp/201062 "2019-09-25T15:22:00Z")

</div>

I'm trying to use a datetime field (startTime) from the input xml logs and use it as @timestamp but something is not properly set as it idenfies the field as string but is not able to apply the transformation leaving the…

---

## [Kibana keeps displaying notice about area charts and null values even after I change the chart type](https://discuss.elastic.co/t/kibana-keeps-displaying-notice-about-area-charts-and-null-values-even-after-i-change-the-chart-type/107094)

<div class="topic-metadata">

**Author:** [@pshroads](https://discuss.elastic.co/u/pshroads)\
**Replies:** 4\
**Last updated:** [November 10, 2017, 7:02pm UTC](https://discuss.elastic.co/t/kibana-keeps-displaying-notice-about-area-charts-and-null-values-even-after-i-change-the-chart-type/107094 "2017-11-10T19:02:54Z")

</div>

I'm on elasticsearch and kibana 6.0.0-rc2. After creating some area graphs I get the notice Parts of or the entire area chart might not be displayed due to null values in the data. A line chart is recommended when displ…

---

## [Single forward slash in field not accessable in conditional filter](https://discuss.elastic.co/t/single-forward-slash-in-field-not-accessable-in-conditional-filter/65188)

<div class="topic-metadata">

**Author:** [@nick.e](https://discuss.elastic.co/u/nick.e)\
**Replies:** 4\
**Last updated:** [November 7, 2016, 12:58pm UTC](https://discuss.elastic.co/t/single-forward-slash-in-field-not-accessable-in-conditional-filter/65188 "2016-11-07T12:58:51Z")

</div>

Hi, I'm sending oracle auditing events with filebeat 5.0.0. The events itself are written to an xml-file by the oracle database. Sometimes, one field (DB\_User) contains a single /. It'd like to filter this slash in a …

---

## [Logstash pipeline stalling without any error](https://discuss.elastic.co/t/logstash-pipeline-stalling-without-any-error/287274)

<div class="topic-metadata">

**Author:** [@Stephy](https://discuss.elastic.co/u/Stephy)\
**Replies:** 8\
**Last updated:** [October 27, 2021, 4:27pm UTC](https://discuss.elastic.co/t/logstash-pipeline-stalling-without-any-error/287274 "2021-10-27T16:27:47Z")

</div>

Hello, We have a Logstash pipeline (using the official elastic.co Docker Image v7.9.3) running with a JDBC input plugin and Elasticsearch output. Pipeline is set to run with a schedule every 1 minute (\* \* \* \* \*). The in…

---

## [Master not discovered error](https://discuss.elastic.co/t/master-not-discovered-error/198093)

<div class="topic-metadata">

**Author:** [@esrcon](https://discuss.elastic.co/u/esrcon)\
**Replies:** 8\
**Last updated:** [September 5, 2019, 7:02pm UTC](https://discuss.elastic.co/t/master-not-discovered-error/198093 "2019-09-05T19:02:26Z")

</div>

Hello, I created a cluster contains 2 data/master nodes and 3 master-only nodes on AWS EC2. Due to the bootstrap feature, I specified two data nodes ip for luster.initial\_master\_nodes. After cluster started successful…

---

## [Download raw from table directly from link](https://discuss.elastic.co/t/download-raw-from-table-directly-from-link/50415)

<div class="topic-metadata">

**Author:** [@isaacpm](https://discuss.elastic.co/u/isaacpm)\
**Replies:** 2\
**Last updated:** [May 24, 2016, 8:35am UTC](https://discuss.elastic.co/t/download-raw-from-table-directly-from-link/50415 "2016-05-24T08:35:26Z")

</div>

Hi, is there a way to call the export raw download link from a script instead of through the GUI? I'm looking for a way where an export from a table can be easily link to download the csv file and parse it with a scrip…

---

## [Having trouble when using search strings that have a hash symbol (#) in them](https://discuss.elastic.co/t/having-trouble-when-using-search-strings-that-have-a-hash-symbol-in-them/14826)

<div class="topic-metadata">

**Author:** [@Rahul\_Malireddy](https://discuss.elastic.co/u/Rahul_Malireddy)\
**Replies:** 2\
**Last updated:** [December 12, 2013, 12:10pm UTC](https://discuss.elastic.co/t/having-trouble-when-using-search-strings-that-have-a-hash-symbol-in-them/14826 "2013-12-12T12:10:27Z")

</div>

Hi, I am trying to use elasticsearch to index my log files. Some of my environment details are given below: Version of elasticsearch that I am using: 0.90.3 Version of JVM that I am using: 1.7.0\_17 JVM (64-bit…

---

## [Geo Distance Search on Geo Shape with distance returned](https://discuss.elastic.co/t/geo-distance-search-on-geo-shape-with-distance-returned/252212)

<div class="topic-metadata">

**Author:** [@DavidBokor](https://discuss.elastic.co/u/DavidBokor)\
**Replies:** 5\
**Last updated:** [October 16, 2020, 6:21am UTC](https://discuss.elastic.co/t/geo-distance-search-on-geo-shape-with-distance-returned/252212 "2020-10-16T06:21:26Z")

</div>

Based on the discussion here it looks like searching by distance on a geo shape field is supported as of v7.7.0. I'm using 7.9 and getting an error. I have two indices, one points and one polygons. I have no problem doi…

---

## [Need help with kibana search query](https://discuss.elastic.co/t/need-help-with-kibana-search-query/26719)

<div class="topic-metadata">

**Author:** [@Or\_Cohen](https://discuss.elastic.co/u/Or_Cohen)\
**Replies:** 5\
**Last updated:** [August 5, 2015, 11:03am UTC](https://discuss.elastic.co/t/need-help-with-kibana-search-query/26719 "2015-08-05T11:03:08Z")

</div>

Hi I have data like this: {"type":"tag","id":"1234"} {"type":"hit","id":"1234"} {"type":"tag","id":"4444"} {"type":"tag","id":"3333"} {"type":"hit","id":"3333"} {"type":"tag","id":"2222"} {"type":"hit","id":"222…

---

## [Canvas Increase Result Count](https://discuss.elastic.co/t/canvas-increase-result-count/178116)

<div class="topic-metadata">

**Author:** [@glen.smith](https://discuss.elastic.co/u/glen.smith)\
**Replies:** 2\
**Last updated:** [April 30, 2019, 7:36pm UTC](https://discuss.elastic.co/t/canvas-increase-result-count/178116 "2019-04-30T19:36:36Z")

</div>

Hi Everyone, I'm new here so I'm not sure if this is the best place for this. I'm new to using the Canvas feature in Kibana. I'm using essql SELECT requests like: SELECT \* from index but I'm only returned the first 10…

---

## [Shards keep re-initializing](https://discuss.elastic.co/t/shards-keep-re-initializing/233968)

<div class="topic-metadata">

**Author:** [@reshippie](https://discuss.elastic.co/u/reshippie)\
**Replies:** 7\
**Last updated:** [May 27, 2020, 5:39pm UTC](https://discuss.elastic.co/t/shards-keep-re-initializing/233968 "2020-05-27T17:39:39Z")

</div>

I've got a 7 node cluster, each node has 64GB of RAM, 2x XEON E5-2623v4 CPUs(16 Threads) and 12TB of SSD in RAID6. It's hosting 56.63TB of data across 187 Indices and 2,346 shards. Elasticsearch v6.8.3 behind Graylog. …

---

## [Compare fields in two documents](https://discuss.elastic.co/t/compare-fields-in-two-documents/26249)

<div class="topic-metadata">

**Author:** [@karolpivo](https://discuss.elastic.co/u/karolpivo)\
**Replies:** 1\
**Last updated:** [July 27, 2015, 5:19am UTC](https://discuss.elastic.co/t/compare-fields-in-two-documents/26249 "2015-07-27T05:19:19Z")

</div>

I want to compare specific field of two documents in a single index. Based on my research the way to do this is to use scripting module. The script will evaluate if the fields are the same, something like this should do …

---

## [Metricbeat Tx and Rx Rates](https://discuss.elastic.co/t/metricbeat-tx-and-rx-rates/68731)

<div class="topic-metadata">

**Author:** [@Vivek\_Raj](https://discuss.elastic.co/u/Vivek_Raj)\
**Replies:** 6\
**Last updated:** [December 13, 2016, 6:55pm UTC](https://discuss.elastic.co/t/metricbeat-tx-and-rx-rates/68731 "2016-12-13T18:55:45Z")

</div>

Hi Guys, I'm having some issue while pulling the network stats, we want to capture TX and RX values and we able to pull the values to Elasticsearch but on kibana its showing larger values compare to value on the server…

---

## [Curator fails to shrink index](https://discuss.elastic.co/t/curator-fails-to-shrink-index/100010)

<div class="topic-metadata">

**Author:** [@massimo](https://discuss.elastic.co/u/massimo)\
**Replies:** 3\
**Last updated:** [September 12, 2017, 5:54am UTC](https://discuss.elastic.co/t/curator-fails-to-shrink-index/100010 "2017-09-12T05:54:06Z")

</div>

Hello, I wanted to test the shrink action with curator which fails with: 2017-09-11 09:04:56,314 ERROR curator.cli run:184 Failed to complete action: shrink. \<class 'curator.exceptio…

---

## [Elastic cloud with auth but without https](https://discuss.elastic.co/t/elastic-cloud-with-auth-but-without-https/198337)

<div class="topic-metadata">

**Author:** [@O\_K](https://discuss.elastic.co/u/O_K)\
**Replies:** 4\
**Last updated:** [September 7, 2019, 8:43pm UTC](https://discuss.elastic.co/t/elastic-cloud-with-auth-but-without-https/198337 "2019-09-07T20:43:24Z")

</div>

hello, I wonder the proper way to disable https but remain authentication for this example https://www.elastic.co/guide/en/cloud-on-k8s/current/k8s-quickstart.html#k8s-deploy-eck

---

## [Dynamic Template not working](https://discuss.elastic.co/t/dynamic-template-not-working/185247)

<div class="topic-metadata">

**Author:** [@jaya](https://discuss.elastic.co/u/jaya)\
**Replies:** 4\
**Last updated:** [June 13, 2019, 4:22am UTC](https://discuss.elastic.co/t/dynamic-template-not-working/185247 "2019-06-13T04:22:37Z")

</div>

I want to apply custom analyzer to all fields in an existing mapping to enable search with special characters. I created custom ngram analyzer and a dynamic template to apply custom\_analyzer on all text fields to do so. …

---

## [German stemmer - looking for snowball alternative](https://discuss.elastic.co/t/german-stemmer-looking-for-snowball-alternative/13968)

<div class="topic-metadata">

**Author:** [@ThomasL](https://discuss.elastic.co/u/ThomasL)\
**Replies:** 4\
**Last updated:** [October 21, 2013, 9:12pm UTC](https://discuss.elastic.co/t/german-stemmer-looking-for-snowball-alternative/13968 "2013-10-21T21:12:04Z")

</div>

As we are not satisfied with the german snowball stemmer we are looking for alternatives. For example we miss stemming for some plural variants like: Kiwis --\> Kiwi / Autos --\> Auto and Nudeln --\> Nudel etc. We f…

---

## [Sending data from S3 to elasticsearch](https://discuss.elastic.co/t/sending-data-from-s3-to-elasticsearch/154675)

<div class="topic-metadata">

**Author:** [@vnallamothu](https://discuss.elastic.co/u/vnallamothu)\
**Replies:** 2\
**Last updated:** [October 30, 2018, 5:35pm UTC](https://discuss.elastic.co/t/sending-data-from-s3-to-elasticsearch/154675 "2018-10-30T17:35:36Z")

</div>

Is there anyway that I can send the data from AWS S3 to self managed elastic search? Please let me know.

---

## [RegEx Filter Not Matching on Hash tag (#)](https://discuss.elastic.co/t/regex-filter-not-matching-on-hash-tag/22764)

<div class="topic-metadata">

**Author:** [@Mahesh\_Kommareddi](https://discuss.elastic.co/u/Mahesh_Kommareddi)\
**Replies:** 2\
**Last updated:** [March 19, 2015, 5:47pm UTC](https://discuss.elastic.co/t/regex-filter-not-matching-on-hash-tag/22764 "2015-03-19T17:47:59Z")

</div>

Hi, I'm trying to do a RegEx Filter to match on .\*#.\* to find all the items (in a field) that contains a hash tag. I looked around and thought maybe the analyzer was stripping the character, so I took a cue from a p…

---

## [Index a simple folder with simple text files - how hard can it be](https://discuss.elastic.co/t/index-a-simple-folder-with-simple-text-files-how-hard-can-it-be/64378)

<div class="topic-metadata">

**Author:** [@avilleneuve](https://discuss.elastic.co/u/avilleneuve)\
**Replies:** 1\
**Last updated:** [October 30, 2016, 7:11pm UTC](https://discuss.elastic.co/t/index-a-simple-folder-with-simple-text-files-how-hard-can-it-be/64378 "2016-10-30T19:11:00Z")

</div>

Hello Folks I "finally" got ES 5.0 working on Windows Server 2012. What a bear! And I managed to get the Shakespeare data set loaded and searchable. I have two things I would like to accomplish with ES 5.0. ind…

---

## [Forward logs from Kiwi to Elasticsearch](https://discuss.elastic.co/t/forward-logs-from-kiwi-to-elasticsearch/247682)

<div class="topic-metadata">

**Author:** [@markb](https://discuss.elastic.co/u/markb)\
**Replies:** 5\
**Last updated:** [September 7, 2020, 1:43pm UTC](https://discuss.elastic.co/t/forward-logs-from-kiwi-to-elasticsearch/247682 "2020-09-07T13:43:15Z")

</div>

I would like to forward logs from Kiwi Syslog Server to Elasticsearch by Logstash. After configuring both Kiwi log action and Logstash pipeline I see no log in ES side. This is the Kiwi remote host forward rule: Thi…

---

## [SSL to logstash doesnt seem to work](https://discuss.elastic.co/t/ssl-to-logstash-doesnt-seem-to-work/113462)

<div class="topic-metadata">

**Author:** [@Zach\_Lewis](https://discuss.elastic.co/u/Zach_Lewis)\
**Replies:** 5\
**Last updated:** [January 3, 2018, 10:40pm UTC](https://discuss.elastic.co/t/ssl-to-logstash-doesnt-seem-to-work/113462 "2018-01-03T22:40:50Z")

</div>

I tired to setup winlogbeat to forward some windows events off to logstash but it seems there might be a bug in winlogbeat. If I dont uncomment any SSL settings for logstash in the yml config then it seems to 'work'. I k…

---

## [Can not access to params.\_source in script\_score](https://discuss.elastic.co/t/can-not-access-to-params-source-in-script-score/153851)

<div class="topic-metadata">

**Author:** [@wgkoro](https://discuss.elastic.co/u/wgkoro)\
**Replies:** 3\
**Last updated:** [October 25, 2018, 1:37am UTC](https://discuss.elastic.co/t/can-not-access-to-params-source-in-script-score/153851 "2018-10-25T01:37:02Z")

</div>

Hi. newbie here. I'm trying to write script\_score with params.\_source, but it returns null pointer exception. (I want to access nested data) Query is like this. GET /users/\_search { "query": { "function\_score":…

---

## [High Java CPU usage with fresh elasticsearch install](https://discuss.elastic.co/t/high-java-cpu-usage-with-fresh-elasticsearch-install/112809)

<div class="topic-metadata">

**Author:** [@Andrew\_Jones](https://discuss.elastic.co/u/Andrew_Jones)\
**Replies:** 3\
**Last updated:** [December 21, 2017, 3:17pm UTC](https://discuss.elastic.co/t/high-java-cpu-usage-with-fresh-elasticsearch-install/112809 "2017-12-21T15:17:01Z")

</div>

Hi, I'm testing out / learning the ELK stack in our simple environment. I have followed the simple guide here https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-logstash-and-kibana-elk-stack-on…

---

## [ES 5.0 Java testing using ESIntegTestCase not supported in TestNg?](https://discuss.elastic.co/t/es-5-0-java-testing-using-esintegtestcase-not-supported-in-testng/64850)

<div class="topic-metadata">

**Author:** [@escay](https://discuss.elastic.co/u/escay)\
**Replies:** 3\
**Last updated:** [November 3, 2016, 3:00pm UTC](https://discuss.elastic.co/t/es-5-0-java-testing-using-esintegtestcase-not-supported-in-testng/64850 "2016-11-03T15:00:05Z")

</div>

I cannot seem to get a simple EsIntegrationTest to work in TestNg. I get all kinds of java.security.AccessControlException exceptions. Failing TestNg example pom.xml: \<project xmlns="http://maven.apache.org/POM/4.0.…

[Previous page](https://discuss.elastic.co/top.md?page=736&per_page=50&period=all)

[Next page](https://discuss.elastic.co/top.md?page=738&per_page=50&period=all)
