# Top

**URL:** https://discuss.elastic.co/top.md?page=288&period=all

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 289

---

## [How to remove fields in logstash output](https://discuss.elastic.co/t/how-to-remove-fields-in-logstash-output/173469)

<div class="topic-metadata">

**Author:** [@evahsiao](https://discuss.elastic.co/u/evahsiao)\
**Replies:** 7\
**Last updated:** [April 10, 2019, 9:27am UTC](https://discuss.elastic.co/t/how-to-remove-fields-in-logstash-output/173469 "2019-04-10T09:27:03Z")

</div>

I want to pass my json data from kafka to elasticseaarch. Judged by the operation param to different action of elasticsearch. my json data is like this: { "operation": "create", "fields": { "sign": "im\_messages", "…

---

## [Kibana dashboard embed in iframe](https://discuss.elastic.co/t/kibana-dashboard-embed-in-iframe/93776)

<div class="topic-metadata">

**Author:** [@Filippo\_Pisapia](https://discuss.elastic.co/u/Filippo_Pisapia)\
**Replies:** 3\
**Last updated:** [July 24, 2017, 5:17pm UTC](https://discuss.elastic.co/t/kibana-dashboard-embed-in-iframe/93776 "2017-07-24T17:17:48Z")

</div>

Hi all, i'm finding problems embedding kibana dashboards in iframe on ipad device using both safari and firefox. (dashboard go over the maximum visible page size) Some one have a template html that manage them correctl…

---

## [Increase total fields limit via creation of index in logstash](https://discuss.elastic.co/t/increase-total-fields-limit-via-creation-of-index-in-logstash/98742)

<div class="topic-metadata">

**Author:** [@reswob](https://discuss.elastic.co/u/reswob)\
**Replies:** 6\
**Last updated:** [August 30, 2017, 11:50am UTC](https://discuss.elastic.co/t/increase-total-fields-limit-via-creation-of-index-in-logstash/98742 "2017-08-30T11:50:28Z")

</div>

My logstash conf has the following output: output { elasticsearch { hosts =\> \["IP1:9200","IP2:9200"\] index =\> "test-${+YYYY.MM.dd}" user =\> elastic password =\> supersecret } } …

---

## [Near duplicate document detection](https://discuss.elastic.co/t/near-duplicate-document-detection/241334)

<div class="topic-metadata">

**Author:** [@tallison](https://discuss.elastic.co/u/tallison)\
**Replies:** 1\
**Last updated:** [July 15, 2020, 5:35pm UTC](https://discuss.elastic.co/t/near-duplicate-document-detection/241334 "2020-07-15T17:35:03Z")

</div>

I have an index w ~12 million files. We have a serious duplication issue and near duplication issue. The exact duplicate problem is trivial because we store a digest. The near duplicate issue is more profound, and I'v…

---

## [Get count of fields in Kibana](https://discuss.elastic.co/t/get-count-of-fields-in-kibana/98784)

<div class="topic-metadata">

**Author:** [@kottapar](https://discuss.elastic.co/u/kottapar)\
**Replies:** 2\
**Last updated:** [August 30, 2017, 11:10am UTC](https://discuss.elastic.co/t/get-count-of-fields-in-kibana/98784 "2017-08-30T11:10:10Z")

</div>

Hello, we’re gathering an inventory of virtual machines from vcenters. I was just wondering if there’s a way we can create a new field with a count of total VMs or with a count of the total number of ESX servers or some…

---

## [Best Configuration for 3 Node Cluster](https://discuss.elastic.co/t/best-configuration-for-3-node-cluster/57708)

<div class="topic-metadata">

**Author:** [@ramkchirra](https://discuss.elastic.co/u/ramkchirra)\
**Replies:** 8\
**Last updated:** [August 11, 2016, 2:06pm UTC](https://discuss.elastic.co/t/best-configuration-for-3-node-cluster/57708 "2016-08-11T14:06:40Z")

</div>

Hi, I have a 3 node cluster. I want to know what would be the best configuration of elasticsearch. Following is my hardware capability : 1) Server1 - 16GB RAM , 94GB Disk space 2) Server2 - 16GB RAM, 94GB Di…

---

## [Action.search.shard\_count.limit exceeded](https://discuss.elastic.co/t/action-search-shard-count-limit-exceeded/62891)

<div class="topic-metadata">

**Author:** [@Hamsaraj](https://discuss.elastic.co/u/Hamsaraj)\
**Replies:** 7\
**Last updated:** [March 29, 2017, 3:42pm UTC](https://discuss.elastic.co/t/action-search-shard-count-limit-exceeded/62891 "2017-03-29T15:42:15Z")

</div>

Can someone please help locate the file containing this parameter action.search.shard\_count.limit I trying to parse a single log file of around 3.2 GB using ELK stack. The same has got indexed and when I am trying to d…

---

## [Unassigned shards, crashed cluster recovery](https://discuss.elastic.co/t/unassigned-shards-crashed-cluster-recovery/113833)

<div class="topic-metadata">

**Author:** [@wweeder](https://discuss.elastic.co/u/wweeder)\
**Replies:** 8\
**Last updated:** [January 5, 2018, 4:19pm UTC](https://discuss.elastic.co/t/unassigned-shards-crashed-cluster-recovery/113833 "2018-01-05T16:19:41Z")

</div>

Hello, I am trying to get a production ELK stack working again. It is stuck on 'indexing' in kibana. I do not care about past log data at all. I just want it to work again for new data. Here are the details: I have rec…

---

## [Network.host: 0.0.0.0 won't start](https://discuss.elastic.co/t/network-host-0-0-0-0-wont-start/64943)

<div class="topic-metadata">

**Author:** [@loranger](https://discuss.elastic.co/u/loranger)\
**Replies:** 5\
**Last updated:** [November 3, 2016, 9:11pm UTC](https://discuss.elastic.co/t/network-host-0-0-0-0-wont-start/64943 "2016-11-03T21:11:49Z")

</div>

Hello, I've just setup a fresh elasticsearch 5 on a debian 8.6. In order to test it, remotely, I've added network.host: 0.0.0.0 to my /etc/elasticsearch/elasticsearch.yml but it refuses to restart. The only log I can…

---

## [Sorting by Nested Field](https://discuss.elastic.co/t/sorting-by-nested-field/103141)

<div class="topic-metadata">

**Author:** [@Atul\_Harsha](https://discuss.elastic.co/u/Atul_Harsha)\
**Replies:** 4\
**Last updated:** [October 8, 2017, 9:17am UTC](https://discuss.elastic.co/t/sorting-by-nested-field/103141 "2017-10-08T09:17:50Z")

</div>

Error : \[nested\] query does not support \[filter\] Code : GET /\_search { "query": { "nested": { "path": "comments", "filter": { "range": { "comments.date":…

---

## [Filter - is one of](https://discuss.elastic.co/t/filter-is-one-of/113818)

<div class="topic-metadata">

**Author:** [@ghouston10](https://discuss.elastic.co/u/ghouston10)\
**Replies:** 3\
**Last updated:** [January 22, 2018, 4:17pm UTC](https://discuss.elastic.co/t/filter-is-one-of/113818 "2018-01-22T16:17:57Z")

</div>

Could someone explain to me how to use the 'is one of' filter. I want to filter the index to display documents containing only flight numbers 103 and 469. I have attached a screenshot displaying the section I need to …

---

## [Apply a script on an aggregation result in visualization](https://discuss.elastic.co/t/apply-a-script-on-an-aggregation-result-in-visualization/107052)

<div class="topic-metadata">

**Author:** [@Sarra\_Bouhenni](https://discuss.elastic.co/u/Sarra_Bouhenni)\
**Replies:** 5\
**Last updated:** [November 13, 2017, 4:50pm UTC](https://discuss.elastic.co/t/apply-a-script-on-an-aggregation-result-in-visualization/107052 "2017-11-13T16:50:35Z")

</div>

Hello, I have a visualization on Kibana of type "Data table", I need to apply a simple script on the count aggregations result (divied count by 2). \[Capture1\] I tried to embed a script in advanced JSON like this : { …

---

## [Conditional expression to test for a list of possible partial matches in a string](https://discuss.elastic.co/t/conditional-expression-to-test-for-a-list-of-possible-partial-matches-in-a-string/133583)

<div class="topic-metadata">

**Author:** [@jlsam](https://discuss.elastic.co/u/jlsam)\
**Replies:** 3\
**Last updated:** [May 29, 2018, 12:16am UTC](https://discuss.elastic.co/t/conditional-expression-to-test-for-a-list-of-possible-partial-matches-in-a-string/133583 "2018-05-29T00:16:14Z")

</div>

I want to select and output only the uncommon messages in a log, based on a partial match (the beginning of the message). I can filter out one message like so output { if "foo" not in \[msg\] { But if it try to match …

---

## [Archiving OLD data](https://discuss.elastic.co/t/archiving-old-data/141854)

<div class="topic-metadata">

**Author:** [@sujatharudra](https://discuss.elastic.co/u/sujatharudra)\
**Replies:** 5\
**Last updated:** [August 9, 2018, 10:35pm UTC](https://discuss.elastic.co/t/archiving-old-data/141854 "2018-08-09T22:35:14Z")

</div>

Can you help me with how to archive data with compression works in elasticsearch. My cluster have all physical boxes . I am trying to archive last month indices for querying in case we need it.

---

## [Elasticsearch output Document missing exception 404](https://discuss.elastic.co/t/elasticsearch-output-document-missing-exception-404/42747)

<div class="topic-metadata">

**Author:** [@iomismo](https://discuss.elastic.co/u/iomismo)\
**Replies:** 5\
**Last updated:** [August 19, 2016, 7:29pm UTC](https://discuss.elastic.co/t/elasticsearch-output-document-missing-exception-404/42747 "2016-08-19T19:29:15Z")

</div>

Hi everyone! I am facing a problem with logstash and elasticsearch output plugin. Basically i want to index couchdb changes. Using this config: input { couchdb\_changes { db =\> "database" …

---

## [Using must\_not and wildcard to search](https://discuss.elastic.co/t/using-must-not-and-wildcard-to-search/134590)

<div class="topic-metadata">

**Author:** [@sirbrian](https://discuss.elastic.co/u/sirbrian)\
**Replies:** 5\
**Last updated:** [June 5, 2018, 2:48pm UTC](https://discuss.elastic.co/t/using-must-not-and-wildcard-to-search/134590 "2018-06-05T14:48:33Z")

</div>

Hi, I am new to Elasticsearch and Kibana. I am using the Kibana Dev Tools to search Elasticsearch. What I want to do is find all results that don't match a wildcard term. If I try this a search with "must\_not": \[ …

---

## [How to handle german Umlauts or anything thats not UTF-8](https://discuss.elastic.co/t/how-to-handle-german-umlauts-or-anything-thats-not-utf-8/25294)

<div class="topic-metadata">

**Author:** [@roflrox](https://discuss.elastic.co/u/roflrox)\
**Replies:** 3\
**Last updated:** [July 10, 2015, 9:21am UTC](https://discuss.elastic.co/t/how-to-handle-german-umlauts-or-anything-thats-not-utf-8/25294 "2015-07-10T09:21:33Z")

</div>

Hallo, i had a little Problem with processing Logmessages that contain some german umlauts. But i found a solution how to handle umlauts (or anything which is not UTF-8 encoded) When you check the logstash.log you mi…

---

## [Received response for a request that has timed out Error](https://discuss.elastic.co/t/received-response-for-a-request-that-has-timed-out-error/19799)

<div class="topic-metadata">

**Author:** [@shriyansh\_jain](https://discuss.elastic.co/u/shriyansh_jain)\
**Replies:** 3\
**Last updated:** [August 5, 2015, 1:11pm UTC](https://discuss.elastic.co/t/received-response-for-a-request-that-has-timed-out-error/19799 "2015-08-05T13:11:30Z")

</div>

Hi, I am getting the following error in the elasticsearch log file. I have a cluster of 2 elasticsearch nodes, and have a setup of ELK stack with redis as a buffer. Everything was running fine but suddenly, logsta…

---

## [Trying to get a filebeat running in docker-compose](https://discuss.elastic.co/t/trying-to-get-a-filebeat-running-in-docker-compose/169958)

<div class="topic-metadata">

**Author:** [@fribse](https://discuss.elastic.co/u/fribse)\
**Replies:** 4\
**Last updated:** [March 8, 2019, 11:42am UTC](https://discuss.elastic.co/t/trying-to-get-a-filebeat-running-in-docker-compose/169958 "2019-03-08T11:42:50Z")

</div>

Hi All I'm a bit unsure what I've done wrong. I have a docker-compose that places dmarc logs in a folder. I then want to have another docker image running with a filebeat, that pushes it into logstash. But for some r…

---

## [Any guideline with Elasticsearch nodes and AWS instance types?](https://discuss.elastic.co/t/any-guideline-with-elasticsearch-nodes-and-aws-instance-types/79057)

<div class="topic-metadata">

**Author:** [@ZillaG](https://discuss.elastic.co/u/ZillaG)\
**Replies:** 6\
**Last updated:** [March 21, 2017, 4:14pm UTC](https://discuss.elastic.co/t/any-guideline-with-elasticsearch-nodes-and-aws-instance-types/79057 "2017-03-21T16:14:26Z")

</div>

I'm trying to setup a production ELK instance in AWS. Any guidelines for which instance type to use for the different types on nodes? I want to have the following configuration. 3 master Elasticsearch nodes (CPU and me…

---

## [Elastic JVM heap file dumps deletion](https://discuss.elastic.co/t/elastic-jvm-heap-file-dumps-deletion/135409)

<div class="topic-metadata">

**Author:** [@Amandeep\_Singh1](https://discuss.elastic.co/u/Amandeep_Singh1)\
**Replies:** 1\
**Last updated:** [June 15, 2018, 9:43am UTC](https://discuss.elastic.co/t/elastic-jvm-heap-file-dumps-deletion/135409 "2018-06-15T09:43:46Z")

</div>

Elasticsearch ships withs -XX:+HeapDumpOnOutOfMemory enabled, this leads to the heap dumps being generated whenever the JVM encounters an OutOfMemoryError. These generate hprof files in with default location as /var/lib…

---

## [Elasticsearch.service: Failed with result 'exit-code'](https://discuss.elastic.co/t/elasticsearch-service-failed-with-result-exit-code/283123)

<div class="topic-metadata">

**Author:** [@padamrai](https://discuss.elastic.co/u/padamrai)\
**Replies:** 7\
**Last updated:** [September 2, 2021, 5:51am UTC](https://discuss.elastic.co/t/elasticsearch-service-failed-with-result-exit-code/283123 "2021-09-02T05:51:26Z")

</div>

My Elasticsearch is not starting, I don't know why I am getting below error. root@i3insight2:~# systemctl status elasticsearch.service â elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/system/e…

---

## [Where does Logstash store its data?](https://discuss.elastic.co/t/where-does-logstash-store-its-data/60930)

<div class="topic-metadata">

**Author:** [@ZillaG](https://discuss.elastic.co/u/ZillaG)\
**Replies:** 8\
**Last updated:** [September 20, 2016, 8:42pm UTC](https://discuss.elastic.co/t/where-does-logstash-store-its-data/60930 "2016-09-20T20:42:20Z")

</div>

I'm using a central Logstash server that gets logs from multiple remote Logstash clients, which use rsyslog to forward logs. Where does Logstash store the logs in the server? Can I setup an NFS mount and tell Logstash to…

---

## [Bulk update in ES](https://discuss.elastic.co/t/bulk-update-in-es/149503)

<div class="topic-metadata">

**Author:** [@Gosforth](https://discuss.elastic.co/u/Gosforth)\
**Replies:** 7\
**Last updated:** [October 5, 2018, 4:55pm UTC](https://discuss.elastic.co/t/bulk-update-in-es/149503 "2018-10-05T16:55:27Z")

</div>

How can I update millions of docs in E? I found this https://www.elastic.co/guide/en/elasticsearch/reference/current/\_updating\_documents.html but I cannot imagine this can be done with millions of rows. Even writing som…

---

## [ElasticMARC - DMARC Aggregate Report Analysis](https://discuss.elastic.co/t/elasticmarc-dmarc-aggregate-report-analysis/125044)

<div class="topic-metadata">

**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\
**Replies:** 7\
**Last updated:** [April 5, 2018, 2:55pm UTC](https://discuss.elastic.co/t/elasticmarc-dmarc-aggregate-report-analysis/125044 "2018-04-05T14:55:21Z")

</div>

Here's a solution I developed to ingest DMARC Aggregate reports. It's primarily aimed at Windows but if someone wants to collaborate to get the PowerShell functions ported into an OS agnostic language or a separate proc…

---

## [How to make Logstash highly available](https://discuss.elastic.co/t/how-to-make-logstash-highly-available/29926)

<div class="topic-metadata">

**Author:** [@vikas\_gopal](https://discuss.elastic.co/u/vikas_gopal)\
**Replies:** 5\
**Last updated:** [September 25, 2015, 12:14am UTC](https://discuss.elastic.co/t/how-to-make-logstash-highly-available/29926 "2015-09-25T00:14:57Z")

</div>

Hi Experts, My plan is to make LS highly available as I did it for ES and Kibana. So I have load balancer for ES and for Kibana. Not sure how I achieve this for LS. Please suggest. Thanks VG

---

## [Elastic search get bucket count](https://discuss.elastic.co/t/elastic-search-get-bucket-count/63133)

<div class="topic-metadata">

**Author:** [@Mister\_L](https://discuss.elastic.co/u/Mister_L)\
**Replies:** 5\
**Last updated:** [October 20, 2016, 7:42am UTC](https://discuss.elastic.co/t/elastic-search-get-bucket-count/63133 "2016-10-20T07:42:06Z")

</div>

I have the following query: GET images/\_search { "query": { "bool": { "must": \[ { "term": { "appID.raw": "myApp" } } \] } }, "size": 0, …

---

## [Issue with server.publicBaseUrl](https://discuss.elastic.co/t/issue-with-server-publicbaseurl/285796)

<div class="topic-metadata">

**Author:** [@PhilD](https://discuss.elastic.co/u/PhilD)\
**Replies:** 4\
**Last updated:** [October 5, 2021, 12:51pm UTC](https://discuss.elastic.co/t/issue-with-server-publicbaseurl/285796 "2021-10-05T12:51:11Z")

</div>

Hello, I've deployed Kibana 7.14, behind a NGINX proxy, but keep getting a toast notification that server.publicBaseUrl has not been set; yet it has been in kibana.yml. Is there a way to dump the running configuration t…

---

## [Rally 0.9.2 released](https://discuss.elastic.co/t/rally-0-9-2-released/120583)

<div class="topic-metadata">

**Author:** [@danielmitterdorfer](https://discuss.elastic.co/u/danielmitterdorfer)\
**Replies:** 0\
**Last updated:** [February 20, 2018, 9:29am UTC](https://discuss.elastic.co/t/rally-0-9-2-released/120583 "2018-02-20T09:29:13Z")

</div>

We have just released Rally 0.9.2. This release contains several bugfixes and some minor improvements (see also the 0.9.2 release page). How to...? ... upgrade: pip3 install --upgrade esrally ... install: pip3 install…

---

## [FATAL Error: \[elasticsearch.url\]: definition for this key is missing](https://discuss.elastic.co/t/fatal-error-elasticsearch-url-definition-for-this-key-is-missing/191345)

<div class="topic-metadata">

**Author:** [@vkuehn](https://discuss.elastic.co/u/vkuehn)\
**Replies:** 6\
**Last updated:** [August 2, 2019, 3:22am UTC](https://discuss.elastic.co/t/fatal-error-elasticsearch-url-definition-for-this-key-is-missing/191345 "2019-08-02T03:22:03Z")

</div>

Hello, I am am new to all elastic , so there might me a straight solution I simply don't know I installed elastic and kibana on a ubuntu 18.04. when I start Kibana I find this FATAL Error: \[elasticsearch.url\]: definit…

---

## [Fixed -- "Elasticsearch plugin is red" after 6.0.0 upgrade](https://discuss.elastic.co/t/fixed-elasticsearch-plugin-is-red-after-6-0-0-upgrade/109604)

<div class="topic-metadata">

**Author:** [@xanadsonf](https://discuss.elastic.co/u/xanadsonf)\
**Replies:** 7\
**Last updated:** [November 30, 2017, 9:18am UTC](https://discuss.elastic.co/t/fixed-elasticsearch-plugin-is-red-after-6-0-0-upgrade/109604 "2017-11-30T09:18:13Z")

</div>

Hi, I upgraded succesfully my cluster from 5.6.4 to 6.0.0. I upgraded logstash & kibana to 6.0.0. Platform debian 8.9, installation from packages (https://artifacts.elastic.co/downloads/elasticsearch/\*) ES is ok (loc…

---

## [What is the definitive way of only retaining 7 days of logs](https://discuss.elastic.co/t/what-is-the-definitive-way-of-only-retaining-7-days-of-logs/28399)

<div class="topic-metadata">

**Author:** [@Sam\_Saffron](https://discuss.elastic.co/u/Sam_Saffron)\
**Replies:** 8\
**Last updated:** [February 14, 2017, 9:00pm UTC](https://discuss.elastic.co/t/what-is-the-definitive-way-of-only-retaining-7-days-of-logs/28399 "2017-02-14T21:00:48Z")

</div>

Our haproxy logs are eating up a large amount of space in logstash indexes, what is the "correct" / "best" way of setting up logstash only to retain 7 days of logs in elastic? Step by step guide would be much apprecia…

---

## [How to mask the data in Elasticsearch?](https://discuss.elastic.co/t/how-to-mask-the-data-in-elasticsearch/49753)

<div class="topic-metadata">

**Author:** [@sanju1323](https://discuss.elastic.co/u/sanju1323)\
**Replies:** 8\
**Last updated:** [May 11, 2016, 9:30pm UTC](https://discuss.elastic.co/t/how-to-mask-the-data-in-elasticsearch/49753 "2016-05-11T21:30:50Z")

</div>

Hi, I have some data that can't be exposed. So, I want to mask the data which is existing in the Elasticsearch Index. Is there a way to mask the data in Elasticsearch. If yes, please guide me the right direction. Tha…

---

## [Is JSON too verbose for high performance](https://discuss.elastic.co/t/is-json-too-verbose-for-high-performance/33570)

<div class="topic-metadata">

**Author:** [@iamthealex](https://discuss.elastic.co/u/iamthealex)\
**Replies:** 7\
**Last updated:** [January 17, 2017, 2:20am UTC](https://discuss.elastic.co/t/is-json-too-verbose-for-high-performance/33570 "2017-01-17T02:20:26Z")

</div>

JSON is quite verbose. Google introduced protocol buffers many years ago, and one of the the key features was to reduce the number of bytes that need to go "over the wire". Newer attempts to optimize for bigdata use fo…

---

## [What is default index analyzer?](https://discuss.elastic.co/t/what-is-default-index-analyzer/69402)

<div class="topic-metadata">

**Author:** [@Youxu](https://discuss.elastic.co/u/Youxu)\
**Replies:** 4\
**Last updated:** [December 19, 2016, 1:04pm UTC](https://discuss.elastic.co/t/what-is-default-index-analyzer/69402 "2016-12-19T13:04:32Z")

</div>

I though default analyzer is "standard" analyzer, but per my following experimentation, seems not. Create index with customized standard analyzer which included a pattern\_capture filter to split words by "." or "\_" P…

---

## [Grok Pattern for date and time format "03-MAR-21 00:40:21"](https://discuss.elastic.co/t/grok-pattern-for-date-and-time-format-03-mar-21-0021/271014)

<div class="topic-metadata">

**Author:** [@Wilks](https://discuss.elastic.co/u/Wilks)\
**Replies:** 3\
**Last updated:** [April 23, 2021, 1:12am UTC](https://discuss.elastic.co/t/grok-pattern-for-date-and-time-format-03-mar-21-0021/271014 "2021-04-23T01:12:04Z")

</div>

This is likely a simple one but what's the grok pattern for this? I have gone through all the ones I could find but I cant get a match for the format 03-MAR-21 00:40:2 Currently I am using a string but need to change i…

---

## [Kibana painless scripted fields. Loop on array of objects](https://discuss.elastic.co/t/kibana-painless-scripted-fields-loop-on-array-of-objects/132847)

<div class="topic-metadata">

**Author:** [@ramchjob](https://discuss.elastic.co/u/ramchjob)\
**Replies:** 6\
**Last updated:** [May 22, 2018, 6:06pm UTC](https://discuss.elastic.co/t/kibana-painless-scripted-fields-loop-on-array-of-objects/132847 "2018-05-22T18:06:52Z")

</div>

Hey ES Gurus, I been trying to generate reports from es documents in kibana. Below is the sample { "customer" : "contact": { "phones" : \[ { "category":"personal", "number":"1111111111" }, { "category":"work", "number…

---

## [Using aggregation in Elasticsearch to find duplicate data in the same index](https://discuss.elastic.co/t/using-aggregation-in-elasticsearch-to-find-duplicate-data-in-the-same-index/259637)

<div class="topic-metadata">

**Author:** [@Amraneze](https://discuss.elastic.co/u/Amraneze)\
**Replies:** 5\
**Last updated:** [December 25, 2020, 5:41pm UTC](https://discuss.elastic.co/t/using-aggregation-in-elasticsearch-to-find-duplicate-data-in-the-same-index/259637 "2020-12-25T17:41:47Z")

</div>

Hi everyone, I'm trying to find duplicates within the same index. I tried to use aggregation like this : { "aggs": { "duplicates": { "terms": { "script": { "source": "if (doc\['username.sort-field'\].size(…

---

## [Elastic 7.7.0 too many requests with one request!](https://discuss.elastic.co/t/elastic-7-7-0-too-many-requests-with-one-request/233417)

<div class="topic-metadata">

**Author:** [@staticdev](https://discuss.elastic.co/u/staticdev)\
**Replies:** 3\
**Last updated:** [May 21, 2020, 6:02pm UTC](https://discuss.elastic.co/t/elastic-7-7-0-too-many-requests-with-one-request/233417 "2020-05-21T18:02:01Z")

</div>

I am developing an application using elasticsearch 7.7.0 image from docker (docker.elastic.co/elasticsearch/elasticsearch:7.7.0) with single node. Configs: - cluster.name=log - bootstrap.memory\_lock=true - "ES\_JAV…

---

## [Logstash 5.5.0 ERROR StatusLogger No log4j2 configuration file found](https://discuss.elastic.co/t/logstash-5-5-0-error-statuslogger-no-log4j2-configuration-file-found/92921)

<div class="topic-metadata">

**Author:** [@dawncold](https://discuss.elastic.co/u/dawncold)\
**Replies:** 1\
**Last updated:** [July 14, 2017, 5:48pm UTC](https://discuss.elastic.co/t/logstash-5-5-0-error-statuslogger-no-log4j2-configuration-file-found/92921 "2017-07-14T17:48:43Z")

</div>

After I upgraded logstash from 5.4.1 to 5.5.0, I got this error: ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console. Sending Logstash's logs to /var/…

---

## [How to add a link / URL to a Dashboard](https://discuss.elastic.co/t/how-to-add-a-link-url-to-a-dashboard/72225)

<div class="topic-metadata">

**Author:** [@gkraan](https://discuss.elastic.co/u/gkraan)\
**Replies:** 2\
**Last updated:** [January 20, 2017, 1:03pm UTC](https://discuss.elastic.co/t/how-to-add-a-link-url-to-a-dashboard/72225 "2017-01-20T13:03:58Z")

</div>

Hi, assume I have two Dashboard, D1 and D2, with D1 being my primary Dashboard. I want to add a link / URL to D1, so I can click on it (button, Visualization or otherwise), so D2 opens up, preferably as a new window …

---

## [Set up Elasticsearch cluster 2 nodes on same machine](https://discuss.elastic.co/t/set-up-elasticsearch-cluster-2-nodes-on-same-machine/120824)

<div class="topic-metadata">

**Author:** [@Darshan\_Shah1](https://discuss.elastic.co/u/Darshan_Shah1)\
**Replies:** 5\
**Last updated:** [February 21, 2018, 1:57pm UTC](https://discuss.elastic.co/t/set-up-elasticsearch-cluster-2-nodes-on-same-machine/120824 "2018-02-21T13:57:23Z")

</div>

Hi , The requirement is need to set up two nodes of cluster on same host. if I use network.host: with same IP http.port : different port Below is my config file for node-1. In 2nd node cluster name is same,node name …

---

## [java.lang.IllegalArgumentException: unknown setting \[node.roles\] please check that any required plugins are installed](https://discuss.elastic.co/t/java-lang-illegalargumentexception-unknown-setting-node-roles-please-check-that-any-required-plugins-are-installed/247121)

<div class="topic-metadata">

**Author:** [@snehadarshini](https://discuss.elastic.co/u/snehadarshini)\
**Replies:** 7\
**Last updated:** [June 4, 2022, 11:12am UTC](https://discuss.elastic.co/t/java-lang-illegalargumentexception-unknown-setting-node-roles-please-check-that-any-required-plugins-are-installed/247121 "2022-06-04T11:12:52Z")

</div>

Added node.roles: \[ master \] in elasticsearch.yml configuration. Index or shard allocation is not done yet. Using 7.8.1 version of elastic search. However on starting the node I get the below exception Caused by: java.la…

---

## [JDBC Plugin - Missing Converter handling for full class name=org.postgresql.util.PGobject, simple name=PGobject](https://discuss.elastic.co/t/jdbc-plugin-missing-converter-handling-for-full-class-name-org-postgresql-util-pgobject-simple-name-pgobject/163772)

<div class="topic-metadata">

**Author:** [@jamesamuir](https://discuss.elastic.co/u/jamesamuir)\
**Replies:** 0\
**Last updated:** [January 10, 2019, 3:43pm UTC](https://discuss.elastic.co/t/jdbc-plugin-missing-converter-handling-for-full-class-name-org-postgresql-util-pgobject-simple-name-pgobject/163772 "2019-01-10T15:43:34Z")

</div>

Hello, I am trying to determine how to get the JDBC plugin to correctly load JSON and JSONB field types from PostgreSQL. I am running Postgres 9.5 and Logstash 6.5. Here is an example to replicate. create table if not…

---

## [Bug? Search (specific) query doesn't return documents that does exist!](https://discuss.elastic.co/t/bug-search-specific-query-doesnt-return-documents-that-does-exist/28352)

<div class="topic-metadata">

**Author:** [@Nir\_Reuveny](https://discuss.elastic.co/u/Nir_Reuveny)\
**Replies:** 8\
**Last updated:** [September 7, 2015, 6:50am UTC](https://discuss.elastic.co/t/bug-search-specific-query-doesnt-return-documents-that-does-exist/28352 "2015-09-07T06:50:37Z")

</div>

Hi, We have ES 1.7 cluster with daily logstash indexes. We've noticed a major issue which we can't explain... when searching (or running term aggr) on a specific field we need it doesn't return any documents, although …

---

## [How to disable formatting fields automatically](https://discuss.elastic.co/t/how-to-disable-formatting-fields-automatically/86562)

<div class="topic-metadata">

**Author:** [@mendy](https://discuss.elastic.co/u/mendy)\
**Replies:** 3\
**Last updated:** [June 1, 2017, 8:50am UTC](https://discuss.elastic.co/t/how-to-disable-formatting-fields-automatically/86562 "2017-06-01T08:50:12Z")

</div>

i have many fields in a index. but if i have a new field in an index and the data come in format 'yyyy/MM/dd' the elastic auto map this field as date format but in next value in this field could be text. i want to disa…

---

## [Issue with elastic search 5.0.0 - java.lang.ClassNotFoundException: org.apache.logging.log4j.core.async.DaemonThreadFactory](https://discuss.elastic.co/t/issue-with-elastic-search-5-0-0-java-lang-classnotfoundexception-org-apache-logging-log4j-core-async-daemonthreadfactory/64345)

<div class="topic-metadata">

**Author:** [@lao](https://discuss.elastic.co/u/lao)\
**Replies:** 8\
**Last updated:** [January 12, 2017, 1:57am UTC](https://discuss.elastic.co/t/issue-with-elastic-search-5-0-0-java-lang-classnotfoundexception-org-apache-logging-log4j-core-async-daemonthreadfactory/64345 "2017-01-12T01:57:49Z")

</div>

ERROR Could not reconfigure JMX java.lang.NoClassDefFoundError: org/apache/logging/log4j/core/async/DaemonThreadFactory at org.apache.logging.log4j.core.jmx.Server.createExecutor(Server.java:81) at org.apache.logging.l…

---

## [Not able to send post request from form](https://discuss.elastic.co/t/not-able-to-send-post-request-from-form/125485)

<div class="topic-metadata">

**Author:** [@Sunny\_Sachan](https://discuss.elastic.co/u/Sunny_Sachan)\
**Replies:** 2\
**Last updated:** [March 26, 2018, 9:25am UTC](https://discuss.elastic.co/t/not-able-to-send-post-request-from-form/125485 "2018-03-26T09:25:59Z")

</div>

Hi all, I have made a custom plugin for kibana version 6.2.1, in which I am having a form, now whenever I am submitting those form values with get request all works absolutely fine. But submitting the form values with …

---

## [Error: Port 5601 is already in use. Another instance of Kibana may be running!](https://discuss.elastic.co/t/error-port-5601-is-already-in-use-another-instance-of-kibana-may-be-running/240070)

<div class="topic-metadata">

**Author:** [@Splunk](https://discuss.elastic.co/u/Splunk)\
**Replies:** 5\
**Last updated:** [July 7, 2020, 1:44am UTC](https://discuss.elastic.co/t/error-port-5601-is-already-in-use-another-instance-of-kibana-may-be-running/240070 "2020-07-07T01:44:06Z")

</div>

bin kibana log \[22:25:12.491\] \[warning\]\[plugins-discovery\] Expect plugin "id" in camelCase, but found: apm\_oss log \[22:25:12.504\] \[warning\]\[plugins-discovery\] Expect plugin "id" in camelCase, but found: triggers\_a…

---

## [Security\_exception: unable to authenticate user \[kibana\_system\] for REST request \[/\_nodes?filter\_path=nodes..version%2Cnodes..http.publish\_address%2Cnodes..ip\]](https://discuss.elastic.co/t/security-exception-unable-to-authenticate-user-kibana-system-for-rest-request-nodes-filter-path-nodes-version-2cnodes-http-publish-address-2cnodes-ip/340187)

<div class="topic-metadata">

**Author:** [@Joao\_Malebo](https://discuss.elastic.co/u/Joao_Malebo)\
**Replies:** 7\
**Last updated:** [August 6, 2023, 3:11pm UTC](https://discuss.elastic.co/t/security-exception-unable-to-authenticate-user-kibana-system-for-rest-request-nodes-filter-path-nodes-version-2cnodes-http-publish-address-2cnodes-ip/340187 "2023-08-06T15:11:02Z")

</div>

hello friends, I am getting this error when launching kibana in the browser... below is the cause of the error returned by kibana statuses. Please can you help overcome this situation md/system/kibana.service; enabled…

[Previous page](https://discuss.elastic.co/top.md?page=287&per_page=50&period=all)

[Next page](https://discuss.elastic.co/top.md?page=289&per_page=50&period=all)
