# Top

**URL:** https://discuss.elastic.co/top.md?page=697&period=all

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 698

---

## [Access nested field inside function query with script score](https://discuss.elastic.co/t/access-nested-field-inside-function-query-with-script-score/19484)

<div class="topic-metadata">

**Author:** [@Srinivasan\_Ramaswamy](https://discuss.elastic.co/u/Srinivasan_Ramaswamy)\
**Replies:** 2\
**Last updated:** [August 28, 2014, 2:51am UTC](https://discuss.elastic.co/t/access-nested-field-inside-function-query-with-script-score/19484 "2014-08-28T02:51:56Z")

</div>

I have the following document schema authorid: 1 athorName: joshua bloch books: \[ { bookId: 100 bookName: effective java sales: 200 }, { bookId: 101 bookName: Java Puzzlers sales: 100 } \] sellerTags: \["j…

---

## [Filebeats custom fields not sending with message](https://discuss.elastic.co/t/filebeats-custom-fields-not-sending-with-message/100708)

<div class="topic-metadata">

**Author:** [@jspeer](https://discuss.elastic.co/u/jspeer)\
**Replies:** 4\
**Last updated:** [September 15, 2017, 7:04pm UTC](https://discuss.elastic.co/t/filebeats-custom-fields-not-sending-with-message/100708 "2017-09-15T19:04:33Z")

</div>

I'm running filebeats 5.5.1, the 2 fields that I've added into the prospector aren't sending with the logs. Here is my prospector: - input\_type: log paths: - /etc/filebeat/log/\*.log fields: log\_…

---

## [Bulk insert issue with ElasticSearch.Net 6.0.2](https://discuss.elastic.co/t/bulk-insert-issue-with-elasticsearch-net-6-0-2/128284)

<div class="topic-metadata">

**Author:** [@aneesh](https://discuss.elastic.co/u/aneesh)\
**Replies:** 5\
**Last updated:** [April 18, 2018, 9:39am UTC](https://discuss.elastic.co/t/bulk-insert-issue-with-elasticsearch-net-6-0-2/128284 "2018-04-18T09:39:10Z")

</div>

Hi Following code in NEST with lowlevelclient ElasticLowLevelClient objClient = new ElasticLowLevelClient(objSettings); string strData = "{\\"RollNo\\": \\"1\\",\\"Name\\": \\"Abc\\"}"; JObject data =JObject.Parse(str…

---

## [Packetbeat to analysi offline packet captures](https://discuss.elastic.co/t/packetbeat-to-analysi-offline-packet-captures/80068)

<div class="topic-metadata">

**Author:** [@anilkumar911](https://discuss.elastic.co/u/anilkumar911)\
**Replies:** 2\
**Last updated:** [April 3, 2017, 10:18am UTC](https://discuss.elastic.co/t/packetbeat-to-analysi-offline-packet-captures/80068 "2017-04-03T10:18:27Z")

</div>

Hi, I plan to use/modify packetbeat as an alternative to wireshark, to analyse huge trace files ( \> 10GB) . I have 2 requirements below: export data from a pcap capture file capture all fields of different protocol …

---

## ["Action.search.shard\_count.limit exceeded" error in kibana](https://discuss.elastic.co/t/action-search-shard-count-limit-exceeded-error-in-kibana/72268)

<div class="topic-metadata">

**Author:** [@bini](https://discuss.elastic.co/u/bini)\
**Replies:** 2\
**Last updated:** [January 25, 2017, 12:02pm UTC](https://discuss.elastic.co/t/action-search-shard-count-limit-exceeded-error-in-kibana/72268 "2017-01-25T12:02:33Z")

</div>

Hi, I am getting "Action.search.shard\_count.limit exceeded" whenever i am trying to load dashboard in kibana 5.1.1 . Kindly suggest the reason and solution for this. Thanks in advance. :slight\_smile:

---

## [Logging embedded elasticsearch logs to file with log4j2](https://discuss.elastic.co/t/logging-embedded-elasticsearch-logs-to-file-with-log4j2/53966)

<div class="topic-metadata">

**Author:** [@Rajind\_Ruparathna](https://discuss.elastic.co/u/Rajind_Ruparathna)\
**Replies:** 2\
**Last updated:** [June 26, 2016, 9:58pm UTC](https://discuss.elastic.co/t/logging-embedded-elasticsearch-logs-to-file-with-log4j2/53966 "2016-06-26T21:58:56Z")

</div>

Hi, I'm using elasticsearch 2.3 embedded in my Java program and I want to log generate logs similar to how the standalone elasticsearch does logging. Can you please point me in the right direction ? I've tried this so …

---

## [How to configure and query multiple context suggesters in 5.0](https://discuss.elastic.co/t/how-to-configure-and-query-multiple-context-suggesters-in-5-0/64659)

<div class="topic-metadata">

**Author:** [@kabcampbell](https://discuss.elastic.co/u/kabcampbell)\
**Replies:** 3\
**Last updated:** [April 18, 2017, 3:48pm UTC](https://discuss.elastic.co/t/how-to-configure-and-query-multiple-context-suggesters-in-5-0/64659 "2017-04-18T15:48:25Z")

</div>

I have set up my completion suggester with the following contexts: \> "suggest": { \> "type": "completion", \> "contexts": \[ \> { \> "name": "companyContext", \> "type": "category" \> }, \> { \> "name": "usersC…

---

## [Modify Kibana Source Code](https://discuss.elastic.co/t/modify-kibana-source-code/56306)

<div class="topic-metadata">

**Author:** [@sharon.c](https://discuss.elastic.co/u/sharon.c)\
**Replies:** 3\
**Last updated:** [July 26, 2016, 10:29am UTC](https://discuss.elastic.co/t/modify-kibana-source-code/56306 "2016-07-26T10:29:58Z")

</div>

My company uses ELK to do business analytics, and we generate millions of documents every day. One problem we have is that in Kibana reports, we need the legend to have enriched data like user names, product names, sale…

---

## [ELK behind ELB](https://discuss.elastic.co/t/elk-behind-elb/35143)

<div class="topic-metadata">

**Author:** [@jkumar\_99](https://discuss.elastic.co/u/jkumar_99)\
**Replies:** 3\
**Last updated:** [December 3, 2015, 6:15pm UTC](https://discuss.elastic.co/t/elk-behind-elb/35143 "2015-12-03T18:15:47Z")

</div>

HI, I just upgraded my ELK stack to use ES 2.0 and KIbana 4.2.1. Now I am getting blank page while accessing Kibana . When Kibana is working on one node, I can see everything, but when I start Kibana on more than one…

---

## [Doute in Environement path](https://discuss.elastic.co/t/doute-in-environement-path/25437)

<div class="topic-metadata">

**Author:** [@karthikjaps](https://discuss.elastic.co/u/karthikjaps)\
**Replies:** 7\
**Last updated:** [July 13, 2015, 12:49pm UTC](https://discuss.elastic.co/t/doute-in-environement-path/25437 "2015-07-13T12:49:10Z")

</div>

hi , due to system crash , i reinstall elastic search , elastic search wotking fine , when i try to reinstall shield i add in /etc/environemnt , export ES\_JAVA\_OPTS="-Des.path.conf=/etc/elasticsearch" where my elastics…

---

## [Getting "connections idle , closing" log on running facet-script](https://discuss.elastic.co/t/getting-connections-idle-closing-log-on-running-facet-script/16587)

<div class="topic-metadata">

**Author:** [@vineeth\_mohan\_2](https://discuss.elastic.co/u/vineeth_mohan_2)\
**Replies:** 1\
**Last updated:** [March 25, 2014, 3:21pm UTC](https://discuss.elastic.co/t/getting-connections-idle-closing-log-on-running-facet-script/16587 "2014-03-25T15:21:25Z")

</div>

Hi , While running a script using - https://github.com/imotov/elasticsearch-facet-script I am seeing following error in debug log. Is there any settings i can tune to increase this timeout or some other workaroun…

---

## [Filebeat Dissect Processor](https://discuss.elastic.co/t/filebeat-dissect-processor/276350)

<div class="topic-metadata">

**Author:** [@Anabella\_Cristaldi](https://discuss.elastic.co/u/Anabella_Cristaldi)\
**Replies:** 2\
**Last updated:** [June 21, 2021, 5:30am UTC](https://discuss.elastic.co/t/filebeat-dissect-processor/276350 "2021-06-21T05:30:24Z")

</div>

Hi All, I was testing the dissect processor in filebeat with this "%{ip\_address} - %{user} \[%{by\_date|date}\] \\"%{request}\\" %{response\_code} %{response\_size} %{msg\_tail}" and I wanted to test directly to convert the f…

---

## [Accessdenied expcetion on snapshot directory](https://discuss.elastic.co/t/accessdenied-expcetion-on-snapshot-directory/224083)

<div class="topic-metadata">

**Author:** [@Arp](https://discuss.elastic.co/u/Arp)\
**Replies:** 8\
**Last updated:** [March 19, 2020, 3:10pm UTC](https://discuss.elastic.co/t/accessdenied-expcetion-on-snapshot-directory/224083 "2020-03-19T15:10:37Z")

</div>

Hi, I am trying to set up a snapshot directory. I created /home/user/elastic and put this into the configuration file: path.repo: "/home/user/elastic" If I then restart, I get the error. I googled a lot around and I …

---

## ['You do not have permission to access the requested page' after ELK Docker Compose tutorial](https://discuss.elastic.co/t/you-do-not-have-permission-to-access-the-requested-page-after-elk-docker-compose-tutorial/297171)

<div class="topic-metadata">

**Author:** [@JaspervLeeuwen](https://discuss.elastic.co/u/JaspervLeeuwen)\
**Replies:** 2\
**Last updated:** [February 15, 2022, 8:51am UTC](https://discuss.elastic.co/t/you-do-not-have-permission-to-access-the-requested-page-after-elk-docker-compose-tutorial/297171 "2022-02-15T08:51:27Z")

</div>

I have followed the guide on installing the Elastic Stack using Docker Compose (Running the Elastic Stack ("ELK") on Docker | Getting Started \[8.0\] | Elastic). When I try to sign in Kibana using kibana\_system as username…

---

## [FileBeat to logstash via IPv6 - cannot assign requested address](https://discuss.elastic.co/t/filebeat-to-logstash-via-ipv6-cannot-assign-requested-address/206039)

<div class="topic-metadata">

**Author:** [@dmdean](https://discuss.elastic.co/u/dmdean)\
**Replies:** 2\
**Last updated:** [October 31, 2019, 1:08pm UTC](https://discuss.elastic.co/t/filebeat-to-logstash-via-ipv6-cannot-assign-requested-address/206039 "2019-10-31T13:08:50Z")

</div>

Hi Folks An ELK/Beats noob here I'm trying to send audit log entries from the app server to an ELK server using filebeats (docker) These are the errors i'm seeing 2019-10-31T12:16:57.109Z INFO log/harvester.go:2…

---

## [Logstash JSON ParserError: Unexpected characher '-'](https://discuss.elastic.co/t/logstash-json-parsererror-unexpected-characher/183400)

<div class="topic-metadata">

**Author:** [@motts](https://discuss.elastic.co/u/motts)\
**Replies:** 2\
**Last updated:** [May 29, 2019, 6:47pm UTC](https://discuss.elastic.co/t/logstash-json-parsererror-unexpected-characher/183400 "2019-05-29T18:47:16Z")

</div>

It appears that LogStash doesn't like hyphens or something? These are IIS logs by the way. I get this error in my date field: \[2019-05-28T16:35:58,176\]\[WARN \]\[logstash.codecs.jsonlines\] JSON parse error, original data…

---

## [Need example for match query with fuzziness](https://discuss.elastic.co/t/need-example-for-match-query-with-fuzziness/35014)

<div class="topic-metadata">

**Author:** [@nlk](https://discuss.elastic.co/u/nlk)\
**Replies:** 2\
**Last updated:** [November 19, 2015, 11:09am UTC](https://discuss.elastic.co/t/need-example-for-match-query-with-fuzziness/35014 "2015-11-19T11:09:35Z")

</div>

Hi! A have 2 records in type "authors", and use elasticsearch\_dsl to perform queries to es. Now i want to find record in type authors with first\_name like "danil". In index i have this recordm but first\_name in it == Don…

---

## [Logstash unable to filter geoip for nginx](https://discuss.elastic.co/t/logstash-unable-to-filter-geoip-for-nginx/96465)

<div class="topic-metadata">

**Author:** [@runtman](https://discuss.elastic.co/u/runtman)\
**Replies:** 3\
**Last updated:** [August 10, 2017, 10:13am UTC](https://discuss.elastic.co/t/logstash-unable-to-filter-geoip-for-nginx/96465 "2017-08-10T10:13:50Z")

</div>

Now I have asked this before inside kibana forums and the discussions died with no resolution so I will start again. I have just span up a brand new 5.5 cluster: x2 master nodes (elasticsearch) x2 data nodes (elastics…

---

## [How to add field using Environment plugin in Logstash configuration file](https://discuss.elastic.co/t/how-to-add-field-using-environment-plugin-in-logstash-configuration-file/92717)

<div class="topic-metadata">

**Author:** [@SandhyaRani](https://discuss.elastic.co/u/SandhyaRani)\
**Replies:** 3\
**Last updated:** [July 13, 2017, 3:05pm UTC](https://discuss.elastic.co/t/how-to-add-field-using-environment-plugin-in-logstash-configuration-file/92717 "2017-07-13T15:05:48Z")

</div>

Question: How to add field from Environment plugin in logstash config file. Here is my Config file input{ stdin{ } } filter { if "exception" not in \[tags\] { # example output: # 2016-12-16 20:43:20,535 DEBU…

---

## [Why ILM is impractical for managing logs / what curator can and cannot do better](https://discuss.elastic.co/t/why-ilm-is-impractical-for-managing-logs-what-curator-can-and-cannot-do-better/276563)

<div class="topic-metadata">

**Author:** [@m.passing](https://discuss.elastic.co/u/m.passing)\
**Replies:** 4\
**Last updated:** [July 14, 2021, 4:09pm UTC](https://discuss.elastic.co/t/why-ilm-is-impractical-for-managing-logs-what-curator-can-and-cannot-do-better/276563 "2021-07-14T16:09:29Z")

</div>

In our setup we have been using curator since a long time, but recent features (namely cold nodes with searchable snapshots), are not supported by it. I want to point out the issues we are having with ILM and the workaro…

---

## [Object mapping errors](https://discuss.elastic.co/t/object-mapping-errors/290032)

<div class="topic-metadata">

**Author:** [@Sconic](https://discuss.elastic.co/u/Sconic)\
**Replies:** 6\
**Last updated:** [November 25, 2021, 4:27am UTC](https://discuss.elastic.co/t/object-mapping-errors/290032 "2021-11-25T04:27:44Z")

</div>

Hi All, We've run into an issue with Logstash (or could be Filebeat) where it's not sending some log entries to ES. We're currently running version 7.15.2 of all the Elastic Components, although I haven't been able to …

---

## [Kibana4.1 tarda mucho en devolver las búsquedas](https://discuss.elastic.co/t/kibana4-1-tarda-mucho-en-devolver-las-busquedas/25927)

<div class="topic-metadata">

**Author:** [@NachoPerez](https://discuss.elastic.co/u/NachoPerez)\
**Replies:** 6\
**Last updated:** [July 20, 2015, 7:21pm UTC](https://discuss.elastic.co/t/kibana4-1-tarda-mucho-en-devolver-las-busquedas/25927 "2015-07-20T19:21:38Z")

</div>

Hola, Me acabo de unir y quería dar las gracias por crear esta Categoría en Castellano. Actualmente, tengo un Cluster de ES (Versión 1.4.2) de 4 Nodos, 3 de ellos son "data\_nodes" y el cuarto nodo no almacena informa…

---

## [Logstash not reading file when started as a service](https://discuss.elastic.co/t/logstash-not-reading-file-when-started-as-a-service/58877)

<div class="topic-metadata">

**Author:** [@obudiman](https://discuss.elastic.co/u/obudiman)\
**Replies:** 7\
**Last updated:** [August 25, 2016, 11:36pm UTC](https://discuss.elastic.co/t/logstash-not-reading-file-when-started-as-a-service/58877 "2016-08-25T23:36:15Z")

</div>

We have the following logstash configuration file which has been tested successfully using the configtest option, input { file { path =\> "/etc/httpd/logs/clickstream.log" } } filter { …

---

## [Index rotation](https://discuss.elastic.co/t/index-rotation/274150)

<div class="topic-metadata">

**Author:** [@humartinez](https://discuss.elastic.co/u/humartinez)\
**Replies:** 2\
**Last updated:** [May 29, 2021, 8:41am UTC](https://discuss.elastic.co/t/index-rotation/274150 "2021-05-29T08:41:54Z")

</div>

Hello, I would like to know if there is a way to rotate an index for a period of time. I have an app that writes to a fix ES index name and I need to to rotate the index lets say after one day "app-index-0001", the next…

---

## [How to write a multi-line SQL in logstash pipelines](https://discuss.elastic.co/t/how-to-write-a-multi-line-sql-in-logstash-pipelines/234182)

<div class="topic-metadata">

**Author:** [@tenet\_testuser1](https://discuss.elastic.co/u/tenet_testuser1)\
**Replies:** 8\
**Last updated:** [May 27, 2020, 4:28pm UTC](https://discuss.elastic.co/t/how-to-write-a-multi-line-sql-in-logstash-pipelines/234182 "2020-05-27T16:28:07Z")

</div>

Hello, So far, I am able to write a single line SQL in logstash pipelines and it's working fine. However, How do I write multiline SQL with single-quotes (') in the SQL? I tried with a backslash for continuation, but t…

---

## [Es server connect to client，than throw connect timeout](https://discuss.elastic.co/t/es-server-connect-to-client-than-throw-connect-timeout/116627)

<div class="topic-metadata">

**Author:** [@fightingaman](https://discuss.elastic.co/u/fightingaman)\
**Replies:** 3\
**Last updated:** [January 23, 2018, 11:49am UTC](https://discuss.elastic.co/t/es-server-connect-to-client-than-throw-connect-timeout/116627 "2018-01-23T11:49:10Z")

</div>

Hi, I have some doubts. problem: I use es-rest client api，than the es-server throw connect timeout. It could be this. I can't imagine why es-server connect to client? Thanks. \[2018-01-18T05:11:15,107\]\[WARN \]\[o.e.h.n…

---

## [Courier fetch error when creating index pattern (5.5.1)](https://discuss.elastic.co/t/courier-fetch-error-when-creating-index-pattern-5-5-1/107038)

<div class="topic-metadata">

**Author:** [@mg6](https://discuss.elastic.co/u/mg6)\
**Replies:** 8\
**Last updated:** [November 14, 2017, 7:53pm UTC](https://discuss.elastic.co/t/courier-fetch-error-when-creating-index-pattern-5-5-1/107038 "2017-11-14T19:53:49Z")

</div>

Hello, We have successfully deployed ELK 5.5.1 stack to our GCE cluster. Elasticsearch seems to run fine and is able to get the data through Logstash (indexes are created and populated correctly; cluster state is green)…

---

## [Limit result](https://discuss.elastic.co/t/limit-result/80516)

<div class="topic-metadata">

**Author:** [@hpatoio](https://discuss.elastic.co/u/hpatoio)\
**Replies:** 3\
**Last updated:** [March 30, 2017, 6:51pm UTC](https://discuss.elastic.co/t/limit-result/80516 "2017-03-30T18:51:29Z")

</div>

Hello. I'm pretty new to elastic and this is my first post in the forum :slight\_smile: I've a very simple document with this format { "shop\_name" : "Armani", "country" : "italy", "city": "milan", "…

---

## [High indexing ES cluster sawtooth pattern](https://discuss.elastic.co/t/high-indexing-es-cluster-sawtooth-pattern/79665)

<div class="topic-metadata">

**Author:** [@j\_wulf\_j](https://discuss.elastic.co/u/j_wulf_j)\
**Replies:** 8\
**Last updated:** [March 24, 2017, 7:19pm UTC](https://discuss.elastic.co/t/high-indexing-es-cluster-sawtooth-pattern/79665 "2017-03-24T19:19:05Z")

</div>

Hello folks, I have a classic ELK cluster for storing logs from my applications. Elastic search: version: 5.1.2 3 nodes 8Gb of RAM each box (6Gb dedicated to ES) Running on AWS gp2 provisioned 3000 IOps hard drives. …

---

## [Elasticsearch 5.2.0 unable to form cluster](https://discuss.elastic.co/t/elasticsearch-5-2-0-unable-to-form-cluster/77031)

<div class="topic-metadata">

**Author:** [@Neuron\_Ring](https://discuss.elastic.co/u/Neuron_Ring)\
**Replies:** 8\
**Last updated:** [March 2, 2017, 4:08pm UTC](https://discuss.elastic.co/t/elasticsearch-5-2-0-unable-to-form-cluster/77031 "2017-03-02T16:08:14Z")

</div>

Hi Team, I have difficulty setting up Elasticsearch cluster in version 5.2.0. This is the first time i am using Version 5.x. I have been happily using v2.4 so far. Please find my elasticsearch.yml file below. I have th…

---

## [Does index operation (refresh:true) return before or after refresh?](https://discuss.elastic.co/t/does-index-operation-refresh-true-return-before-or-after-refresh/72315)

<div class="topic-metadata">

**Author:** [@Serg\_Pilipenko](https://discuss.elastic.co/u/Serg_Pilipenko)\
**Replies:** 4\
**Last updated:** [January 23, 2017, 8:15pm UTC](https://discuss.elastic.co/t/does-index-operation-refresh-true-return-before-or-after-refresh/72315 "2017-01-23T20:15:36Z")

</div>

Assuming version 2.4: does index operation with refresh set to true return after or before the refresh is done? Doc is not clear about this

---

## [Kibana Access logs](https://discuss.elastic.co/t/kibana-access-logs/275428)

<div class="topic-metadata">

**Author:** [@Prasanth\_V](https://discuss.elastic.co/u/Prasanth_V)\
**Replies:** 1\
**Last updated:** [June 9, 2021, 9:50pm UTC](https://discuss.elastic.co/t/kibana-access-logs/275428 "2021-06-09T21:50:50Z")

</div>

How can configure the Kibana access log? it meant whoever using services will get logged....

---

## [Add a new field to document based on the value of the previous with the same correlation id](https://discuss.elastic.co/t/add-a-new-field-to-document-based-on-the-value-of-the-previous-with-the-same-correlation-id/96379)

<div class="topic-metadata">

**Author:** [@vb4t](https://discuss.elastic.co/u/vb4t)\
**Replies:** 5\
**Last updated:** [August 9, 2017, 11:36am UTC](https://discuss.elastic.co/t/add-a-new-field-to-document-based-on-the-value-of-the-previous-with-the-same-correlation-id/96379 "2017-08-09T11:36:40Z")

</div>

Hello. I want to index following logs in elasticsearch: message1 correlation1 urlfield message2 correlation6 message3 correlation1 message4 correlation1 I want documents message3 and message4 to contain the urlfield fi…

---

## [Elasticsearch Comrade - admin panel](https://discuss.elastic.co/t/elasticsearch-comrade-admin-panel/198557)

<div class="topic-metadata">

**Author:** [@moshe\_zada](https://discuss.elastic.co/u/moshe_zada)\
**Replies:** 1\
**Last updated:** [January 6, 2020, 9:16pm UTC](https://discuss.elastic.co/t/elasticsearch-comrade-admin-panel/198557 "2020-01-06T21:16:23Z")

</div>

Hi comrades👏 My name is Moshe and in the last months, I wrote an admin panel for elastic from scratch. Wanted to hear your opinions before I go public with it. Github repo and documentation are here - https://github.c…

---

## [Auto-sync mongodb documents with elasticsearch](https://discuss.elastic.co/t/auto-sync-mongodb-documents-with-elasticsearch/65974)

<div class="topic-metadata">

**Author:** [@Chiranjith\_Rai](https://discuss.elastic.co/u/Chiranjith_Rai)\
**Replies:** 2\
**Last updated:** [November 14, 2016, 12:52pm UTC](https://discuss.elastic.co/t/auto-sync-mongodb-documents-with-elasticsearch/65974 "2016-11-14T12:52:00Z")

</div>

Hi, Is there any way to auto-sync mongodb documents with elasticsearch on a specified time period? is there any built in tool, or any alternate solutions?

---

## [Multiple pipelines questions](https://discuss.elastic.co/t/multiple-pipelines-questions/117571)

<div class="topic-metadata">

**Author:** [@asp](https://discuss.elastic.co/u/asp)\
**Replies:** 6\
**Last updated:** [January 30, 2018, 8:14am UTC](https://discuss.elastic.co/t/multiple-pipelines-questions/117571 "2018-01-30T08:14:35Z")

</div>

Hi, currently we are only using the main pipeline. Processing of different types of logfiles are separated by conditionals. I have a few questions about using multiple pipelines: Can both pipelines use the same beats…

---

## [Path.data not working](https://discuss.elastic.co/t/path-data-not-working/13461)

<div class="topic-metadata">

**Author:** [@gzion7](https://discuss.elastic.co/u/gzion7)\
**Replies:** 6\
**Last updated:** [September 5, 2013, 5:27pm UTC](https://discuss.elastic.co/t/path-data-not-working/13461 "2013-09-05T17:27:25Z")

</div>

I am trying to change the location where ES stores my data. I am using AWS/EC2, it works in the default location but when I change the path in the .yml file it fails to start. I am also unable to enable debugging f…

---

## [How to remove some text in json file using logstash filter plugin? Which plugin to use?](https://discuss.elastic.co/t/how-to-remove-some-text-in-json-file-using-logstash-filter-plugin-which-plugin-to-use/130437)

<div class="topic-metadata">

**Author:** [@omkarr](https://discuss.elastic.co/u/omkarr)\
**Replies:** 7\
**Last updated:** [May 7, 2018, 10:41am UTC](https://discuss.elastic.co/t/how-to-remove-some-text-in-json-file-using-logstash-filter-plugin-which-plugin-to-use/130437 "2018-05-07T10:41:42Z")

</div>

We are trying to load cloudtrail logs into elasticsearch using logstash. But the json is in following format. {"Records":\[{"eventVersion":"1.05","userIdentity":{"type":"AWSService","invokedBy":"config.amazonaws.com"}...…

---

## [Filebeat appears to drop files randomly](https://discuss.elastic.co/t/filebeat-appears-to-drop-files-randomly/99463)

<div class="topic-metadata">

**Author:** [@abd.wsu](https://discuss.elastic.co/u/abd.wsu)\
**Replies:** 7\
**Last updated:** [September 11, 2017, 12:46pm UTC](https://discuss.elastic.co/t/filebeat-appears-to-drop-files-randomly/99463 "2017-09-11T12:46:34Z")

</div>

Hello, I am running filebeat on a server where my script is offloading messages from a queue as a individual files for filebeat to consume. The setup works fine, but every now and then i see the no. of files doesn’t ma…

---

## [How to show number value in percentage in kibana data table](https://discuss.elastic.co/t/how-to-show-number-value-in-percentage-in-kibana-data-table/102111)

<div class="topic-metadata">

**Author:** [@ajit](https://discuss.elastic.co/u/ajit)\
**Replies:** 1\
**Last updated:** [September 28, 2017, 5:48pm UTC](https://discuss.elastic.co/t/how-to-show-number-value-in-percentage-in-kibana-data-table/102111 "2017-09-28T17:48:54Z")

</div>

Suppose I have two fields Subject1 and Subject2. I got 40 marks in subject1 and 50 marks in subject2. I want to show it in percentage %. Please provide solution.

---

## [Elasticsearch 6.2.2 conditional sorting](https://discuss.elastic.co/t/elasticsearch-6-2-2-conditional-sorting/124144)

<div class="topic-metadata">

**Author:** [@Varan](https://discuss.elastic.co/u/Varan)\
**Replies:** 3\
**Last updated:** [March 20, 2018, 9:46am UTC](https://discuss.elastic.co/t/elasticsearch-6-2-2-conditional-sorting/124144 "2018-03-20T09:46:29Z")

</div>

I'm on Elasticsearch 6.2.2. Could I do differents sorts based on a field of an index? #Here I want to sort by age if code=child or by city if code=adult GET index1/\_search { "query": { "match\_all": {} }, …

---

## [Replace document vs update document](https://discuss.elastic.co/t/replace-document-vs-update-document/293549)

<div class="topic-metadata">

**Author:** [@AhmadHamouda](https://discuss.elastic.co/u/AhmadHamouda)\
**Replies:** 1\
**Last updated:** [January 5, 2022, 2:28pm UTC](https://discuss.elastic.co/t/replace-document-vs-update-document/293549 "2022-01-05T14:28:14Z")

</div>

Ill have documents which contain json ex: {id:100, usersIds: \[1,2,54\]} Ill need to update userIds adding some new ids and removing some exist ids My question is it better to replace the whole document or do update oper…

---

## [How to use a Kibana Visualization with own data in a React plugin?](https://discuss.elastic.co/t/how-to-use-a-kibana-visualization-with-own-data-in-a-react-plugin/139846)

<div class="topic-metadata">

**Author:** [@dMusicb](https://discuss.elastic.co/u/dMusicb)\
**Replies:** 4\
**Last updated:** [July 13, 2018, 1:19am UTC](https://discuss.elastic.co/t/how-to-use-a-kibana-visualization-with-own-data-in-a-react-plugin/139846 "2018-07-13T01:19:14Z")

</div>

Trying to find examples of a Visualization being used in a React plugin, but all I seem to find is Angular ones which is hard to follow since the plugin generator generates a React plugin and it's recommended to use Reac…

---

## [Block in coverage\_state Error in Logstash Pipeline](https://discuss.elastic.co/t/block-in-coverage-state-error-in-logstash-pipeline/315040)

<div class="topic-metadata">

**Author:** [@andreakatie](https://discuss.elastic.co/u/andreakatie)\
**Replies:** 2\
**Last updated:** [September 23, 2022, 5:25pm UTC](https://discuss.elastic.co/t/block-in-coverage-state-error-in-logstash-pipeline/315040 "2022-09-23T17:25:42Z")

</div>

Hello all, I am running an ELK stack (Elasticsearch v. 7.1.2, Filebeat v. 7.8.0, and Logstash v. 7.16.3) and recently added the following code to a Logstash .conf template (one of many in the stack which has been succes…

---

## [Elasticsearch indexes - watcher notifications](https://discuss.elastic.co/t/elasticsearch-indexes-watcher-notifications/96723)

<div class="topic-metadata">

**Author:** [@Raj\_Kumar](https://discuss.elastic.co/u/Raj_Kumar)\
**Replies:** 8\
**Last updated:** [August 18, 2017, 12:30pm UTC](https://discuss.elastic.co/t/elasticsearch-indexes-watcher-notifications/96723 "2017-08-18T12:30:55Z")

</div>

Hi All, Iam using elastic stack 5.5 to monitor the netflow and sflow and I have two separate indexes , I view them in kibana , for search and dashboards. If i stop receiving the logs in the indexes, from logstash or th…

---

## [Elasticsearch error when trying to run bin/elasticsearch-setup-passwords](https://discuss.elastic.co/t/elasticsearch-error-when-trying-to-run-bin-elasticsearch-setup-passwords/338625)

<div class="topic-metadata">

**Author:** [@Kris\_U](https://discuss.elastic.co/u/Kris_U)\
**Replies:** 5\
**Last updated:** [July 18, 2023, 2:14pm UTC](https://discuss.elastic.co/t/elasticsearch-error-when-trying-to-run-bin-elasticsearch-setup-passwords/338625 "2023-07-18T14:14:12Z")

</div>

I am setting up Elasticsearch version 7.17.11 on Ubuntu 20.04. It will be a single instance of Elasticsearch but I will have separate instances for Kibana and Logstash. I am trying to recreate our setup in another cloud …

---

## [Correct setting of "es.scroll.size" with for optimal Spark read performance](https://discuss.elastic.co/t/correct-setting-of-es-scroll-size-with-for-optimal-spark-read-performance/91077)

<div class="topic-metadata">

**Author:** [@ntim](https://discuss.elastic.co/u/ntim)\
**Replies:** 1\
**Last updated:** [June 29, 2017, 2:12pm UTC](https://discuss.elastic.co/t/correct-setting-of-es-scroll-size-with-for-optimal-spark-read-performance/91077 "2017-06-29T14:12:24Z")

</div>

Hi, I am using ElasticSearch 5.4.1, Spark 2.1.1 and Elasticsearch Hadoop 5.4.2. I have three nodes with ~250 indices with ~750 shards (no replication) containing ~1.7 billion documents. If I try to query one day wo…

---

## [How can I debug a plugin in an IDE?](https://discuss.elastic.co/t/how-can-i-debug-a-plugin-in-an-ide/56893)

<div class="topic-metadata">

**Author:** [@adityasinghraghav](https://discuss.elastic.co/u/adityasinghraghav)\
**Replies:** 1\
**Last updated:** [August 1, 2016, 1:42pm UTC](https://discuss.elastic.co/t/how-can-i-debug-a-plugin-in-an-ide/56893 "2016-08-01T13:42:06Z")

</div>

I used gradle idea to import the elasticsearch source to IntelliJ and now can run and debug the source. Now I want to start my elasticsearch instance in IntelliJ with a plugin installed(for instance the jvm-example from …

---

## [How to make the object fields available from elastalert](https://discuss.elastic.co/t/how-to-make-the-object-fields-available-from-elastalert/84055)

<div class="topic-metadata">

**Author:** [@mr\_chang7](https://discuss.elastic.co/u/mr_chang7)\
**Replies:** 0\
**Last updated:** [April 28, 2017, 8:13pm UTC](https://discuss.elastic.co/t/how-to-make-the-object-fields-available-from-elastalert/84055 "2017-04-28T20:13:35Z")

</div>

The following is some of the fields from the elastalert; but learned that the match\_body is an object that cannot be recognized/used on kibana. (Kibana index refresh does not get the ? marks away) t index elastalertsta…

---

## [Ingest Pipeline does not update on filebeat setup](https://discuss.elastic.co/t/ingest-pipeline-does-not-update-on-filebeat-setup/142769)

<div class="topic-metadata">

**Author:** [@Tethik](https://discuss.elastic.co/u/Tethik)\
**Replies:** 3\
**Last updated:** [August 2, 2018, 2:27pm UTC](https://discuss.elastic.co/t/ingest-pipeline-does-not-update-on-filebeat-setup/142769 "2018-08-02T14:27:59Z")

</div>

I'm trying to develop two new modules for filebeat, but ran into issues as I was trying to update my pipelines after some trial and error. It seems like they don't update like they should, so this could be a potential is…

[Previous page](https://discuss.elastic.co/top.md?page=696&per_page=50&period=all)

[Next page](https://discuss.elastic.co/top.md?page=698&per_page=50&period=all)
