# Top

**URL:** https://discuss.elastic.co/top.md?page=1767&period=all

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1768

---

## [Elastic Cloud AWS Cloudwatch log integration](https://discuss.elastic.co/t/elastic-cloud-aws-cloudwatch-log-integration/296633)

<div class="topic-metadata">

**Author:** [@spindlerm](https://discuss.elastic.co/u/spindlerm)\
**Replies:** 5\
**Last updated:** [February 9, 2022, 3:17am UTC](https://discuss.elastic.co/t/elastic-cloud-aws-cloudwatch-log-integration/296633 "2022-02-09T03:17:41Z")

</div>

Hi There, I'm on day 2 of my Elastic Cloud trial, I'm confused and am looking for some advice as to how I go about collecting my AWS VPC flowlogs from AWS Cloudwatch. So far I have installed the AWS integration and con…

---

## [Kibana User Session](https://discuss.elastic.co/t/kibana-user-session/285342)

<div class="topic-metadata">

**Author:** [@hiba](https://discuss.elastic.co/u/hiba)\
**Replies:** 5\
**Last updated:** [September 29, 2021, 2:49pm UTC](https://discuss.elastic.co/t/kibana-user-session/285342 "2021-09-29T14:49:06Z")

</div>

Hi team, I have a question that I’m having trouble finding the answer to elsewhere. I would like to create dashboards that customize the data based on the specific user logged in. The response of this api Post : http:…

---

## [Ingesting Data via Python to Elastic](https://discuss.elastic.co/t/ingesting-data-via-python-to-elastic/247230)

<div class="topic-metadata">

**Author:** [@Rahul0711](https://discuss.elastic.co/u/Rahul0711)\
**Replies:** 5\
**Last updated:** [September 4, 2020, 8:52am UTC](https://discuss.elastic.co/t/ingesting-data-via-python-to-elastic/247230 "2020-09-04T08:52:14Z")

</div>

Hello Team I need help in ingesting the data via python into elastic. I have a cert that I have already uploaded the cert on the browser. After pre-processing is completed, I converted dataframe into dict. Now I want to…

---

## [Issue with nGram Analyzer on ECE](https://discuss.elastic.co/t/issue-with-ngram-analyzer-on-ece/208967)

<div class="topic-metadata">

**Author:** [@Francisco\_Noguera](https://discuss.elastic.co/u/Francisco_Noguera)\
**Replies:** 5\
**Last updated:** [November 22, 2019, 6:37pm UTC](https://discuss.elastic.co/t/issue-with-ngram-analyzer-on-ece/208967 "2019-11-22T18:37:39Z")

</div>

Hi, I'm creating a index on ECE with a nGram analyzer but never works the query. This is my index: { "settings": { "analysis": { "analyzer": { "ailabs\_analyzer": { "type": "stop", "stopwords": \["a", …

---

## [Customize the title of share link](https://discuss.elastic.co/t/customize-the-title-of-share-link/187202)

<div class="topic-metadata">

**Author:** [@csholic](https://discuss.elastic.co/u/csholic)\
**Replies:** 5\
**Last updated:** [June 25, 2019, 1:51am UTC](https://discuss.elastic.co/t/customize-the-title-of-share-link/187202 "2019-06-25T01:51:06Z")

</div>

Hi, I'm currently using Kibana for the visualization of our project, I built some charts using the data from Elasticsearch. My manager wants me to share the link of the dashboard so that anyone who has the link can view…

---

## [JMX naming](https://discuss.elastic.co/t/jmx-naming/4204)

<div class="topic-metadata">

**Author:** [@Paul\_Loy](https://discuss.elastic.co/u/Paul_Loy)\
**Replies:** 5\
**Last updated:** [April 8, 2011, 4:06pm UTC](https://discuss.elastic.co/t/jmx-naming/4204 "2011-04-08T16:06:38Z")

</div>

Hi Shay, we're in the last stages of productionising our solution. We are now facing a little issue with the monitoring of our app using JMX. Elasticsearch seems to be adding a random (enough) node id to the name of…

---

## [Elasticsearch upgrade from 2.4.6 to 7.x](https://discuss.elastic.co/t/elasticsearch-upgrade-from-2-4-6-to-7-x/330620)

<div class="topic-metadata">

**Author:** [@iarunava](https://discuss.elastic.co/u/iarunava)\
**Replies:** 7\
**Last updated:** [April 26, 2023, 1:12pm UTC](https://discuss.elastic.co/t/elasticsearch-upgrade-from-2-4-6-to-7-x/330620 "2023-04-26T13:12:14Z")

</div>

Hi. Arunava here. Im trying to upgrade elasticsearch 2.4.6 to 7.17.x Im new to elasticsearch. I would appreciate some pointers. The 7.17 stack is ready. and there is a task defined which tries to bulk insert the data …

---

## [After SAML Configuration, when we try to access we seeing below mentioned error We hit an authentication error. Please check your credentials and try again. If you still can't log in, contact your system administrator](https://discuss.elastic.co/t/after-saml-configuration-when-we-try-to-access-we-seeing-below-mentioned-error-we-hit-an-authentication-error-please-check-your-credentials-and-try-again-if-you-still-cant-log-in-contact-your-system-administrator/316090)

<div class="topic-metadata">

**Author:** [@Elastic\_User3](https://discuss.elastic.co/u/Elastic_User3)\
**Replies:** 1\
**Last updated:** [October 7, 2022, 4:30pm UTC](https://discuss.elastic.co/t/after-saml-configuration-when-we-try-to-access-we-seeing-below-mentioned-error-we-hit-an-authentication-error-please-check-your-credentials-and-try-again-if-you-still-cant-log-in-contact-your-system-administrator/316090 "2022-10-07T16:30:14Z")

</div>

Observed error : We hit an authentication error. Please check your credentials and try again. If you still can't log in, contact your system administrator.

---

## [Creating Custom Field in Kibana and fetching the values from a particular line in message](https://discuss.elastic.co/t/creating-custom-field-in-kibana-and-fetching-the-values-from-a-particular-line-in-message/309889)

<div class="topic-metadata">

**Author:** [@Dhinesh\_Prabakaran](https://discuss.elastic.co/u/Dhinesh_Prabakaran)\
**Replies:** 1\
**Last updated:** [July 19, 2022, 10:19am UTC](https://discuss.elastic.co/t/creating-custom-field-in-kibana-and-fetching-the-values-from-a-particular-line-in-message/309889 "2022-07-19T10:19:34Z")

</div>

Hi All, We've been using ELK to monitor our network and infrastructure logs. We have a requirement. We need to create a custom field name in filebeat so that we can use it as a unique key to filter the log messages in …

---

## [Cluster setup issue when path.data and path.logs are configured](https://discuss.elastic.co/t/cluster-setup-issue-when-path-data-and-path-logs-are-configured/298124)

<div class="topic-metadata">

**Author:** [@Newbie111985](https://discuss.elastic.co/u/Newbie111985)\
**Replies:** 7\
**Last updated:** [February 28, 2022, 9:38am UTC](https://discuss.elastic.co/t/cluster-setup-issue-when-path-data-and-path-logs-are-configured/298124 "2022-02-28T09:38:08Z")

</div>

I am trying to setup a 3 node cluster using Elasticsearch-7.17.0 in linux. I have made the following configurations in elasticsearch.yml file of all 3 nodes: path.data: /some/path/data path.logs: /some/path/logs network…

---

## [Logstash- Create different logfiles for different pipeline](https://discuss.elastic.co/t/logstash-create-different-logfiles-for-different-pipeline/286370)

<div class="topic-metadata">

**Author:** [@praffuln](https://discuss.elastic.co/u/praffuln)\
**Replies:** 1\
**Last updated:** [October 11, 2021, 5:14pm UTC](https://discuss.elastic.co/t/logstash-create-different-logfiles-for-different-pipeline/286370 "2021-10-11T17:14:52Z")

</div>

Hi, I am using logstash log4j2.properties configuration for log controlling e.g. log rotation, log preservation, controlling file name for logging, location of logs etc. Based on below discussion I used to configure lo…

---

## [Is it possible to run a shell script from Kibana?](https://discuss.elastic.co/t/is-it-possible-to-run-a-shell-script-from-kibana/280230)

<div class="topic-metadata">

**Author:** [@danibe](https://discuss.elastic.co/u/danibe)\
**Replies:** 1\
**Last updated:** [August 2, 2021, 9:24pm UTC](https://discuss.elastic.co/t/is-it-possible-to-run-a-shell-script-from-kibana/280230 "2021-08-02T21:24:44Z")

</div>

Is it possible to customize one of the Kibana web pages to have a link/button that runs a shell script (in the server that hosts Kibana) upon clicking it? If so, where do I find documentation or tutorial that explains h…

---

## [Async Search Issue: FORBIDDEN/8/index write (api)](https://discuss.elastic.co/t/async-search-issue-forbidden-8-index-write-api/238221)

<div class="topic-metadata">

**Author:** [@tomx1](https://discuss.elastic.co/u/tomx1)\
**Replies:** 1\
**Last updated:** [June 23, 2020, 4:25pm UTC](https://discuss.elastic.co/t/async-search-issue-forbidden-8-index-write-api/238221 "2020-06-23T16:25:49Z")

</div>

Since upgrading our cluster from 7.6 to 7.8 we are experiencing problems with kibana. We are using elasticsearch for our central logging, we have a logstash index for every single day. If I do a empty kibana search (usin…

---

## [How to specify custom /etc/default file in elasticsearch 7](https://discuss.elastic.co/t/how-to-specify-custom-etc-default-file-in-elasticsearch-7/236540)

<div class="topic-metadata">

**Author:** [@Nestor\_Manrique](https://discuss.elastic.co/u/Nestor_Manrique)\
**Replies:** 1\
**Last updated:** [June 11, 2020, 11:36pm UTC](https://discuss.elastic.co/t/how-to-specify-custom-etc-default-file-in-elasticsearch-7/236540 "2020-06-11T23:36:42Z")

</div>

In the documentation it says explicitly For the package distributions, the config directory location defaults to /etc/elasticsearch . The location of the config directory can also be changed via the ES\_PATH\_CONF env…

---

## [Live/historical charts by elasticsearch documents](https://discuss.elastic.co/t/live-historical-charts-by-elasticsearch-documents/230864)

<div class="topic-metadata">

**Author:** [@JavaDeveloper](https://discuss.elastic.co/u/JavaDeveloper)\
**Replies:** 7\
**Last updated:** [May 4, 2020, 8:13am UTC](https://discuss.elastic.co/t/live-historical-charts-by-elasticsearch-documents/230864 "2020-05-04T08:13:35Z")

</div>

Hi everyone. I want to create real time and historical charts (for example by chart.js library) from the elasticsearch documents. each document has its own date field. So I want to have a linear chart (x axis : time fi…

---

## [Logstash skip records by adding latest updated record date in last run metadata file](https://discuss.elastic.co/t/logstash-skip-records-by-adding-latest-updated-record-date-in-last-run-metadata-file/209309)

<div class="topic-metadata">

**Author:** [@saifrehman](https://discuss.elastic.co/u/saifrehman)\
**Replies:** 1\
**Last updated:** [November 25, 2019, 1:28pm UTC](https://discuss.elastic.co/t/logstash-skip-records-by-adding-latest-updated-record-date-in-last-run-metadata-file/209309 "2019-11-25T13:28:01Z")

</div>

My goal is to set up continuous data migration from MySQL to Elasticsearch. Everything is working fine but I've stuck with :sql\_last\_value. My server and database timezone is in UTC format. Problem: When i update 4 to 6…

---

## [Need help in improving search speed (about 20s) (elastic 6.3)](https://discuss.elastic.co/t/need-help-in-improving-search-speed-about-20s-elastic-6-3/182739)

<div class="topic-metadata">

**Author:** [@Convergence](https://discuss.elastic.co/u/Convergence)\
**Replies:** 7\
**Last updated:** [May 26, 2019, 4:13pm UTC](https://discuss.elastic.co/t/need-help-in-improving-search-speed-about-20s-elastic-6-3/182739 "2019-05-26T16:13:10Z")

</div>

Hello community, I have an elastic search cluster split around 2 nodes (and given 4gb ram to elastic on each). There I have an index containing about 80 million docs. I have split this across 10 shards. There are many a…

---

## [Trouble with Logstash sincedb file](https://discuss.elastic.co/t/trouble-with-logstash-sincedb-file/158882)

<div class="topic-metadata">

**Author:** [@Amedeo\_Avogadro](https://discuss.elastic.co/u/Amedeo_Avogadro)\
**Replies:** 1\
**Last updated:** [December 7, 2018, 11:24am UTC](https://discuss.elastic.co/t/trouble-with-logstash-sincedb-file/158882 "2018-12-07T11:24:06Z")

</div>

Now I have current .conf file for Logstash (6.3): input { file { path =\> "/home/ubuntu/mail/attachment/csv/Scan\_Report/current.csv" start\_position =\> "beginning" stat\_interval =\> 300 #sincedb\_path =\> "/dev/null…

---

## [How to implement dynamic aggregation?](https://discuss.elastic.co/t/how-to-implement-dynamic-aggregation/133917)

<div class="topic-metadata">

**Author:** [@Youxu](https://discuss.elastic.co/u/Youxu)\
**Replies:** 1\
**Last updated:** [June 1, 2018, 4:31pm UTC](https://discuss.elastic.co/t/how-to-implement-dynamic-aggregation/133917 "2018-06-01T16:31:39Z")

</div>

I posted same question on stackoverflow, but would like posting here as well. By dynamic aggregation I means, the aggregation buckets are different per search query. Take ebay as example, if search for "iphone" https://…

---

## [Conditional Include and Exclude Fields](https://discuss.elastic.co/t/conditional-include-and-exclude-fields/129403)

<div class="topic-metadata">

**Author:** [@ronit\_dhingra](https://discuss.elastic.co/u/ronit_dhingra)\
**Replies:** 1\
**Last updated:** [April 27, 2018, 9:45am UTC](https://discuss.elastic.co/t/conditional-include-and-exclude-fields/129403 "2018-04-27T09:45:28Z")

</div>

I am using Terms Aggregation for x-axis. and splitting the series on a specific condition. some terms in x-axis dos not have the field on which split is applied. Can i order the aggregation in such a way that only the …

---

## [Logstash run time error export JAVA\_HOME=/usr/lib/jvm/jre-1.6.0/](https://discuss.elastic.co/t/logstash-run-time-error-export-java-home-usr-lib-jvm-jre-1-6-0/88337)

<div class="topic-metadata">

**Author:** [@filebeater](https://discuss.elastic.co/u/filebeater)\
**Replies:** 1\
**Last updated:** [June 6, 2017, 5:46pm UTC](https://discuss.elastic.co/t/logstash-run-time-error-export-java-home-usr-lib-jvm-jre-1-6-0/88337 "2017-06-06T17:46:49Z")

</div>

Hello, i have a newbie question. I think i have the correct java version, however, i got the following error from running logstash. any pointer is appreciated! echo $JAVA\_HOME /export/apps/jdk/JDK-1\_8\_0\_5 After I upda…

---

## [Logstash aggregate complicated, please help](https://discuss.elastic.co/t/logstash-aggregate-complicated-please-help/83701)

<div class="topic-metadata">

**Author:** [@deatheros](https://discuss.elastic.co/u/deatheros)\
**Replies:** 1\
**Last updated:** [April 26, 2017, 3:31pm UTC](https://discuss.elastic.co/t/logstash-aggregate-complicated-please-help/83701 "2017-04-26T15:31:27Z")

</div>

Hi there I'm trying to create aggregation filter for my email exim logs. Can you help me? Basically I have logs like these: 2017-04-10 00:00:30 1cxKsn-0001GB-2t CTAS=IN RefID= ( ISpam= IFlags=v=2.2 cv=Op4/823t c=1 sm…

---

## [Is It Possible To See the JSON Query Generated By QueryBuilder](https://discuss.elastic.co/t/is-it-possible-to-see-the-json-query-generated-by-querybuilder/55618)

<div class="topic-metadata">

**Author:** [@dadepo](https://discuss.elastic.co/u/dadepo)\
**Replies:** 1\
**Last updated:** [July 15, 2016, 4:59pm UTC](https://discuss.elastic.co/t/is-it-possible-to-see-the-json-query-generated-by-querybuilder/55618 "2016-07-15T16:59:18Z")

</div>

Is there any facility when using the QueryBuilder in Java to dump/extract/see the JSON that the builders generates?

---

## [Migrating from access control to shield / Make deny the default](https://discuss.elastic.co/t/migrating-from-access-control-to-shield-make-deny-the-default/36903)

<div class="topic-metadata">

**Author:** [@xyz](https://discuss.elastic.co/u/xyz)\
**Replies:** 1\
**Last updated:** [December 15, 2015, 6:57pm UTC](https://discuss.elastic.co/t/migrating-from-access-control-to-shield-make-deny-the-default/36903 "2015-12-15T18:57:53Z")

</div>

I want to upgrade our elasticsearch instance from 1.6.x to 2.1. There is the new shield configuration. We use 2 indices. One for search requests from the application with a lot of details and another where we have inde…

---

## [What is ES / Marvel doing to my configurations?](https://discuss.elastic.co/t/what-is-es-marvel-doing-to-my-configurations/21496)

<div class="topic-metadata">

**Author:** [@Chris\_Neal](https://discuss.elastic.co/u/Chris_Neal)\
**Replies:** 7\
**Last updated:** [January 13, 2015, 7:32am UTC](https://discuss.elastic.co/t/what-is-es-marvel-doing-to-my-configurations/21496 "2015-01-13T07:32:55Z")

</div>

Hi all. My elasticsearch.yml file has these settings with regards to merging: index: codec: bloom: load: false merge: policy: max\_merge\_at\_once: 4 max\_merge\_at\_once\_explicit: 4 …

---

## [Recommended jre version/update for Elasticsearch 1.0.0.Beta2](https://discuss.elastic.co/t/recommended-jre-version-update-for-elasticsearch-1-0-0-beta2/15686)

<div class="topic-metadata">

**Author:** [@Ia\_Soudina](https://discuss.elastic.co/u/Ia_Soudina)\
**Replies:** 7\
**Last updated:** [February 10, 2014, 11:02pm UTC](https://discuss.elastic.co/t/recommended-jre-version-update-for-elasticsearch-1-0-0-beta2/15686 "2014-02-10T23:02:28Z")

</div>

Hi, I heard before that jre 7u40 to 7u45 were not recommended to use with Elasticsearch. I used jre-7u25 with Elasticsearch 0.90.x We are now using Beta2 version, and i noticed that latest java update is jre-7u51,…

---

## [How to use multiple snapshot repository directory's](https://discuss.elastic.co/t/how-to-use-multiple-snapshot-repository-directorys/321991)

<div class="topic-metadata">

**Author:** [@Santhosh\_K](https://discuss.elastic.co/u/Santhosh_K)\
**Replies:** 2\
**Last updated:** [December 27, 2022, 5:26am UTC](https://discuss.elastic.co/t/how-to-use-multiple-snapshot-repository-directorys/321991 "2022-12-27T05:26:37Z")

</div>

Hi, I have to use multiple snapshot repositories, Does that support multiple directories, if so, how? I want to know how to put multiple snapshot repository directory's in elasticsearch.yml file. And what about singl…

---

## [Merge data and metadata csv file in logstash](https://discuss.elastic.co/t/merge-data-and-metadata-csv-file-in-logstash/295815)

<div class="topic-metadata">

**Author:** [@danova](https://discuss.elastic.co/u/danova)\
**Replies:** 2\
**Last updated:** [January 31, 2022, 8:13pm UTC](https://discuss.elastic.co/t/merge-data-and-metadata-csv-file-in-logstash/295815 "2022-01-31T20:13:05Z")

</div>

Hi, I´m trying to import/combine two csv files as follows logstash\_metadata.csv: Sample,Treatment,Code S4444003,T\_7896\_D3,G10 S4444004,T\_4516\_D0t1h,G01 logstash\_file.csv: Sample,genus,value S4444003,Chloronema…

---

## [Using workpad variables in esql queries](https://discuss.elastic.co/t/using-workpad-variables-in-esql-queries/284235)

<div class="topic-metadata">

**Author:** [@IGB042](https://discuss.elastic.co/u/IGB042)\
**Replies:** 2\
**Last updated:** [September 22, 2021, 10:51pm UTC](https://discuss.elastic.co/t/using-workpad-variables-in-esql-queries/284235 "2021-09-22T22:51:54Z")

</div>

I am developing a report in Canvas currently and several elements use the same field within their esql queries. As it is intended that this workpad would be cloned it would be really useful to use a variable in the query …

---

## [Question regarding the name field in references object when Importing Kibana Objects](https://discuss.elastic.co/t/question-regarding-the-name-field-in-references-object-when-importing-kibana-objects/218704)

<div class="topic-metadata">

**Author:** [@ecarmona](https://discuss.elastic.co/u/ecarmona)\
**Replies:** 2\
**Last updated:** [February 12, 2020, 10:37pm UTC](https://discuss.elastic.co/t/question-regarding-the-name-field-in-references-object-when-importing-kibana-objects/218704 "2020-02-12T22:37:31Z")

</div>

Dear All, I have been working in a script that replicates all the Kibana objects (index-patterns, searches, visualizations and dashboards) from a source server into others. I am using the Bulk Create Saved Objects API,…

---

## [Elasticsearch7.4 multinode cluster - Bootstrap Service discovery on Openshift cluster](https://discuss.elastic.co/t/elasticsearch7-4-multinode-cluster-bootstrap-service-discovery-on-openshift-cluster/217356)

<div class="topic-metadata">

**Author:** [@bishtj](https://discuss.elastic.co/u/bishtj)\
**Replies:** 2\
**Last updated:** [January 31, 2020, 11:52am UTC](https://discuss.elastic.co/t/elasticsearch7-4-multinode-cluster-bootstrap-service-discovery-on-openshift-cluster/217356 "2020-01-31T11:52:06Z")

</div>

Hi, I am working on upgrading 3 node cluster elasticsearch5.5 hosted on openshift to elasticsearch7.4. Everything works on dev/qa ( single node cluster). My solution is to create brand new cluster and then migrate his…

---

## [Logstash updating the data not working](https://discuss.elastic.co/t/logstash-updating-the-data-not-working/163862)

<div class="topic-metadata">

**Author:** [@inandi](https://discuss.elastic.co/u/inandi)\
**Replies:** 2\
**Last updated:** [January 11, 2019, 8:42am UTC](https://discuss.elastic.co/t/logstash-updating-the-data-not-working/163862 "2019-01-11T08:42:42Z")

</div>

logstash.conf file input { file { path =\> "/var/www/html/review/EsData/review\_data.json" start\_position =\> "beginning" sincedb\_path =\> "/dev/null" codec =\> "json" } } filter { } output { …

---

## [Filebeat has problem to record new lines separated](https://discuss.elastic.co/t/filebeat-has-problem-to-record-new-lines-separated/155040)

<div class="topic-metadata">

**Author:** [@bab](https://discuss.elastic.co/u/bab)\
**Replies:** 2\
**Last updated:** [November 1, 2018, 6:34pm UTC](https://discuss.elastic.co/t/filebeat-has-problem-to-record-new-lines-separated/155040 "2018-11-01T18:34:57Z")

</div>

Hi I have following lines, and I am using filebeat to publish this data to logstash and then trying to extract values using grok in Logstash filter, untell now every thing is good (new pattern, multiline config , etc...…

---

## [Multi-cluster Kubernetes monitoring - best practices? Cluster name field?](https://discuss.elastic.co/t/multi-cluster-kubernetes-monitoring-best-practices-cluster-name-field/143990)

<div class="topic-metadata">

**Author:** [@Yoav\_Zuri](https://discuss.elastic.co/u/Yoav_Zuri)\
**Replies:** 2\
**Last updated:** [August 14, 2018, 4:37pm UTC](https://discuss.elastic.co/t/multi-cluster-kubernetes-monitoring-best-practices-cluster-name-field/143990 "2018-08-14T16:37:31Z")

</div>

Hi, I want to monitor multiple Kubernetes Clusters to one ES cluster using Filebeats. Are there any best practices on how to separate the monitored clusters? Can I add custom field to Beats per cluster? So it'll send …

---

## [Filebeat not publishing multi-line event after timeout](https://discuss.elastic.co/t/filebeat-not-publishing-multi-line-event-after-timeout/137235)

<div class="topic-metadata">

**Author:** [@dev.net](https://discuss.elastic.co/u/dev.net)\
**Replies:** 2\
**Last updated:** [June 25, 2018, 3:18pm UTC](https://discuss.elastic.co/t/filebeat-not-publishing-multi-line-event-after-timeout/137235 "2018-06-25T15:18:02Z")

</div>

Hi, I have configured filebeat with a multi line pattern to watch log files that will be written to once and contain a single root XML element with no XML declaration. Sometimes the root XML element can span multiple li…

---

## [Can't find error "\_grokparsefailure" IIS Advanced Logs](https://discuss.elastic.co/t/cant-find-error-grokparsefailure-iis-advanced-logs/113773)

<div class="topic-metadata">

**Author:** [@cassiodeveloper](https://discuss.elastic.co/u/cassiodeveloper)\
**Replies:** 2\
**Last updated:** [January 5, 2018, 11:46am UTC](https://discuss.elastic.co/t/cant-find-error-grokparsefailure-iis-advanced-logs/113773 "2018-01-05T11:46:53Z")

</div>

Hello everyone, I can't find the error on logstash using grok filter. My config file: input { file { type =\> "iis" path =\> "C:/inetpub/logs/LogFiles/AdvancedLogs/\*.log" } } filter { if \[message\] =~ "^#" { d…

---

## [Filebeat: Variables in Output Hosts Doesn't Work](https://discuss.elastic.co/t/filebeat-variables-in-output-hosts-doesnt-work/106226)

<div class="topic-metadata">

**Author:** [@derekcal](https://discuss.elastic.co/u/derekcal)\
**Replies:** 2\
**Last updated:** [November 2, 2017, 9:16pm UTC](https://discuss.elastic.co/t/filebeat-variables-in-output-hosts-doesnt-work/106226 "2017-11-02T21:16:40Z")

</div>

Is there a way to include variables in output hosts? For example filebeat.yml filebeat: config\_dir: "/var/filebeat/conf.d" output.kafka: hosts: "%{\[fields.mybrokers\]}" topic: "%{\[fields.mytopic\]}" conf.d/myc…

---

## [ElasticSearch REST client](https://discuss.elastic.co/t/elasticsearch-rest-client/85815)

<div class="topic-metadata">

**Author:** [@venkata\_sreekanth\_bh](https://discuss.elastic.co/u/venkata_sreekanth_bh)\
**Replies:** 2\
**Last updated:** [May 16, 2017, 4:12pm UTC](https://discuss.elastic.co/t/elasticsearch-rest-client/85815 "2017-05-16T16:12:33Z")

</div>

Can we keep the rest client alive through out the application life cycle. or do we need to close the client after each request. final RestClient restClient = RestClient.builder(new HttpHost("localhost", 9200, "http")).…

---

## [NoClassDefFoundError issue when use PreBuiltTransportClient](https://discuss.elastic.co/t/noclassdeffounderror-issue-when-use-prebuilttransportclient/71319)

<div class="topic-metadata">

**Author:** [@AmazoneWebService](https://discuss.elastic.co/u/AmazoneWebService)\
**Replies:** 2\
**Last updated:** [January 12, 2017, 9:29am UTC](https://discuss.elastic.co/t/noclassdeffounderror-issue-when-use-prebuilttransportclient/71319 "2017-01-12T09:29:18Z")

</div>

When running PreBuiltTransportClient in ES 5.1 environment, the following error occurs. it is my pom.xml I deleted the 2.3 version, and registered the 5.1 version of the transport. and i changed the log4j versi…

---

## [Logstah do not parse csv](https://discuss.elastic.co/t/logstah-do-not-parse-csv/54762)

<div class="topic-metadata">

**Author:** [@antonin42](https://discuss.elastic.co/u/antonin42)\
**Replies:** 2\
**Last updated:** [July 6, 2016, 7:07am UTC](https://discuss.elastic.co/t/logstah-do-not-parse-csv/54762 "2016-07-06T07:07:04Z")

</div>

Hi there with a simple config, to check that logstash works correctly, I get no output : input { file { path =\> \["/home/dive/fromJenkins/es\_files/data/MRC\_reit\_test/output/reiteration\_t1\_mono\*.csv"\] start\_po…

---

## [Parent-child join and time-based indexes](https://discuss.elastic.co/t/parent-child-join-and-time-based-indexes/48433)

<div class="topic-metadata">

**Author:** [@fassisrosa](https://discuss.elastic.co/u/fassisrosa)\
**Replies:** 2\
**Last updated:** [April 29, 2016, 1:37pm UTC](https://discuss.elastic.co/t/parent-child-join-and-time-based-indexes/48433 "2016-04-29T13:37:16Z")

</div>

Here is a short description of my problem, we have: \*) One to many relation with lots of documents (hundreds of thousands) on the one side, and a large size on the many side (a couple of thousand per document on the on…

---

## [Global variables](https://discuss.elastic.co/t/global-variables/46943)

<div class="topic-metadata">

**Author:** [@Sai\_Birada](https://discuss.elastic.co/u/Sai_Birada)\
**Replies:** 2\
**Last updated:** [April 11, 2016, 6:16am UTC](https://discuss.elastic.co/t/global-variables/46943 "2016-04-11T06:16:06Z")

</div>

My data is in the format Feb 22 23:13:35 ams2-eu2-c-smsm query\[84218\]: { Zqlquery : { Select: { Fieldnames: \[1, respsize, reqsize\] }, { FieldTypes: \[LONG, U\_INT, U\_INT\] }, { Functionames: \[count, sum, +\] }} , { W…

---

## [Unable to index xml file properly using logstash](https://discuss.elastic.co/t/unable-to-index-xml-file-properly-using-logstash/42318)

<div class="topic-metadata">

**Author:** [@sdaruna](https://discuss.elastic.co/u/sdaruna)\
**Replies:** 2\
**Last updated:** [February 22, 2016, 6:52pm UTC](https://discuss.elastic.co/t/unable-to-index-xml-file-properly-using-logstash/42318 "2016-02-22T18:52:16Z")

</div>

Hi, I am trying to index big xml file. Below is my xml file. input { file { path =\> "/Users/srini/Downloads/imp/2016-01-27/\*.xml" start\_position =\> "beginning" } } filter { xml { s…

---

## [Scripted date field from timestamp](https://discuss.elastic.co/t/scripted-date-field-from-timestamp/41175)

<div class="topic-metadata">

**Author:** [@Croos](https://discuss.elastic.co/u/Croos)\
**Replies:** 2\
**Last updated:** [February 8, 2016, 7:41pm UTC](https://discuss.elastic.co/t/scripted-date-field-from-timestamp/41175 "2016-02-08T19:41:20Z")

</div>

how to create a scripted date field from timestamp in kibana?

---

## [Heap OOM.. after running for a long time](https://discuss.elastic.co/t/heap-oom-after-running-for-a-long-time/14699)

<div class="topic-metadata">

**Author:** [@Klavs\_Klavsen](https://discuss.elastic.co/u/Klavs_Klavsen)\
**Replies:** 2\
**Last updated:** [December 4, 2013, 11:23am UTC](https://discuss.elastic.co/t/heap-oom-after-running-for-a-long-time/14699 "2013-12-04T11:23:44Z")

</div>

elasticsearch 0.90.6 just crashed on me.. :( I have given it 16GB Heap space.. -Xms16051M -Xmx16051M -Xss256k Error in log was: \[2013-12-04 11:05:20,111\]\[DEBUG\]\[action.search.type \] \[Necrodamus\] \[logstash-…

---

## [Is Bulk Percolation possible?](https://discuss.elastic.co/t/is-bulk-percolation-possible/11485)

<div class="topic-metadata">

**Author:** [@Mohammady\_Mahdy](https://discuss.elastic.co/u/Mohammady_Mahdy)\
**Replies:** 2\
**Last updated:** [April 9, 2013, 5:23am UTC](https://discuss.elastic.co/t/is-bulk-percolation-possible/11485 "2013-04-09T05:23:37Z")

</div>

I have a use case were I am receiving a constant stream of documents (on the scale of a thousand document every couple of seconds). and I have a functionality were certain users are interested in only a subset of thi…

---

## [Elasticsearch throws exceptions while using with logstash and kibana](https://discuss.elastic.co/t/elasticsearch-throws-exceptions-while-using-with-logstash-and-kibana/11397)

<div class="topic-metadata">

**Author:** [@Sunny\_Jaisinghani](https://discuss.elastic.co/u/Sunny_Jaisinghani)\
**Replies:** 2\
**Last updated:** [April 2, 2013, 4:56am UTC](https://discuss.elastic.co/t/elasticsearch-throws-exceptions-while-using-with-logstash-and-kibana/11397 "2013-04-02T04:56:29Z")

</div>

Hello Experts, I am new to elasticsearch and i am using elasticsearch in embedded mode with logstash. I have recently started exploring logstash after i heard it from my peers who attended puppetconf 2012 W…

---

## [Setting up "private" field in mapping, with \_source enabled?](https://discuss.elastic.co/t/setting-up-private-field-in-mapping-with--source-enabled/11375)

<div class="topic-metadata">

**Author:** [@Damien\_Alexandre](https://discuss.elastic.co/u/Damien_Alexandre)\
**Replies:** 2\
**Last updated:** [March 29, 2013, 11:46am UTC](https://discuss.elastic.co/t/setting-up-private-field-in-mapping-with--source-enabled/11375 "2013-03-29T11:46:45Z")

</div>

Hi folks, I'm new to mapping in ES and I have a need: I'm indexing some Documents, those documents can have a field or two that I do not want in the response but I want to be able to search on them (they should…

---

## [opType create does not seem to create duplicates](https://discuss.elastic.co/t/optype-create-does-not-seem-to-create-duplicates/2976)

<div class="topic-metadata">

**Author:** [@Paul\_Loy](https://discuss.elastic.co/u/Paul_Loy)\
**Replies:** 2\
**Last updated:** [May 26, 2010, 10:23am UTC](https://discuss.elastic.co/t/optype-create-does-not-seem-to-create-duplicates/2976 "2010-05-26T10:23:02Z")

</div>

Hi, in the documentationhttp://www.elasticsearch.com/docs/elasticsearch/rest\_api/index/#Operation\_Typeit states that: "If the op\_type is set to create, and there is already an existing document with the same type an…

---

## [Metricbeat dashboard strange behaviour](https://discuss.elastic.co/t/metricbeat-dashboard-strange-behaviour/267401)

<div class="topic-metadata">

**Author:** [@alfredo.deluca](https://discuss.elastic.co/u/alfredo.deluca)\
**Replies:** 8\
**Last updated:** [April 20, 2021, 11:01am UTC](https://discuss.elastic.co/t/metricbeat-dashboard-strange-behaviour/267401 "2021-04-20T11:01:11Z")

</div>

Hi all. I am using elastic.co cloud 7.11.1 and I have 2 different metricbeat sitting in 2 different k8s clusters sending all the metrics to ELK. The first one works fine and I can see all the metrics in kibana but when…

[Previous page](https://discuss.elastic.co/top.md?page=1766&per_page=50&period=all)

[Next page](https://discuss.elastic.co/top.md?page=1768&per_page=50&period=all)
