# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1906 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1907 --- ## [Elastic search as a service](https://discuss.elastic.co/t/elastic-search-as-a-service/242384)
**Author:** [@deyujjal70](https://discuss.elastic.co/u/deyujjal70)\ **Replies:** 1\ **Last updated:** [July 26, 2020, 11:02pm UTC](https://discuss.elastic.co/t/elastic-search-as-a-service/242384 "2020-07-26T23:02:41Z")
Hello All ,I am new to elastic search .I have recenly built 4 node elastic search .1 master node,2 master+data and 1 Dedicated data node.We have installed ES using the tar file on redhat 7. We are not using Root access.… --- ## [About Authenticates to Hadoop](https://discuss.elastic.co/t/about-authenticates-to-hadoop/242447)
**Author:** [@loopong](https://discuss.elastic.co/u/loopong)\ **Replies:** 0\ **Last updated:** [July 24, 2020, 5:01am UTC](https://discuss.elastic.co/t/about-authenticates-to-hadoop/242447 "2020-07-24T05:01:24Z")
I‘m using the repository-hdfs plugin to back up our indices. I know that we can use the keytab file in ES\_HOME/config/repository-hdfs/krb5.keytab to get Authenticates to Hadoop, but is there any other ways? For example, … --- ## [Get a count of values from the most recent document](https://discuss.elastic.co/t/get-a-count-of-values-from-the-most-recent-document/242474)
**Author:** [@Miguel\_BA](https://discuss.elastic.co/u/Miguel_BA)\ **Replies:** 0\ **Last updated:** [July 24, 2020, 7:49am UTC](https://discuss.elastic.co/t/get-a-count-of-values-from-the-most-recent-document/242474 "2020-07-24T07:49:10Z")
I can't get a count of fields with a filtered document value. I have this json { "took" : 6, "timed\_out" : false, "\_shards" : { "total" : 1, "successful" : 1, "skipped" : 0, "failed" : 0 }, "hi… --- ## [Mapping different logs into a single index or keep separate?](https://discuss.elastic.co/t/mapping-different-logs-into-a-single-index-or-keep-separate/242482)
**Author:** [@Norman\_Khine](https://discuss.elastic.co/u/Norman_Khine)\ **Replies:** 1\ **Last updated:** [July 26, 2020, 10:58pm UTC](https://discuss.elastic.co/t/mapping-different-logs-into-a-single-index-or-keep-separate/242482 "2020-07-26T22:58:21Z")
Hello, we are considering mapping all the ELB, ALB, CloudFront and API Gateway logs into a single json structure and pushing this for analysis in an ES cluster. is this the right way to go about or should we push each … --- ## [Bootstrap method initialization exception - Elasticsearch 7.8.0](https://discuss.elastic.co/t/bootstrap-method-initialization-exception-elasticsearch-7-8-0/242588)
**Author:** [@dpadasala93](https://discuss.elastic.co/u/dpadasala93)\ **Replies:** 0\ **Last updated:** [July 25, 2020, 5:04am UTC](https://discuss.elastic.co/t/bootstrap-method-initialization-exception-elasticsearch-7-8-0/242588 "2020-07-25T05:04:29Z")
Hi Team, Using java-high-level-rest client when we call getMapping for index or create index functions below errors get generated every time. almost for all the index related calls are generating this exception. bootst… --- ## [Create index pattern with python](https://discuss.elastic.co/t/create-index-pattern-with-python/242633)
**Author:** [@momora9809](https://discuss.elastic.co/u/momora9809)\ **Replies:** 0\ **Last updated:** [July 26, 2020, 7:22am UTC](https://discuss.elastic.co/t/create-index-pattern-with-python/242633 "2020-07-26T07:22:14Z")
Hi, How can I set index pattern with python, before putting any docs? I came up with this, am I on the right tracks? query = "settings": { "number\_of\_shards": 2, "number\_of\_replicas": 1, "mapp… --- ## [Kibana stuck on Elastic loading screen on Chrome](https://discuss.elastic.co/t/kibana-stuck-on-elastic-loading-screen-on-chrome/240504)
**Author:** [@NoNu](https://discuss.elastic.co/u/NoNu)\ **Replies:** 3\ **Last updated:** [July 26, 2020, 10:25pm UTC](https://discuss.elastic.co/t/kibana-stuck-on-elastic-loading-screen-on-chrome/240504 "2020-07-26T22:25:40Z")
I updated Chrome and now I can log into Kibana, but right after it gets stuck on the "Loading Elastic" screen. Chrome console has these errors: kibana#/discover:342 Refused to execute inline script because it violates t… --- ## [Facing issues while installing kibana version 7.8.0 on windows 10](https://discuss.elastic.co/t/facing-issues-while-installing-kibana-version-7-8-0-on-windows-10/240492)
**Author:** [@nilbak](https://discuss.elastic.co/u/nilbak)\ **Replies:** 6\ **Last updated:** [July 26, 2020, 10:23pm UTC](https://discuss.elastic.co/t/facing-issues-while-installing-kibana-version-7-8-0-on-windows-10/240492 "2020-07-26T22:23:08Z")
Hi All, I am new to ELK stack. I was trying to download and install ELK with latest version . I was able to install Elasticsearch successfully but was not able to install Kibana because of below errors. log \[04:42… --- ## [Failed to execute action {:action=\>LogStash::PipelineAction::Create/pipeline\_id:main, :exception=\>"LogStash::ConfigurationError", :message=\>"Expected one of \[A-Za-z0-9\_-\], \[ \\\\t\\\\r\\\\n\]](https://discuss.elastic.co/t/failed-to-execute-action-action-logstash-create-pipeline-id-main-exception-logstash-configurationerror-message-expected-one-of-a-za-z0-9-t-r-n/242613)
**Author:** [@abhijeet\_sinha](https://discuss.elastic.co/u/abhijeet_sinha)\ **Replies:** 3\ **Last updated:** [July 26, 2020, 4:40pm UTC](https://discuss.elastic.co/t/failed-to-execute-action-action-logstash-create-pipeline-id-main-exception-logstash-configurationerror-message-expected-one-of-a-za-z0-9-t-r-n/242613 "2020-07-26T16:40:59Z")
Hi, I'm trying to set up ELK stack and while setting up pipeline in logstash is gave me error: \[ERROR\]\[logstash.agent \] Failed to execute action {:action=\>LogStash::PipelineAction::Create/pipeline\_id:main, :ex… --- ## [Need 6 months of log data in to ELK](https://discuss.elastic.co/t/need-6-months-of-log-data-in-to-elk/242437)
**Author:** [@nikhilesh](https://discuss.elastic.co/u/nikhilesh)\ **Replies:** 1\ **Last updated:** [July 26, 2020, 2:30pm UTC](https://discuss.elastic.co/t/need-6-months-of-log-data-in-to-elk/242437 "2020-07-26T14:30:18Z")
Hi Team, I have a requirement to fetch the 6 months of log data in to the Elasticsearch , is that possible? for suppose, if i install filebeat now, how many day/months of data will come to elastic search. Please help … --- ## [Bulk API item error types](https://discuss.elastic.co/t/bulk-api-item-error-types/242639)
**Author:** [@Munawwar1](https://discuss.elastic.co/u/Munawwar1)\ **Replies:** 1\ **Last updated:** [July 26, 2020, 12:11pm UTC](https://discuss.elastic.co/t/bulk-api-item-error-types/242639 "2020-07-26T12:11:02Z")
Hi. I am trying to differentiate validation errors from intermittent errors from bulk index API. So let's say I tried to index 3 documents, and one failed.. I want to retry the indexing only if it was an intermittent er… --- ## [Get all the Records from the Scroll not working](https://discuss.elastic.co/t/get-all-the-records-from-the-scroll-not-working/242650)
**Author:** [@Asad\_Iftikhar94](https://discuss.elastic.co/u/Asad_Iftikhar94)\ **Replies:** 0\ **Last updated:** [July 26, 2020, 11:50am UTC](https://discuss.elastic.co/t/get-all-the-records-from-the-scroll-not-working/242650 "2020-07-26T11:50:25Z")
I am trying to get all the records from the index the issue i am having is that i cannot get all the reocrds using Scroll filters.Add(new TermsQuery { Field = new Field("MERCHANTN… --- ## [Function\_score is so slow . how can i slove it?](https://discuss.elastic.co/t/function-score-is-so-slow-how-can-i-slove-it/242636)
**Author:** [@liutao053877](https://discuss.elastic.co/u/liutao053877)\ **Replies:** 6\ **Last updated:** [July 26, 2020, 11:03am UTC](https://discuss.elastic.co/t/function-score-is-so-slow-how-can-i-slove-it/242636 "2020-07-26T11:03:09Z")
just like this . : https://discuss.elastic.co/t/simple-function-score-query-shows-very-poor-performance/274 I use the version es 6.8. I write a rescore plugin in java and the speed is so slow . I rescore need to fetc… --- ## [Elasticsearch Client for high performance](https://discuss.elastic.co/t/elasticsearch-client-for-high-performance/242642)
**Author:** [@bastimm](https://discuss.elastic.co/u/bastimm)\ **Replies:** 1\ **Last updated:** [July 26, 2020, 10:05am UTC](https://discuss.elastic.co/t/elasticsearch-client-for-high-performance/242642 "2020-07-26T10:05:36Z")
Hello, everyone, some years ago I wrote a search server for several webshops. Currently the search is based on Elasticsearch-5 and PHP and an Elasticsearch server. Now I want to create this search completely new. The g… --- ## [Using "pg" gem for ruby filter plugin](https://discuss.elastic.co/t/using-pg-gem-for-ruby-filter-plugin/242637)
**Author:** [@Ayan\_Saha](https://discuss.elastic.co/u/Ayan_Saha)\ **Replies:** 0\ **Last updated:** [July 26, 2020, 7:54am UTC](https://discuss.elastic.co/t/using-pg-gem-for-ruby-filter-plugin/242637 "2020-07-26T07:54:49Z")
Hi, I am very new to logstash and facing problem when tried to use 'pg' in ruby filter plugin for sql query. This is my config file input { jdbc { # Postgres jdbc connection string to our datab… --- ## [Is ID query faster than terms?](https://discuss.elastic.co/t/is-id-query-faster-than-terms/242623)
**Author:** [@cynosureabu](https://discuss.elastic.co/u/cynosureabu)\ **Replies:** 1\ **Last updated:** [July 26, 2020, 4:53am UTC](https://discuss.elastic.co/t/is-id-query-faster-than-terms/242623 "2020-07-26T04:53:51Z")
So I am trying to save comment objects to ES, should I just use comment\_id as the native \_id field? Later if I am to retrieve 500 comments, will query by ids { "query": { "ids" : { "values" : \[id1, id2, ...\] } } … --- ## [Filter Out word in Kibana](https://discuss.elastic.co/t/filter-out-word-in-kibana/238098)
**Author:** [@Jim\_Thunder](https://discuss.elastic.co/u/Jim_Thunder)\ **Replies:** 3\ **Last updated:** [July 25, 2020, 10:14pm UTC](https://discuss.elastic.co/t/filter-out-word-in-kibana/238098 "2020-07-25T22:14:29Z")
In Kibana, I'm trying to filter out all instances of a field that match this: \<3 letters\>\<4 numbers\>\<1 letter\> No spaces or anything. Can anyone help me with that? --- ## [How To Add a Hack New Plugins](https://discuss.elastic.co/t/how-to-add-a-hack-new-plugins/237965)
**Author:** [@aaron-nimocks](https://discuss.elastic.co/u/aaron-nimocks)\ **Replies:** 5\ **Last updated:** [July 25, 2020, 10:07pm UTC](https://discuss.elastic.co/t/how-to-add-a-hack-new-plugins/237965 "2020-07-25T22:07:39Z")
There is plenty of documentation on how to add a hack in kibana.plugin using UI exports. How do you add them with the new plugin structure? I generated the plugin and using 7.7.2. I assume it goes somewhere in here. i… --- ## [Is there a way to update by Aggregation results](https://discuss.elastic.co/t/is-there-a-way-to-update-by-aggregation-results/242617)
**Author:** [@WoH](https://discuss.elastic.co/u/WoH)\ **Replies:** 0\ **Last updated:** [July 25, 2020, 8:13pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-update-by-aggregation-results/242617 "2020-07-25T20:13:04Z")
I'm looking to update a large amount of documents. I am able to update individual documents if I use the following script where MD51 and MD52 are the actual values that I enter. { "script": { "source"… --- ## [Filter for Multivalues field not working](https://discuss.elastic.co/t/filter-for-multivalues-field-not-working/242611)
**Author:** [@Karthi96](https://discuss.elastic.co/u/Karthi96)\ **Replies:** 0\ **Last updated:** [July 25, 2020, 5:42pm UTC](https://discuss.elastic.co/t/filter-for-multivalues-field-not-working/242611 "2020-07-25T17:42:03Z")
Hi All, I'm trying to filter a multivalued field from ES but unfortunately, it's not working. GET/\_search{ "query": { "bool": { "must": { "multi\_match": { "fields": \[ "title^3"… --- ## [Trouble with logstash pipeline creating es index](https://discuss.elastic.co/t/trouble-with-logstash-pipeline-creating-es-index/242397)
**Author:** [@jwade](https://discuss.elastic.co/u/jwade)\ **Replies:** 4\ **Last updated:** [July 25, 2020, 11:31am UTC](https://discuss.elastic.co/t/trouble-with-logstash-pipeline-creating-es-index/242397 "2020-07-25T11:31:02Z")
I am attempting to ingest this logfile: ---,36.25, 30.14, 0.01, 0.01, 26.36, 23.92, 23.68 ---,36.25, 30.15, 0.01, 0.01, 26.36, 24.04, 23.68 ---,36.26, 30.14, 0.01, 0.01, 26.36, 24.04, 23.68 ---,36.25,… --- ## [Create repository throws error on creation](https://discuss.elastic.co/t/create-repository-throws-error-on-creation/242593)
**Author:** [@Tudor\_Frincu](https://discuss.elastic.co/u/Tudor_Frincu)\ **Replies:** 1\ **Last updated:** [July 25, 2020, 9:27am UTC](https://discuss.elastic.co/t/create-repository-throws-error-on-creation/242593 "2020-07-25T09:27:51Z")
I am trying to take a snapshot for a elasticsearch cluster.The design is the following. There are 3 VMs that run 1 master, 1 data and 1 client node each in Docker containers. Each VM has a volume attached for storing. So… --- ## [How to filter beat data by version on logstash?](https://discuss.elastic.co/t/how-to-filter-beat-data-by-version-on-logstash/242591)
**Author:** [@varun1992](https://discuss.elastic.co/u/varun1992)\ **Replies:** 2\ **Last updated:** [July 25, 2020, 9:08am UTC](https://discuss.elastic.co/t/how-to-filter-beat-data-by-version-on-logstash/242591 "2020-07-25T09:08:39Z")
How to filter beat data by version on logstash ? I tried code as belw on logstash config , but it did not work. I want to filter out version 6.8.6 data input { beats { port =\> 5044 } } filter { if \[agent.versi… --- ## [Modelling to Elastic Common Schema (ECS): Best practices in logstash](https://discuss.elastic.co/t/modelling-to-elastic-common-schema-ecs-best-practices-in-logstash/242597)
**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\ **Replies:** 0\ **Last updated:** [July 25, 2020, 8:22am UTC](https://discuss.elastic.co/t/modelling-to-elastic-common-schema-ecs-best-practices-in-logstash/242597 "2020-07-25T08:22:15Z")
hi Being a big fan of ECS, I understand most of them are built-in for known products and technology if beats does it, but how to tackle it at logstash? My scenario is like Data arrives to data lake via syslog and is … --- ## [Delete\_by\_query optimization](https://discuss.elastic.co/t/delete-by-query-optimization/242590)
**Author:** [@ness1602](https://discuss.elastic.co/u/ness1602)\ **Replies:** 0\ **Last updated:** [July 25, 2020, 5:55am UTC](https://discuss.elastic.co/t/delete-by-query-optimization/242590 "2020-07-25T05:55:23Z")
Hi i have a question, how to optimize delete\_by\_query when deleting from multiple indices? Let's say i have 100 indices, can we somehow set delete\_by\_query one by one index , or limit number of simultaneous deletes? Or c… --- ## [How to script a multi-match](https://discuss.elastic.co/t/how-to-script-a-multi-match/242589)
**Author:** [@Wurzelsepp](https://discuss.elastic.co/u/Wurzelsepp)\ **Replies:** 0\ **Last updated:** [July 25, 2020, 5:18am UTC](https://discuss.elastic.co/t/how-to-script-a-multi-match/242589 "2020-07-25T05:18:29Z")
Hi, I am trying to understand how a multi-match score could be scripted. Consider a list of publications, with sample data items like { "title": "Sounds of Silence", "author": \[ { "first": "Paul", "last"\_ "Simon" }, { … --- ## [Can a dissect processor have a condition?](https://discuss.elastic.co/t/can-a-dissect-processor-have-a-condition/242578)
**Author:** [@geoffreyphippsuw](https://discuss.elastic.co/u/geoffreyphippsuw)\ **Replies:** 1\ **Last updated:** [July 25, 2020, 12:44am UTC](https://discuss.elastic.co/t/can-a-dissect-processor-have-a-condition/242578 "2020-07-25T00:44:56Z")
Our EFK stack is receiving logs from several different kubernetes containers and other sources that use differing log patterns. I have created a dissect processor that can extract certain fields from the message field. B… --- ## [When should I use Kafka?](https://discuss.elastic.co/t/when-should-i-use-kafka/241989)
**Author:** [@falconpurple](https://discuss.elastic.co/u/falconpurple)\ **Replies:** 3\ **Last updated:** [July 24, 2020, 9:56pm UTC](https://discuss.elastic.co/t/when-should-i-use-kafka/241989 "2020-07-24T21:56:34Z")
Hi, I am capturing logs from filebeat and sending to logstash for filtering.The data is then send to elasticsearch .The results are displayed on kibana. Data captured per day is about 150MB. Should I connect kafka wi… --- ## [How to add external script to Kibana?](https://discuss.elastic.co/t/how-to-add-external-script-to-kibana/242541)
**Author:** [@nisargtest1](https://discuss.elastic.co/u/nisargtest1)\ **Replies:** 1\ **Last updated:** [July 24, 2020, 9:39pm UTC](https://discuss.elastic.co/t/how-to-add-external-script-to-kibana/242541 "2020-07-24T21:39:04Z")
I am new to Kibana and Elasticsearch. I have one python script which I want add in Kibana. How I able to achieve this? Thank you. --- ## [Parse date field with format epoch\_millis in a specific time zone](https://discuss.elastic.co/t/parse-date-field-with-format-epoch-millis-in-a-specific-time-zone/241956)
**Author:** [@kosuke](https://discuss.elastic.co/u/kosuke)\ **Replies:** 1\ **Last updated:** [July 24, 2020, 9:31pm UTC](https://discuss.elastic.co/t/parse-date-field-with-format-epoch-millis-in-a-specific-time-zone/241956 "2020-07-24T21:31:13Z")
Hi all, I'm using 7.4 for Elasticsearch and Kibana. When I zoom in a few seconds scale in line visualization, I found the following error message: failed to parse date field \[-577961999930\] with format \[epoch\_millis… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1905) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1907)