# Top **URL:** https://discuss.elastic.co/top.md?page=411&period=all [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 412 --- ## [Extract the year from a date](https://discuss.elastic.co/t/extract-the-year-from-a-date/95142)
**Author:** [@marwa](https://discuss.elastic.co/u/marwa)\ **Replies:** 7\ **Last updated:** [August 2, 2017, 12:12pm UTC](https://discuss.elastic.co/t/extract-the-year-from-a-date/95142 "2017-08-02T12:12:18Z")
Hello, i have data stored in elasticsearch with a field called transaction\_date mapped as a date ,this is its structure in the csv file 2/24/2017;14:15:43 and this how it is viewed in kibana April 18th 2016, 15:15:44.0… --- ## [Did not find expected \](https://discuss.elastic.co/t/did-not-find-expected-document-start/164138)
**Author:** [@Urs\_Bronk](https://discuss.elastic.co/u/Urs_Bronk)\ **Replies:** 1\ **Last updated:** [January 15, 2019, 5:00am UTC](https://discuss.elastic.co/t/did-not-find-expected-document-start/164138 "2019-01-15T05:00:46Z")
Hi guys, I've been at this for days, I'm still new to filebeat and have setup filebeat on a different server with the same config, but on this server doesn't matter what I try I get the following error and error after e… --- ## [java.lang.NoClassDefFoundError: org/elasticsearch/action/GenericAction](https://discuss.elastic.co/t/java-lang-noclassdeffounderror-org-elasticsearch-action-genericaction/202475)
**Author:** [@Milind\_Kaklij](https://discuss.elastic.co/u/Milind_Kaklij)\ **Replies:** 5\ **Last updated:** [October 7, 2019, 12:58pm UTC](https://discuss.elastic.co/t/java-lang-noclassdeffounderror-org-elasticsearch-action-genericaction/202475 "2019-10-07T12:58:56Z")
Hello Experts, I am getting "java.lang.NoClassDefFoundError: org/elasticsearch/action/GenericAction" while creating index via JAVA API with all 7.0+ ES versions . I decompiled its library but dont see GenericAction… --- ## [Can i set the timezone for results returned from search?](https://discuss.elastic.co/t/can-i-set-the-timezone-for-results-returned-from-search/49934)
**Author:** [@afaraone](https://discuss.elastic.co/u/afaraone)\ **Replies:** 0\ **Last updated:** [May 12, 2016, 7:47pm UTC](https://discuss.elastic.co/t/can-i-set-the-timezone-for-results-returned-from-search/49934 "2016-05-12T19:47:01Z")
I'm beginning to fear the answer is "no". I'm storing my data as UTC, I'm setting the time\_zone param on a date range filter i've applied to my search, I want the returned date-type results (only one field, for my purp… --- ## [SMS Alerting](https://discuss.elastic.co/t/sms-alerting/251744)
**Author:** [@Farid\_N](https://discuss.elastic.co/u/Farid_N)\ **Replies:** 6\ **Last updated:** [October 13, 2020, 5:45pm UTC](https://discuss.elastic.co/t/sms-alerting/251744 "2020-10-13T17:45:40Z")
Hi If I have a premium ELK license, how can I use with alerting?!? I just know the connection between kibana and elasticsearch must be secured... how?!? And also, what should I do, to send some alerts or anomalies to … --- ## [Error de conexion con maquina con elasticsearch](https://discuss.elastic.co/t/error-de-conexion-con-maquina-con-elasticsearch/133500)
**Author:** [@Ramon\_Saborit\_Villal](https://discuss.elastic.co/u/Ramon_Saborit_Villal)\ **Replies:** 6\ **Last updated:** [June 21, 2018, 11:37am UTC](https://discuss.elastic.co/t/error-de-conexion-con-maquina-con-elasticsearch/133500 "2018-06-21T11:37:50Z")
Hola soy nuevo en el framework elasticsearch. He tenido el siguiente mensaje de error en la maquina con elasticsearch y no entiendo el significado real de lo que ha podido ocurrir: \[2018-05-25T18:50:02,710\]\[WARN \]\[o.e.h… --- ## [Elastic agent - configuration for "custom logs" integration?](https://discuss.elastic.co/t/elastic-agent-configuration-for-custom-logs-integration/293886)
**Author:** [@mybyte](https://discuss.elastic.co/u/mybyte)\ **Replies:** 1\ **Last updated:** [January 17, 2022, 12:30pm UTC](https://discuss.elastic.co/t/elastic-agent-configuration-for-custom-logs-integration/293886 "2022-01-17T12:30:30Z")
Where can I find any sort of reference for the available parameters for the "Custom logs" integration? --- ## [CITRIX ICA protocol](https://discuss.elastic.co/t/citrix-ica-protocol/89380)
**Author:** [@Raj\_Kumar](https://discuss.elastic.co/u/Raj_Kumar)\ **Replies:** 1\ **Last updated:** [June 14, 2017, 11:25pm UTC](https://discuss.elastic.co/t/citrix-ica-protocol/89380 "2017-06-14T23:25:34Z")
Hi All, Is it possible monitor CITRIX ICA Protocol using Packetbeats or any other beats can help to monitor the Citrix environment.So that I could use the ELK platform for creating dashboards and alerting . Any help… --- ## [Dynamic field names in logstash](https://discuss.elastic.co/t/dynamic-field-names-in-logstash/81981)
**Author:** [@Aditya\_Srivastava](https://discuss.elastic.co/u/Aditya_Srivastava)\ **Replies:** 5\ **Last updated:** [April 11, 2017, 3:04pm UTC](https://discuss.elastic.co/t/dynamic-field-names-in-logstash/81981 "2017-04-11T15:04:12Z")
I have a string which is dynamic .It represents resp time and ip address 60.006,0.001#10.10.24.14:8082,10.10.22.11:8082 The no of machine can grow and so will the subsequent resp time and ip address. What I am tryi… --- ## [High system load causing performance issues](https://discuss.elastic.co/t/high-system-load-causing-performance-issues/118078)
**Author:** [@Ant](https://discuss.elastic.co/u/Ant)\ **Replies:** 3\ **Last updated:** [February 6, 2018, 9:32am UTC](https://discuss.elastic.co/t/high-system-load-causing-performance-issues/118078 "2018-02-06T09:32:56Z")
Hi I'm noticing a latency spike on my elastic cluster when system interupts go over 8k a second. My knowledge of what that is is limited to me googling of the last hour and what I've come to realise is I don't really k… --- ## [Remove part of field name from json inputted fields](https://discuss.elastic.co/t/remove-part-of-field-name-from-json-inputted-fields/61412)
**Author:** [@sirmodok](https://discuss.elastic.co/u/sirmodok)\ **Replies:** 8\ **Last updated:** [September 28, 2016, 3:45pm UTC](https://discuss.elastic.co/t/remove-part-of-field-name-from-json-inputted-fields/61412 "2016-09-28T15:45:38Z")
I have an input into elasticsearch from a large amount of json formatted data. The input looks like this file{ codec =\> json path =\> "/opt/apps/logs/health/\*.log" type =\> "health" } } Very simple. … --- ## [Kibana 7.15.2 Security Update](https://discuss.elastic.co/t/kibana-7-15-2-security-update/288923)
**Author:** [@douglasday](https://discuss.elastic.co/u/douglasday)\ **Replies:** 0\ **Last updated:** [November 10, 2021, 7:18pm UTC](https://discuss.elastic.co/t/kibana-7-15-2-security-update/288923 "2021-11-10T19:18:19Z")
Kibana Path Traversal issue (ESA-2021-26) It was discovered that on Windows operating systems specifically, Kibana was not validating a user supplied path, which would load .pbf files. Because of this, a malicious user … --- ## [Error: com.mysql.cj.jdbc.Driver not loaded. Are you sure you've included the correct jdbc driver in :jdbc\_driver\_library?](https://discuss.elastic.co/t/error-com-mysql-cj-jdbc-driver-not-loaded-are-you-sure-youve-included-the-correct-jdbc-driver-in-jdbc-driver-library/194133)
**Author:** [@manideep](https://discuss.elastic.co/u/manideep)\ **Replies:** 5\ **Last updated:** [August 8, 2019, 3:46pm UTC](https://discuss.elastic.co/t/error-com-mysql-cj-jdbc-driver-not-loaded-are-you-sure-youve-included-the-correct-jdbc-driver-in-jdbc-driver-library/194133 "2019-08-08T15:46:03Z")
Hi All, I don't understand what's wrong in below conf file. input { jdbc { jdbc\_driver\_library =\> "/usr/share/logstash/myjars/mysql-connector-java-8.0.11.jar" jdbc\_driver\_class =\> "com.mysql.cj.jdbc.Driver" jdbc\_co… --- ## [Multiple Logstash Configuration Files](https://discuss.elastic.co/t/multiple-logstash-configuration-files/235241)
**Author:** [@alpo](https://discuss.elastic.co/u/alpo)\ **Replies:** 3\ **Last updated:** [June 1, 2020, 11:05pm UTC](https://discuss.elastic.co/t/multiple-logstash-configuration-files/235241 "2020-06-01T23:05:23Z")
All: We're having an issue with Logstash and/or Elasticsearch, and we're not really sure where the issue resides. We are running Logstash and Elasticsearch on a single physical server and when viewing the data in Kiban… --- ## [How to use pfx file with certutil](https://discuss.elastic.co/t/how-to-use-pfx-file-with-certutil/118023)
**Author:** [@stephenpatten](https://discuss.elastic.co/u/stephenpatten)\ **Replies:** 3\ **Last updated:** [February 6, 2018, 4:40am UTC](https://discuss.elastic.co/t/how-to-use-pfx-file-with-certutil/118023 "2018-02-06T04:40:25Z")
Hello, I have a pfx file from my IT dept to use in one of our environments, can I use that, or convert it to a format suitable for use with certutil? Total noob question, sorry Thank you, Stephen --- ## [How to use grok pattern to separate nginx access log fields !?](https://discuss.elastic.co/t/how-to-use-grok-pattern-to-separate-nginx-access-log-fields/92645)
**Author:** [@omid](https://discuss.elastic.co/u/omid)\ **Replies:** 3\ **Last updated:** [July 15, 2017, 6:51am UTC](https://discuss.elastic.co/t/how-to-use-grok-pattern-to-separate-nginx-access-log-fields/92645 "2017-07-15T06:51:24Z")
i want from access log nginx from elk\_stack, Of all fields ((timestamp, version, host, clientip, ident, auth, verb, request, httpversion, response, bytes, referrer, agent)) Separately from each field Visualize and make a… --- ## [Document Count discrepancy after Reindex](https://discuss.elastic.co/t/document-count-discrepancy-after-reindex/92021)
**Author:** [@ritchierich](https://discuss.elastic.co/u/ritchierich)\ **Replies:** 7\ **Last updated:** [July 6, 2017, 7:52am UTC](https://discuss.elastic.co/t/document-count-discrepancy-after-reindex/92021 "2017-07-06T07:52:50Z")
Today I tried reindex in v5.4.3. The document count dropped from 6.4k in the source index to 1.6k in the destination index. Is this expected behavior for 5.4.x? I've been using document count as validation for reinde… --- ## [Converting date to YYYY-MM-DD from YYYY/MM/DD HH:MM:SS](https://discuss.elastic.co/t/converting-date-to-yyyy-mm-dd-from-yyyy-mm-dd-hh-mm-ss/31689)
**Author:** [@Deb](https://discuss.elastic.co/u/Deb)\ **Replies:** 3\ **Last updated:** [October 24, 2015, 7:16am UTC](https://discuss.elastic.co/t/converting-date-to-yyyy-mm-dd-from-yyyy-mm-dd-hh-mm-ss/31689 "2015-10-24T07:16:22Z")
Hi, I am having nginx error logs of the form:- 2015/09/30 22:19:38 \[error\] 32317#0: \*23 \[lua\] responses.lua:61: handler(): Cassandra error: Error during UNIQUE check: Cassandra error: connection refused, client: 127.0… --- ## [Advanced filter -\> OR condition?](https://discuss.elastic.co/t/advanced-filter-or-condition/174789)
**Author:** [@asp](https://discuss.elastic.co/u/asp)\ **Replies:** 2\ **Last updated:** [April 1, 2019, 7:02pm UTC](https://discuss.elastic.co/t/advanced-filter-or-condition/174789 "2019-04-01T19:02:33Z")
Hi there, I currently have two instances for parallel loadtesting. Each instance is consists of a load generator server (esrally) and an elasticsearch single instance which is tested against. Additionally I have an ela… --- ## [Unknown repository type s3 when creating snapshot in 2.x](https://discuss.elastic.co/t/unknown-repository-type-s3-when-creating-snapshot-in-2-x/35697)
**Author:** [@andy\_snow](https://discuss.elastic.co/u/andy_snow)\ **Replies:** 5\ **Last updated:** [February 29, 2016, 2:46pm UTC](https://discuss.elastic.co/t/unknown-repository-type-s3-when-creating-snapshot-in-2-x/35697 "2016-02-29T14:46:27Z")
Hi, I am trying to create an S3 repository using the exact same method (on the exact same server) that works fine on 1.7. Request: curl -XPUT "http://127.0.0.1:9200/\_snapshot/s3autosnapshots" -d '{ "type": "s3", "s… --- ## [Getting position of document in search results](https://discuss.elastic.co/t/getting-position-of-document-in-search-results/4227)
**Author:** [@Wojciech\_Durczynski](https://discuss.elastic.co/u/Wojciech_Durczynski)\ **Replies:** 8\ **Last updated:** [August 21, 2014, 8:20pm UTC](https://discuss.elastic.co/t/getting-position-of-document-in-search-results/4227 "2014-08-21T20:20:16Z")
Hello. I use elasticsearch for search (java API) and would like to achieve following functionality: Having document id and query criteria (query, filters and sort specification) I'd like to get position of document wi… --- ## [Mapping timestamp in Kibana](https://discuss.elastic.co/t/mapping-timestamp-in-kibana/219581)
**Author:** [@Ilija\_Angeloski](https://discuss.elastic.co/u/Ilija_Angeloski)\ **Replies:** 6\ **Last updated:** [February 19, 2020, 5:30pm UTC](https://discuss.elastic.co/t/mapping-timestamp-in-kibana/219581 "2020-02-19T17:30:02Z")
Hi, I have problem mapping timestamp field. I have field in my csv file timestamp that have values like 1545003901, 1543347920 etc... In kibana in dev tools i type "properties":{ "timestamp":{ "type" : "date" "format… --- ## [X-Pack on OSS](https://discuss.elastic.co/t/x-pack-on-oss/146143)
**Author:** [@slack](https://discuss.elastic.co/u/slack)\ **Replies:** 4\ **Last updated:** [August 27, 2018, 10:05am UTC](https://discuss.elastic.co/t/x-pack-on-oss/146143 "2018-08-27T10:05:43Z")
Hello, Some time ago there was news on blog about X-Pack free features (https://www.elastic.co/products/x-pack/open). According to such information I wonder if is possible to install X-Pack on -oss version ES? Best re… --- ## [CLOSE THIS TOPIC - Failed to connect: 404 Not Found - Indexes are not being created](https://discuss.elastic.co/t/close-this-topic-failed-to-connect-404-not-found-indexes-are-not-being-created/123571)
**Author:** [@Kernel\_Panic](https://discuss.elastic.co/u/Kernel_Panic)\ **Replies:** 8\ **Last updated:** [March 17, 2018, 12:04am UTC](https://discuss.elastic.co/t/close-this-topic-failed-to-connect-404-not-found-indexes-are-not-being-created/123571 "2018-03-17T00:04:21Z")
Hello I installed ES Kibana and MB 6.2, started ES and started kibana so far, I can access KB dashboard, so fa so good , then I installed metricbeat with the following configuration metricbeat.config.modules: path: … --- ## [ElasticSearch + Rails in 1GB RAM VPS (CentOS)](https://discuss.elastic.co/t/elasticsearch-rails-in-1gb-ram-vps-centos/47589)
**Author:** [@Rynaro](https://discuss.elastic.co/u/Rynaro)\ **Replies:** 4\ **Last updated:** [April 18, 2016, 4:21pm UTC](https://discuss.elastic.co/t/elasticsearch-rails-in-1gb-ram-vps-centos/47589 "2016-04-18T16:21:04Z")
Hello everyone, Recently I've made an e-Commerce (a clone of eBay) app in Rails, and the search engine, I used the ElasticSearch (with the awesome Searchkick gem). In development machine, all works in perfectly harmony… --- ## [Reindex data with a new Field](https://discuss.elastic.co/t/reindex-data-with-a-new-field/115073)
**Author:** [@mikelD](https://discuss.elastic.co/u/mikelD)\ **Replies:** 1\ **Last updated:** [January 19, 2018, 3:43pm UTC](https://discuss.elastic.co/t/reindex-data-with-a-new-field/115073 "2018-01-19T15:43:48Z")
Hi, Is there anyway to reindex the data and create a new field, from the data in the documents. For example, reindex an entire index and create a new field Hour(number) from a date type field(YYYY-mm-dd, HH-mm-ss). I K… --- ## [Csv data visualize in kibana](https://discuss.elastic.co/t/csv-data-visualize-in-kibana/76615)
**Author:** [@aryaray](https://discuss.elastic.co/u/aryaray)\ **Replies:** 7\ **Last updated:** [March 9, 2017, 7:46am UTC](https://discuss.elastic.co/t/csv-data-visualize-in-kibana/76615 "2017-03-09T07:46:06Z")
Hi, I Import a .csv file through logstash and want to display it using kibana . Kibana version 4.5.4 My kibana source file is look like below message: 2017-02-24,15:30:02,101k/min,101k/min,100k/min,67k/min,67k/min,… --- ## [Recommended number of master eligible nodes in a cluster](https://discuss.elastic.co/t/recommended-number-of-master-eligible-nodes-in-a-cluster/21627)
**Author:** [@Darshat\_Shah](https://discuss.elastic.co/u/Darshat_Shah)\ **Replies:** 7\ **Last updated:** [October 11, 2016, 8:23pm UTC](https://discuss.elastic.co/t/recommended-number-of-master-eligible-nodes-in-a-cluster/21627 "2016-10-11T20:23:16Z")
Hi, What is the guideline on recommended number of master eligible nodes in a cluster? We have a big cluster with 90+ nodes, currently all are eligible to be masters. However I do see master election take very lo… --- ## [Deleting documents by date](https://discuss.elastic.co/t/deleting-documents-by-date/82276)
**Author:** [@kernelpanic](https://discuss.elastic.co/u/kernelpanic)\ **Replies:** 4\ **Last updated:** [April 13, 2017, 11:54am UTC](https://discuss.elastic.co/t/deleting-documents-by-date/82276 "2017-04-13T11:54:33Z")
Hello all, in my reading on this it does appear that the advice is to use time-based indices and delete the index rather than individual documents due to efficiency. Apart from efficiency concerns, are there any other re… --- ## [Adding config for custom log integration on an agent](https://discuss.elastic.co/t/adding-config-for-custom-log-integration-on-an-agent/262181)
**Author:** [@Tim\_Estes](https://discuss.elastic.co/u/Tim_Estes)\ **Replies:** 5\ **Last updated:** [January 26, 2021, 4:55am UTC](https://discuss.elastic.co/t/adding-config-for-custom-log-integration-on-an-agent/262181 "2021-01-26T04:55:08Z")
Hello, I'm trying to index json logs with a Fleet-managed agent using a custom log configuration. I successfully downloaded the agent to my computer and specified a path where the log files live. However, when I genera… --- ## [\[ANNOUNCEMENT\] logstash-input-firebase released](https://discuss.elastic.co/t/announcement-logstash-input-firebase-released/71331)
**Author:** [@val](https://discuss.elastic.co/u/val)\ **Replies:** 0\ **Last updated:** [January 12, 2017, 7:35am UTC](https://discuss.elastic.co/t/announcement-logstash-input-firebase-released/71331 "2017-01-12T07:35:24Z")
A new Logstash input plugin called logstash-input-firebase is now available to retrieve data out of your Firebase real-time databases. This plugin can work in two modes: 1. get mode: Retrieve the value of database ref… --- ## [Updating data fields](https://discuss.elastic.co/t/updating-data-fields/103769)
**Author:** [@afonso.ribeiro](https://discuss.elastic.co/u/afonso.ribeiro)\ **Replies:** 5\ **Last updated:** [October 13, 2017, 1:36pm UTC](https://discuss.elastic.co/t/updating-data-fields/103769 "2017-10-13T13:36:26Z")
Hello guys, I want to update a field in elasticsearch but with a condition. In sql it would like something like this: UPDATE table\_name SET column1 = value1 WHERE column1="blabla" and column1="bleble"; Can I do thi… --- ## [Mapping definition for \[body\] has unsupported parameters](https://discuss.elastic.co/t/mapping-definition-for-body-has-unsupported-parameters/161765)
**Author:** [@Zorkmid](https://discuss.elastic.co/u/Zorkmid)\ **Replies:** 7\ **Last updated:** [January 5, 2019, 12:03am UTC](https://discuss.elastic.co/t/mapping-definition-for-body-has-unsupported-parameters/161765 "2019-01-05T00:03:43Z")
Hello All, I've got the follow setup installed: packetbeat-6.5.4-1.x86\_64 (installed on 2 different downstream servers) elasticsearch-6.5.4-1.noarch (installed on 6 physical servers - setup as 3 data and 3 masters) k… --- ## [How to do a range query to match all greater than X](https://discuss.elastic.co/t/how-to-do-a-range-query-to-match-all-greater-than-x/102434)
**Author:** [@tomer](https://discuss.elastic.co/u/tomer)\ **Replies:** 1\ **Last updated:** [October 2, 2017, 12:11pm UTC](https://discuss.elastic.co/t/how-to-do-a-range-query-to-match-all-greater-than-x/102434 "2017-10-02T12:11:24Z")
How to do a range query to match all greater than X? for an example all that the delay field has a value greater than 3 as in the following example: { "range": { "delay": { … --- ## [Unable to connect Kibana on 5601](https://discuss.elastic.co/t/unable-to-connect-kibana-on-5601/103936)
**Author:** [@Carlos\_Andres\_Zambra](https://discuss.elastic.co/u/Carlos_Andres_Zambra)\ **Replies:** 5\ **Last updated:** [October 13, 2017, 5:45pm UTC](https://discuss.elastic.co/t/unable-to-connect-kibana-on-5601/103936 "2017-10-13T17:45:10Z")
I am installing elasticsearch and kibana on EC2 aws, currently following this steps https://www.elastic.co/blog/running-elasticsearch-on-aws, I am trying with 5.6.3 elastic search and it is installed. Both services are r… --- ## [Nested grok filter or filtering a field using grok](https://discuss.elastic.co/t/nested-grok-filter-or-filtering-a-field-using-grok/100841)
**Author:** [@kumar.1989p](https://discuss.elastic.co/u/kumar.1989p)\ **Replies:** 5\ **Last updated:** [September 20, 2017, 7:00am UTC](https://discuss.elastic.co/t/nested-grok-filter-or-filtering-a-field-using-grok/100841 "2017-09-20T07:00:27Z")
Hello, So I have a CommonApache access log format in the below form: 8.6.7.9 - - \[10/Sep/2017:05:17:11 +0000\] "POST /integration/servletloadserviceupdate HTTP/1.0" 200 9157 So I have used the below filter: filter {… --- ## [TypeError: Cannot destructure property 'type' of 'undefined' as it is undefined](https://discuss.elastic.co/t/typeerror-cannot-destructure-property-type-of-undefined-as-it-is-undefined/309160)
**Author:** [@alter1](https://discuss.elastic.co/u/alter1)\ **Replies:** 5\ **Last updated:** [July 25, 2022, 8:36am UTC](https://discuss.elastic.co/t/typeerror-cannot-destructure-property-type-of-undefined-as-it-is-undefined/309160 "2022-07-25T08:36:06Z")
Hi, I just installed kibana 8.3.2 on a local windows 10 pc, and when starting it I get this error: Unable to complete saved object migrations for the \[.kibana\] index. TypeError: Cannot destructure property 'type' of 'un… --- ## [ILM not deleting indicies](https://discuss.elastic.co/t/ilm-not-deleting-indicies/265799)
**Author:** [@jamesp220291](https://discuss.elastic.co/u/jamesp220291)\ **Replies:** 5\ **Last updated:** [March 3, 2021, 10:26pm UTC](https://discuss.elastic.co/t/ilm-not-deleting-indicies/265799 "2021-03-03T22:26:19Z")
Hi i have some ILM with a delete phase after 7/30 days. However the indexs are not being deleted. ### Index lifecycle management \*\*Lifecycle policy\*\* \[apm-rollover-30-days\] \*\*Current action\*\* complete \*\*Failed st… --- ## [How to query all unique IP addresses](https://discuss.elastic.co/t/how-to-query-all-unique-ip-addresses/288420)
**Author:** [@jeromeat](https://discuss.elastic.co/u/jeromeat)\ **Replies:** 6\ **Last updated:** [November 4, 2021, 8:18pm UTC](https://discuss.elastic.co/t/how-to-query-all-unique-ip-addresses/288420 "2021-11-04T20:18:01Z")
I'm looking for help on how to query all unique IP addresses, however, the field types that the IPs get parsed to are setup as "keyword" and not "IP". And they are setup as ip\_src, ip\_dst, dst\_ip, src\_ip. Yes, I unders… --- ## [How to create sub-indices inside indices](https://discuss.elastic.co/t/how-to-create-sub-indices-inside-indices/171725)
**Author:** [@soumrock123](https://discuss.elastic.co/u/soumrock123)\ **Replies:** 6\ **Last updated:** [March 21, 2019, 1:56pm UTC](https://discuss.elastic.co/t/how-to-create-sub-indices-inside-indices/171725 "2019-03-21T13:56:11Z")
I have currently around 200 customer databases under one ES node and for each database, I am running 10 different queries to assess performance. For that I have 200\*10 indices now, but that does not look good. I plan to … --- ## [Prevent duplicates in a data stream](https://discuss.elastic.co/t/prevent-duplicates-in-a-data-stream/283076)
**Author:** [@romathonat](https://discuss.elastic.co/u/romathonat)\ **Replies:** 5\ **Last updated:** [September 2, 2021, 7:40am UTC](https://discuss.elastic.co/t/prevent-duplicates-in-a-data-stream/283076 "2021-09-02T07:40:05Z")
Hello, Is there a way to prevent duplicates in a data stream ? For a given index, specifying the \_id gives us the guarantee that there will be no duplicate with same \_id. For data streams however, it does not work app… --- ## [Kibana Query Language (KQL) library to convert KQL to ElasticSearch Query](https://discuss.elastic.co/t/kibana-query-language-kql-library-to-convert-kql-to-elasticsearch-query/276722)
**Author:** [@Saurabh\_Kumar](https://discuss.elastic.co/u/Saurabh_Kumar)\ **Replies:** 3\ **Last updated:** [June 29, 2021, 8:31am UTC](https://discuss.elastic.co/t/kibana-query-language-kql-library-to-convert-kql-to-elasticsearch-query/276722 "2021-06-29T08:31:02Z")
Hello Experts, I am trying to create DataQueryInterface (API Layer) which is independent from backend Datasource. Current I am thinking to have ElasticSearch as my datasource but in future if I want to move out of Elast… --- ## [How to write to ES from a pyspark dataframe?](https://discuss.elastic.co/t/how-to-write-to-es-from-a-pyspark-dataframe/34728)
**Author:** [@sendai](https://discuss.elastic.co/u/sendai)\ **Replies:** 4\ **Last updated:** [November 23, 2015, 9:51pm UTC](https://discuss.elastic.co/t/how-to-write-to-es-from-a-pyspark-dataframe/34728 "2015-11-23T21:51:59Z")
I am not having any luck figuring out this. On the docs there is code to read from ES not to write to ES. Can someone provide some documentation or examples? --- ## [Is Filebeat ready for production](https://discuss.elastic.co/t/is-filebeat-ready-for-production/51962)
**Author:** [@xfournet](https://discuss.elastic.co/u/xfournet)\ **Replies:** 2\ **Last updated:** [June 6, 2016, 10:03pm UTC](https://discuss.elastic.co/t/is-filebeat-ready-for-production/51962 "2016-06-06T22:03:40Z")
Hi, we have designed a solution based on Filebeat. But one of your customer is insisting on using Logstash Forwarder instead of Filebeat because some ELK consultants told them to wait on Filebeat (until end of 2016) be… --- ## [Harvester\_limit over directory with more 1M files](https://discuss.elastic.co/t/harvester-limit-over-directory-with-more-1m-files/128412)
**Author:** [@Juan\_Andres\_Ramirez](https://discuss.elastic.co/u/Juan_Andres_Ramirez)\ **Replies:** 2\ **Last updated:** [April 18, 2018, 1:10pm UTC](https://discuss.elastic.co/t/harvester-limit-over-directory-with-more-1m-files/128412 "2018-04-18T13:10:25Z")
hello guys, I have a directory with around 1M files, so I tried added in the filebeat.yml a harvester\_limit: filebeat.prospectors: - type: log enabled: true paths: - /logs/\*\* harvester\_limit: 400000 But file… --- ## [Call External REST API from Kibana Plugin](https://discuss.elastic.co/t/call-external-rest-api-from-kibana-plugin/110541)
**Author:** [@tamisalex](https://discuss.elastic.co/u/tamisalex)\ **Replies:** 4\ **Last updated:** [December 7, 2017, 5:08pm UTC](https://discuss.elastic.co/t/call-external-rest-api-from-kibana-plugin/110541 "2017-12-07T17:08:33Z")
My question is very similar to this thread: How to call external web service from Kibana Plugin? However, I don't have control over this api so I cant change what headers/origin it accepts. The external REST api accepts… --- ## [CORS issue in Elastic Search](https://discuss.elastic.co/t/cors-issue-in-elastic-search/45499)
**Author:** [@Priyanka\_Kharote](https://discuss.elastic.co/u/Priyanka_Kharote)\ **Replies:** 3\ **Last updated:** [March 26, 2016, 12:48pm UTC](https://discuss.elastic.co/t/cors-issue-in-elastic-search/45499 "2016-03-26T12:48:46Z")
I am consuming Elastic Search Web-service. But I receive XMLHttpRequest cannot load http://\:9200/providers3/provider3/\_search. Response to preflight request doesn't pass access control check: No 'Access-Control-Allo… --- ## [Duplicate document with same \_id and \_type](https://discuss.elastic.co/t/duplicate-document-with-same--id-and--type/8631)
**Author:** [@dchancogne](https://discuss.elastic.co/u/dchancogne)\ **Replies:** 2\ **Last updated:** [August 3, 2012, 5:38pm UTC](https://discuss.elastic.co/t/duplicate-document-with-same--id-and--type/8631 "2012-08-03T17:38:28Z")
We are running in the same issue as in this post, unfortunately the thread doesn't really have any answer :-( : http://elasticsearch-users.115913.n3.nabble.com/duplicate-id-type-within-the-same-index-td3530682.html … --- ## [Logstash configuration file unit testing](https://discuss.elastic.co/t/logstash-configuration-file-unit-testing/88450)
**Author:** [@nileshgattani](https://discuss.elastic.co/u/nileshgattani)\ **Replies:** 5\ **Last updated:** [June 12, 2017, 3:52pm UTC](https://discuss.elastic.co/t/logstash-configuration-file-unit-testing/88450 "2017-06-12T15:52:07Z")
Hi there, Are there any general guidelines on how to go about unit testing logstash config files? I did some research and picked on a few examples, but they all are very old and don't seem to be compatible with logsta… --- ## [Number of master nodes for a multi-node cluster](https://discuss.elastic.co/t/number-of-master-nodes-for-a-multi-node-cluster/223310)
**Author:** [@jkhere](https://discuss.elastic.co/u/jkhere)\ **Replies:** 4\ **Last updated:** [March 12, 2020, 12:45pm UTC](https://discuss.elastic.co/t/number-of-master-nodes-for-a-multi-node-cluster/223310 "2020-03-12T12:45:02Z")
Hi, I am planning to set up an elasticsearch cluster of around 160 nodes. As I have read in the documentation and some other forum posts, I need to set up dedicated master nodes and data nodes. The cluster will be Inde… [Previous page](https://discuss.elastic.co/top.md?page=410&per_page=50&period=all) [Next page](https://discuss.elastic.co/top.md?page=412&per_page=50&period=all)