# \#none **URL:** https://discuss.elastic.co/tag/none.md?no_tags=true&page=1975 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1976 --- ## [Kafka input plugin serialization](https://discuss.elastic.co/t/kafka-input-plugin-serialization/194138)
**Author:** [@real\_legend](https://discuss.elastic.co/u/real_legend)\ **Replies:** 1\ **Last updated:** [August 7, 2019, 5:24am UTC](https://discuss.elastic.co/t/kafka-input-plugin-serialization/194138 "2019-08-07T05:24:27Z")
Hi there in docs i was readed that serialization method of kafka pulgin is org.apache.kafka.common.serialization.Stringserializer and org.apache.kafka.common.serialization.StringDeserializer i want to use some other m… --- ## [Kibana- Pie Chart Visualization using Filters](https://discuss.elastic.co/t/kibana-pie-chart-visualization-using-filters/190878)
**Author:** [@Sujata\_Yadav](https://discuss.elastic.co/u/Sujata_Yadav)\ **Replies:** 2\ **Last updated:** [August 7, 2019, 5:17am UTC](https://discuss.elastic.co/t/kibana-pie-chart-visualization-using-filters/190878 "2019-08-07T05:17:23Z")
Hi All, I am using kibana 7.2.0. I want to split slices using Filters Aggregation. In the filters I want the data to be filtered on the basis of a word. I want to match the data if it contains ''NLevel" OR "Nlevel" OR … --- ## [Log lines appearing twice](https://discuss.elastic.co/t/log-lines-appearing-twice/193532)
**Author:** [@Eva](https://discuss.elastic.co/u/Eva)\ **Replies:** 4\ **Last updated:** [August 7, 2019, 5:02am UTC](https://discuss.elastic.co/t/log-lines-appearing-twice/193532 "2019-08-07T05:02:26Z")
Hello I'm shipping json logs to Logstash and have used below config: input { beats { port =\> 5044 } beats { port =\> 5045 } } filter{ if (\[fields\]\[app\] == "abc") { json { source =\> "message" } split { fiel… --- ## [Content Security Policy](https://discuss.elastic.co/t/content-security-policy/193932)
**Author:** [@ordidaad](https://discuss.elastic.co/u/ordidaad)\ **Replies:** 2\ **Last updated:** [August 7, 2019, 4:41am UTC](https://discuss.elastic.co/t/content-security-policy/193932 "2019-08-07T04:41:16Z")
Hi, i keep getting content-security-policy error while loading kibana in browser, so i put csp.strict: false in my kibana.yml file but problem still remains. Should i use csp.rules ? Kibana version 7.3.0 OS: Ubuntu… --- ## [Issue converting number field to date](https://discuss.elastic.co/t/issue-converting-number-field-to-date/189497)
**Author:** [@moti.mor](https://discuss.elastic.co/u/moti.mor)\ **Replies:** 3\ **Last updated:** [July 10, 2019, 4:39am UTC](https://discuss.elastic.co/t/issue-converting-number-field-to-date/189497 "2019-07-10T04:39:42Z")
Hi there, I'm trying to convert the following number field to date. Please see pic attached. and it's not working... please see my logstash configuration attahced on another photo. this is urgent issue for me , h… --- ## [How to calculate two aggregations on same field within the same body?](https://discuss.elastic.co/t/how-to-calculate-two-aggregations-on-same-field-within-the-same-body/193889)
**Author:** [@Kaushik123](https://discuss.elastic.co/u/Kaushik123)\ **Replies:** 5\ **Last updated:** [August 7, 2019, 3:43am UTC](https://discuss.elastic.co/t/how-to-calculate-two-aggregations-on-same-field-within-the-same-body/193889 "2019-08-07T03:43:25Z")
I am trying to find the sum aggregate data(total count) of a field for my query. I also want to find the sum aggregate data of that same field, but on a different day/time. How can I write that has this type of functiona… --- ## [Comparing the result(sum count) of 2 aggregations - ElasticSearch](https://discuss.elastic.co/t/comparing-the-result-sum-count-of-2-aggregations-elasticsearch/193826)
**Author:** [@Kaushik123](https://discuss.elastic.co/u/Kaushik123)\ **Replies:** 1\ **Last updated:** [August 7, 2019, 3:39am UTC](https://discuss.elastic.co/t/comparing-the-result-sum-count-of-2-aggregations-elasticsearch/193826 "2019-08-07T03:39:45Z")
Hi all, I am relatively new to Elasticsearch and am trying to write a script that is supposed to compare two different aggregations. For example, I have 2 sum aggregations of the same field, but calculated at 2 differe… --- ## [How to print Query parameters also along with the query?](https://discuss.elastic.co/t/how-to-print-query-parameters-also-along-with-the-query/194016)
**Author:** [@kumarvivek633](https://discuss.elastic.co/u/kumarvivek633)\ **Replies:** 1\ **Last updated:** [August 7, 2019, 2:28am UTC](https://discuss.elastic.co/t/how-to-print-query-parameters-also-along-with-the-query/194016 "2019-08-07T02:28:20Z")
I am using APM 6.6 to monitor application performance along with Elasticsearch and Kibana but the thing is that i want to show the sql parameters as well. How can i achieve this --- ## [Parse xml with logstash](https://discuss.elastic.co/t/parse-xml-with-logstash/193910)
**Author:** [@wzxmt\_l](https://discuss.elastic.co/u/wzxmt_l)\ **Replies:** 2\ **Last updated:** [August 7, 2019, 1:29am UTC](https://discuss.elastic.co/t/parse-xml-with-logstash/193910 "2019-08-07T01:29:40Z")
Hi All,Here is my xml,I want to parse this xml, how can I parse it? \ \ \10028603\ \*\*\*\*\*\*\*\* \0\ \1000\ **Author:** [@dcuti8](https://discuss.elastic.co/u/dcuti8)\ **Replies:** 2\ **Last updated:** [August 7, 2019, 1:24am UTC](https://discuss.elastic.co/t/elasticsearch-index-problem/193943 "2019-08-07T01:24:54Z") environment: OS: Windows Server 2019 CORE: 4-Core RAM: 8GB HDD: 60GB elasticsearch: 7.3.0 kibana:7.3.0 JVM：4GB One cluster, one node I put the sql server trace log data （last 7 days） into elasticsearch and show … --- ## [Wildcard queries on date based indexes, searches all indexes?](https://discuss.elastic.co/t/wildcard-queries-on-date-based-indexes-searches-all-indexes/194121)
**Author:** [@Aharon](https://discuss.elastic.co/u/Aharon)\ **Replies:** 0\ **Last updated:** [August 7, 2019, 12:38am UTC](https://discuss.elastic.co/t/wildcard-queries-on-date-based-indexes-searches-all-indexes/194121 "2019-08-07T00:38:24Z")
About me: ES: 6.5.4 X-PACK Document Security on all indexes 200TB of date based indexes Multi-tenant environment 7 days of data on Hot data nodes 180 days in Warm data nodes Question: If I have a user log into Ki… --- ## [Exception on ingest an attachment using client.index()](https://discuss.elastic.co/t/exception-on-ingest-an-attachment-using-client-index/193641)
**Author:** [@n2nelastic](https://discuss.elastic.co/u/n2nelastic)\ **Replies:** 10\ **Last updated:** [August 6, 2019, 11:48pm UTC](https://discuss.elastic.co/t/exception-on-ingest-an-attachment-using-client-index/193641 "2019-08-06T23:48:02Z")
I have properly set up an index and pipeline to ingest base64 encoded documents. Using the elasticsearch client, I call client.index() to process a base64 document, but I get "ResponseError: Exception" from client.index… --- ## [Aggregateのtask\_idを複数指定したい](https://discuss.elastic.co/t/aggregate-task-id/193923)
**Author:** [@harue](https://discuss.elastic.co/u/harue)\ **Replies:** 2\ **Last updated:** [August 6, 2019, 11:38pm UTC](https://discuss.elastic.co/t/aggregate-task-id/193923 "2019-08-06T23:38:31Z")
お世話になっております。 LogstashのAggregate filterについて質問させて頂きます。 実現したいこと 複数の指定した項目のデータが一致している場合、ログをグループ化 例 条件：id,hostが両方同じ値であれば、nameをグループ化 下記の場合、idは同値だがhostが異なる値のため、nameはグループ化されないようにしたい | id |host | name | | 1 … --- ## [Error in filter elasticsearch plugin](https://discuss.elastic.co/t/error-in-filter-elasticsearch-plugin/194074)
**Author:** [@leeyu](https://discuss.elastic.co/u/leeyu)\ **Replies:** 7\ **Last updated:** [August 6, 2019, 11:20pm UTC](https://discuss.elastic.co/t/error-in-filter-elasticsearch-plugin/194074 "2019-08-06T23:20:24Z")
Hi all, I am using version 7.2. I encountered some trouble while using the filter elasticsearch plugin. The behavior is very random, some of the data uploaded correctly but I also get some error Here is the log from … --- ## [How to filter date field by days and hours separately](https://discuss.elastic.co/t/how-to-filter-date-field-by-days-and-hours-separately/193946)
**Author:** [@Guylot](https://discuss.elastic.co/u/Guylot)\ **Replies:** 5\ **Last updated:** [August 6, 2019, 9:33pm UTC](https://discuss.elastic.co/t/how-to-filter-date-field-by-days-and-hours-separately/193946 "2019-08-06T21:33:19Z")
Hi, I want to create a query that returns all the data from last 3 days and only between 09:00 AM - 18:00 PM. My date field contains both the date and the time of the day (For example "time" : "2019-08-06T06:40:55Z"). … --- ## [Query using Shingle filter on 5.1.2 and 5.2.2 behave differently](https://discuss.elastic.co/t/query-using-shingle-filter-on-5-1-2-and-5-2-2-behave-differently/193007)
**Author:** [@mingchi](https://discuss.elastic.co/u/mingchi)\ **Replies:** 2\ **Last updated:** [August 6, 2019, 9:30pm UTC](https://discuss.elastic.co/t/query-using-shingle-filter-on-5-1-2-and-5-2-2-behave-differently/193007 "2019-08-06T21:30:20Z")
I have a shingle filter: "custom\_shingle\_filter": { "type": "shingle", "max\_shingle\_size": 2, "min\_shingle\_size": 2, "token\_separator": "", "output\_unigrams": true } Then I use this shingle filte… --- ## [How to filter out unnecessary field from the kibana output](https://discuss.elastic.co/t/how-to-filter-out-unnecessary-field-from-the-kibana-output/194093)
**Author:** [@zatom](https://discuss.elastic.co/u/zatom)\ **Replies:** 0\ **Last updated:** [August 6, 2019, 7:32pm UTC](https://discuss.elastic.co/t/how-to-filter-out-unnecessary-field-from-the-kibana-output/194093 "2019-08-06T19:32:42Z")
Hi, I am wondering if we can write queries that automatically removes the fields in the output that we don't want. I am asking this because my nested aggregation keeps crashing my cluster. If we could remove millions of … --- ## [How to deal with the transition when a field changes format "string" -\> "timestamp"](https://discuss.elastic.co/t/how-to-deal-with-the-transition-when-a-field-changes-format-string-timestamp/193649)
**Author:** [@jcaballero](https://discuss.elastic.co/u/jcaballero)\ **Replies:** 4\ **Last updated:** [August 6, 2019, 7:28pm UTC](https://discuss.elastic.co/t/how-to-deal-with-the-transition-when-a-field-changes-format-string-timestamp/193649 "2019-08-06T19:28:42Z")
Hello. Facts: Using ElasticSearch version 5.6.10 Currently, the Template \[1\] for one of my indices contains a section like this, since LogStash is creating field "my\_datefield" as a string, with one of these two p… --- ## [Manually send json object to beats listener](https://discuss.elastic.co/t/manually-send-json-object-to-beats-listener/193908)
**Author:** [@nnet](https://discuss.elastic.co/u/nnet)\ **Replies:** 4\ **Last updated:** [August 6, 2019, 6:57pm UTC](https://discuss.elastic.co/t/manually-send-json-object-to-beats-listener/193908 "2019-08-06T18:57:40Z")
Hi, I have a working beats listener configured in logstash, and a filebeats prospector shipping json data from a log file. input { beats { port =\> 5047 include\_codec\_tag =\> false } } I want to test arbitrar… --- ## [How to get a range of documents before and after \_id](https://discuss.elastic.co/t/how-to-get-a-range-of-documents-before-and-after-id/194086)
**Author:** [@nolatone](https://discuss.elastic.co/u/nolatone)\ **Replies:** 0\ **Last updated:** [August 6, 2019, 6:51pm UTC](https://discuss.elastic.co/t/how-to-get-a-range-of-documents-before-and-after-id/194086 "2019-08-06T18:51:06Z")
Hello all, I'm investigating using Elasticsearch (and other parts of the ELK stack) for the data source for log analysis tools my team is developing. We're currently working with logs loaded into a postgres DB. One of … --- ## [Как это работает "ctx.\_index = '\<.monitoring-es-6-{now}\>';"?](https://discuss.elastic.co/t/ctx-index-monitoring-es-6-now/194035)
**Author:** [@GreenX](https://discuss.elastic.co/u/GreenX)\ **Replies:** 4\ **Last updated:** [August 6, 2019, 6:45pm UTC](https://discuss.elastic.co/t/ctx-index-monitoring-es-6-now/194035 "2019-08-06T18:45:34Z")
Читал pipeline от xpack. Наткнулся на строку ctx.\_index = '\<.monitoring-es-6-{now}\>'; Смысл понятен, но непонятно как это работает. Чей это синтаксис? Откуда "now"? А главное, где дока? --- ## [Comparing 2 sum metric aggregations](https://discuss.elastic.co/t/comparing-2-sum-metric-aggregations/194084)
**Author:** [@Kaushik123](https://discuss.elastic.co/u/Kaushik123)\ **Replies:** 0\ **Last updated:** [August 6, 2019, 6:44pm UTC](https://discuss.elastic.co/t/comparing-2-sum-metric-aggregations/194084 "2019-08-06T18:44:35Z")
Is it possible to compare two metric aggregations - both return the sum of a field. Both aggregations are performed on the same field, but at different time intervals using the bool and range query. For example, if the… --- ## [Conditional statements in logstash.conf](https://discuss.elastic.co/t/conditional-statements-in-logstash-conf/192108)
**Author:** [@griffer98](https://discuss.elastic.co/u/griffer98)\ **Replies:** 10\ **Last updated:** [August 6, 2019, 6:35pm UTC](https://discuss.elastic.co/t/conditional-statements-in-logstash-conf/192108 "2019-08-06T18:35:22Z")
I am parsing xml documents but there are different types with different names. Each type of document has different tags so each document will require different xpath expressions. What I want to do is write a conditional … --- ## [ES 7.3 | XPack | Custom realm](https://discuss.elastic.co/t/es-7-3-xpack-custom-realm/194079)
**Author:** [@cambierr](https://discuss.elastic.co/u/cambierr)\ **Replies:** 0\ **Last updated:** [August 6, 2019, 6:25pm UTC](https://discuss.elastic.co/t/es-7-3-xpack-custom-realm/194079 "2019-08-06T18:25:05Z")
Hi all, I'm running a local ES cluster using basic XPack license and I'm interested in creating a custom realm, my goal being to be able to authenticate myself using my gitlab account. My idea is to add to the kibana l… --- ## [Grok until first period](https://discuss.elastic.co/t/grok-until-first-period/193909)
**Author:** [@uklipse](https://discuss.elastic.co/u/uklipse)\ **Replies:** 4\ **Last updated:** [August 6, 2019, 6:05pm UTC](https://discuss.elastic.co/t/grok-until-first-period/193909 "2019-08-06T18:05:10Z")
Hi, new to creating parsing rules so bear with me. I need to parse up until the first period but can't seem to make it work. Below is what I'm trying to parse. GlobalProtect gateway user authentication succeeded. Login … --- ## [How to grok parse a pipe | delimited string of key-value pairs (sorta like FIX)](https://discuss.elastic.co/t/how-to-grok-parse-a-pipe-delimited-string-of-key-value-pairs-sorta-like-fix/194073)
**Author:** [@kmiklas](https://discuss.elastic.co/u/kmiklas)\ **Replies:** 1\ **Last updated:** [August 6, 2019, 5:49pm UTC](https://discuss.elastic.co/t/how-to-grok-parse-a-pipe-delimited-string-of-key-value-pairs-sorta-like-fix/194073 "2019-08-06T17:49:59Z")
Hello All, I need to grok a pipe-delimited string of values in a grok line; for example: |NAME=keith|DAY=wednesday|TIME=09:27:423227|DATE=08/06/2019|amount=68.23|currency=USD|etc... What is the easiest way to do this?… --- ## [Custom field to process DOB field calculating 'age'](https://discuss.elastic.co/t/custom-field-to-process-dob-field-calculating-age/194018)
**Author:** [@asad\_ali](https://discuss.elastic.co/u/asad_ali)\ **Replies:** 12\ **Last updated:** [August 6, 2019, 5:44pm UTC](https://discuss.elastic.co/t/custom-field-to-process-dob-field-calculating-age/194018 "2019-08-06T17:44:46Z")
I have sample data as:- Sr No,CNIC,Cell Phone,Date Of Birth,Gender 1,3710144892657,3215510968,06/06/1961,male 2,3710155658463,3238547712,6/17/1952,male 3,3710153121295,3015357676,01/01/1956,male 4,3710116643365,32157019… --- ## [Kafka input - Type missing](https://discuss.elastic.co/t/kafka-input-type-missing/194064)
**Author:** [@asacr](https://discuss.elastic.co/u/asacr)\ **Replies:** 3\ **Last updated:** [August 6, 2019, 5:37pm UTC](https://discuss.elastic.co/t/kafka-input-type-missing/194064 "2019-08-06T17:37:00Z")
Hello, We've got an existing ELK environment using filebeat primarily. Everything is working fine there, but I'm trying to add some data using the Kafka input plugin and running into an issue. Logstash Version: 5.4.0 … --- ## [How to disconnect runner before deleting it?](https://discuss.elastic.co/t/how-to-disconnect-runner-before-deleting-it/194065)
**Author:** [@daniel\_a](https://discuss.elastic.co/u/daniel_a)\ **Replies:** 3\ **Last updated:** [August 6, 2019, 5:33pm UTC](https://discuss.elastic.co/t/how-to-disconnect-runner-before-deleting-it/194065 "2019-08-06T17:33:58Z")
I'm trying to delete a runner, but the delete button in the platform is grayed out, and it shows the following message: "Disconnect this runner before deleting it." I can't find how to disconnect a runner in the ECE doc… --- ## [I want to take Lat Long from MYSQL database and map as geopoint in elasticsearch index](https://discuss.elastic.co/t/i-want-to-take-lat-long-from-mysql-database-and-map-as-geopoint-in-elasticsearch-index/194060)
**Author:** [@Sandeep\_Bind](https://discuss.elastic.co/u/Sandeep_Bind)\ **Replies:** 2\ **Last updated:** [August 6, 2019, 4:48pm UTC](https://discuss.elastic.co/t/i-want-to-take-lat-long-from-mysql-database-and-map-as-geopoint-in-elasticsearch-index/194060 "2019-08-06T16:48:58Z")
Below is my logstash configuration file. input { jdbc { jdbc\_driver\_library =\> "mysql-connector-java-8.0.16/mysql-connector-java-8.0.16.jar" jdbc\_driver\_class =\> "com.mysql.cj.jdbc.Driver" jdbc\_connection\_string =\> … [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1974) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1976)