# \#none **URL:** https://discuss.elastic.co/tag/none.md?no_tags=true&page=1224 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1225 --- ## [Compare Dates in Logstash Pipeline](https://discuss.elastic.co/t/compare-dates-in-logstash-pipeline/247415)
**Author:** [@d-ring](https://discuss.elastic.co/u/d-ring)\ **Replies:** 4\ **Last updated:** [September 23, 2020, 9:51pm UTC](https://discuss.elastic.co/t/compare-dates-in-logstash-pipeline/247415 "2020-09-23T21:51:17Z")
I have created a data field during the pipeline and I am trying to find a way to compare that field to see if it is 30 days old or newer. I am not sure how to do about it however. This is the code I have for creating th… --- ## [Only query new documents from Elasticsearch index](https://discuss.elastic.co/t/only-query-new-documents-from-elasticsearch-index/249703)
**Author:** [@mussa572](https://discuss.elastic.co/u/mussa572)\ **Replies:** 2\ **Last updated:** [September 23, 2020, 9:49pm UTC](https://discuss.elastic.co/t/only-query-new-documents-from-elasticsearch-index/249703 "2020-09-23T21:49:46Z")
I am writing a python program which will query elasticsearch index . I am using a match all query in the while loop which looks for the new documents . First problem is that I always get all the documents every time I q… --- ## [Performance when inserting/deleting many documents](https://discuss.elastic.co/t/performance-when-inserting-deleting-many-documents/249676)
**Author:** [@Roman\_Kagan](https://discuss.elastic.co/u/Roman_Kagan)\ **Replies:** 1\ **Last updated:** [September 23, 2020, 9:47pm UTC](https://discuss.elastic.co/t/performance-when-inserting-deleting-many-documents/249676 "2020-09-23T21:47:36Z")
Hello: We have a very old Elastic 2.2.0 instance running in production that contains approximately 26 million documents. We also insert 230k (yes - thousands) of documents a week and mark for deletion 30k documents a … --- ## [Problem with stopping Kibana](https://discuss.elastic.co/t/problem-with-stopping-kibana/249070)
**Author:** [@vasek](https://discuss.elastic.co/u/vasek)\ **Replies:** 3\ **Last updated:** [September 23, 2020, 9:32pm UTC](https://discuss.elastic.co/t/problem-with-stopping-kibana/249070 "2020-09-23T21:32:21Z")
Hello, I'm doing Elasticsearch Engineering II - Lab 3.1: Securing Elasticsearch - Section 7 I should stop Kibana but I have no terminal opened, so I can't press CTRL+C. I have no permission to perform kill -15 . I… --- ## [Unable to create visualization from command prompt in Kibana 6.8](https://discuss.elastic.co/t/unable-to-create-visualization-from-command-prompt-in-kibana-6-8/249706)
**Author:** [@rajkumar.m](https://discuss.elastic.co/u/rajkumar.m)\ **Replies:** 0\ **Last updated:** [September 23, 2020, 8:37pm UTC](https://discuss.elastic.co/t/unable-to-create-visualization-from-command-prompt-in-kibana-6-8/249706 "2020-09-23T20:37:26Z")
Hi Team, I am unable to create visualization from command using curl in ELK 6.8. I have a working solution which I followed from the below link and it is working in ELK5. As per the solution shared, it is going to w… --- ## [SNMP/MIBs issue error: no such instance currently exists at this OID](https://discuss.elastic.co/t/snmp-mibs-issue-error-no-such-instance-currently-exists-at-this-oid/249700)
**Author:** [@ShermSherm51](https://discuss.elastic.co/u/ShermSherm51)\ **Replies:** 0\ **Last updated:** [September 23, 2020, 7:37pm UTC](https://discuss.elastic.co/t/snmp-mibs-issue-error-no-such-instance-currently-exists-at-this-oid/249700 "2020-09-23T19:37:41Z")
I'm getting logstash errors: no such instance currently exists at this OID Sep 23 15:30:04 \ logstash\[27639\]: "iso.org.dod.internet.private.enterprises.purestorage.pureObjects.pureProductVersion… --- ## [Parsing date\_field with date plugin and set it as @timestamp](https://discuss.elastic.co/t/parsing-date-field-with-date-plugin-and-set-it-as-timestamp/249701)
**Author:** [@nino](https://discuss.elastic.co/u/nino)\ **Replies:** 2\ **Last updated:** [September 23, 2020, 8:03pm UTC](https://discuss.elastic.co/t/parsing-date-field-with-date-plugin-and-set-it-as-timestamp/249701 "2020-09-23T20:03:38Z")
Hello all, i am having problems trying to parse this date field and set as @timestamp { "field\_date" =\> "2020-09-08 0:00:00.0" } This try is not running date { timezone =\> "UCT" match =\> \["field\_date", "… --- ## [Event.set and nested filed](https://discuss.elastic.co/t/event-set-and-nested-filed/249684)
**Author:** [@arp220](https://discuss.elastic.co/u/arp220)\ **Replies:** 4\ **Last updated:** [September 23, 2020, 6:47pm UTC](https://discuss.elastic.co/t/event-set-and-nested-filed/249684 "2020-09-23T18:47:24Z")
Hi. I have this config: input { file { path =\> "/opt/logs/sb\_log.json" sincedb\_path =\> "/etc/logstash/.sincedb\_sblog" start\_position =\> "beginning" } } filter{ json { source =\> "message" … --- ## [Best logstash plugin or advice to ingest this csv file on elasticsearch](https://discuss.elastic.co/t/best-logstash-plugin-or-advice-to-ingest-this-csv-file-on-elasticsearch/249686)
**Author:** [@nino](https://discuss.elastic.co/u/nino)\ **Replies:** 2\ **Last updated:** [September 23, 2020, 6:12pm UTC](https://discuss.elastic.co/t/best-logstash-plugin-or-advice-to-ingest-this-csv-file-on-elasticsearch/249686 "2020-09-23T18:12:05Z")
Hello all, i have this csv file that i need to send to elastic: alwats the same csv structure field\_1,field\_2,field\_3,field\_4,field\_5,field\_6 888,0000000A,S,4,2020-09-08 00:00:00.0,name 999,0000000C,S,4,2020-09-08 00:… --- ## [Elasticsearch 7.8 worse heap management](https://discuss.elastic.co/t/elasticsearch-7-8-worse-heap-management/240996)
**Author:** [@Carlos\_Moya](https://discuss.elastic.co/u/Carlos_Moya)\ **Replies:** 39\ **Last updated:** [September 23, 2020, 5:50pm UTC](https://discuss.elastic.co/t/elasticsearch-7-8-worse-heap-management/240996 "2020-09-23T17:50:26Z")
Hello, We have an Elasticsearch cluster of 94 servers and last Wednesday we updated it from 7.6.2 to 7.8.0. On Friday one of our teams reported that a nightly process reduced its performance dramatically. We verified i… --- ## [Message not splitting into events on new line](https://discuss.elastic.co/t/message-not-splitting-into-events-on-new-line/249399)
**Author:** [@kbrisso](https://discuss.elastic.co/u/kbrisso)\ **Replies:** 3\ **Last updated:** [September 23, 2020, 5:24pm UTC](https://discuss.elastic.co/t/message-not-splitting-into-events-on-new-line/249399 "2020-09-23T17:24:27Z")
Hello- I have a message that looks like below: \[INFO\] 2020-09-21 09:40:21,476\[ajp-nio-9031-exec-1\] com.gts.ci.jws.filter.ValidationFilter - Validation Filter URL /jsp\_web/access/app\_logout.jsp\\n\[DEBUG\] 2020-09-21 09:4… --- ## [Is there a way to choose the other master eligible node as master automatically if the elected master node goes down (in unexpected sceanrio's)?](https://discuss.elastic.co/t/is-there-a-way-to-choose-the-other-master-eligible-node-as-master-automatically-if-the-elected-master-node-goes-down-in-unexpected-sceanrios/249607)
**Author:** [@Elango\_P](https://discuss.elastic.co/u/Elango_P)\ **Replies:** 7\ **Last updated:** [September 23, 2020, 4:17pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-choose-the-other-master-eligible-node-as-master-automatically-if-the-elected-master-node-goes-down-in-unexpected-sceanrios/249607 "2020-09-23T16:17:56Z")
Hi, We are facing some issues while upgrading ES from 5.5.2 -\> 7.8.1. We have two nodes deployment setup. ES is installed in both nodes and both are master eligible. In earlier version we used to have two master nodes… --- ## [Grok processor to parse specific fields of IIS Logs message field](https://discuss.elastic.co/t/grok-processor-to-parse-specific-fields-of-iis-logs-message-field/249346)
**Author:** [@chand](https://discuss.elastic.co/u/chand)\ **Replies:** 1\ **Last updated:** [September 23, 2020, 4:25pm UTC](https://discuss.elastic.co/t/grok-processor-to-parse-specific-fields-of-iis-logs-message-field/249346 "2020-09-23T16:25:32Z")
Hi, I've the following grok processor, which basically splits message field data into multiple fields. In my case message field data changes every time for each log entry. How would I pass the message field data dynamic… --- ## [Is there a way to look at data for a specific time daily on a kibana time series visualization](https://discuss.elastic.co/t/is-there-a-way-to-look-at-data-for-a-specific-time-daily-on-a-kibana-time-series-visualization/249679)
**Author:** [@nishnath.nandi](https://discuss.elastic.co/u/nishnath.nandi)\ **Replies:** 1\ **Last updated:** [September 23, 2020, 4:05pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-look-at-data-for-a-specific-time-daily-on-a-kibana-time-series-visualization/249679 "2020-09-23T16:05:30Z")
Currently, I am using Kibana visualizations with a date histogram to look at data for last 2 months. But I would like to filter it further and look at only week days and for business hours (9 A.M. to 5 P.M.) --- ## [Elastic SIEM showing duplicate hosts when Defender ATP logs are shipped in](https://discuss.elastic.co/t/elastic-siem-showing-duplicate-hosts-when-defender-atp-logs-are-shipped-in/249152)
**Author:** [@InnerJoin](https://discuss.elastic.co/u/InnerJoin)\ **Replies:** 5\ **Last updated:** [September 23, 2020, 2:44pm UTC](https://discuss.elastic.co/t/elastic-siem-showing-duplicate-hosts-when-defender-atp-logs-are-shipped-in/249152 "2020-09-23T14:44:54Z")
I am currently working on getting together a POC of the Elastic SIEM solution. I already have a machine shipping logs into Elasticsearch with a winlogbeat agent and I am showing in the Hosts section of the SIEM that logs… --- ## [How to access a deashboard or view from another php front end](https://discuss.elastic.co/t/how-to-access-a-deashboard-or-view-from-another-php-front-end/249557)
**Author:** [@francieliton\_araujo](https://discuss.elastic.co/u/francieliton_araujo)\ **Replies:** 6\ **Last updated:** [September 23, 2020, 2:33pm UTC](https://discuss.elastic.co/t/how-to-access-a-deashboard-or-view-from-another-php-front-end/249557 "2020-09-23T14:33:39Z")
i am trying to create a php that accesses a kibana deashboard however my kibana needs a user password. what happens is that i would like to access it password need to put username and password. but before that i already … --- ## [How to get field in xml?](https://discuss.elastic.co/t/how-to-get-field-in-xml/249609)
**Author:** [@Luan\_Ph\_m](https://discuss.elastic.co/u/Luan_Ph_m)\ **Replies:** 1\ **Last updated:** [September 23, 2020, 1:57pm UTC](https://discuss.elastic.co/t/how-to-get-field-in-xml/249609 "2020-09-23T13:57:47Z")
Hi I need to get some field in my xml file but i don't know how to get it. Here my xml \ \ \ \ \1027\ \active\ \ \ **Author:** [@parosio](https://discuss.elastic.co/u/parosio)\ **Replies:** 2\ **Last updated:** [September 23, 2020, 1:06pm UTC](https://discuss.elastic.co/t/use-kibana-index-param-as-prefix-for-ancillary-kibana-indices/249639 "2020-09-23T13:06:23Z") Hello, I'm having sort of a problem with a double kibana installation on top of a single Elastic cluster (currently using 6.7 stack, basic license). The second kibana has this setting: kibana.index: ".my-second-app-kib… --- ## [Visualizing a metric on two unique counts](https://discuss.elastic.co/t/visualizing-a-metric-on-two-unique-counts/249562)
**Author:** [@jwetzel](https://discuss.elastic.co/u/jwetzel)\ **Replies:** 2\ **Last updated:** [September 23, 2020, 1:49pm UTC](https://discuss.elastic.co/t/visualizing-a-metric-on-two-unique-counts/249562 "2020-09-23T13:49:05Z")
I am collecting custom logs from a web server. I am trying to summarize what % of unique users encounter an error. I am having trouble finding a visualization that will do a % calculation on two unique (cardinatily) valu… --- ## [Rename field - input syslog](https://discuss.elastic.co/t/rename-field-input-syslog/249575)
**Author:** [@Paulogbr](https://discuss.elastic.co/u/Paulogbr)\ **Replies:** 1\ **Last updated:** [September 23, 2020, 1:25pm UTC](https://discuss.elastic.co/t/rename-field-input-syslog/249575 "2020-09-23T13:25:25Z")
Hello Team, I tried rename field in logstash. I received syslog and save log in file. This is my conf. input { udp { port =\> "5133" type =\> "syslog" } } filter { if \[type\] == "syslog" { grok { … --- ## [XML: converting each tag attribute as the actual keys](https://discuss.elastic.co/t/xml-converting-each-tag-attribute-as-the-actual-keys/249546)
**Author:** [@thdesy](https://discuss.elastic.co/u/thdesy)\ **Replies:** 2\ **Last updated:** [September 23, 2020, 12:34pm UTC](https://discuss.elastic.co/t/xml-converting-each-tag-attribute-as-the-actual-keys/249546 "2020-09-23T12:34:53Z")
Hi, I have a somewhat XML log, where the attributes are the actual keys, e.g., \[1\] each event is in a \ tag and every message key/value is in a \ tag. The actual key name is the n attribute and the value is in a 'f… --- ## [Generate a hash/CRC for part of a document?](https://discuss.elastic.co/t/generate-a-hash-crc-for-part-of-a-document/249641)
**Author:** [@HybridBanana](https://discuss.elastic.co/u/HybridBanana)\ **Replies:** 1\ **Last updated:** [September 23, 2020, 12:29pm UTC](https://discuss.elastic.co/t/generate-a-hash-crc-for-part-of-a-document/249641 "2020-09-23T12:29:41Z")
I need to generate a unique (or almost-certainly-unique) hash/CRC value for part of my ElasticSearch document. The sub-document being hashed can contain arbitrary data types, nested documents, and lists where order is u… --- ## [Installed kibana and elasticsearch from archive](https://discuss.elastic.co/t/installed-kibana-and-elasticsearch-from-archive/249643)
**Author:** [@MOHIT2710](https://discuss.elastic.co/u/MOHIT2710)\ **Replies:** 1\ **Last updated:** [September 23, 2020, 11:53am UTC](https://discuss.elastic.co/t/installed-kibana-and-elasticsearch-from-archive/249643 "2020-09-23T11:53:53Z")
Hi Team, I have installed kibana and elasticsearch version 6.3.2 from archive. Now I want to update them to latest stable version. How can I update both my packages, I don't want to lost my data from elastic, report a… --- ## [FSCrawler Ingestion Issue](https://discuss.elastic.co/t/fscrawler-ingestion-issue/247706)
**Author:** [@Umesh\_S\_Bhimani](https://discuss.elastic.co/u/Umesh_S_Bhimani)\ **Replies:** 4\ **Last updated:** [September 23, 2020, 11:17am UTC](https://discuss.elastic.co/t/fscrawler-ingestion-issue/247706 "2020-09-23T11:17:43Z")
I have installed FSCrawler using a user account on a server and am trying to use a service account later to create a job and ingest the data. Does it require to use the same account used for FSCrawler installation to ing… --- ## [How to add criteria dynamically while searching against elasticsearch](https://discuss.elastic.co/t/how-to-add-criteria-dynamically-while-searching-against-elasticsearch/248333)
**Author:** [@ocmvin](https://discuss.elastic.co/u/ocmvin)\ **Replies:** 3\ **Last updated:** [September 23, 2020, 10:50am UTC](https://discuss.elastic.co/t/how-to-add-criteria-dynamically-while-searching-against-elasticsearch/248333 "2020-09-23T10:50:32Z")
I have a big document with a requirement to dynamically search E.g. Student { id, name, Address, Associated\_Subjects phone, home\_phone, mobile, year, dob, geolocation:(lat/long) height . . . etc } Ho… --- ## [Kibana iframe request origin (client or server side)](https://discuss.elastic.co/t/kibana-iframe-request-origin-client-or-server-side/249368)
**Author:** [@Ayden](https://discuss.elastic.co/u/Ayden)\ **Replies:** 1\ **Last updated:** [September 23, 2020, 10:46am UTC](https://discuss.elastic.co/t/kibana-iframe-request-origin-client-or-server-side/249368 "2020-09-23T10:46:12Z")
Hello, I was recently looking to embed Kibana dashboards in a web application. In my current setup, Kibana is in a private network and the web application will be in a different host publicly accessible. The clients wo… --- ## [The request for this panel failed for TSVB visualization](https://discuss.elastic.co/t/the-request-for-this-panel-failed-for-tsvb-visualization/249616)
**Author:** [@akshatha](https://discuss.elastic.co/u/akshatha)\ **Replies:** 2\ **Last updated:** [September 23, 2020, 10:06am UTC](https://discuss.elastic.co/t/the-request-for-this-panel-failed-for-tsvb-visualization/249616 "2020-09-23T10:06:40Z")
Hi, I'm trying to create visualization with super user access, while creating TSVB visualization it shows "The request for this panel failed". Can anyone please share what is the reason and how to resolve this issue. … --- ## [Update Angular version from 1.6.9 to 1.8.0](https://discuss.elastic.co/t/update-angular-version-from-1-6-9-to-1-8-0/249488)
**Author:** [@MOHIT2710](https://discuss.elastic.co/u/MOHIT2710)\ **Replies:** 3\ **Last updated:** [September 23, 2020, 9:28am UTC](https://discuss.elastic.co/t/update-angular-version-from-1-6-9-to-1-8-0/249488 "2020-09-23T09:28:32Z")
Hi Team, I am using kibana 6.3.2 version and I would like to update some dependencies like angular version from 1.6.9 to 1.8.0 and handlebars .Is it possible to update these specific libraries in kibana.If yes, Please g… --- ## [Elastic does not index some of the data](https://discuss.elastic.co/t/elastic-does-not-index-some-of-the-data/249459)
**Author:** [@Orly\_Knop](https://discuss.elastic.co/u/Orly_Knop)\ **Replies:** 10\ **Last updated:** [September 23, 2020, 9:13am UTC](https://discuss.elastic.co/t/elastic-does-not-index-some-of-the-data/249459 "2020-09-23T09:13:48Z")
I have set up indexing of 3 types of data: items, single pages and files. All of them are represented as objects with properties. This is some examples of the properties: For some reason, if I include file content pro… --- ## [Kibana logging although logging.silent: true](https://discuss.elastic.co/t/kibana-logging-although-logging-silent-true/249382)
**Author:** [@adleCode](https://discuss.elastic.co/u/adleCode)\ **Replies:** 1\ **Last updated:** [September 23, 2020, 9:25am UTC](https://discuss.elastic.co/t/kibana-logging-although-logging-silent-true/249382 "2020-09-23T09:25:11Z")
Hello, When i launch my elk stack kibana bombards my stdout with log messages such as: kibana | {"type":"log","@timestamp":"2020-09-21T14:28:11Z","tags":\["status","plugin:timelion@7.6.2","info"\],"pid":6,"st… [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1223) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1225)