# \#none **URL:** https://discuss.elastic.co/tag/none.md?no_tags=true&page=784 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 785 --- ## [How to make logstash to automatically detect new pipleines configuration and execute them?](https://discuss.elastic.co/t/how-to-make-logstash-to-automatically-detect-new-pipleines-configuration-and-execute-them/288541)
**Author:** [@Husnain](https://discuss.elastic.co/u/Husnain)\ **Replies:** 4\ **Last updated:** [November 6, 2021, 7:06pm UTC](https://discuss.elastic.co/t/how-to-make-logstash-to-automatically-detect-new-pipleines-configuration-and-execute-them/288541 "2021-11-06T19:06:47Z")
Hii.I am using logstash to ingest data from four different data sources from i.e Elasticsearch,mongodb,textfile and mysql.My requirement is,that I will specify a directory path and logstash will read pipeline configurati… --- ## [Serval indices were created with different timestamp upon using new winlogbeat template](https://discuss.elastic.co/t/serval-indices-were-created-with-different-timestamp-upon-using-new-winlogbeat-template/288539)
**Author:** [@Alaxwora](https://discuss.elastic.co/u/Alaxwora)\ **Replies:** 1\ **Last updated:** [November 6, 2021, 4:06pm UTC](https://discuss.elastic.co/t/serval-indices-were-created-with-different-timestamp-upon-using-new-winlogbeat-template/288539 "2021-11-06T16:06:50Z")
Hello, I noted serval indices were created upon using my new winlogbeat template, and I already set ILM to rollover after 30 days or upon index size reaches 10 Giga but it seems that I made a mistake. the following scr… --- ## [How to send logs from different filebeat to logstash](https://discuss.elastic.co/t/how-to-send-logs-from-different-filebeat-to-logstash/288305)
**Author:** [@root\_linux](https://discuss.elastic.co/u/root_linux)\ **Replies:** 2\ **Last updated:** [November 6, 2021, 2:27pm UTC](https://discuss.elastic.co/t/how-to-send-logs-from-different-filebeat-to-logstash/288305 "2021-11-06T14:27:05Z")
I have configured Elasticsearch, kibana and logstash on same server. I want to send logs from multiple filebeat clients to logstash with different index name. How can I configure it? --- ## [Large shard size](https://discuss.elastic.co/t/large-shard-size/288458)
**Author:** [@caseydm](https://discuss.elastic.co/u/caseydm)\ **Replies:** 3\ **Last updated:** [November 6, 2021, 4:57am UTC](https://discuss.elastic.co/t/large-shard-size/288458 "2021-11-06T04:57:56Z")
I am setting up a new Elasticsearch cluster that will hold around 300 million records in a single index to start. The documents are academic paper data. Right now I have two nodes, so I set my shards as 2 primary and 1 r… --- ## [Java Msgs in Log](https://discuss.elastic.co/t/java-msgs-in-log/287967)
**Author:** [@SteveP](https://discuss.elastic.co/u/SteveP)\ **Replies:** 8\ **Last updated:** [November 6, 2021, 2:13am UTC](https://discuss.elastic.co/t/java-msgs-in-log/287967 "2021-11-06T02:13:16Z")
Hello all, I have installed Elasticsearch for the first time and I am seeing msgs that a terminally deprecated method in java.lang.system has been called. Should I be concerned with this, even though it looks like Elast… --- ## [Elastic Stack 7.14.1 Security Update](https://discuss.elastic.co/t/elastic-stack-7-14-1-security-update/283077)
**Author:** [@douglasday](https://discuss.elastic.co/u/douglasday)\ **Replies:** 0\ **Last updated:** [September 1, 2021, 4:10pm UTC](https://discuss.elastic.co/t/elastic-stack-7-14-1-security-update/283077 "2021-09-01T16:10:55Z")
Kibana code execution issue (ESA-2021-21) It was discovered that a user with fleet admin permissions could upload a malicious package. Due to using an older version of the js-yaml library, this package would be loaded i… --- ## [Build a Query based off the result of another query](https://discuss.elastic.co/t/build-a-query-based-off-the-result-of-another-query/288174)
**Author:** [@Wonjun\_Cho](https://discuss.elastic.co/u/Wonjun_Cho)\ **Replies:** 2\ **Last updated:** [November 5, 2021, 7:48pm UTC](https://discuss.elastic.co/t/build-a-query-based-off-the-result-of-another-query/288174 "2021-11-05T19:48:51Z")
Hi guys, I would like to know if it is possible to make a query based off the result of another query. For example, there are indices for school and students. School { "settings": { ... }, "mappings": { "propertie… --- ## [JDBC Input plugin installation](https://discuss.elastic.co/t/jdbc-input-plugin-installation/288510)
**Author:** [@SANDRA\_ROY\_ARICATT](https://discuss.elastic.co/u/SANDRA_ROY_ARICATT)\ **Replies:** 1\ **Last updated:** [November 5, 2021, 7:00pm UTC](https://discuss.elastic.co/t/jdbc-input-plugin-installation/288510 "2021-11-05T19:00:06Z")
I have the new Mac M1 Silicon. I need to get data from MySQL workbench into Elasticsearch. I came to know that it can be achieved using Logstash, which in turn uses JDBC input plugin for getting data from database into… --- ## [Dealing with invalid json](https://discuss.elastic.co/t/dealing-with-invalid-json/288179)
**Author:** [@caseydm](https://discuss.elastic.co/u/caseydm)\ **Replies:** 6\ **Last updated:** [November 5, 2021, 6:01pm UTC](https://discuss.elastic.co/t/dealing-with-invalid-json/288179 "2021-11-05T18:01:32Z")
I'm trying to import some json data that is in a column in redshift. Some of the records have a field that includes invalid json escape sequences, such as this: "work\_title": "The Discrete and Semi-continuous Fr\\'echet … --- ## [Logstash group time series by decade](https://discuss.elastic.co/t/logstash-group-time-series-by-decade/288462)
**Author:** [@caseydm](https://discuss.elastic.co/u/caseydm)\ **Replies:** 4\ **Last updated:** [November 5, 2021, 5:48pm UTC](https://discuss.elastic.co/t/logstash-group-time-series-by-decade/288462 "2021-11-05T17:48:03Z")
I am ingesting academic articles and splitting the index by year: output { elasticsearch { hosts =\> \["${ES\_HOST\_PROD}"\] index =\> "works-%{year}" user =\> "${ES\_USER\_PROD}" password =\> … --- ## [Recurring Date - What is the best patterns?](https://discuss.elastic.co/t/recurring-date-what-is-the-best-patterns/288515)
**Author:** [@Remy\_Letient](https://discuss.elastic.co/u/Remy_Letient)\ **Replies:** 0\ **Last updated:** [November 5, 2021, 5:19pm UTC](https://discuss.elastic.co/t/recurring-date-what-is-the-best-patterns/288515 "2021-11-05T17:19:11Z")
Hi, I need to represent "recurring event" like "each month" with the goal to create a calendar view of them. The events can be unlimited in time. What is the best way to represent this kind of data to permit query like… --- ## [How to make a nested term query](https://discuss.elastic.co/t/how-to-make-a-nested-term-query/288506)
**Author:** [@Araf\_Shihab](https://discuss.elastic.co/u/Araf_Shihab)\ **Replies:** 0\ **Last updated:** [November 5, 2021, 2:58pm UTC](https://discuss.elastic.co/t/how-to-make-a-nested-term-query/288506 "2021-11-05T14:58:59Z")
Hey Elasticsearch community. I have a nested query as such { "size": 20, "\_source": \["tags"\], "sort": \[ { "@timestamp": { "order": "desc" } } \], "query": { "nested" : { "path" : "tags… --- ## [No live logs coming in for Observability Engineers Module Lab 3.3/4.1](https://discuss.elastic.co/t/no-live-logs-coming-in-for-observability-engineers-module-lab-3-3-4-1/288487)
**Author:** [@Mark3](https://discuss.elastic.co/u/Mark3)\ **Replies:** 1\ **Last updated:** [November 5, 2021, 2:46pm UTC](https://discuss.elastic.co/t/no-live-logs-coming-in-for-observability-engineers-module-lab-3-3-4-1/288487 "2021-11-05T14:46:57Z")
Hi, cannot experience the value of Elastic Observability Engineer Training modules 3.3 or 4.1 as when I select "Logs" in the Kibana visualiser I am seeing no live logs appear? Is this a known fault as a colleague has ex… --- ## [SIEM network map states "Error loading map features" at all end points](https://discuss.elastic.co/t/siem-network-map-states-error-loading-map-features-at-all-end-points/288503)
**Author:** [@teamomni](https://discuss.elastic.co/u/teamomni)\ **Replies:** 0\ **Last updated:** [November 5, 2021, 2:33pm UTC](https://discuss.elastic.co/t/siem-network-map-states-error-loading-map-features-at-all-end-points/288503 "2021-11-05T14:33:47Z")
We currently are using Logstash to export all of our source, destination, and connection data from our network to our cloud, but the map states "Error loading map features" on all end points. All end points collected fr… --- ## [Avoid duplicates via node ingest pipelines](https://discuss.elastic.co/t/avoid-duplicates-via-node-ingest-pipelines/288408)
**Author:** [@omartinez](https://discuss.elastic.co/u/omartinez)\ **Replies:** 9\ **Last updated:** [November 5, 2021, 2:30pm UTC](https://discuss.elastic.co/t/avoid-duplicates-via-node-ingest-pipelines/288408 "2021-11-05T14:30:06Z")
Hi all, I need a solution on the elastic side to handle duplicate logs. I need to develop an elastic ingest node pipeline that can manage duplicates by replacing \_id with uuid, any other suggestions are welcome, but I d… --- ## [Query unique documents after my query](https://discuss.elastic.co/t/query-unique-documents-after-my-query/288496)
**Author:** [@Araf\_Shihab](https://discuss.elastic.co/u/Araf_Shihab)\ **Replies:** 0\ **Last updated:** [November 5, 2021, 1:41pm UTC](https://discuss.elastic.co/t/query-unique-documents-after-my-query/288496 "2021-11-05T13:41:02Z")
Hey stack overflow I have an Elasticsearch document that looks like below. I'm only interested in the 'tags' key. "\_index": "graph\_20211025t0909", "\_type": "\_doc", "\_id": "E12201A5-CC50-… --- ## [Upgrading Kibana from 7.14.2 to 7.15.X results in error TypeError: Cannot read property 'schema' of undefined](https://discuss.elastic.co/t/upgrading-kibana-from-7-14-2-to-7-15-x-results-in-error-typeerror-cannot-read-property-schema-of-undefined/288417)
**Author:** [@kking-biometrica](https://discuss.elastic.co/u/kking-biometrica)\ **Replies:** 7\ **Last updated:** [November 5, 2021, 1:38pm UTC](https://discuss.elastic.co/t/upgrading-kibana-from-7-14-2-to-7-15-x-results-in-error-typeerror-cannot-read-property-schema-of-undefined/288417 "2021-11-05T13:38:46Z")
I'm trying to upgrade Kibana on a Linux platform. When upgrading, I am performing the following actions: Download and extract linux tar.gz file to a temp location Stop Kibana Backup existing Kibana install: sudo cp -R… --- ## [Tsvb calculation](https://discuss.elastic.co/t/tsvb-calculation/288477)
**Author:** [@paigekim](https://discuss.elastic.co/u/paigekim)\ **Replies:** 1\ **Last updated:** [November 5, 2021, 10:47am UTC](https://discuss.elastic.co/t/tsvb-calculation/288477 "2021-11-05T10:47:40Z")
Hello, I have a question regards to tsvb calculation. I would like to get an accumulated Break Even Point(BEP) by using tsvb and you could see the attachment how I calculated. Currently, I divide accumulated revenue b… --- ## [Exporting data into HTML table](https://discuss.elastic.co/t/exporting-data-into-html-table/288485)
**Author:** [@AlessandroKP](https://discuss.elastic.co/u/AlessandroKP)\ **Replies:** 0\ **Last updated:** [November 5, 2021, 10:30am UTC](https://discuss.elastic.co/t/exporting-data-into-html-table/288485 "2021-11-05T10:30:02Z")
Hello, I am looking for a tool that lets you export data stored in Elasticsearch on a file in HTML format. I know that you can use Kibana to export the content of an index (or a subset) into CSV format. Do you know if… --- ## [Deprecation in Kibana 7.13.4](https://discuss.elastic.co/t/deprecation-in-kibana-7-13-4/284819)
**Author:** [@CatalinBinzari](https://discuss.elastic.co/u/CatalinBinzari)\ **Replies:** 3\ **Last updated:** [November 5, 2021, 10:26am UTC](https://discuss.elastic.co/t/deprecation-in-kibana-7-13-4/284819 "2021-11-05T10:26:28Z")
in kibana 7.13.4 i can not get rid of next deprecations: plugins.scanDirs is deprecated and is no longer used has been deprecated and will be removed in 8.0. To set the destination moving forward, you can use the "… --- ## [Logstash output creating error](https://discuss.elastic.co/t/logstash-output-creating-error/288161)
**Author:** [@BeMoore](https://discuss.elastic.co/u/BeMoore)\ **Replies:** 25\ **Last updated:** [November 5, 2021, 9:39am UTC](https://discuss.elastic.co/t/logstash-output-creating-error/288161 "2021-11-05T09:39:45Z")
Hi all, I have a weird error i can't nail down. Running 7.15.1 ES / Logstash I have a simple Logstash conf thats listening on a port for beats data and it should just push it to an index. input { beats { p… --- ## [Vizualize Netflow data in Kibana (used network trafic)](https://discuss.elastic.co/t/vizualize-netflow-data-in-kibana-used-network-trafic/287645)
**Author:** [@gmbynkrkrqz](https://discuss.elastic.co/u/gmbynkrkrqz)\ **Replies:** 3\ **Last updated:** [November 5, 2021, 8:03am UTC](https://discuss.elastic.co/t/vizualize-netflow-data-in-kibana-used-network-trafic/287645 "2021-11-05T08:03:18Z")
Hi, I would like to create a dashboard on Kibana using the OPNsense Netflow logs to vizualize the bandwith used per source IP. Here is my logstash config. input { # OPNsense netflow logs input udp { port =\> 1… --- ## [Create Aggregate field with separated by comma](https://discuss.elastic.co/t/create-aggregate-field-with-separated-by-comma/288463)
**Author:** [@ari\_wahyu\_nahar](https://discuss.elastic.co/u/ari_wahyu_nahar)\ **Replies:** 3\ **Last updated:** [November 5, 2021, 7:40am UTC](https://discuss.elastic.co/t/create-aggregate-field-with-separated-by-comma/288463 "2021-11-05T07:40:25Z")
Need Help. i have data like this: what steps should i take, to get results like this: A: 3 B: 3 C: 2 D: 3 E: 4 Thank you! --- ## [Dense\_vector in oss ES 7.6](https://discuss.elastic.co/t/dense-vector-in-oss-es-7-6/288471)
**Author:** [@gchakkalakkal](https://discuss.elastic.co/u/gchakkalakkal)\ **Replies:** 2\ **Last updated:** [November 5, 2021, 7:38am UTC](https://discuss.elastic.co/t/dense-vector-in-oss-es-7-6/288471 "2021-11-05T07:38:39Z")
hi All, Is dense\_vector available in OSS version of ES 7.6. As i getting below error while trying to create index using dense\_vector field type. "reason" : "No handler for type \[dense\_vector\] declared on field \[my\_vec… --- ## [Is there a way to get the key of the current aggregation bucket in script？](https://discuss.elastic.co/t/is-there-a-way-to-get-the-key-of-the-current-aggregation-bucket-in-script/288466)
**Author:** [@jakey](https://discuss.elastic.co/u/jakey)\ **Replies:** 0\ **Last updated:** [November 5, 2021, 5:27am UTC](https://discuss.elastic.co/t/is-there-a-way-to-get-the-key-of-the-current-aggregation-bucket-in-script/288466 "2021-11-05T05:27:36Z")
For example: how to get the key (country) of the current bucket in the script after aggregating countries? Hope to give a solution, thank you！ "aggs"{ "country\_group":{ "terms":{ "field":"country", "size":1000 … --- ## [Need to configure message timestamp as timestamp in elastic stack](https://discuss.elastic.co/t/need-to-configure-message-timestamp-as-timestamp-in-elastic-stack/288191)
**Author:** [@Mobin](https://discuss.elastic.co/u/Mobin)\ **Replies:** 6\ **Last updated:** [November 5, 2021, 5:06am UTC](https://discuss.elastic.co/t/need-to-configure-message-timestamp-as-timestamp-in-elastic-stack/288191 "2021-11-05T05:06:26Z")
We have created an elastic stack to monitor logs from the Linux clients. On Linux clients, filebeat is configured to ship the logs to the elastic stack. When we are searching for the logs using elastic discover option @… --- ## [Logstash Logging setting to output rubydebug info for running service](https://discuss.elastic.co/t/logstash-logging-setting-to-output-rubydebug-info-for-running-service/288435)
**Author:** [@teebu](https://discuss.elastic.co/u/teebu)\ **Replies:** 11\ **Last updated:** [November 5, 2021, 2:23am UTC](https://discuss.elastic.co/t/logstash-logging-setting-to-output-rubydebug-info-for-running-service/288435 "2021-11-05T02:23:28Z")
I'm using the default settings. When I run LS as a service, the logging in the plain.log file doesn't have any of the rubydebug output. When I run it with the -f flag, I see all the output normally. What setting file d… --- ## [ELK capabilities to replace traditional monitoring](https://discuss.elastic.co/t/elk-capabilities-to-replace-traditional-monitoring/288445)
**Author:** [@gbeltramelli](https://discuss.elastic.co/u/gbeltramelli)\ **Replies:** 3\ **Last updated:** [November 5, 2021, 1:11am UTC](https://discuss.elastic.co/t/elk-capabilities-to-replace-traditional-monitoring/288445 "2021-11-05T01:11:09Z")
Hi, I am new to Elastic and in my organization we are thinking of eliminating NAGIOS as a monitoring tool so we are investigating the capabilities that this stack can give us. I have not been able to find how to replace… --- ## [7.15 auto heap for none data node](https://discuss.elastic.co/t/7-15-auto-heap-for-none-data-node/288446)
**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\ **Replies:** 1\ **Last updated:** [November 4, 2021, 11:11pm UTC](https://discuss.elastic.co/t/7-15-auto-heap-for-none-data-node/288446 "2021-11-04T23:11:23Z")
I have noticed that none data node still allocates half of system RAM. Wouldn't it make more sense to allocate more RAM for ES heap in such node? We don't really need to leave too much RAM for the system since there's … --- ## [Azure event hub plugin modify offset](https://discuss.elastic.co/t/azure-event-hub-plugin-modify-offset/288452)
**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\ **Replies:** 3\ **Last updated:** [November 4, 2021, 10:27pm UTC](https://discuss.elastic.co/t/azure-event-hub-plugin-modify-offset/288452 "2021-11-04T22:27:59Z")
Hi where is the offset of the Azure event hub plugin is located? and if si located in the blob storage can you give me some reference where to find it? I dont have access to Azure and have to give directions to a cowor… [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=783) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=785)