# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1831 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1832 --- ## [Sending a all source document into one dest field](https://discuss.elastic.co/t/sending-a-all-source-document-into-one-dest-field/247134)
**Author:** [@bmth](https://discuss.elastic.co/u/bmth)\ **Replies:** 3\ **Last updated:** [September 1, 2020, 7:45pm UTC](https://discuss.elastic.co/t/sending-a-all-source-document-into-one-dest-field/247134 "2020-09-01T19:45:56Z")
I have the following documents in a index: { "demand\_id": 1, "date": "2020-08-20 12:00:00" }, { "action\_id": 1, "demand\_id": 1, "client": "renato", "date": "2020-08-20 12:05:00", "topic": "ready" }, { "action\_id": 1, "d… --- ## [Issues with special characters in docker env](https://discuss.elastic.co/t/issues-with-special-characters-in-docker-env/247021)
**Author:** [@NickyW1995](https://discuss.elastic.co/u/NickyW1995)\ **Replies:** 2\ **Last updated:** [September 1, 2020, 7:45pm UTC](https://discuss.elastic.co/t/issues-with-special-characters-in-docker-env/247021 "2020-09-01T19:45:45Z")
Hi, I've got an issue trying to parse special characters into CONFIG\_STRING in my dockerfile. I'm not sure here is the right place to ask, but figured someone might've come across this before. If I try to parse EN… --- ## [Logstash and InfluxDB](https://discuss.elastic.co/t/logstash-and-influxdb/246965)
**Author:** [@Vladpov](https://discuss.elastic.co/u/Vladpov)\ **Replies:** 2\ **Last updated:** [September 1, 2020, 7:39pm UTC](https://discuss.elastic.co/t/logstash-and-influxdb/246965 "2020-09-01T19:39:25Z")
Hello everyone! I'm struggling with cooperation of Logstash and InfluxDB. I'm trying to use Logstash for parsing some data and then push them to influxdb. I'm trying it with influxdb output plugin that seems not be real… --- ## [Elasctisearch warning failed to add documents to export bulks](https://discuss.elastic.co/t/elasctisearch-warning-failed-to-add-documents-to-export-bulks/247142)
**Author:** [@chen\_levi1](https://discuss.elastic.co/u/chen_levi1)\ **Replies:** 1\ **Last updated:** [September 1, 2020, 7:20pm UTC](https://discuss.elastic.co/t/elasctisearch-warning-failed-to-add-documents-to-export-bulks/247142 "2020-09-01T19:20:57Z")
Hi Elasticsearch log is full with the following warning message: \[instance-0000000057\] monitoring execution failed org.elasticsearch.xpack.monitoring.exporter.ExportException: failed to add documents to export bulks at… --- ## [Elasticsearch Indexing Not Working Periodically](https://discuss.elastic.co/t/elasticsearch-indexing-not-working-periodically/247036)
**Author:** [@jaydba](https://discuss.elastic.co/u/jaydba)\ **Replies:** 6\ **Last updated:** [September 1, 2020, 7:17pm UTC](https://discuss.elastic.co/t/elasticsearch-indexing-not-working-periodically/247036 "2020-09-01T19:17:43Z")
Hello; I am very new to working with Elasticsearch, but I've come up against an error that the vendor of our software (bundled with Elasticsearch) is not able to solve or find a root cause of. Unfortunately I am not se… --- ## [Problem with Logstash Kinesis Input Plugin](https://discuss.elastic.co/t/problem-with-logstash-kinesis-input-plugin/247037)
**Author:** [@Rahul\_Kumar4](https://discuss.elastic.co/u/Rahul_Kumar4)\ **Replies:** 2\ **Last updated:** [September 1, 2020, 5:39pm UTC](https://discuss.elastic.co/t/problem-with-logstash-kinesis-input-plugin/247037 "2020-09-01T17:39:43Z")
Seeing this error in the Kinesis input plugin which is preventing the Kinesis records from getting consumed by the Logstash workers. I switched the log level to DEBUG and managed to see this. Is this a known problem? \[2… --- ## [Remove Multiple entries in visualization](https://discuss.elastic.co/t/remove-multiple-entries-in-visualization/246327)
**Author:** [@jerin](https://discuss.elastic.co/u/jerin)\ **Replies:** 4\ **Last updated:** [September 1, 2020, 5:07pm UTC](https://discuss.elastic.co/t/remove-multiple-entries-in-visualization/246327 "2020-09-01T17:07:32Z")
Hello , I am trying to remove duplicate values in kibana viz Example : i have two keys and values Key: id value: value1 key:status value: value1 key:id value:value1 key:status value:value2 if you look above F… --- ## [After changing index template, new index not taking the changes](https://discuss.elastic.co/t/after-changing-index-template-new-index-not-taking-the-changes/245465)
**Author:** [@zvazquez](https://discuss.elastic.co/u/zvazquez)\ **Replies:** 8\ **Last updated:** [September 1, 2020, 5:06pm UTC](https://discuss.elastic.co/t/after-changing-index-template-new-index-not-taking-the-changes/245465 "2020-09-01T17:06:09Z")
Hi, I am experiencing a weird problem where I am updating an index template by changing the mapping of a timestamp property from date to date\_nano and even when in the definition of template it shows the proper mapping … --- ## [Problem with build dev kibana plugin in 7.8](https://discuss.elastic.co/t/problem-with-build-dev-kibana-plugin-in-7-8/247046)
**Author:** [@Ali\_Zali](https://discuss.elastic.co/u/Ali_Zali)\ **Replies:** 2\ **Last updated:** [September 1, 2020, 4:51pm UTC](https://discuss.elastic.co/t/problem-with-build-dev-kibana-plugin-in-7-8/247046 "2020-09-01T16:51:06Z")
Hi I want to build an external kibana plugin. I create plugin with node scripts/generate\_plugin my\_plugin\_name then in the plugin directory yarn build Its work on 7.6 and create build folder with zip file in a few seco… --- ## [Multiple small indexes or one index with potential mapping explosion](https://discuss.elastic.co/t/multiple-small-indexes-or-one-index-with-potential-mapping-explosion/244917)
**Author:** [@mcampster](https://discuss.elastic.co/u/mcampster)\ **Replies:** 2\ **Last updated:** [September 1, 2020, 4:22pm UTC](https://discuss.elastic.co/t/multiple-small-indexes-or-one-index-with-potential-mapping-explosion/244917 "2020-09-01T16:22:34Z")
Background Having read the various posts on multiple indexes with small number of document vs single index with all the documents, I still am not sure what to do in my situation... We have a approximately 2-3 million d… --- ## [Heartbeat 7.9.0 Http Send Request Headers not working](https://discuss.elastic.co/t/heartbeat-7-9-0-http-send-request-headers-not-working/246157)
**Author:** [@simonowusu](https://discuss.elastic.co/u/simonowusu)\ **Replies:** 3\ **Last updated:** [September 1, 2020, 3:52pm UTC](https://discuss.elastic.co/t/heartbeat-7-9-0-http-send-request-headers-not-working/246157 "2020-09-01T15:52:36Z")
Trying to send the user information which is required as part of the Header Http Monitor # Request settings: check.request: # Configure HTTP method to use. Only 'HEAD', 'GET' and 'POST' methods are allowed. m… --- ## [How to get metadata file for Kibana to use for OKTA](https://discuss.elastic.co/t/how-to-get-metadata-file-for-kibana-to-use-for-okta/247023)
**Author:** [@FREDDIE2020](https://discuss.elastic.co/u/FREDDIE2020)\ **Replies:** 3\ **Last updated:** [September 1, 2020, 3:32pm UTC](https://discuss.elastic.co/t/how-to-get-metadata-file-for-kibana-to-use-for-okta/247023 "2020-09-01T15:32:51Z")
Hello, Need to know how to get the metadata file for Kibana. I am needing for Okta setup. ny information greatly appreciated. Thanks, Freddie2020 --- ## [Logstash parsing ECS](https://discuss.elastic.co/t/logstash-parsing-ecs/247108)
**Author:** [@Abdelhalim](https://discuss.elastic.co/u/Abdelhalim)\ **Replies:** 4\ **Last updated:** [September 1, 2020, 3:27pm UTC](https://discuss.elastic.co/t/logstash-parsing-ecs/247108 "2020-09-01T15:27:33Z")
Hello everybody, I am using logstash to parse my firewall logs, and some logs contain these information : src=x.x.x.x srcport=YYY dst=x.x.x.x modsrc=x.x.x.x origdst=x.x.x.x dst= x.x.x.x srcport=YY modsrcport= YY ori… --- ## [Cidr filter for over 1000 subnets](https://discuss.elastic.co/t/cidr-filter-for-over-1000-subnets/247110)
**Author:** [@ksremo](https://discuss.elastic.co/u/ksremo)\ **Replies:** 0\ **Last updated:** [September 1, 2020, 3:04pm UTC](https://discuss.elastic.co/t/cidr-filter-for-over-1000-subnets/247110 "2020-09-01T15:04:54Z")
I have round about 1500 subnets, with masks from /18 to /29, but mainly /24 networks. I tried to use the cidr logstash filter plugin but the pipeline then come not up. i think because the pipeline is too big and there a… --- ## [Kibana error in log : Unable to connect to Elasticsearch Error: master not discovered exception](https://discuss.elastic.co/t/kibana-error-in-log-unable-to-connect-to-elasticsearch-error-master-not-discovered-exception/247103)
**Author:** [@FREDDIE2020](https://discuss.elastic.co/u/FREDDIE2020)\ **Replies:** 1\ **Last updated:** [September 1, 2020, 2:29pm UTC](https://discuss.elastic.co/t/kibana-error-in-log-unable-to-connect-to-elasticsearch-error-master-not-discovered-exception/247103 "2020-09-01T14:29:29Z")
Hello All, I am trying to execute mt Kibana UI login and it fails. I checked the logs for the pod and this is what it shows: \[lewellf\_adm@awva-pclif03001 kibana\]$ kubectl logs kibana-75f647cf75-5l5lz -n monitoring-too… --- ## [Scripted fields regular expression not working](https://discuss.elastic.co/t/scripted-fields-regular-expression-not-working/247102)
**Author:** [@greg.melasecca](https://discuss.elastic.co/u/greg.melasecca)\ **Replies:** 1\ **Last updated:** [September 1, 2020, 2:25pm UTC](https://discuss.elastic.co/t/scripted-fields-regular-expression-not-working/247102 "2020-09-01T14:25:33Z")
I am having issues getting my regular expression to work with my scripted fields. I have the below code (dont judge I am not a developer) and for some reason the same exact line ends up in different "else" clauses. the m… --- ## [Kibana - Stack Monitoring - No structured logs found](https://discuss.elastic.co/t/kibana-stack-monitoring-no-structured-logs-found/241213)
**Author:** [@jason\_0](https://discuss.elastic.co/u/jason_0)\ **Replies:** 22\ **Last updated:** [September 1, 2020, 2:23pm UTC](https://discuss.elastic.co/t/kibana-stack-monitoring-no-structured-logs-found/241213 "2020-09-01T14:23:28Z")
Hi All, We have an issue where Kibana throws a "No structured logs found" message in the Log section when viewing the Stack Monitoring page, where it should show the last 10 log entries. I have Filebeat running on each… --- ## [Kibana 7.4.1 Does not search string directly](https://discuss.elastic.co/t/kibana-7-4-1-does-not-search-string-directly/245358)
**Author:** [@mricote](https://discuss.elastic.co/u/mricote)\ **Replies:** 5\ **Last updated:** [September 1, 2020, 2:11pm UTC](https://discuss.elastic.co/t/kibana-7-4-1-does-not-search-string-directly/245358 "2020-09-01T14:11:31Z")
Hi. Kibana 7.4.1 in discover does not found string directly. Any idea? Regards --- ## [ES 7.9 doesn't start](https://discuss.elastic.co/t/es-7-9-doesnt-start/246908)
**Author:** [@YURA](https://discuss.elastic.co/u/YURA)\ **Replies:** 7\ **Last updated:** [September 1, 2020, 1:34pm UTC](https://discuss.elastic.co/t/es-7-9-doesnt-start/246908 "2020-09-01T13:34:04Z")
java -version openjdk version "1.8.0\_262" OpenJDK Runtime Environment (build 1.8.0\_262-b10) OpenJDK 64-Bit Server VM (build 25.262-b10, mixed mode) cat /etc/redhat-release CentOS Linux release 7.8.2003 (Core) was i… --- ## [Painless script error in getting sameday documents](https://discuss.elastic.co/t/painless-script-error-in-getting-sameday-documents/247061)
**Author:** [@Gauti](https://discuss.elastic.co/u/Gauti)\ **Replies:** 5\ **Last updated:** [September 1, 2020, 1:23pm UTC](https://discuss.elastic.co/t/painless-script-error-in-getting-sameday-documents/247061 "2020-09-01T13:23:20Z")
Hi All, We are pulling data into elasticsearch using logstash http\_poller and our datasource is servicenow. We have so many incidents created in a day, i'm trying to write a painless script get get the same day closure… --- ## [Automatically Delete older Documents](https://discuss.elastic.co/t/automatically-delete-older-documents/247078)
**Author:** [@Arun\_N](https://discuss.elastic.co/u/Arun_N)\ **Replies:** 10\ **Last updated:** [September 1, 2020, 1:16pm UTC](https://discuss.elastic.co/t/automatically-delete-older-documents/247078 "2020-09-01T13:16:54Z")
Hi Team, I need your help to understand how to set TTL like mechanism to delete the Elastic Search documentation automatically once it's reached the expiration time. I have read about delete by query API but the proble… --- ## [Index Management](https://discuss.elastic.co/t/index-management/246979)
**Author:** [@Pierrelaurent](https://discuss.elastic.co/u/Pierrelaurent)\ **Replies:** 8\ **Last updated:** [September 1, 2020, 1:16pm UTC](https://discuss.elastic.co/t/index-management/246979 "2020-09-01T13:16:46Z")
Hi There I keep getting this error when i try to start metricbeat. I have got the newest version of Logstash Elasticsearch and Kibana running on centos 7 ERROR instance/beat.go:951 Exiting: Index management requested b… --- ## [TopHitsAggregator objects are not Garbage Collected](https://discuss.elastic.co/t/tophitsaggregator-objects-are-not-garbage-collected/246487)
**Author:** [@parasharsh](https://discuss.elastic.co/u/parasharsh)\ **Replies:** 1\ **Last updated:** [September 1, 2020, 12:57pm UTC](https://discuss.elastic.co/t/tophitsaggregator-objects-are-not-garbage-collected/246487 "2020-09-01T12:57:02Z")
Hi,Recently we saw the OOM on our ES instance. On Checking the Heap Dump in VisulaVM we observed large number of instances of org.apache.lucene.search.ScoreDoc in the HEAP - 41,984,154 The dominators by Retained size (O… --- ## [Scripted field causes discover to fail kibana 7.8](https://discuss.elastic.co/t/scripted-field-causes-discover-to-fail-kibana-7-8/247083)
**Author:** [@perfectduffer](https://discuss.elastic.co/u/perfectduffer)\ **Replies:** 1\ **Last updated:** [September 1, 2020, 12:45pm UTC](https://discuss.elastic.co/t/scripted-field-causes-discover-to-fail-kibana-7-8/247083 "2020-09-01T12:45:53Z")
i added a scripted field and after that i can no longer use the discover to search or create filters, on the particular index that i added the field on... this is what i have in scripted field if(doc\['keywords.sentime… --- ## [Can we use " :: " as a separator in csv filter in logstash](https://discuss.elastic.co/t/can-we-use-as-a-separator-in-csv-filter-in-logstash/246983)
**Author:** [@Shahid\_Mustafa](https://discuss.elastic.co/u/Shahid_Mustafa)\ **Replies:** 3\ **Last updated:** [September 1, 2020, 11:59am UTC](https://discuss.elastic.co/t/can-we-use-as-a-separator-in-csv-filter-in-logstash/246983 "2020-09-01T11:59:13Z")
Can we use following csv filter: I cannot test this directly in our system. csv { columns =\> \[ "LogLevel", "DateTime", "RequestID", "LogMessage" \] s… --- ## [How to extract the uri path and the param from the uri](https://discuss.elastic.co/t/how-to-extract-the-uri-path-and-the-param-from-the-uri/245521)
**Author:** [@Tristan\_D](https://discuss.elastic.co/u/Tristan_D)\ **Replies:** 1\ **Last updated:** [September 1, 2020, 11:43am UTC](https://discuss.elastic.co/t/how-to-extract-the-uri-path-and-the-param-from-the-uri/245521 "2020-09-01T11:43:20Z")
I want to extract the uri path and the param from the uri. There are two forms of the uri, one with params and one without. Here is the examples of the uri /sentence\_func?key=23872323232 /bot\_recognize I use this patt… --- ## [Wildcard queries on multiple fields and filtering by score](https://discuss.elastic.co/t/wildcard-queries-on-multiple-fields-and-filtering-by-score/247079)
**Author:** [@zamkinos](https://discuss.elastic.co/u/zamkinos)\ **Replies:** 0\ **Last updated:** [September 1, 2020, 11:22am UTC](https://discuss.elastic.co/t/wildcard-queries-on-multiple-fields-and-filtering-by-score/247079 "2020-09-01T11:22:31Z")
I have an index like below: For example user searchs "c 001", I look at search\_all\_fields and find it in two documents. With WildCardQuery for all searching keywords " c " and " 001 " But the second one is useless. … --- ## [Remove ignore\_above default mapping from logstash instead of changing it to each index from elastic search](https://discuss.elastic.co/t/remove-ignore-above-default-mapping-from-logstash-instead-of-changing-it-to-each-index-from-elastic-search/247077)
**Author:** [@Radha](https://discuss.elastic.co/u/Radha)\ **Replies:** 0\ **Last updated:** [September 1, 2020, 11:12am UTC](https://discuss.elastic.co/t/remove-ignore-above-default-mapping-from-logstash-instead-of-changing-it-to-each-index-from-elastic-search/247077 "2020-09-01T11:12:37Z")
Hello, I am having some multiple indexes and logs are being filtered in logstash and sending to elastic search and kibana, when I see in elastic searching mapping some text/keyword fields but with additional property o… --- ## [Unable to uplaod geojson data in Kibana Maps](https://discuss.elastic.co/t/unable-to-uplaod-geojson-data-in-kibana-maps/247029)
**Author:** [@krishnendu](https://discuss.elastic.co/u/krishnendu)\ **Replies:** 1\ **Last updated:** [September 1, 2020, 10:52am UTC](https://discuss.elastic.co/t/unable-to-uplaod-geojson-data-in-kibana-maps/247029 "2020-09-01T10:52:08Z")
https://opendata.arcgis.com/datasets/2b37b84e67374fb98577c20ef8be6c62\_0.geojson I am trying to upload the above geojson data . Its failing in kibana 7.9 while its working fin on 7.8. Any suggestions ? I tried to upload … --- ## [Failed to start transform](https://discuss.elastic.co/t/failed-to-start-transform/246273)
**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\ **Replies:** 8\ **Last updated:** [September 1, 2020, 10:24am UTC](https://discuss.elastic.co/t/failed-to-start-transform/246273 "2020-09-01T10:24:09Z")
Hi I'm trying to start a transform but keep getting errors and turns the cluster's state into red (sooooo... frustrating ) last message on Kinana is "Created transform." Any help will be appreciated (removing the pain… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1830) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1832)