# \#none **URL:** https://discuss.elastic.co/tag/none.md?no_tags=true&page=1325 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1326 --- ## [Use ssl/tls between Filebeat and Logstash problems](https://discuss.elastic.co/t/use-ssl-tls-between-filebeat-and-logstash-problems/241632)
**Author:** [@d.silwon](https://discuss.elastic.co/u/d.silwon)\ **Replies:** 1\ **Last updated:** [July 17, 2020, 2:57pm UTC](https://discuss.elastic.co/t/use-ssl-tls-between-filebeat-and-logstash-problems/241632 "2020-07-17T14:57:02Z")
Dears, When I created the certs for Filebeat: /usr/share/elasticsearch/bin/elasticsearch-certutil cert --pem --ca-cert /etc/elasticsearch/certs/ca.crt --ca-key /etc/elasticsearch/certs/ca.key --in /tmp/filebeats.yml --… --- ## [Elasticsearch as producer/consumer solution](https://discuss.elastic.co/t/elasticsearch-as-producer-consumer-solution/241645)
**Author:** [@invenisso](https://discuss.elastic.co/u/invenisso)\ **Replies:** 3\ **Last updated:** [July 17, 2020, 2:53pm UTC](https://discuss.elastic.co/t/elasticsearch-as-producer-consumer-solution/241645 "2020-07-17T14:53:18Z")
Hello Community! Is it possible to use Elasticserach in a producer / consumer scenario? The producer writes documents to Elasticserach. The consumer reads documents from Eleasticserach and processes them. The order o… --- ## [Random\_score , how to moderate its impact?](https://discuss.elastic.co/t/random-score-how-to-moderate-its-impact/241555)
**Author:** [@ClubberLang](https://discuss.elastic.co/u/ClubberLang)\ **Replies:** 0\ **Last updated:** [July 16, 2020, 10:02pm UTC](https://discuss.elastic.co/t/random-score-how-to-moderate-its-impact/241555 "2020-07-16T22:02:27Z")
Hi, I use the following query, in this one I have 2 functions: distance\_feature : compute a score based on distance random\_score : compute a value between 0 and 1 The final score = distance\_feature \* random\_score Th… --- ## [Custom/Derived Metric?](https://discuss.elastic.co/t/custom-derived-metric/235625)
**Author:** [@mpn17](https://discuss.elastic.co/u/mpn17)\ **Replies:** 3\ **Last updated:** [July 17, 2020, 1:54pm UTC](https://discuss.elastic.co/t/custom-derived-metric/235625 "2020-07-17T13:54:18Z")
Hi All! I'm new to Elasticsearch and Kibana and trying to figure out the best way to create a custom metric that takes into account the current value of other metrics. For example lets say I want to create a custom str… --- ## [Kibana log error message "event.dataset cisco.asa failed to find message"](https://discuss.elastic.co/t/kibana-log-error-message-event-dataset-cisco-asa-failed-to-find-message/240034)
**Author:** [@robertitox](https://discuss.elastic.co/u/robertitox)\ **Replies:** 4\ **Last updated:** [July 17, 2020, 1:34pm UTC](https://discuss.elastic.co/t/kibana-log-error-message-event-dataset-cisco-asa-failed-to-find-message/240034 "2020-07-17T13:34:34Z")
Dear people, I have an ELK 7.8.0 server running OK. I've setup the Cisco ASA module in filebeat and all the ASA logs are coming OK to my ELK server on port UDP/514. I can see the ASA lohgs in Discover and SIEM Netwotk t… --- ## [Exclude Include options syntax in Kibana visualization](https://discuss.elastic.co/t/exclude-include-options-syntax-in-kibana-visualization/241609)
**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\ **Replies:** 3\ **Last updated:** [July 17, 2020, 1:32pm UTC](https://discuss.elastic.co/t/exclude-include-options-syntax-in-kibana-visualization/241609 "2020-07-17T13:32:46Z")
I am creating a visualization. On x-axis I am doing a terms aggregation. What is the right way for provide a series of values to be included. This works. This does not. As per the documentation, a series of terms… --- ## [Logstash memcached not returning value](https://discuss.elastic.co/t/logstash-memcached-not-returning-value/241649)
**Author:** [@WhensTheWeekend](https://discuss.elastic.co/u/WhensTheWeekend)\ **Replies:** 0\ **Last updated:** [July 17, 2020, 1:31pm UTC](https://discuss.elastic.co/t/logstash-memcached-not-returning-value/241649 "2020-07-17T13:31:41Z")
Hi, New to memcached and am using is as a filter in logstash as follows; memcached { id=\>"getconditionterminology" hosts =\> \["${memcacheserver}"\] namespace =\> "code\_concept" get =\> { "%{rsnstcode}" =\> "\[mm\_rsnstcod… --- ## [Elasticsearch Ingest Pipeline + index for language identification and text analysis](https://discuss.elastic.co/t/elasticsearch-ingest-pipeline-index-for-language-identification-and-text-analysis/241646)
**Author:** [@yolo](https://discuss.elastic.co/u/yolo)\ **Replies:** 0\ **Last updated:** [July 17, 2020, 1:17pm UTC](https://discuss.elastic.co/t/elasticsearch-ingest-pipeline-index-for-language-identification-and-text-analysis/241646 "2020-07-17T13:17:55Z")
Hi, i am using elasticsearch ingest pipeline for language identification. Furthermore, i would like to apply to each language-field a language analyzer. To my knowledge there is no ingest pipeline for langauge analyzers… --- ## [Not able to create graphs with new data available (with new data type) in same index pattern](https://discuss.elastic.co/t/not-able-to-create-graphs-with-new-data-available-with-new-data-type-in-same-index-pattern/236700)
**Author:** [@Kartikey\_Bhatore](https://discuss.elastic.co/u/Kartikey_Bhatore)\ **Replies:** 3\ **Last updated:** [July 17, 2020, 1:26pm UTC](https://discuss.elastic.co/t/not-able-to-create-graphs-with-new-data-available-with-new-data-type-in-same-index-pattern/236700 "2020-07-17T13:26:16Z")
I am using ELK v6.5.3 oss I had some data in a index say abc-xyz-2020.06.05 (its a daily index) in the above index data type of some fields were wrong. I have changed the data type in logstash and ingested data in tod… --- ## [How to parse haproxy logs using logstash and filebeat](https://discuss.elastic.co/t/how-to-parse-haproxy-logs-using-logstash-and-filebeat/241487)
**Author:** [@Kay\_Khan](https://discuss.elastic.co/u/Kay_Khan)\ **Replies:** 1\ **Last updated:** [July 17, 2020, 12:23pm UTC](https://discuss.elastic.co/t/how-to-parse-haproxy-logs-using-logstash-and-filebeat/241487 "2020-07-17T12:23:47Z")
I have setup logstash and filebeat on my ECK stack so in kibana/elasticsearch i can view logs from kubernetes. I followed this article to set this up https://medium.com/@raphaeldelio/deploy-logstash-and-filebeat-on-kuber… --- ## [Have logstash automatically parse any .json files](https://discuss.elastic.co/t/have-logstash-automatically-parse-any-json-files/241610)
**Author:** [@elk6](https://discuss.elastic.co/u/elk6)\ **Replies:** 6\ **Last updated:** [July 17, 2020, 11:55am UTC](https://discuss.elastic.co/t/have-logstash-automatically-parse-any-json-files/241610 "2020-07-17T11:55:54Z")
I'm planning on shipping lots of logs into logstash. Is it possible to configure logstash in such a way so that only if a file ends with .json it would go through: json { source =\> "message" } Thanks ahea… --- ## [Kibana 7.8: modifying the dashboard\_grid.js file for our customization is not reflecting in dashboard\_plugin.js file](https://discuss.elastic.co/t/kibana-7-8-modifying-the-dashboard-grid-js-file-for-our-customization-is-not-reflecting-in-dashboard-plugin-js-file/241413)
**Author:** [@Prathibha\_Y](https://discuss.elastic.co/u/Prathibha_Y)\ **Replies:** 4\ **Last updated:** [July 17, 2020, 11:48am UTC](https://discuss.elastic.co/t/kibana-7-8-modifying-the-dashboard-grid-js-file-for-our-customization-is-not-reflecting-in-dashboard-plugin-js-file/241413 "2020-07-17T11:48:02Z")
Hi, I have custom modified the dashboard\_grid.js file for for 7.0, 7.6 and prev versions, and it used to get reflected in kibana.plugin.js/dashboard.plugin.js file, after removing the optimize directory completely and r… --- ## [Kibana - Embedding dashboard in website with dynamic filter param](https://discuss.elastic.co/t/kibana-embedding-dashboard-in-website-with-dynamic-filter-param/241518)
**Author:** [@chezhian](https://discuss.elastic.co/u/chezhian)\ **Replies:** 1\ **Last updated:** [July 17, 2020, 11:13am UTC](https://discuss.elastic.co/t/kibana-embedding-dashboard-in-website-with-dynamic-filter-param/241518 "2020-07-17T11:13:54Z")
Hi I have the same needs as this blog some years back . I want to embbed dashboard on my website: i need to know how to pass URL filters dynamically so i can show each customer only their dashboard data based in cust… --- ## [Where did https://www.elastic.co/de/community/security go?](https://discuss.elastic.co/t/where-did-https-www-elastic-co-de-community-security-go/241502)
**Author:** [@C0FFEEC0FFEE](https://discuss.elastic.co/u/C0FFEEC0FFEE)\ **Replies:** 4\ **Last updated:** [July 17, 2020, 10:23am UTC](https://discuss.elastic.co/t/where-did-https-www-elastic-co-de-community-security-go/241502 "2020-07-17T10:23:49Z")
Im missing https://www.elastic.co/de/community/security. Until recently i went there for the Security Advisories but now it throws an 404. Where did the Security Advisories move? --- ## [We use id to update or delete without routing. I can't find this document. Is there a way to broadcast this operation without routing to all shards?](https://discuss.elastic.co/t/we-use-id-to-update-or-delete-without-routing-i-cant-find-this-document-is-there-a-way-to-broadcast-this-operation-without-routing-to-all-shards/241599)
**Author:** [@Liyes](https://discuss.elastic.co/u/Liyes)\ **Replies:** 11\ **Last updated:** [July 17, 2020, 10:09am UTC](https://discuss.elastic.co/t/we-use-id-to-update-or-delete-without-routing-i-cant-find-this-document-is-there-a-way-to-broadcast-this-operation-without-routing-to-all-shards/241599 "2020-07-17T10:09:08Z")
Our index has 3 primary shards. Previously, id was used for routing by default. Now we need to change to use another field as routing, and create a docuemnt based on this routing, but when we do update or delete operati… --- ## [Kibana Markdown visualization](https://discuss.elastic.co/t/kibana-markdown-visualization/239340)
**Author:** [@ErwinEnableU](https://discuss.elastic.co/u/ErwinEnableU)\ **Replies:** 2\ **Last updated:** [July 17, 2020, 9:41am UTC](https://discuss.elastic.co/t/kibana-markdown-visualization/239340 "2020-07-17T09:41:55Z")
The dashboard we created is used by our customers. For layout and the look-and-feel we use several Markdown elements within this Kibana dashboard. I would like some guidance towards layout options for this Markdown visua… --- ## [Ingest Pipeline - Check if a field exists](https://discuss.elastic.co/t/ingest-pipeline-check-if-a-field-exists/238040)
**Author:** [@sean\_wills](https://discuss.elastic.co/u/sean_wills)\ **Replies:** 1\ **Last updated:** [July 17, 2020, 9:07am UTC](https://discuss.elastic.co/t/ingest-pipeline-check-if-a-field-exists/238040 "2020-07-17T09:07:48Z")
Hello, I'm trying to do something that seems like it should be relatively simple, but I haven't been able to track down the correct syntax the documentation. I have a basic ingest pipeline which I want to use to referen… --- ## [Run a subquery for each of the filtered documents](https://discuss.elastic.co/t/run-a-subquery-for-each-of-the-filtered-documents/237925)
**Author:** [@kamboh](https://discuss.elastic.co/u/kamboh)\ **Replies:** 1\ **Last updated:** [July 17, 2020, 8:50am UTC](https://discuss.elastic.co/t/run-a-subquery-for-each-of-the-filtered-documents/237925 "2020-07-17T08:50:50Z")
I have an index named employees with the following structure: { id: integer, name: text, age: integer, cityId: integer, resumeText: text \<--------- parsed resume text } I want to search employees with certain… --- ## [How to skip second row in log file while processing it through CSV filter](https://discuss.elastic.co/t/how-to-skip-second-row-in-log-file-while-processing-it-through-csv-filter/241314)
**Author:** [@Ashish\_kapoor](https://discuss.elastic.co/u/Ashish_kapoor)\ **Replies:** 4\ **Last updated:** [July 17, 2020, 8:49am UTC](https://discuss.elastic.co/t/how-to-skip-second-row-in-log-file-while-processing-it-through-csv-filter/241314 "2020-07-17T08:49:29Z")
Hi I want to skip second line in my logs while processing these logs with CSV filter. second line of my logs looks like this: #Remark Values: ComponentType="OAM" ReleaseVersion="11.1.1.9.0" and logstash conf for pro… --- ## [Graph without any aggregation in Kibana](https://discuss.elastic.co/t/graph-without-any-aggregation-in-kibana/241594)
**Author:** [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\ **Replies:** 4\ **Last updated:** [July 17, 2020, 8:47am UTC](https://discuss.elastic.co/t/graph-without-any-aggregation-in-kibana/241594 "2020-07-17T08:47:08Z")
I have graph without any aggregation and I want to show it in Kibana How can I do that? I’ve already tried to do that in Vega but it’s a static graph and it’s not advanced and I want the graph to show millions of point… --- ## [Errors after updating plugins in 6.8](https://discuss.elastic.co/t/errors-after-updating-plugins-in-6-8/241331)
**Author:** [@jong99](https://discuss.elastic.co/u/jong99)\ **Replies:** 1\ **Last updated:** [July 17, 2020, 8:40am UTC](https://discuss.elastic.co/t/errors-after-updating-plugins-in-6-8/241331 "2020-07-17T08:40:24Z")
I'm using Logstash 6.8 and am using some updated versions of plugins which have been updated with the command: logstash-plugin update logstash-filter-kv logstash-input-s3 logstash-filter-json This has worked fine for a… --- ## [Problem with JSON file import into ElasticSearch](https://discuss.elastic.co/t/problem-with-json-file-import-into-elasticsearch/240871)
**Author:** [@siva4](https://discuss.elastic.co/u/siva4)\ **Replies:** 9\ **Last updated:** [July 17, 2020, 6:35am UTC](https://discuss.elastic.co/t/problem-with-json-file-import-into-elasticsearch/240871 "2020-07-17T06:35:59Z")
Exported data from Mongo and generated JSON file. Sample JSON File data (1 record): { "\_id": { "$oid": "5d84438f4514cb1f8a" }, "slug": "test-home-technology", "title": "test home technology", "subtitle": … --- ## [Space requirement for logstash and elasticsearch](https://discuss.elastic.co/t/space-requirement-for-logstash-and-elasticsearch/241587)
**Author:** [@falconpurple](https://discuss.elastic.co/u/falconpurple)\ **Replies:** 0\ **Last updated:** [July 17, 2020, 6:33am UTC](https://discuss.elastic.co/t/space-requirement-for-logstash-and-elasticsearch/241587 "2020-07-17T06:33:05Z")
Hi, I have to ELK stack . The filebeat collects log and then passes to kafka for buffering and then to logstash for analysis and filtering .The data is passes then to elasticsearch and displaying dashboards on kibana. … --- ## [Highlight does not work properly with ScriptScore, version 7.8](https://discuss.elastic.co/t/highlight-does-not-work-properly-with-scriptscore-version-7-8/241584)
**Author:** [@gurjit\_buck](https://discuss.elastic.co/u/gurjit_buck)\ **Replies:** 0\ **Last updated:** [July 17, 2020, 6:22am UTC](https://discuss.elastic.co/t/highlight-does-not-work-properly-with-scriptscore-version-7-8/241584 "2020-07-17T06:22:06Z")
Elasticsearch version (7.8): OS version (Windows 10): Along with ScriptScore function, Highlight function does not work properly. If we search two words only first word gets higlighted or last word doesn't display hig… --- ## [Logstash date filter can not convert certain range of unix time](https://discuss.elastic.co/t/logstash-date-filter-can-not-convert-certain-range-of-unix-time/241425)
**Author:** [@Rex\_lin](https://discuss.elastic.co/u/Rex_lin)\ **Replies:** 2\ **Last updated:** [July 17, 2020, 6:09am UTC](https://discuss.elastic.co/t/logstash-date-filter-can-not-convert-certain-range-of-unix-time/241425 "2020-07-17T06:09:46Z")
I have met some date filter problem, when tried to convert my unix time to seconds. As my picture, when I input "2903299199" , I except the result is "2061-12-31T23:59:59+00:00 in ISO 8601, however it returned failure… --- ## [Would there be an impact / difference of Big and Small Indices?](https://discuss.elastic.co/t/would-there-be-an-impact-difference-of-big-and-small-indices/241560)
**Author:** [@Noctis17](https://discuss.elastic.co/u/Noctis17)\ **Replies:** 8\ **Last updated:** [July 17, 2020, 6:05am UTC](https://discuss.elastic.co/t/would-there-be-an-impact-difference-of-big-and-small-indices/241560 "2020-07-17T06:05:55Z")
Hello and good day! Just like what the title says, I humbly request for you guys' expertise and a healthy, bountiful discussion regarding this.... My team has 2 indices called "web" and "socialmedia", both of them got … --- ## [Still getting 'max open shards' error after re-indexing and decreasing shards to 850](https://discuss.elastic.co/t/still-getting-max-open-shards-error-after-re-indexing-and-decreasing-shards-to-850/241369)
**Author:** [@anda](https://discuss.elastic.co/u/anda)\ **Replies:** 9\ **Last updated:** [July 17, 2020, 5:42am UTC](https://discuss.elastic.co/t/still-getting-max-open-shards-error-after-re-indexing-and-decreasing-shards-to-850/241369 "2020-07-17T05:42:49Z")
Hello, I'm running ELK 7.4 and have been getting this error in Logstash logs for basically every event that's being processed: \[2020-07-15T15:24:06,789\]\[WARN \]\[logstash.outputs.elasticsearch\]\[enm\] Could not index event… --- ## [Mapping Value is not changing after updating](https://discuss.elastic.co/t/mapping-value-is-not-changing-after-updating/241437)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 2\ **Last updated:** [July 17, 2020, 5:35am UTC](https://discuss.elastic.co/t/mapping-value-is-not-changing-after-updating/241437 "2020-07-17T05:35:39Z")
"mappings": { "properties": { "client.ip":{"type": "ip"}, "host.ip":{"type": "ip"}, "server.ip":{"type": "ip"}, "source.ip":{"type": "ip"}, "destination.ip":{"type": "ip"}, "geoip": { "dynamic": true, "properti… --- ## [Failed to setup APM - yaml: line 159: did not find expected key](https://discuss.elastic.co/t/failed-to-setup-apm-yaml-line-159-did-not-find-expected-key/241575)
**Author:** [@GraceYu](https://discuss.elastic.co/u/GraceYu)\ **Replies:** 2\ **Last updated:** [July 17, 2020, 5:29am UTC](https://discuss.elastic.co/t/failed-to-setup-apm-yaml-line-159-did-not-find-expected-key/241575 "2020-07-17T05:29:13Z")
Hi, I have failed to setup APM. ./apm-server setup Exiting: error loading config file: yaml: line 159: did not find expected key The following is the yml file: output.elasticsearch: hosts: \[":9200"\] username: "ela… --- ## [CircuitBreakingException Data too large](https://discuss.elastic.co/t/circuitbreakingexception-data-too-large/237953)
**Author:** [@Barak](https://discuss.elastic.co/u/Barak)\ **Replies:** 3\ **Last updated:** [July 17, 2020, 3:33am UTC](https://discuss.elastic.co/t/circuitbreakingexception-data-too-large/237953 "2020-07-17T03:33:55Z")
Hi, I have an ES stack running on AWS spot instances, so shard reallocation happens quite frequently. Occasionally I receive the following error message and then the shard remains unassigned without further allocation … [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1324) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1326)