# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1968

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1969

---

## [Transfer csv to elasticsearch from Python](https://discuss.elastic.co/t/transfer-csv-to-elasticsearch-from-python/238044)

<div class="topic-metadata">

**Author:** [@namali](https://discuss.elastic.co/u/namali)\
**Replies:** 4\
**Last updated:** [June 26, 2020, 4:19pm UTC](https://discuss.elastic.co/t/transfer-csv-to-elasticsearch-from-python/238044 "2020-06-26T16:19:28Z")

</div>

wanted to transfer following csv to elsticsearch |hcode|hname| |1|aaaa| |2|bbbbb| |3|ccccc| |4|dddd| |5|eeee| |6|ffff| and need to insert hcode field as document\_id. getting below error elasticseach version is 7…

---

## [Fscrawler not indexing all files](https://discuss.elastic.co/t/fscrawler-not-indexing-all-files/236576)

<div class="topic-metadata">

**Author:** [@morningkaren](https://discuss.elastic.co/u/morningkaren)\
**Replies:** 3\
**Last updated:** [June 26, 2020, 3:57pm UTC](https://discuss.elastic.co/t/fscrawler-not-indexing-all-files/236576 "2020-06-26T15:57:37Z")

</div>

Hello, I am having trouble getting fscrawler to index all my files. For example, I am trying to index all 7701 files , but only 2627 got indexed after a full day. The count stopped at 2627 today. I took some files that…

---

## [Beats monitoring settings](https://discuss.elastic.co/t/beats-monitoring-settings/238882)

<div class="topic-metadata">

**Author:** [@Ronin](https://discuss.elastic.co/u/Ronin)\
**Replies:** 0\
**Last updated:** [June 26, 2020, 3:37pm UTC](https://discuss.elastic.co/t/beats-monitoring-settings/238882 "2020-06-26T15:37:58Z")

</div>

We are using Elastic Cloud and its unclear from the documentation of what we should put for the monitoring settings. Following this documentation: https://www.elastic.co/guide/en/beats/filebeat/current/monitoring-interna…

---

## [Multiple logstash configs with different filters running at the same time](https://discuss.elastic.co/t/multiple-logstash-configs-with-different-filters-running-at-the-same-time/238749)

<div class="topic-metadata">

**Author:** [@Archie\_Crawford](https://discuss.elastic.co/u/Archie_Crawford)\
**Replies:** 6\
**Last updated:** [June 26, 2020, 3:14pm UTC](https://discuss.elastic.co/t/multiple-logstash-configs-with-different-filters-running-at-the-same-time/238749 "2020-06-26T15:14:21Z")

</div>

Hello, I have been having this issue when I try to send server logs to logstash.. Java stack trace server logs sent to Logstash with their own input.conf filter.conf and output.conf and Cisco ASA firewall logs going t…

---

## [Add\_tags processor in Filebeat panw module](https://discuss.elastic.co/t/add-tags-processor-in-filebeat-panw-module/238745)

<div class="topic-metadata">

**Author:** [@zombiebrak](https://discuss.elastic.co/u/zombiebrak)\
**Replies:** 2\
**Last updated:** [June 26, 2020, 3:06pm UTC](https://discuss.elastic.co/t/add-tags-processor-in-filebeat-panw-module/238745 "2020-06-26T15:06:42Z")

</div>

I am trying to implement the add\_tags processor within the panw Filebeat module, but Filebeat fails with the error: Exiting: each processor must have exactly one action, but found 2 actions (add\_locale,add\_tags) add\_lo…

---

## [Vega Transform Timestamp to date](https://discuss.elastic.co/t/vega-transform-timestamp-to-date/238834)

<div class="topic-metadata">

**Author:** [@issaissa](https://discuss.elastic.co/u/issaissa)\
**Replies:** 1\
**Last updated:** [June 26, 2020, 2:59pm UTC](https://discuss.elastic.co/t/vega-transform-timestamp-to-date/238834 "2020-06-26T14:59:45Z")

</div>

In vega-lite I can transform timestamp into time type after reading it from index as follows: transform: \[{calculate: "toDate(datum.\_source\['measure\_date\_time'\])", as: "time"} \] what is the equivalent for this in ve…

---

## [Sum of one common value on two fields](https://discuss.elastic.co/t/sum-of-one-common-value-on-two-fields/238877)

<div class="topic-metadata">

**Author:** [@kamfart](https://discuss.elastic.co/u/kamfart)\
**Replies:** 0\
**Last updated:** [June 26, 2020, 2:55pm UTC](https://discuss.elastic.co/t/sum-of-one-common-value-on-two-fields/238877 "2020-06-26T14:55:16Z")

</div>

Hi there, I'm trying to build a visualisation which calculates the sum of one specific value across all my documents filtered by 2 fields. Here some truncated data to illustrate my words : { ... "class": "A", "valu…

---

## [How to change field type from string to number](https://discuss.elastic.co/t/how-to-change-field-type-from-string-to-number/238876)

<div class="topic-metadata">

**Author:** [@peirceg](https://discuss.elastic.co/u/peirceg)\
**Replies:** 0\
**Last updated:** [June 26, 2020, 2:40pm UTC](https://discuss.elastic.co/t/how-to-change-field-type-from-string-to-number/238876 "2020-06-26T14:40:25Z")

</div>

I have imported some sample sales data and want to change the total profits field from a string to a number. I have no coding experience and do not understand the steps on most google pages. Any help would be appreciated…

---

## [Curator no output](https://discuss.elastic.co/t/curator-no-output/238317)

<div class="topic-metadata">

**Author:** [@Yawn](https://discuss.elastic.co/u/Yawn)\
**Replies:** 5\
**Last updated:** [June 26, 2020, 2:12pm UTC](https://discuss.elastic.co/t/curator-no-output/238317 "2020-06-26T14:12:05Z")

</div>

Hello, I am having a weird issue with curator. I did some tests previously running curator manually to take a few snapshots, and it worked. Now I am running it again and I see nothing happening and nothing in the logs…

---

## [Visualization: Display missing values on filter aggregation](https://discuss.elastic.co/t/visualization-display-missing-values-on-filter-aggregation/238586)

<div class="topic-metadata">

**Author:** [@kimjavier43](https://discuss.elastic.co/u/kimjavier43)\
**Replies:** 4\
**Last updated:** [June 26, 2020, 2:09pm UTC](https://discuss.elastic.co/t/visualization-display-missing-values-on-filter-aggregation/238586 "2020-06-26T14:09:19Z")

</div>

Hello, Is there a way to include missing fields in filters aggregation like in terms aggregation? Thanks,

---

## [Journalbeat container.image output incompatible with ECS](https://discuss.elastic.co/t/journalbeat-container-image-output-incompatible-with-ecs/236475)

<div class="topic-metadata">

**Author:** [@bbailey](https://discuss.elastic.co/u/bbailey)\
**Replies:** 3\
**Last updated:** [June 26, 2020, 1:31pm UTC](https://discuss.elastic.co/t/journalbeat-container-image-output-incompatible-with-ecs/236475 "2020-06-26T13:31:46Z")

</div>

Using Journalbeat, logstash and elasticsearch version 7.6.0 we are getting bulk indexing errors due to an incompatibility with the ECS schema Journalbeat appears to be outputting container.image as a concrete value wher…

---

## [Terms aggregations exclude the key of parent](https://discuss.elastic.co/t/terms-aggregations-exclude-the-key-of-parent/236977)

<div class="topic-metadata">

**Author:** [@Peter\_Steenbergen](https://discuss.elastic.co/u/Peter_Steenbergen)\
**Replies:** 3\
**Last updated:** [June 26, 2020, 1:23pm UTC](https://discuss.elastic.co/t/terms-aggregations-exclude-the-key-of-parent/236977 "2020-06-26T13:23:26Z")

</div>

GET posts/\_search { "size": 0, "aggs": { "hashtags": { "terms": { "field": "hashtags", "size": 10 }, "aggs": { "tagalongs": { …

---

## [Setting the User-Agent of heartbeat](https://discuss.elastic.co/t/setting-the-user-agent-of-heartbeat/238806)

<div class="topic-metadata">

**Author:** [@Peter\_Steenbergen](https://discuss.elastic.co/u/Peter_Steenbergen)\
**Replies:** 4\
**Last updated:** [June 26, 2020, 11:12am UTC](https://discuss.elastic.co/t/setting-the-user-agent-of-heartbeat/238806 "2020-06-26T11:12:19Z")

</div>

Is there a way to set override the user-agent of heartbeat? The default one is "Go-http-client/1.1" I want to change that to "heartbeat".

---

## [Elasticsearch - query with 2 conditions](https://discuss.elastic.co/t/elasticsearch-query-with-2-conditions/238273)

<div class="topic-metadata">

**Author:** [@Rohlik](https://discuss.elastic.co/u/Rohlik)\
**Replies:** 3\
**Last updated:** [June 26, 2020, 1:15pm UTC](https://discuss.elastic.co/t/elasticsearch-query-with-2-conditions/238273 "2020-06-26T13:15:40Z")

</div>

Hi there, I want get result from Elasticsearch of specific fields (and their values) which match 2 criteria - date and string match. But I something doing wrong, because I receiving this error: \[match\] malformed quer…

---

## [Possible values for ‘discovery-type’ (re-opening)](https://discuss.elastic.co/t/possible-values-for-discovery-type-re-opening/238837)

<div class="topic-metadata">

**Author:** [@formiaczek](https://discuss.elastic.co/u/formiaczek)\
**Replies:** 2\
**Last updated:** [June 26, 2020, 1:11pm UTC](https://discuss.elastic.co/t/possible-values-for-discovery-type-re-opening/238837 "2020-06-26T13:11:30Z")

</div>

no longer allows to add replies.. (nor to re-open it) . I'm not satisfied with this setting, given @DavidTurner's answer: single-node is the only permitted value for discovery.type . The only other option is not t…

---

## [Querying log data to get unique error messages](https://discuss.elastic.co/t/querying-log-data-to-get-unique-error-messages/238774)

<div class="topic-metadata">

**Author:** [@N220](https://discuss.elastic.co/u/N220)\
**Replies:** 0\
**Last updated:** [June 26, 2020, 3:37am UTC](https://discuss.elastic.co/t/querying-log-data-to-get-unique-error-messages/238774 "2020-06-26T03:37:13Z")

</div>

Hi , Issue: To get unique error messages from the logs available in elastic search. I have enabled field data as true for text fields. my query: { "query": { "bool": { "must": \[ { "match…

---

## [Filebeat lost lines from docker json log file](https://discuss.elastic.co/t/filebeat-lost-lines-from-docker-json-log-file/238863)

<div class="topic-metadata">

**Author:** [@BBrainBurst](https://discuss.elastic.co/u/BBrainBurst)\
**Replies:** 0\
**Last updated:** [June 26, 2020, 1:05pm UTC](https://discuss.elastic.co/t/filebeat-lost-lines-from-docker-json-log-file/238863 "2020-06-26T13:05:50Z")

</div>

Hi, I'm using Filebeat to process docker json logs and send them into logstash. My Filebeat config: filebeat.inputs: - type: docker containers.ids: '\*' processors: - add\_docker\_metadata: …

---

## [Keyword default size](https://discuss.elastic.co/t/keyword-default-size/238735)

<div class="topic-metadata">

**Author:** [@cjabrantes](https://discuss.elastic.co/u/cjabrantes)\
**Replies:** 4\
**Last updated:** [June 26, 2020, 12:54pm UTC](https://discuss.elastic.co/t/keyword-default-size/238735 "2020-06-26T12:54:39Z")

</div>

Hi, As far as i know the keywords are created automatically with 256. Problem is that when i do some group by term with that field some are missing because they are a bit above 256. I can add the mapping with 300, but…

---

## [Unable to create Index in kibana](https://discuss.elastic.co/t/unable-to-create-index-in-kibana/238633)

<div class="topic-metadata">

**Author:** [@Magesh](https://discuss.elastic.co/u/Magesh)\
**Replies:** 3\
**Last updated:** [June 26, 2020, 11:46am UTC](https://discuss.elastic.co/t/unable-to-create-index-in-kibana/238633 "2020-06-26T11:46:07Z")

</div>

Hi i have created logstash index logstash\* please refer the screen however i'm unable to create index pattern in Kibana, my index (logstash\*) is not getting listed, Please refer the screenshot

---

## [Is there a way to use http input where you can keep the contents in sync like jdbc plugin?](https://discuss.elastic.co/t/is-there-a-way-to-use-http-input-where-you-can-keep-the-contents-in-sync-like-jdbc-plugin/238846)

<div class="topic-metadata">

**Author:** [@genehunter29009](https://discuss.elastic.co/u/genehunter29009)\
**Replies:** 1\
**Last updated:** [June 26, 2020, 11:37am UTC](https://discuss.elastic.co/t/is-there-a-way-to-use-http-input-where-you-can-keep-the-contents-in-sync-like-jdbc-plugin/238846 "2020-06-26T11:37:21Z")

</div>

Is there a way to use the http input in logstash where you are constantly polling to get the latest records in the same way you can do that with the jdbc plugin and tracking column?

---

## [Gauge visualization: Is there a way to set the default value as 0](https://discuss.elastic.co/t/gauge-visualization-is-there-a-way-to-set-the-default-value-as-0/238830)

<div class="topic-metadata">

**Author:** [@calumpp](https://discuss.elastic.co/u/calumpp)\
**Replies:** 0\
**Last updated:** [June 26, 2020, 10:06am UTC](https://discuss.elastic.co/t/gauge-visualization-is-there-a-way-to-set-the-default-value-as-0/238830 "2020-06-26T10:06:25Z")

</div>

Hi, I have a few gauge visualizations that display information on servers once the controls has a server selected. However when there is nothing selected on the controls, it displays a value for the first server on the …

---

## [Elastic Search Repository possibility to get more than 10000 results](https://discuss.elastic.co/t/elastic-search-repository-possibility-to-get-more-than-10000-results/238832)

<div class="topic-metadata">

**Author:** [@Naveena1](https://discuss.elastic.co/u/Naveena1)\
**Replies:** 1\
**Last updated:** [June 26, 2020, 11:18am UTC](https://discuss.elastic.co/t/elastic-search-repository-possibility-to-get-more-than-10000-results/238832 "2020-06-26T11:18:19Z")

</div>

Hi, I am using ElasticSearchRepository and fetching search results using SearchQuery. like below :- Employee class represents documents of Employee index in ElasticSearch and EmployeeRepository is elasticsearch reposi…

---

## [GROK filter for specific keyword and values](https://discuss.elastic.co/t/grok-filter-for-specific-keyword-and-values/238808)

<div class="topic-metadata">

**Author:** [@Akshara](https://discuss.elastic.co/u/Akshara)\
**Replies:** 9\
**Last updated:** [June 26, 2020, 11:11am UTC](https://discuss.elastic.co/t/grok-filter-for-specific-keyword-and-values/238808 "2020-06-26T11:11:47Z")

</div>

LOG MSG : "2020-05-13 09:30:15.405 \[localhost\] \[Services\] \[Request Id : 06118032-ba2f-406e-b6b3-89f0511924ba\] \[User Id : HUNTER@UK.B-AND-Q.COM\] INFO com.logging.aspect.AspectController:120 - \[1242,124202,\] Exit LookupLa…

---

## [Trial Version](https://discuss.elastic.co/t/trial-version/238783)

<div class="topic-metadata">

**Author:** [@adz](https://discuss.elastic.co/u/adz)\
**Replies:** 3\
**Last updated:** [June 26, 2020, 11:02am UTC](https://discuss.elastic.co/t/trial-version/238783 "2020-06-26T11:02:10Z")

</div>

I would like to inquire about how I can use the trial version on my local machine instead of the cloud.

---

## [Bad Request error when creating a new Kibana index pattern](https://discuss.elastic.co/t/bad-request-error-when-creating-a-new-kibana-index-pattern/238831)

<div class="topic-metadata">

**Author:** [@Mark\_Duncan](https://discuss.elastic.co/u/Mark_Duncan)\
**Replies:** 2\
**Last updated:** [June 26, 2020, 10:56am UTC](https://discuss.elastic.co/t/bad-request-error-when-creating-a-new-kibana-index-pattern/238831 "2020-06-26T10:56:14Z")

</div>

I am getting an error when trying to create a new Kibana index pattern: Error: Bad Request I don't have any details about why it's not working. Any thoughts? ... I did apply the following the other day - intending …

---

## [Time series calendar](https://discuss.elastic.co/t/time-series-calendar/238838)

<div class="topic-metadata">

**Author:** [@balaji\_18](https://discuss.elastic.co/u/balaji_18)\
**Replies:** 0\
**Last updated:** [June 26, 2020, 10:44am UTC](https://discuss.elastic.co/t/time-series-calendar/238838 "2020-06-26T10:44:17Z")

</div>

Hi team, We are trying to implement vs prior concept in kibana, where as we used serial Diff using TSVB, we got output with comparison of previous month, but if we use the calendar using date range selector, the value i…

---

## [Getting some erroe while accessing discover tab in kibana](https://discuss.elastic.co/t/getting-some-erroe-while-accessing-discover-tab-in-kibana/238836)

<div class="topic-metadata">

**Author:** [@Masco\_Kaliyamoorthy](https://discuss.elastic.co/u/Masco_Kaliyamoorthy)\
**Replies:** 0\
**Last updated:** [June 26, 2020, 10:35am UTC](https://discuss.elastic.co/t/getting-some-erroe-while-accessing-discover-tab-in-kibana/238836 "2020-06-26T10:35:06Z")

</div>

Getting the error message while try to access the discover tab from a index Error: Request to Elasticsearch failed: {"error":{}} at http://10.9.76.205:5601/bundles/commons.bundle.js:3:4901144 at Function.\_module.servi…

---

## [Cluster with 2 node in es 7.8 version showing 1 node only](https://discuss.elastic.co/t/cluster-with-2-node-in-es-7-8-version-showing-1-node-only/238833)

<div class="topic-metadata">

**Author:** [@Dilip\_Kumar](https://discuss.elastic.co/u/Dilip_Kumar)\
**Replies:** 0\
**Last updated:** [June 26, 2020, 10:21am UTC](https://discuss.elastic.co/t/cluster-with-2-node-in-es-7-8-version-showing-1-node-only/238833 "2020-06-26T10:21:27Z")

</div>

Hi, I am doing clustering with two nodes (Elasticsearch 7.8) everything follow according to doc, but cluster health showing only one node, means each node making 1 cluster node himself. please help in configuration, N…

---

## [Retrieve documents from Completion Suggester using Elasticsearch Java API](https://discuss.elastic.co/t/retrieve-documents-from-completion-suggester-using-elasticsearch-java-api/238810)

<div class="topic-metadata">

**Author:** [@gitterhh](https://discuss.elastic.co/u/gitterhh)\
**Replies:** 2\
**Last updated:** [June 26, 2020, 10:18am UTC](https://discuss.elastic.co/t/retrieve-documents-from-completion-suggester-using-elasticsearch-java-api/238810 "2020-06-26T10:18:28Z")

</div>

When I execute completion suggester request using curl, in the response I can find also the documents curl -X GET 'localhost:9200/shop/\_search?pretty&size=20' -H 'Content-Type: application/json' -d'{ "suggest": { …

---

## [Filebeat dissect tokenizer problem](https://discuss.elastic.co/t/filebeat-dissect-tokenizer-problem/238701)

<div class="topic-metadata">

**Author:** [@elastic\_dave](https://discuss.elastic.co/u/elastic_dave)\
**Replies:** 2\
**Last updated:** [June 26, 2020, 9:57am UTC](https://discuss.elastic.co/t/filebeat-dissect-tokenizer-problem/238701 "2020-06-26T09:57:06Z")

</div>

Hi everyone, having problem with setting up .yml config file and specificaly processors:dissect. i have root filebeat.yml file pointing to several config files. This seems to work, in filebeat log i can see that confi…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1967)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1969)
