# Latest **URL:** https://discuss.elastic.co/latest.md?page=1872 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1873 --- ## [ElasticSearch 6.8 Slow on Apple Silicon](https://discuss.elastic.co/t/elasticsearch-6-8-slow-on-apple-silicon/262379)
**Author:** [@gjaldon](https://discuss.elastic.co/u/gjaldon)\ **Replies:** 0\ **Last updated:** [January 27, 2021, 2:42pm UTC](https://discuss.elastic.co/t/elasticsearch-6-8-slow-on-apple-silicon/262379 "2021-01-27T14:42:49Z")
Hi everyone! I'm running ElasticSearch 6.8 on my Mac Air M1 which I downloaded from https://www.elastic.co/guide/en/elasticsearch/reference/6.8/zip-targz.html. I noticed that our test suite runs much slower on Elasticsea… --- ## [Fscrawler](https://discuss.elastic.co/t/fscrawler/260467)
**Author:** [@vikram\_singh](https://discuss.elastic.co/u/vikram_singh)\ **Replies:** 14\ **Last updated:** [January 27, 2021, 2:25pm UTC](https://discuss.elastic.co/t/fscrawler/260467 "2021-01-27T14:25:25Z")
Hi I am running elasticsearch cluster in docker. Setup fscrawler, but when I am running it is giving error We can not start Elasticsearch Client. Exiting. Here are complete error Recreating fscrawler ... done Attachin… --- ## [Boost throughput of Kafka input](https://discuss.elastic.co/t/boost-throughput-of-kafka-input/261958)
**Author:** [@YvorL](https://discuss.elastic.co/u/YvorL)\ **Replies:** 5\ **Last updated:** [January 27, 2021, 2:19pm UTC](https://discuss.elastic.co/t/boost-throughput-of-kafka-input/261958 "2021-01-27T14:19:38Z")
Hi, I've tried to look up every available documentation, example, blog post that's available on the net but I couldn't find anything useful on how to speed up ingesting from Kafka. Logstash barely uses any resources (10… --- ## [Падают дата-ноды](https://discuss.elastic.co/t/topic/261924)
**Author:** [@doc113](https://discuss.elastic.co/u/doc113)\ **Replies:** 2\ **Last updated:** [January 27, 2021, 2:07pm UTC](https://discuss.elastic.co/t/topic/261924 "2021-01-27T14:07:29Z")
Доброго времени суток! Столкнулся с необъяснимой вещью - во время kNN-поиска падают дата-ноды (в разном порядке и через раз). Кластер: master 4cpu, 4gb coordinator 8cpu, 8gb (я не уверен что он играет роль, пока что … --- ## [Logstash and Mysql logs](https://discuss.elastic.co/t/logstash-and-mysql-logs/262374)
**Author:** [@cwt](https://discuss.elastic.co/u/cwt)\ **Replies:** 0\ **Last updated:** [January 27, 2021, 2:04pm UTC](https://discuss.elastic.co/t/logstash-and-mysql-logs/262374 "2021-01-27T14:04:41Z")
Hi. I have a problem with a JSON logs from mysql servers. I send such logs to logstash but they don't get into elastic and give no error. If I change single quotes for 'alerts test' to double quotes "alerts test" everyth… --- ## [Deleting data deleted from the source in Elasticsearch](https://discuss.elastic.co/t/deleting-data-deleted-from-the-source-in-elasticsearch/262366)
**Author:** [@RusseL](https://discuss.elastic.co/u/RusseL)\ **Replies:** 1\ **Last updated:** [January 27, 2021, 1:48pm UTC](https://discuss.elastic.co/t/deleting-data-deleted-from-the-source-in-elasticsearch/262366 "2021-01-27T13:48:32Z")
Hi guys, I transfer data between MSSQL and Elasticsearch using LogStash. I want the data deleted on the MSSQL side to be deleted in Elasticsearch. Is it possible? Please say if more details are required. --- ## [Logstash monitoring with metricbeat, where is Kibana viz?](https://discuss.elastic.co/t/logstash-monitoring-with-metricbeat-where-is-kibana-viz/262227)
**Author:** [@ebuildy](https://discuss.elastic.co/u/ebuildy)\ **Replies:** 1\ **Last updated:** [January 27, 2021, 1:41pm UTC](https://discuss.elastic.co/t/logstash-monitoring-with-metricbeat-where-is-kibana-viz/262227 "2021-01-27T13:41:57Z")
I have setup metricbeat to monitor logstash and output data to elasticsearch. I can see the index: "monitoring-logstash-7-mb-2021.01.26" with data. On Kibana, when I click on "Stack monitoring", Kibana asks me to setup… --- ## [Beat me if i'm wrong harvester info 302 and 333 has no use, how to turn off](https://discuss.elastic.co/t/beat-me-if-im-wrong-harvester-info-302-and-333-has-no-use-how-to-turn-off/262337)
**Author:** [@Peter\_Boos](https://discuss.elastic.co/u/Peter_Boos)\ **Replies:** 0\ **Last updated:** [January 27, 2021, 8:33am UTC](https://discuss.elastic.co/t/beat-me-if-im-wrong-harvester-info-302-and-333-has-no-use-how-to-turn-off/262337 "2021-01-27T08:33:35Z")
I test deployed ELK and installed filebeat. To see if there are interesting things mentioned in log files and manage it centrally. I already disabled the 30s update about filebeat state to much clutter imo. Another o… --- ## [Create point to point map from Logstash pipeline](https://discuss.elastic.co/t/create-point-to-point-map-from-logstash-pipeline/259722)
**Author:** [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\ **Replies:** 12\ **Last updated:** [January 27, 2021, 12:59pm UTC](https://discuss.elastic.co/t/create-point-to-point-map-from-logstash-pipeline/259722 "2021-01-27T12:59:44Z")
Hello, I am using logstash to parse my firewall logs and enrich them with geo location information geoip { source =\> "source.ip" target =\> "source.geo" } geoip { source =\> "destination.ip" … --- ## [Error reindex some data](https://discuss.elastic.co/t/error-reindex-some-data/262284)
**Author:** [@higor.grilo](https://discuss.elastic.co/u/higor.grilo)\ **Replies:** 1\ **Last updated:** [January 27, 2021, 12:27pm UTC](https://discuss.elastic.co/t/error-reindex-some-data/262284 "2021-01-27T12:27:09Z")
Hi, I've been trying to migrate my ELK from v6.8 to v7.10, but prior to this i have to solve some issues pointed by 7.0 Upgrade Assistant. I have some fields with the format: yyyy-MM-dd HH:mm:ss, i've already created a… --- ## [ILM phase don't delete indexes, only clean up](https://discuss.elastic.co/t/ilm-phase-dont-delete-indexes-only-clean-up/261440)
**Author:** [@zakabluk](https://discuss.elastic.co/u/zakabluk)\ **Replies:** 7\ **Last updated:** [January 27, 2021, 12:12pm UTC](https://discuss.elastic.co/t/ilm-phase-dont-delete-indexes-only-clean-up/261440 "2021-01-27T12:12:09Z")
I cretaed ILM policy for two steps. It's hot and delete. full template PUT \_ilm/policy/logstash-f-lb { "policy": { "phases": { "hot": { "min\_age": "0ms", "actions": { "rollover": {… --- ## [How to remove a Metricbeat daemonset?](https://discuss.elastic.co/t/how-to-remove-a-metricbeat-daemonset/262244)
**Author:** [@mchudinov](https://discuss.elastic.co/u/mchudinov)\ **Replies:** 3\ **Last updated:** [January 27, 2021, 12:01pm UTC](https://discuss.elastic.co/t/how-to-remove-a-metricbeat-daemonset/262244 "2021-01-27T12:01:44Z")
How to remove a Metricbeat daemonset created with yaml: apiVersion: beat.k8s.elastic.co/v1beta1 kind: Beat metadata: name: metricbeat namespace: myspace spec: type: metricbeat version: 7.10.2 elasticsearchRef… --- ## [Delaying Tasks](https://discuss.elastic.co/t/delaying-tasks/261949)
**Author:** [@Emiliano\_Baum](https://discuss.elastic.co/u/Emiliano_Baum)\ **Replies:** 2\ **Last updated:** [January 27, 2021, 11:20am UTC](https://discuss.elastic.co/t/delaying-tasks/261949 "2021-01-27T11:20:59Z")
Hi, i try to set the delayed\_timeout variable and have an 503 master timout error. Before that the cluster start to delay tasks: "number\_of\_pending\_tasks" : 127, the command I ran was: curl -X PUT "localhost:9200/\_al… --- ## [Nodes constantly losing connection](https://discuss.elastic.co/t/nodes-constantly-losing-connection/262331)
**Author:** [@borna\_talebi](https://discuss.elastic.co/u/borna_talebi)\ **Replies:** 3\ **Last updated:** [January 27, 2021, 10:30am UTC](https://discuss.elastic.co/t/nodes-constantly-losing-connection/262331 "2021-01-27T10:30:37Z")
I have a 2-node cluster(archive and main) and today they start losing connection. These are the two logs that keep appearing: \[2021-01-27T10:26:55,816\]\[WARN \]\[o.e.g.PersistedClusterStateService\] \[XXXarchive.XXX.local\] … --- ## [Can we linked two visualization from different index in one dashboard](https://discuss.elastic.co/t/can-we-linked-two-visualization-from-different-index-in-one-dashboard/262055)
**Author:** [@tahseen\_fatima](https://discuss.elastic.co/u/tahseen_fatima)\ **Replies:** 4\ **Last updated:** [January 27, 2021, 9:28am UTC](https://discuss.elastic.co/t/can-we-linked-two-visualization-from-different-index-in-one-dashboard/262055 "2021-01-27T09:28:32Z")
Hi, I have a ELK setup of 7.10.0v. I am having two different index with some common filed names. I want to create one dashboard with index1 and index2, so the question is can we linked two visualization in one dashboa… --- ## [Sync many nodes into one](https://discuss.elastic.co/t/sync-many-nodes-into-one/262340)
**Author:** [@manyahin](https://discuss.elastic.co/u/manyahin)\ **Replies:** 0\ **Last updated:** [January 27, 2021, 8:51am UTC](https://discuss.elastic.co/t/sync-many-nodes-into-one/262340 "2021-01-27T08:51:58Z")
Hello, This is a theoretical problem. I have 100+ servers in the world connected to the Internet. Sometimes they are offline but continue to work and collect data. I would like to sync all those servers when they are… --- ## [Winlogbeat no longer logging to Logstash](https://discuss.elastic.co/t/winlogbeat-no-longer-logging-to-logstash/261267)
**Author:** [@Craig2188](https://discuss.elastic.co/u/Craig2188)\ **Replies:** 2\ **Last updated:** [January 27, 2021, 8:50am UTC](https://discuss.elastic.co/t/winlogbeat-no-longer-logging-to-logstash/261267 "2021-01-27T08:50:11Z")
Hi, We had an instance where the disk space caused logging to stop over xmas which has now since been resolved. However, since then, 2 servers which are Server 2019 are no longer logging to Logstash \> Elastic. Winlogbe… --- ## [I will get an error on Vega with new Ealsticsearch version](https://discuss.elastic.co/t/i-will-get-an-error-on-vega-with-new-ealsticsearch-version/262200)
**Author:** [@m-amano](https://discuss.elastic.co/u/m-amano)\ **Replies:** 2\ **Last updated:** [January 27, 2021, 8:24am UTC](https://discuss.elastic.co/t/i-will-get-an-error-on-vega-with-new-ealsticsearch-version/262200 "2021-01-27T08:24:18Z")
The version of Vega is v.4.3.0 and Elasticsearch is v.7.6.1. With new version of Elasticsearch v.7.10.2, the error message below shows up on the top of Vega and no code has been changed. Infinite extent for field "y1":… --- ## [How to change data mapping to include 'suggest type' for an existing index](https://discuss.elastic.co/t/how-to-change-data-mapping-to-include-suggest-type-for-an-existing-index/261930)
**Author:** [@nadyahmed123](https://discuss.elastic.co/u/nadyahmed123)\ **Replies:** 1\ **Last updated:** [January 27, 2021, 8:21am UTC](https://discuss.elastic.co/t/how-to-change-data-mapping-to-include-suggest-type-for-an-existing-index/261930 "2021-01-27T08:21:52Z")
Hi, I am new to ES. I have already created an index index1 which has some data. I need to implement autocomplete for one of the field, so for that I need to have the suggest type added in mappings (From what I read... d… --- ## [Masternode not being discovered in the workernode server and vice versa](https://discuss.elastic.co/t/masternode-not-being-discovered-in-the-workernode-server-and-vice-versa/262148)
**Author:** [@emem](https://discuss.elastic.co/u/emem)\ **Replies:** 1\ **Last updated:** [January 27, 2021, 8:05am UTC](https://discuss.elastic.co/t/masternode-not-being-discovered-in-the-workernode-server-and-vice-versa/262148 "2021-01-27T08:05:49Z")
\[2021-01-25T13:45:26,577\]\[INFO \]\[o.e.b.BootstrapChecks \] \[data-1\] bound or publishing to a non-loopback address, enforcing bootstrap checks \[2021-01-25T13:45:26,603\]\[INFO \]\[o.e.c.c.ClusterBootstrapService\] \[data-1\] sk… --- ## [Understanding segments: are segments queried concurrently?](https://discuss.elastic.co/t/understanding-segments-are-segments-queried-concurrently/262239)
**Author:** [@gkman](https://discuss.elastic.co/u/gkman)\ **Replies:** 1\ **Last updated:** [January 27, 2021, 8:03am UTC](https://discuss.elastic.co/t/understanding-segments-are-segments-queried-concurrently/262239 "2021-01-27T08:03:51Z")
I was reading about shard sizing and best practices (How many shards should I have in my Elasticsearch cluster? | Elastic Blog) , and understood that having fewer, larger segments, can improve query performance: TIP: A… --- ## [Scaling down ElasticSearch: what happens with closed indices?](https://discuss.elastic.co/t/scaling-down-elasticsearch-what-happens-with-closed-indices/262264)
**Author:** [@caarlos0](https://discuss.elastic.co/u/caarlos0)\ **Replies:** 5\ **Last updated:** [January 27, 2021, 7:56am UTC](https://discuss.elastic.co/t/scaling-down-elasticsearch-what-happens-with-closed-indices/262264 "2021-01-27T07:56:46Z")
To scale down ElasticSearch, I usually disable allocation on a node, wait for shards to relocate, and then remove the node, e.g.: curl -X PUT "localhost:9200/\_cluster/settings" -d'{ "transient" : { "cluster.routin… --- ## [Elasticsearch Not Processing Messages](https://discuss.elastic.co/t/elasticsearch-not-processing-messages/262299)
**Author:** [@Michael\_Anderson](https://discuss.elastic.co/u/Michael_Anderson)\ **Replies:** 1\ **Last updated:** [January 27, 2021, 7:52am UTC](https://discuss.elastic.co/t/elasticsearch-not-processing-messages/262299 "2021-01-27T07:52:23Z")
Hello, I have a 4 server Elasticsearch server cluster supporting graylog, and all of a sudden things have stopped working. Elasticsearch logs do not show any overt issues. The cluster is green, etc. However, graylog h… --- ## [Problem with elasticsearch ILM](https://discuss.elastic.co/t/problem-with-elasticsearch-ilm/262265)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 3\ **Last updated:** [January 27, 2021, 7:35am UTC](https://discuss.elastic.co/t/problem-with-elasticsearch-ilm/262265 "2021-01-27T07:35:22Z")
I have an index log-wlb-sysmon-2021.01.26 having 3 shards and zero replica its size is 30 mb. Here is my sysmon index template "refresh\_interval": "5s", "number\_of\_shards": "3", "number\_of\_replicas": "0" Now … --- ## [Esrally deployment on Kubernetes](https://discuss.elastic.co/t/esrally-deployment-on-kubernetes/261960)
**Author:** [@mastermind](https://discuss.elastic.co/u/mastermind)\ **Replies:** 1\ **Last updated:** [January 27, 2021, 7:34am UTC](https://discuss.elastic.co/t/esrally-deployment-on-kubernetes/261960 "2021-01-27T07:34:51Z")
Hi, I want to deploy esrally on the Kubernetes cluster to test the performance and then run the queries can anyone tell me how I can deploy that on Kubernetes cluster. Any help would be appreciated Thank you so much --- ## [Master not discovered or elected yet, an election requires 2 nodes with ids](https://discuss.elastic.co/t/master-not-discovered-or-elected-yet-an-election-requires-2-nodes-with-ids/262205)
**Author:** [@sadff](https://discuss.elastic.co/u/sadff)\ **Replies:** 8\ **Last updated:** [January 27, 2021, 6:59am UTC](https://discuss.elastic.co/t/master-not-discovered-or-elected-yet-an-election-requires-2-nodes-with-ids/262205 "2021-01-27T06:59:25Z")
\*\*config file \*\* version: '2.2' services: es03: image: docker.elastic.co/elasticsearch/elasticsearch:7.10.2 container\_name: es03 environment: - node.name=es03 - network.publish\_host=192.168.61.… --- ## [Grouped bar chart in vega Kibana](https://discuss.elastic.co/t/grouped-bar-chart-in-vega-kibana/262088)
**Author:** [@sama.sowjanya](https://discuss.elastic.co/u/sama.sowjanya)\ **Replies:** 3\ **Last updated:** [January 27, 2021, 6:38am UTC](https://discuss.elastic.co/t/grouped-bar-chart-in-vega-kibana/262088 "2021-01-27T06:38:33Z")
Hello Everyone I have a grouped bar chart which is plotted correctly in Vega online editor, but when I try the code in Kibana the graph is not plotted correctly. The desired graph should be like x- axis year groupe… --- ## [Not able to connect elastic search from logstash](https://discuss.elastic.co/t/not-able-to-connect-elastic-search-from-logstash/262309)
**Author:** [@Madhu05281](https://discuss.elastic.co/u/Madhu05281)\ **Replies:** 2\ **Last updated:** [January 27, 2021, 6:20am UTC](https://discuss.elastic.co/t/not-able-to-connect-elastic-search-from-logstash/262309 "2021-01-27T06:20:50Z")
kind: ConfigMap metadata: name: logstash-config namespace: ns-erp data: logstash.conf: |- input { beats { port =\> "9600" } } output { # You can uncomment this line to inves… --- ## [Logstash import two columns](https://discuss.elastic.co/t/logstash-import-two-columns/262236)
**Author:** [@Farid\_N](https://discuss.elastic.co/u/Farid_N)\ **Replies:** 3\ **Last updated:** [January 27, 2021, 6:08am UTC](https://discuss.elastic.co/t/logstash-import-two-columns/262236 "2021-01-27T06:08:46Z")
Hi I use JDBC driver to connect Logstash with a data base and run a SP in statement. the result of SP is one number(integer) and two columns. I want to send these into one log in Elasticsearch Could you please tell m… --- ## [Whitelisting own cloud elasticsearch instance IP](https://discuss.elastic.co/t/whitelisting-own-cloud-elasticsearch-instance-ip/262313)
**Author:** [@mkadiri](https://discuss.elastic.co/u/mkadiri)\ **Replies:** 0\ **Last updated:** [January 27, 2021, 5:35am UTC](https://discuss.elastic.co/t/whitelisting-own-cloud-elasticsearch-instance-ip/262313 "2021-01-27T05:35:02Z")
For one our deployments we've created a traffic filter via https://cloud.elastic.co/deployment-features/traffic-filters that whitelists our VPN IP addresses. This works as expected, I can only access elasticsearch/kiban… [Previous page](https://discuss.elastic.co/latest.md?page=1871) [Next page](https://discuss.elastic.co/latest.md?page=1873)