# \#none **URL:** https://discuss.elastic.co/tag/none.md?no_tags=true&page=1106 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1107 --- ## [Snapshots - restoring an index from a large repository with long term storage (LTO ...)](https://discuss.elastic.co/t/snapshots-restoring-an-index-from-a-large-repository-with-long-term-storage-lto/259198)
**Author:** [@Rysiu](https://discuss.elastic.co/u/Rysiu)\ **Replies:** 3\ **Last updated:** [December 21, 2020, 8:18am UTC](https://discuss.elastic.co/t/snapshots-restoring-an-index-from-a-large-repository-with-long-term-storage-lto/259198 "2020-12-21T08:18:36Z")
I have a classic question about snapshots in elasticsearch. I make elasticsearch snapshots to some repository - for example, let it be some Network File System (NFS) or similar. Later this snapshot from this network st… --- ## [Dec 21st, 2020: \[EN\] When neither logging nor code tracing is enough: Log Correlation with APM](https://discuss.elastic.co/t/dec-21st-2020-en-when-neither-logging-nor-code-tracing-is-enough-log-correlation-with-apm/258560)
**Author:** [@Emanuil](https://discuss.elastic.co/u/Emanuil)\ **Replies:** 0\ **Last updated:** [December 21, 2020, 8:00am UTC](https://discuss.elastic.co/t/dec-21st-2020-en-when-neither-logging-nor-code-tracing-is-enough-log-correlation-with-apm/258560 "2020-12-21T08:00:01Z")
Application Performance Monitoring and logging both provide critical insight into your ecosystem. When paired together for context, they can provide vital clues on how to resolve problems with your applications. This pos… --- ## [Restoring deleted elasticsearch indices](https://discuss.elastic.co/t/restoring-deleted-elasticsearch-indices/259017)
**Author:** [@abi.mc](https://discuss.elastic.co/u/abi.mc)\ **Replies:** 4\ **Last updated:** [December 21, 2020, 7:44am UTC](https://discuss.elastic.co/t/restoring-deleted-elasticsearch-indices/259017 "2020-12-21T07:44:20Z")
In kibana (two node cluster ) following indices got deleted from the file system and now kibana is not accessible : bxexbuIpRXqA0n4VyXiDQA - .security-7 3R2woj\_jRVCf58Q8b9--Yg - .apm-agent-configuration RGR9AneMRx6nnQGH… --- ## [Handling custom exception serialisation for plugins](https://discuss.elastic.co/t/handling-custom-exception-serialisation-for-plugins/259225)
**Author:** [@Bukhtawar\_Khan](https://discuss.elastic.co/u/Bukhtawar_Khan)\ **Replies:** 0\ **Last updated:** [December 21, 2020, 7:37am UTC](https://discuss.elastic.co/t/handling-custom-exception-serialisation-for-plugins/259225 "2020-12-21T07:37:29Z")
The wire serialization of exceptions require exceptions to be registered. For instance if the transport node(transport inter-node communication) throws a custom exception, the caller node at transport needs to handle thi… --- ## [Logstash data type change in config file](https://discuss.elastic.co/t/logstash-data-type-change-in-config-file/258680)
**Author:** [@anjali28](https://discuss.elastic.co/u/anjali28)\ **Replies:** 3\ **Last updated:** [December 21, 2020, 7:19am UTC](https://discuss.elastic.co/t/logstash-data-type-change-in-config-file/258680 "2020-12-21T07:19:18Z")
Hello i am creating a config file to import the data from a csv file. when i call the config file as it is, its working properly and data is coming in kibana. But when i am changing the data type of a field in logstas… --- ## [Es update document very slow](https://discuss.elastic.co/t/es-update-document-very-slow/259072)
**Author:** [@111421](https://discuss.elastic.co/u/111421)\ **Replies:** 10\ **Last updated:** [December 21, 2020, 7:09am UTC](https://discuss.elastic.co/t/es-update-document-very-slow/259072 "2020-12-21T07:09:27Z")
Now it even takes about 7 minutes to update a doc. Single node, heap size: 8G, 30 shards, a total of 6.2G data, 2 million doc. This is too slow, if anyone can tell me how to solve it, I would appreciate it iostat Lin… --- ## [Cluster Health RED unassigned primary and replica shards](https://discuss.elastic.co/t/cluster-health-red-unassigned-primary-and-replica-shards/258891)
**Author:** [@RusseL](https://discuss.elastic.co/u/RusseL)\ **Replies:** 2\ **Last updated:** [December 21, 2020, 7:08am UTC](https://discuss.elastic.co/t/cluster-health-red-unassigned-primary-and-replica-shards/258891 "2020-12-21T07:08:54Z")
Hello to everyone, Cluster health turned red when a node fell from the cluster. When I re-add the node, some directories automatically turned from red to green, but there is an index still red and I don't know what to d… --- ## [Filter Plugin - "Tried to load a plugin's code, but failed."](https://discuss.elastic.co/t/filter-plugin-tried-to-load-a-plugins-code-but-failed/259216)
**Author:** [@smm](https://discuss.elastic.co/u/smm)\ **Replies:** 1\ **Last updated:** [December 21, 2020, 6:34am UTC](https://discuss.elastic.co/t/filter-plugin-tried-to-load-a-plugins-code-but-failed/259216 "2020-12-21T06:34:57Z")
Hi there, there is a logstash filter plugin called elapsed. I put (also) this into a config: elapsed { unique\_id\_field =\> "reqid" start\_tag =\> "TranBegin" end\_tag =\> "TranEnd" new\_event\_on\_match =\> false } a… --- ## [Why can't receive log from the ftp server?](https://discuss.elastic.co/t/why-cant-receive-log-from-the-ftp-server/259217)
**Author:** [@111418](https://discuss.elastic.co/u/111418)\ **Replies:** 0\ **Last updated:** [December 21, 2020, 6:14am UTC](https://discuss.elastic.co/t/why-cant-receive-log-from-the-ftp-server/259217 "2020-12-21T06:14:20Z")
My conf is input { tcp { port =\> 10514 type=\> "leo\_ftp" } tcp { port =\> 10515 type =\> "jim\_ftp" } } filter { } output { if\[type\]=="leo\_ftp"{ elasticsearch { hosts =\> \["ip:9200"\] inde… --- ## [HAProxy + Logstash](https://discuss.elastic.co/t/haproxy-logstash/259215)
**Author:** [@Gigazo1d](https://discuss.elastic.co/u/Gigazo1d)\ **Replies:** 0\ **Last updated:** [December 21, 2020, 6:04am UTC](https://discuss.elastic.co/t/haproxy-logstash/259215 "2020-12-21T06:04:45Z")
Hi! I plan to use HAProxy + Logstash to receive events and send them to another syslog server. Could you please share examples of your HAProxy config for my view. --- ## [Reading environment variables set with exec plugin](https://discuss.elastic.co/t/reading-environment-variables-set-with-exec-plugin/259189)
**Author:** [@Lukasz\_Geras](https://discuss.elastic.co/u/Lukasz_Geras)\ **Replies:** 4\ **Last updated:** [December 21, 2020, 5:56am UTC](https://discuss.elastic.co/t/reading-environment-variables-set-with-exec-plugin/259189 "2020-12-21T05:56:59Z")
Hello, could you please help me with reading environment variables set with exec plugin in logstash. Generally, my input looks like this: input{ exec{ command=\> „export FILENAME=$(ls -Arst /path/to/… --- ## [FileBeat/Modules for SNMP Trap](https://discuss.elastic.co/t/filebeat-modules-for-snmp-trap/259214)
**Author:** [@sreekeshava\_srihari](https://discuss.elastic.co/u/sreekeshava_srihari)\ **Replies:** 0\ **Last updated:** [December 21, 2020, 5:41am UTC](https://discuss.elastic.co/t/filebeat-modules-for-snmp-trap/259214 "2020-12-21T05:41:41Z")
Hi All Does Elastic Beats/Modules provide to consume SNMP Traps so that Logstash can be avoided to consume SNMP Traps. Thanks in Advance Sreekeshava S --- ## [Logstash is picking messages quiet slowly](https://discuss.elastic.co/t/logstash-is-picking-messages-quiet-slowly/259160)
**Author:** [@rohitarorait82](https://discuss.elastic.co/u/rohitarorait82)\ **Replies:** 2\ **Last updated:** [December 21, 2020, 5:02am UTC](https://discuss.elastic.co/t/logstash-is-picking-messages-quiet-slowly/259160 "2020-12-21T05:02:28Z")
Hi All, We have traffic around 100 million records per day and it was working fine till yesterday , but today I can see 50 million records are piled up at the the source system . i have tried increasing pipeline.workers… --- ## [Is this an error in documentation of "numeric\_detection"](https://discuss.elastic.co/t/is-this-an-error-in-documentation-of-numeric-detection/258944)
**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\ **Replies:** 5\ **Last updated:** [December 21, 2020, 4:50am UTC](https://discuss.elastic.co/t/is-this-an-error-in-documentation-of-numeric-detection/258944 "2020-12-21T04:50:57Z")
Hi, I was going through the documentation of Dynamic Field Mapping. In the table I see the last entry: JSON data type.......................................Elasticsearch data type string..............................… --- ## [Elastic Community Conference, Feb 26+27 2021 - CfP open now!](https://discuss.elastic.co/t/elastic-community-conference-feb-26-27-2021-cfp-open-now/259211)
**Author:** [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Replies:** 0\ **Last updated:** [December 21, 2020, 3:58am UTC](https://discuss.elastic.co/t/elastic-community-conference-feb-26-27-2021-cfp-open-now/259211 "2020-12-21T03:58:33Z")
We're super excited to announce our first global Elastic Community Conference (ElasticCC in short), is a free technical conference from the community for the community. Open to developers, practitioners, customers, and p… --- ## [Filebeat dashboards are not loaded in kibana - Running on AWS](https://discuss.elastic.co/t/filebeat-dashboards-are-not-loaded-in-kibana-running-on-aws/259204)
**Author:** [@ats](https://discuss.elastic.co/u/ats)\ **Replies:** 3\ **Last updated:** [December 21, 2020, 3:31am UTC](https://discuss.elastic.co/t/filebeat-dashboards-are-not-loaded-in-kibana-running-on-aws/259204 "2020-12-21T03:31:57Z")
I am running 3 nodes in AWS: 1 master and 2 data nodes for Elasticsearch. I installed kibana fine with no issues. Now I'm running into an issue with setting up filebeat dashboard in Kibana. Getting the following error ro… --- ## [Kibana queries time out for some directories](https://discuss.elastic.co/t/kibana-queries-time-out-for-some-directories/258684)
**Author:** [@RusseL](https://discuss.elastic.co/u/RusseL)\ **Replies:** 1\ **Last updated:** [December 21, 2020, 3:29am UTC](https://discuss.elastic.co/t/kibana-queries-time-out-for-some-directories/258684 "2020-12-21T03:29:20Z")
Kibana queries timed out for some directories. Stack Tracking is not working. I know that when I only query on one directory, the query times out. I have 12 nodes(9 data - 3 master). kibana 7.4.2 elasticsearch 7.4.2 --- ## [How to monitor/identify retry result with output elasticsearch](https://discuss.elastic.co/t/how-to-monitor-identify-retry-result-with-output-elasticsearch/258681)
**Author:** [@loker](https://discuss.elastic.co/u/loker)\ **Replies:** 0\ **Last updated:** [December 15, 2020, 8:28am UTC](https://discuss.elastic.co/t/how-to-monitor-identify-retry-result-with-output-elasticsearch/258681 "2020-12-15T08:28:00Z")
Hello there, Recently i meet some warning about es reject caused by queue exceed 200 limit. According to its retry policy for es output plugin, it should retry indefinitely for this kind of error(429). But i don't kno… --- ## [Getting MasterNotDiscoveredException: null in client nodes](https://discuss.elastic.co/t/getting-masternotdiscoveredexception-null-in-client-nodes/258699)
**Author:** [@nchalise](https://discuss.elastic.co/u/nchalise)\ **Replies:** 1\ **Last updated:** [December 21, 2020, 3:23am UTC](https://discuss.elastic.co/t/getting-masternotdiscoveredexception-null-in-client-nodes/258699 "2020-12-21T03:23:43Z")
We have 3 master nodes, 2 client nodes, and 8 data nodes. And client nodes ES logs show below mentioned error even though resource usage(JVM and CPU ) looks fine at that time. And cluster went unresponsive mode. ALL node… --- ## [How to store service account file into embedded ES keystore?](https://discuss.elastic.co/t/how-to-store-service-account-file-into-embedded-es-keystore/258956)
**Author:** [@balakrishnan](https://discuss.elastic.co/u/balakrishnan)\ **Replies:** 1\ **Last updated:** [December 21, 2020, 3:13am UTC](https://discuss.elastic.co/t/how-to-store-service-account-file-into-embedded-es-keystore/258956 "2020-12-21T03:13:14Z")
We are using embedded ES (version 5.6) and am exploring the snapshot & restore options with GCS as snapshot repository. The repository-gcs plugin expects that the service account JSON file must be added into the elastics… --- ## [Issue with Strigo lab not starting - Elastic Eng 1 On-Demand](https://discuss.elastic.co/t/issue-with-strigo-lab-not-starting-elastic-eng-1-on-demand/259084)
**Author:** [@gv007](https://discuss.elastic.co/u/gv007)\ **Replies:** 0\ **Last updated:** [December 18, 2020, 11:01am UTC](https://discuss.elastic.co/t/issue-with-strigo-lab-not-starting-elastic-eng-1-on-demand/259084 "2020-12-18T11:01:35Z")
Issue with Strigo lab not starting Lab 4.1 - Elastic Eng 1 On-Demand When I try to access the workstation on Strigo it's failing with the following error We have encountered a technical issue while setting up you lab.… --- ## [How to filter and narrow the data before aggregation](https://discuss.elastic.co/t/how-to-filter-and-narrow-the-data-before-aggregation/259147)
**Author:** [@jun\_miao](https://discuss.elastic.co/u/jun_miao)\ **Replies:** 2\ **Last updated:** [December 21, 2020, 1:44am UTC](https://discuss.elastic.co/t/how-to-filter-and-narrow-the-data-before-aggregation/259147 "2020-12-21T01:44:37Z")
Hello, all I have a query which group by groupId. { "aggs":{ "result":{ "terms":{ "field":"groupId", "size": 100 } } }, "size": 0 } Because the index co… --- ## [Should we create New Index or Use the same index for all application logs(number of app ~ 5)](https://discuss.elastic.co/t/should-we-create-new-index-or-use-the-same-index-for-all-application-logs-number-of-app-5/259011)
**Author:** [@SHOAIB\_AHMED](https://discuss.elastic.co/u/SHOAIB_AHMED)\ **Replies:** 3\ **Last updated:** [December 20, 2020, 11:52pm UTC](https://discuss.elastic.co/t/should-we-create-new-index-or-use-the-same-index-for-all-application-logs-number-of-app-5/259011 "2020-12-20T23:52:13Z")
I have about 5 apps to monitor using log parsing with ELK. Does it make sense to create new index for each application log or only one index is sufficient to store all app logs. The logs for these apps would also contai… --- ## [Q: ILM and Beats index-template thoughts in a lab 7.10.x setup](https://discuss.elastic.co/t/q-ilm-and-beats-index-template-thoughts-in-a-lab-7-10-x-setup/259208)
**Author:** [@Andreas\_Falk](https://discuss.elastic.co/u/Andreas_Falk)\ **Replies:** 0\ **Last updated:** [December 20, 2020, 11:51pm UTC](https://discuss.elastic.co/t/q-ilm-and-beats-index-template-thoughts-in-a-lab-7-10-x-setup/259208 "2020-12-20T23:51:50Z")
Hi, We are setting up a new 7.10.1 cluster and are struggling with some ILM and beat stuff :slight\_smile: First up, when doing a simple template setup through Filebeat docker run \\ docker.elastic.co/beats/filebeat:7… --- ## [Parsing ip address coming at random places inside logs](https://discuss.elastic.co/t/parsing-ip-address-coming-at-random-places-inside-logs/259177)
**Author:** [@Muhammad\_Faisal](https://discuss.elastic.co/u/Muhammad_Faisal)\ **Replies:** 4\ **Last updated:** [December 20, 2020, 4:05pm UTC](https://discuss.elastic.co/t/parsing-ip-address-coming-at-random-places-inside-logs/259177 "2020-12-20T16:05:12Z")
hi guys, input log message contains IP address but the occurence of ip is random inside message and also some times the message will not contain any ip ...how can we extract this ip address using grok or other filters. … --- ## [My index contains all geo data but not showing in list while creating Maps from that index](https://discuss.elastic.co/t/my-index-contains-all-geo-data-but-not-showing-in-list-while-creating-maps-from-that-index/259196)
**Author:** [@ankitdevnalkar](https://discuss.elastic.co/u/ankitdevnalkar)\ **Replies:** 8\ **Last updated:** [December 20, 2020, 7:31pm UTC](https://discuss.elastic.co/t/my-index-contains-all-geo-data-but-not-showing-in-list-while-creating-maps-from-that-index/259196 "2020-12-20T19:31:36Z")
I am performing Geo lookup via Logstash and added geoip filter to get required data. I am getting data in logs but some how it is not getting listed in indexes while configuring layers in Map. Here is my conf file. inpu… --- ## [Need to parse logs and enrich some values from mysql data at logstats](https://discuss.elastic.co/t/need-to-parse-logs-and-enrich-some-values-from-mysql-data-at-logstats/259176)
**Author:** [@abhi.coerian](https://discuss.elastic.co/u/abhi.coerian)\ **Replies:** 3\ **Last updated:** [December 20, 2020, 3:58pm UTC](https://discuss.elastic.co/t/need-to-parse-logs-and-enrich-some-values-from-mysql-data-at-logstats/259176 "2020-12-20T15:58:07Z")
Need to parse logs on logstash and enrich some values from mysql db based on the log message and generate json message . e.x JOB application\_1603918538928\_3286731 QUEUE default USER xyz Need to fetch details of USER :… --- ## [Term query with keyword mapping](https://discuss.elastic.co/t/term-query-with-keyword-mapping/259173)
**Author:** [@klapvee](https://discuss.elastic.co/u/klapvee)\ **Replies:** 1\ **Last updated:** [December 20, 2020, 1:17pm UTC](https://discuss.elastic.co/t/term-query-with-keyword-mapping/259173 "2020-12-20T13:17:36Z")
Hi, a very simple mappping: { "mappings": { "chat": { "properties": { "checksum": { "type": "keyword" }, "created": { "type": "date", "store": true… --- ## [IPv6 endpoint for S3 repository](https://discuss.elastic.co/t/ipv6-endpoint-for-s3-repository/259164)
**Author:** [@NominaSumpta](https://discuss.elastic.co/u/NominaSumpta)\ **Replies:** 5\ **Last updated:** [December 20, 2020, 10:17am UTC](https://discuss.elastic.co/t/ipv6-endpoint-for-s3-repository/259164 "2020-12-20T10:17:53Z")
How do I use an IPv6 endpoint for an S3 repository? Using a hostname that resolves to an IPv6 address and an IPv4 address results in: { "error": { "root\_cause": \[ { "type": "repository\_verification\_… --- ## [Logs including emojis](https://discuss.elastic.co/t/logs-including-emojis/258946)
**Author:** [@rojin](https://discuss.elastic.co/u/rojin)\ **Replies:** 6\ **Last updated:** [December 20, 2020, 9:29am UTC](https://discuss.elastic.co/t/logs-including-emojis/258946 "2020-12-20T09:29:07Z")
Hello everyone! is there a way to parse this log with emojis? Could it be shown in kibana or logstash output? I do not have a clue how to parse the emojis in logstash pipeline. "emoji\_code":"🌸" Can someone please help … [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1105) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1107)