# Top **URL:** https://discuss.elastic.co/top.md?page=1595&period=all [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1596 --- ## [What could be the reason for " Courier Fetch: 3 of 12 shards failed. " what's the solution for this?](https://discuss.elastic.co/t/what-could-be-the-reason-for-courier-fetch-3-of-12-shards-failed-whats-the-solution-for-this/49631)
**Author:** [@gayathri](https://discuss.elastic.co/u/gayathri)\ **Replies:** 5\ **Last updated:** [May 10, 2016, 8:50pm UTC](https://discuss.elastic.co/t/what-could-be-the-reason-for-courier-fetch-3-of-12-shards-failed-whats-the-solution-for-this/49631 "2016-05-10T20:50:45Z")
What could be the reason for " Courier Fetch: 3 of 12 shards failed. " what's the solution for this? --- ## [Duplicate data in same index](https://discuss.elastic.co/t/duplicate-data-in-same-index/6104)
**Author:** [@aschaar](https://discuss.elastic.co/u/aschaar)\ **Replies:** 5\ **Last updated:** [December 13, 2011, 10:28pm UTC](https://discuss.elastic.co/t/duplicate-data-in-same-index/6104 "2011-12-13T22:28:50Z")
Here's duplicate records: http://pastebin.mozilla.org/1397732 ES Configuration: http://oremj.pastebin.mozilla.org/1397404 Back story: We pushed a new release on Wednesday around 2pm. At that time we d… --- ## [Why Filebeat is not picking up multiline ISO timestamp pattern but picking when pattern is defined manually?](https://discuss.elastic.co/t/why-filebeat-is-not-picking-up-multiline-iso-timestamp-pattern-but-picking-when-pattern-is-defined-manually/255036)
**Author:** [@elasticheart](https://discuss.elastic.co/u/elasticheart)\ **Replies:** 2\ **Last updated:** [November 16, 2020, 12:17pm UTC](https://discuss.elastic.co/t/why-filebeat-is-not-picking-up-multiline-iso-timestamp-pattern-but-picking-when-pattern-is-defined-manually/255036 "2020-11-16T12:17:24Z")
Hi, I have log lines like below; \[2020-11-11T11:19:00+05:30\] \[INFO\] \[msg1\] \[msg2\] \[msg3\] \[msg4\] \[msg5\] \[msg6\] \[msg7\] \[msg8\] \[msg9\] The msg9 attribute may contain multi-line message, so I have decided to configure mult… --- ## [Elasticsearch Index Management - Index Lifecycle Policies](https://discuss.elastic.co/t/elasticsearch-index-management-index-lifecycle-policies/244221)
**Author:** [@brettlarsonwci](https://discuss.elastic.co/u/brettlarsonwci)\ **Replies:** 2\ **Last updated:** [August 19, 2020, 5:22am UTC](https://discuss.elastic.co/t/elasticsearch-index-management-index-lifecycle-policies/244221 "2020-08-19T05:22:25Z")
Hello All - I am currently trying to set up some lifecycle policy's to clean up indices. In Kibana, I have an index pattern of "logstash-\*". Fluentd is just taking everything matching that pattern and sending it. This c… --- ## [Dashboard doesn't "keep" time selected](https://discuss.elastic.co/t/dashboard-doesnt-keep-time-selected/215471)
**Author:** [@Voula\_Mikr](https://discuss.elastic.co/u/Voula_Mikr)\ **Replies:** 2\ **Last updated:** [January 20, 2020, 6:57am UTC](https://discuss.elastic.co/t/dashboard-doesnt-keep-time-selected/215471 "2020-01-20T06:57:45Z")
Hi! I saved a dashboard with a specific time range selected in time filter but when I open again this dashboard, the time in time filter is "Last 15 minutes". So in the corresponding iframe I see data from last 15 minut… --- ## [Benefits of force merging an append-only index](https://discuss.elastic.co/t/benefits-of-force-merging-an-append-only-index/205551)
**Author:** [@bruce289](https://discuss.elastic.co/u/bruce289)\ **Replies:** 2\ **Last updated:** [October 29, 2019, 6:58pm UTC](https://discuss.elastic.co/t/benefits-of-force-merging-an-append-only-index/205551 "2019-10-29T18:58:28Z")
Hi, It's not clear to me whether there are any benefits to force merging an index to which documents were only ever added (no updates or deletes), and if so, what these are? Thanks. --- ## [Kibana taking time to load discover](https://discuss.elastic.co/t/kibana-taking-time-to-load-discover/192204)
**Author:** [@mrashid](https://discuss.elastic.co/u/mrashid)\ **Replies:** 2\ **Last updated:** [July 25, 2019, 7:35pm UTC](https://discuss.elastic.co/t/kibana-taking-time-to-load-discover/192204 "2019-07-25T19:35:41Z")
I have around 6 GB of data coming to elastic search per day. The problem is that it takes around 5-6 seconds to load discover or conduct any search. I was trying to tune - to make it faster. I have the following observ… --- ## [How to use term Run\_As in kibana](https://discuss.elastic.co/t/how-to-use-term-run-as-in-kibana/168708)
**Author:** [@iamazy](https://discuss.elastic.co/u/iamazy)\ **Replies:** 2\ **Last updated:** [February 17, 2019, 8:18am UTC](https://discuss.elastic.co/t/how-to-use-term-run-as-in-kibana/168708 "2019-02-17T08:18:36Z")
Hello Current Logined user is elastic, I want to query dsl run as another user named iamazy, How to write the dsl， I try to run this dsl but got exception POST test\_index/\_search { "query": { "match\_all": {} }… --- ## [S3 input plugin not sending to Elastic Search](https://discuss.elastic.co/t/s3-input-plugin-not-sending-to-elastic-search/122520)
**Author:** [@Patrik\_Iselind](https://discuss.elastic.co/u/Patrik_Iselind)\ **Replies:** 2\ **Last updated:** [March 7, 2018, 1:52pm UTC](https://discuss.elastic.co/t/s3-input-plugin-not-sending-to-elastic-search/122520 "2018-03-07T13:52:25Z")
Hi, I have an issue where the S3 input plugin doesn't seem to propagate the processed data, at all. I can see that the files in my bucket are being processed: ... logstash\_1 | \[2018-03-05T13:09:36,102\]\[DEBUG\]\[log… --- ## [I want change kibana header](https://discuss.elastic.co/t/i-want-change-kibana-header/111713)
**Author:** [@tigerofchina](https://discuss.elastic.co/u/tigerofchina)\ **Replies:** 2\ **Last updated:** [December 15, 2017, 5:02am UTC](https://discuss.elastic.co/t/i-want-change-kibana-header/111713 "2017-12-15T05:02:33Z")
I want change kibana header，my kibana is kibana-5.6.2。I want to change header "kibana" and icons\[微信图片\_20171214163148\] --- ## [Winlogbeats service sugestion](https://discuss.elastic.co/t/winlogbeats-service-sugestion/110436)
**Author:** [@AlvaroRivero](https://discuss.elastic.co/u/AlvaroRivero)\ **Replies:** 2\ **Last updated:** [December 6, 2017, 12:08pm UTC](https://discuss.elastic.co/t/winlogbeats-service-sugestion/110436 "2017-12-06T12:08:25Z")
HI everyone, this is my first post so be kind if im wrong (also excuse my non native english). Where do i make sugestion for Winlogbeat (or any other ELK part)?? So i was instaling my first ELK lab, version 5.6.2 was th… --- ## [Logs going to the wrong index](https://discuss.elastic.co/t/logs-going-to-the-wrong-index/104955)
**Author:** [@shroh](https://discuss.elastic.co/u/shroh)\ **Replies:** 2\ **Last updated:** [October 25, 2017, 3:20pm UTC](https://discuss.elastic.co/t/logs-going-to-the-wrong-index/104955 "2017-10-25T15:20:51Z")
Hi , I have three logstash config files 00\_inputs.conf, 01\_app1.conf, 02\_app2.conf. 01\_inputs.conf just defines the beats input and thats it, nothing more. 02\_app1.conf filter { if \[fields\]\[index\] == "app\_fischer" { … --- ## [Can packetbeat set the number of packets to be captured as tcpdump does?](https://discuss.elastic.co/t/can-packetbeat-set-the-number-of-packets-to-be-captured-as-tcpdump-does/98530)
**Author:** [@moooofly](https://discuss.elastic.co/u/moooofly)\ **Replies:** 2\ **Last updated:** [August 30, 2017, 6:14am UTC](https://discuss.elastic.co/t/can-packetbeat-set-the-number-of-packets-to-be-captured-as-tcpdump-does/98530 "2017-08-30T06:14:13Z")
Showing help of packetbeat, I find no options for setting the number of packets to be captured as tcpdump dose, is there a possibility to support this feature? Thanks in advance! % ./packetbeat --version packetbeat ver… --- ## [Balancing Watcher execution times](https://discuss.elastic.co/t/balancing-watcher-execution-times/79786)
**Author:** [@Ryan\_Grannell](https://discuss.elastic.co/u/Ryan_Grannell)\ **Replies:** 2\ **Last updated:** [March 28, 2017, 9:18am UTC](https://discuss.elastic.co/t/balancing-watcher-execution-times/79786 "2017-03-28T09:18:10Z")
Hi, Most of our Watchers execute on a 15 minute interval. We have about 50 watches, so ideally these should execute at "balanced" times; 50 Watchers should not execute simultaneously at 00:00, 00:15, ... for example. … --- ## [Get \_parent source fields from child document](https://discuss.elastic.co/t/get--parent-source-fields-from-child-document/55707)
**Author:** [@Sergey\_Bevzuk](https://discuss.elastic.co/u/Sergey_Bevzuk)\ **Replies:** 2\ **Last updated:** [July 18, 2016, 10:04am UTC](https://discuss.elastic.co/t/get--parent-source-fields-from-child-document/55707 "2016-07-18T10:04:35Z")
Hi all, actually here is my question: Maybe some of you have some ideas how to do it. --- ## [Processing events on logstash-forwarder only 3.2k events/second](https://discuss.elastic.co/t/processing-events-on-logstash-forwarder-only-3-2k-events-second/42833)
**Author:** [@junior\_h](https://discuss.elastic.co/u/junior_h)\ **Replies:** 2\ **Last updated:** [February 29, 2016, 5:51am UTC](https://discuss.elastic.co/t/processing-events-on-logstash-forwarder-only-3-2k-events-second/42833 "2016-02-29T05:51:53Z")
I am using logstash-forwarder to send nginx access.log with flow: access.log -\> logstash-forwarder 0.4.0-\> logstash 1.5.4 -\> redis 3.0.1 The logstash only run for storing data to redis. Due to high activity on nginx, … --- ## [Role hierarchy](https://discuss.elastic.co/t/role-hierarchy/42384)
**Author:** [@aaroy428](https://discuss.elastic.co/u/aaroy428)\ **Replies:** 2\ **Last updated:** [February 23, 2016, 2:31pm UTC](https://discuss.elastic.co/t/role-hierarchy/42384 "2016-02-23T14:31:04Z")
Hi everybody, I am looking to design my security model. Based on my initial assumption, I thought that because the security is based on index pattern with shield pattern expansion was done. Let me give you an ex… --- ## [Kibana \> Visualize \> Data Table \> Metric Count \> How to set Range for the Counted value?](https://discuss.elastic.co/t/kibana-visualize-data-table-metric-count-how-to-set-range-for-the-counted-value/249597)
**Author:** [@Andreasau](https://discuss.elastic.co/u/Andreasau)\ **Replies:** 1\ **Last updated:** [September 24, 2020, 7:10pm UTC](https://discuss.elastic.co/t/kibana-visualize-data-table-metric-count-how-to-set-range-for-the-counted-value/249597 "2020-09-24T19:10:13Z")
Good day All, Can anyone kindly teach me how to set Range for the Counted value in the Data Table (Visualize)? Real situation: I created a Table which shown the stock level for each product in each shop location, I w… --- ## [How to convert a date to string using local time](https://discuss.elastic.co/t/how-to-convert-a-date-to-string-using-local-time/229038)
**Author:** [@Miguel\_Cabero](https://discuss.elastic.co/u/Miguel_Cabero)\ **Replies:** 1\ **Last updated:** [April 22, 2020, 4:20pm UTC](https://discuss.elastic.co/t/how-to-convert-a-date-to-string-using-local-time/229038 "2020-04-22T16:20:00Z")
Hello, I need to compute a field that concats a string and a date. I don't know how to convert the date using the local time. Can you help getting desired results below? PUT my\_index/x { "ref": "x", "date" : "201… --- ## [Sincedbに書き込まれる内容について](https://discuss.elastic.co/t/sincedb/223452)
**Author:** [@t-nakata](https://discuss.elastic.co/u/t-nakata)\ **Replies:** 1\ **Last updated:** [March 13, 2020, 1:10pm UTC](https://discuss.elastic.co/t/sincedb/223452 "2020-03-13T13:10:22Z")
logstashでどこまでファイルを読み込んだかを記録するincedbがあると思います。 出力させてみたのですが、どの数字が何を表すのかご教示頂けないでしょうか？ マニュアルを参照しても分からず、お手数ですがお願い致します。 (sincedb出力例) 540437991024698906 0 37 8 1584078010.747719 /XXX/XXX.log --- ## [Cisco ASA Netflow](https://discuss.elastic.co/t/cisco-asa-netflow/194107)
**Author:** [@dmitriy.y](https://discuss.elastic.co/u/dmitriy.y)\ **Replies:** 1\ **Last updated:** [August 7, 2019, 4:42pm UTC](https://discuss.elastic.co/t/cisco-asa-netflow/194107 "2019-08-07T16:42:35Z")
I am using latest 7.3 ELK stack with filebeat. Configured netflow with the filebeat netflow plugin to monitor my ASA. For network.direction i am getting "unknown" For network.bytes i am getting just "-" Any tips woul… --- ## [Filebeat mongo module, grok pattern is incorrect for Mongo 4](https://discuss.elastic.co/t/filebeat-mongo-module-grok-pattern-is-incorrect-for-mongo-4/149767)
**Author:** [@Matthew\_Zeemann](https://discuss.elastic.co/u/Matthew_Zeemann)\ **Replies:** 1\ **Last updated:** [September 26, 2018, 1:08pm UTC](https://discuss.elastic.co/t/filebeat-mongo-module-grok-pattern-is-incorrect-for-mongo-4/149767 "2018-09-26T13:08:58Z")
I am trying to use Filebeat to send MongoDB 4 logs to Elastic and it is failing. I have a log messages from Mongo that grok is failing to match against the supplied fields, e.g. 2018-09-25T05:16:13.012+0000 I STORAGE \[… --- ## [High-level-client never close connection](https://discuss.elastic.co/t/high-level-client-never-close-connection/119268)
**Author:** [@Derrick](https://discuss.elastic.co/u/Derrick)\ **Replies:** 1\ **Last updated:** [February 16, 2018, 9:34am UTC](https://discuss.elastic.co/t/high-level-client-never-close-connection/119268 "2018-02-16T09:34:36Z")
Hi, I have one server running and doing CRUD on ES 5.6, but there are so many connections being opened, looks like it is never released, any idea? This is the jstack log "elasticsearch\[high-level-client\]\[scheduler\]\[T#… --- ## [Split Kibana dashboard into two group](https://discuss.elastic.co/t/split-kibana-dashboard-into-two-group/116784)
**Author:** [@albeniz71](https://discuss.elastic.co/u/albeniz71)\ **Replies:** 1\ **Last updated:** [January 24, 2018, 4:39pm UTC](https://discuss.elastic.co/t/split-kibana-dashboard-into-two-group/116784 "2018-01-24T16:39:13Z")
In a single Kibana dashboard screen, I want to split my charts into vertically splitted two groups which has filter conditions it's own. Purpose of this thing is to compare different two timeseries in a single screen.Lik… --- ## [How to access doc values from expert script plugin](https://discuss.elastic.co/t/how-to-access-doc-values-from-expert-script-plugin/105995)
**Author:** [@Srinivasan\_Ramaswamy](https://discuss.elastic.co/u/Srinivasan_Ramaswamy)\ **Replies:** 1\ **Last updated:** [November 7, 2017, 9:30pm UTC](https://discuss.elastic.co/t/how-to-access-doc-values-from-expert-script-plugin/105995 "2017-11-07T21:30:41Z")
I am trying to write an expert script plugin following the instructions given in https://www.elastic.co/guide/en/elasticsearch/reference/5.6/modules-scripting-engine.html "mappings": { "type": { "propert… --- ## [Diagnosing the performance bottleneck in search](https://discuss.elastic.co/t/diagnosing-the-performance-bottleneck-in-search/68945)
**Author:** [@Rodrigo\_Rezende](https://discuss.elastic.co/u/Rodrigo_Rezende)\ **Replies:** 1\ **Last updated:** [December 14, 2016, 5:54pm UTC](https://discuss.elastic.co/t/diagnosing-the-performance-bottleneck-in-search/68945 "2016-12-14T17:54:35Z")
Hi, I'm intrigued by the following performance and I'm looking for the root cause: query GET /dataset/\_search { "size": 0, "profile": true } returns in 26s: (there are only 5 shards but less than 1M docume… --- ## [Filtering nested objects](https://discuss.elastic.co/t/filtering-nested-objects/44215)
**Author:** [@Oscar\_Romero](https://discuss.elastic.co/u/Oscar_Romero)\ **Replies:** 1\ **Last updated:** [March 14, 2016, 7:35pm UTC](https://discuss.elastic.co/t/filtering-nested-objects/44215 "2016-03-14T19:35:20Z")
I've read some topics about nested objects but I can not make this sample to work. Hopefully you can help me to check what is wrong: Elasticsearch version 2.2 # Create Index PUT agency # Mapping PUT agency/site/\_m… --- ## [Questions about Grok and add\_tag](https://discuss.elastic.co/t/questions-about-grok-and-add-tag/42475)
**Author:** [@guojingjing](https://discuss.elastic.co/u/guojingjing)\ **Replies:** 1\ **Last updated:** [February 23, 2016, 6:54pm UTC](https://discuss.elastic.co/t/questions-about-grok-and-add-tag/42475 "2016-02-23T18:54:54Z")
Anyone can help with my two questions regarding grok and add\_tag? 1) Can grok be used more than once in the filter part? after my first grok, which worked perfectly, I added a second grok to extract some more informa… --- ## [Delete datas before insert](https://discuss.elastic.co/t/delete-datas-before-insert/26336)
**Author:** [@Vince059](https://discuss.elastic.co/u/Vince059)\ **Replies:** 1\ **Last updated:** [July 27, 2015, 10:18pm UTC](https://discuss.elastic.co/t/delete-datas-before-insert/26336 "2015-07-27T22:18:39Z")
Hello ! I use logstash to save my CSV files in ElasticSearch. I need to delete my old datas before each treatment. Example : a new CSV file is copied in my directory logstash delete items in elasticsearch with a q… --- ## [Converting Logstash Pipeline to Ingest Pipeline](https://discuss.elastic.co/t/converting-logstash-pipeline-to-ingest-pipeline/371416)
**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\ **Replies:** 8\ **Last updated:** [December 4, 2024, 6:53am UTC](https://discuss.elastic.co/t/converting-logstash-pipeline-to-ingest-pipeline/371416 "2024-12-04T06:53:13Z")
Hello, I have countless of logstash pipelines or logstash filter configs to be more exact. Is there a way to migrate these into ingest pipelines, quickly? I know they offer the same features but is it possible to do t… --- ## [Deleting Events From Frozen Data Tier](https://discuss.elastic.co/t/deleting-events-from-frozen-data-tier/345395)
**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\ **Replies:** 3\ **Last updated:** [October 20, 2023, 6:50am UTC](https://discuss.elastic.co/t/deleting-events-from-frozen-data-tier/345395 "2023-10-20T06:50:17Z")
Attempting to delete by query events in a frozen data tier index belonging to a data stream. I've tried targeting the specific index the events are in as well as the datastream name, but I get the following error: { … --- ## [Event aggregation with logstash error due to mixed task\_id](https://discuss.elastic.co/t/event-aggregation-with-logstash-error-due-to-mixed-task-id/298705)
**Author:** [@lusynda](https://discuss.elastic.co/u/lusynda)\ **Replies:** 3\ **Last updated:** [March 4, 2022, 4:02pm UTC](https://discuss.elastic.co/t/event-aggregation-with-logstash-error-due-to-mixed-task-id/298705 "2022-03-04T16:02:53Z")
Hi all I have a case like this: my email log has a task\_id i called it event.id due to how the log was configed now all the log are seperated and only joined by the event.id field. Now i've tried to use the aggregate … --- ## [Elasticsearch integration tests with Jest](https://discuss.elastic.co/t/elasticsearch-integration-tests-with-jest/294064)
**Author:** [@kabethy](https://discuss.elastic.co/u/kabethy)\ **Replies:** 3\ **Last updated:** [January 12, 2022, 9:14am UTC](https://discuss.elastic.co/t/elasticsearch-integration-tests-with-jest/294064 "2022-01-12T09:14:24Z")
Hi, I am using Elasticsearch (Opensearch) in a Nx monorepo in a node js serverless app that connects to aws services. I would like to use jest to test but so far I have not been able to get responses from Opensearch. … --- ## [How Logstash works for 10,000 lines of log file](https://discuss.elastic.co/t/how-logstash-works-for-10-000-lines-of-log-file/275118)
**Author:** [@sudo-ranjith](https://discuss.elastic.co/u/sudo-ranjith)\ **Replies:** 3\ **Last updated:** [June 7, 2021, 4:58pm UTC](https://discuss.elastic.co/t/how-logstash-works-for-10-000-lines-of-log-file/275118 "2021-06-07T16:58:00Z")
I have log file that has 10,000 lines of logs, every hour 10 lines of logs will be added in the log file. at 3 AM I have 10,000 line of logs at 4 AM 10,010 lines of logs at 5 AM 10,020 lines of logs.... I would like … --- ## [Questions re Sniffing in Logstash elasticsearch output](https://discuss.elastic.co/t/questions-re-sniffing-in-logstash-elasticsearch-output/269631)
**Author:** [@DougR](https://discuss.elastic.co/u/DougR)\ **Replies:** 3\ **Last updated:** [April 8, 2021, 6:59pm UTC](https://discuss.elastic.co/t/questions-re-sniffing-in-logstash-elasticsearch-output/269631 "2021-04-08T18:59:47Z")
I'm testing Logstash sniffing in our environment for the Elasticsearch output. So far, it appears to resolve a few issues I've had, but I've got a few questions: sniffing =\> true in my elasticsearch output appears to … --- ## [Cannot ship ssh logs from filebeat to logstash](https://discuss.elastic.co/t/cannot-ship-ssh-logs-from-filebeat-to-logstash/261575)
**Author:** [@john8](https://discuss.elastic.co/u/john8)\ **Replies:** 3\ **Last updated:** [January 21, 2021, 3:44am UTC](https://discuss.elastic.co/t/cannot-ship-ssh-logs-from-filebeat-to-logstash/261575 "2021-01-21T03:44:36Z")
I sent syslog from filebeat to logstash it appeared in kibana as well then when I changed the path of the log file to /var/logs/auth.log it did not work. My main goal is to visualize the ssh logs. Thanks in advance. --- ## [Filebeat: How to differentiate data from different types sources on same port?](https://discuss.elastic.co/t/filebeat-how-to-differentiate-data-from-different-types-sources-on-same-port/247175)
**Author:** [@denis.atanasov](https://discuss.elastic.co/u/denis.atanasov)\ **Replies:** 3\ **Last updated:** [September 2, 2020, 9:12pm UTC](https://discuss.elastic.co/t/filebeat-how-to-differentiate-data-from-different-types-sources-on-same-port/247175 "2020-09-02T21:12:35Z")
Hello guys, I setup a Filebeat (7.9) on my ELK(7.9) and started receiving syslog messages. So far so good, everything is parsed and visualized successfully. However I am facing problems, when I enable 2 different modul… --- ## [Error getting list of running units](https://discuss.elastic.co/t/error-getting-list-of-running-units/233544)
**Author:** [@Deny7](https://discuss.elastic.co/u/Deny7)\ **Replies:** 3\ **Last updated:** [June 3, 2020, 11:25am UTC](https://discuss.elastic.co/t/error-getting-list-of-running-units/233544 "2020-06-03T11:25:36Z")
Hi, I just installed metricbeat-oss-7.6.2-x86\_64.rpm. I configured system.yml but when I run it as service I get errors in logs: 2020-05-20T14:52:44.744+0200 INFO module/wrapper.go:252 Error fetching data for metricset… --- ## [Remote Reindex is failing with connect\_exception](https://discuss.elastic.co/t/remote-reindex-is-failing-with-connect-exception/204471)
**Author:** [@sree\_hari](https://discuss.elastic.co/u/sree_hari)\ **Replies:** 0\ **Last updated:** [October 21, 2019, 12:43pm UTC](https://discuss.elastic.co/t/remote-reindex-is-failing-with-connect-exception/204471 "2019-10-21T12:43:25Z")
I am trying to re-index from 6.7 to 7.3. root@elk730 ~ $curl -X POST "localhost:9200/\_reindex?pretty" -H 'Content-Type: application/json' -d' { "source": { "remote": { "host": "http://10.10.10.60:9200" }, "index":… --- ## [How many workers to parallel bulk indexing in cluster?](https://discuss.elastic.co/t/how-many-workers-to-parallel-bulk-indexing-in-cluster/199139)
**Author:** [@misam](https://discuss.elastic.co/u/misam)\ **Replies:** 3\ **Last updated:** [September 12, 2019, 7:08am UTC](https://discuss.elastic.co/t/how-many-workers-to-parallel-bulk-indexing-in-cluster/199139 "2019-09-12T07:08:43Z")
I have a cluster with 8 nodes. I want to index a lot of docs. For the best performance, how many workers (to parallel bulk indexing) must run on each node? --- ## [Help with config file for given syntax](https://discuss.elastic.co/t/help-with-config-file-for-given-syntax/173304)
**Author:** [@Shubham\_Yadav1](https://discuss.elastic.co/u/Shubham_Yadav1)\ **Replies:** 8\ **Last updated:** [March 25, 2019, 4:34pm UTC](https://discuss.elastic.co/t/help-with-config-file-for-given-syntax/173304 "2019-03-25T16:34:24Z")
i have a file with data in the format as given below, i have tried several times to index it using logstash conf file but failed. Please help me how can i index in two cases: 1: all key value pairs 2: some key value pa… --- ## [How logstash parse log files internally?](https://discuss.elastic.co/t/how-logstash-parse-log-files-internally/132172)
**Author:** [@clash\_of\_clanss](https://discuss.elastic.co/u/clash_of_clanss)\ **Replies:** 8\ **Last updated:** [May 17, 2018, 7:31am UTC](https://discuss.elastic.co/t/how-logstash-parse-log-files-internally/132172 "2018-05-17T07:31:07Z")
I am new here for ELK(ElasticSearch,Logstash,kibana). I would like to know how logstash parse log files and upload into an ElasticSearch. Lets take an example, If I want to load around 250GB of log files data into an Ela… --- ## [TCP vs HTTP input - reliability](https://discuss.elastic.co/t/tcp-vs-http-input-reliability/112215)
**Author:** [@vb4t](https://discuss.elastic.co/u/vb4t)\ **Replies:** 0\ **Last updated:** [December 18, 2017, 11:10am UTC](https://discuss.elastic.co/t/tcp-vs-http-input-reliability/112215 "2017-12-18T11:10:43Z")
Hello. I need to collect logs using nxlog log shipper (can not use filebeat - unsupported OS). I am able to send events using TCP or HTTP. Probably TCP input is faster but HTTP seems to be more reliable (ACK on applicati… --- ## ["Failed to compute BIC gain" error from Machine Learning](https://discuss.elastic.co/t/failed-to-compute-bic-gain-error-from-machine-learning/94942)
**Author:** [@Tommy\_Monk](https://discuss.elastic.co/u/Tommy_Monk)\ **Replies:** 3\ **Last updated:** [August 7, 2017, 12:04pm UTC](https://discuss.elastic.co/t/failed-to-compute-bic-gain-error-from-machine-learning/94942 "2017-08-07T12:04:12Z")
Elasticsearch version: 5.5.0 Plugins installed: \[x-pack\] JVM version: 1.8.0\_141 OS version: Ubuntu Server 16.04 We’re trialing the machine learning capabilities of Elasticsearch in Kibana. Our test job json is here. … --- ## [Cluster Routing Allocation Settings](https://discuss.elastic.co/t/cluster-routing-allocation-settings/71045)
**Author:** [@xavier.tiendeo](https://discuss.elastic.co/u/xavier.tiendeo)\ **Replies:** 3\ **Last updated:** [January 12, 2017, 9:46am UTC](https://discuss.elastic.co/t/cluster-routing-allocation-settings/71045 "2017-01-12T09:46:37Z")
We have a cluster of two nodes (ES 2.2), indexes have one replica so all shards are in both nodes. If we restart a node, all shards in that node are set as unasigned, we think this can be resolved with "transient": { … --- ## [How to get rid of sum\_other\_doc\_count in aggregations?](https://discuss.elastic.co/t/how-to-get-rid-of-sum-other-doc-count-in-aggregations/50022)
**Author:** [@AndreyL](https://discuss.elastic.co/u/AndreyL)\ **Replies:** 0\ **Last updated:** [May 13, 2016, 6:02pm UTC](https://discuss.elastic.co/t/how-to-get-rid-of-sum-other-doc-count-in-aggregations/50022 "2016-05-13T18:02:02Z")
I am running an aggregation to see what document types does my 'documents' index has (documentType is the field that has the type): GET my\_documents/\_search { size: 0, "aggs": { "dataTypes": { "terms": { … --- ## [Term query with search result](https://discuss.elastic.co/t/term-query-with-search-result/48966)
**Author:** [@no\_jihun](https://discuss.elastic.co/u/no_jihun)\ **Replies:** 3\ **Last updated:** [May 3, 2016, 1:09am UTC](https://discuss.elastic.co/t/term-query-with-search-result/48966 "2016-05-03T01:09:46Z")
Hi. I know ES is not a kind of RDB and no rich support for Joins available. But let me ask you this can be done with ES for check. - index1 is index - user is type, - \_id is auto generated - 6 documents indexed. … --- ## [Takes forever to bring cluster back up](https://discuss.elastic.co/t/takes-forever-to-bring-cluster-back-up/29158)
**Author:** [@xrl](https://discuss.elastic.co/u/xrl)\ **Replies:** 3\ **Last updated:** [September 17, 2015, 4:59am UTC](https://discuss.elastic.co/t/takes-forever-to-bring-cluster-back-up/29158 "2015-09-17T04:59:58Z")
I did some significant maintenance on my cluster, changed from ES 1.6.0 to ES 1.7.1 and also changed from JVM 1.7 to 1.8. This is 13 nodes with 11TB of log data. My plan was to shut off all the nodes and bring them all … --- ## [Correct mapping/search query for my data?](https://discuss.elastic.co/t/correct-mapping-search-query-for-my-data/23395)
**Author:** [@Zelfapp](https://discuss.elastic.co/u/Zelfapp)\ **Replies:** 3\ **Last updated:** [April 29, 2015, 10:55pm UTC](https://discuss.elastic.co/t/correct-mapping-search-query-for-my-data/23395 "2015-04-29T22:55:36Z")
This is my php array mapping for my index and type. Below that is the query I'm currently using and an example of results and the issue I'm not sure how to fix in either my mapping or in my search query. \*Summary … --- ## [Elasticsearch deploy on ec2](https://discuss.elastic.co/t/elasticsearch-deploy-on-ec2/22196)
**Author:** [@Eliran\_Shlomo](https://discuss.elastic.co/u/Eliran_Shlomo)\ **Replies:** 8\ **Last updated:** [February 17, 2015, 6:35am UTC](https://discuss.elastic.co/t/elasticsearch-deploy-on-ec2/22196 "2015-02-17T06:35:02Z")
Hi, I'm trying to deploy new elasticsearch environment on aws and the cluster is always at red and i get the following message { "error": "ClusterBlockException\[blocked by: \[SERVICE\_UNAVAILABLE/1/state not … [Previous page](https://discuss.elastic.co/top.md?page=1594&per_page=50&period=all) [Next page](https://discuss.elastic.co/top.md?page=1596&per_page=50&period=all)