# \#none **URL:** https://discuss.elastic.co/tag/none.md?no_tags=true&page=947 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 948 --- ## [Need Help with Logstash Multiline Codec](https://discuss.elastic.co/t/need-help-with-logstash-multiline-codec/273134)
**Author:** [@Pemitha\_Randiya](https://discuss.elastic.co/u/Pemitha_Randiya)\ **Replies:** 0\ **Last updated:** [May 17, 2021, 7:01am UTC](https://discuss.elastic.co/t/need-help-with-logstash-multiline-codec/273134 "2021-05-17T07:01:39Z")
Here is my sample log data : 2021/05/17 12:17:41.866 | 382DC9789F284D3C9D7CC269F1851094|0000SUMMARY:\[INFO \]: 2021/05/17 12:17:41.866 |--------------------------------------------------------------------- 2021/05/1… --- ## [Does the index API block responses until the indexing process is through?](https://discuss.elastic.co/t/does-the-index-api-block-responses-until-the-indexing-process-is-through/273115)
**Author:** [@Courtan](https://discuss.elastic.co/u/Courtan)\ **Replies:** 9\ **Last updated:** [May 17, 2021, 6:54am UTC](https://discuss.elastic.co/t/does-the-index-api-block-responses-until-the-indexing-process-is-through/273115 "2021-05-17T06:54:14Z")
I am wondering wether the index API waits to return a response until the whole indexing process is complete. More specifically: When I send a document to the API for indexing, will ES only check wether the request, json… --- ## [How to use an array as a param for feature logging (Elasticsearch learning to rank plugin)](https://discuss.elastic.co/t/how-to-use-an-array-as-a-param-for-feature-logging-elasticsearch-learning-to-rank-plugin/273112)
**Author:** [@ndkmath1](https://discuss.elastic.co/u/ndkmath1)\ **Replies:** 4\ **Last updated:** [May 17, 2021, 6:41am UTC](https://discuss.elastic.co/t/how-to-use-an-array-as-a-param-for-feature-logging-elasticsearch-learning-to-rank-plugin/273112 "2021-05-17T06:41:02Z")
I want to create a feature in my featureset and its param is an array. I known how to use a single value for feature logging but I don't know how to use an array. I tried something like below but it didn't help. Do you h… --- ## [Impact of setting max\_inner\_result\_window at index level](https://discuss.elastic.co/t/impact-of-setting-max-inner-result-window-at-index-level/273128)
**Author:** [@surabhi11](https://discuss.elastic.co/u/surabhi11)\ **Replies:** 0\ **Last updated:** [May 17, 2021, 6:20am UTC](https://discuss.elastic.co/t/impact-of-setting-max-inner-result-window-at-index-level/273128 "2021-05-17T06:20:02Z")
Hi, We have a user index and it has recipients (nested object). Since recipients are saved in User domain as nested object, so in order to pull the recipients data with pagination we are using inner\_hits query in respe… --- ## [CPU loading: 100% under load after 10-12 hrs of usage](https://discuss.elastic.co/t/cpu-loading-100-under-load-after-10-12-hrs-of-usage/271041)
**Author:** [@Dmitry\_Uglatch](https://discuss.elastic.co/u/Dmitry_Uglatch)\ **Replies:** 8\ **Last updated:** [May 17, 2021, 6:06am UTC](https://discuss.elastic.co/t/cpu-loading-100-under-load-after-10-12-hrs-of-usage/271041 "2021-05-17T06:06:45Z")
Hello, we're switching from ES 5.5 to 7.12. After applying it works perfect for about 10-12 hrs: and then we get CPU loading: 100% Even simple queries: GET /products/\_search?size=0 works for 5-6 seconds. And it return… --- ## [Daily reingestion of data](https://discuss.elastic.co/t/daily-reingestion-of-data/272972)
**Author:** [@SamKidman](https://discuss.elastic.co/u/SamKidman)\ **Replies:** 2\ **Last updated:** [May 17, 2021, 4:42am UTC](https://discuss.elastic.co/t/daily-reingestion-of-data/272972 "2021-05-17T04:42:21Z")
We've had an elasticsearch setup for a while now that has worked by reingesting all data from a relational database into a new index in denormalised form. We now want to perform immediate updates to the data in elastics… --- ## [Suggest score up by hit position](https://discuss.elastic.co/t/suggest-score-up-by-hit-position/273118)
**Author:** [@Yuya\_Takao](https://discuss.elastic.co/u/Yuya_Takao)\ **Replies:** 0\ **Last updated:** [May 17, 2021, 1:21am UTC](https://discuss.elastic.co/t/suggest-score-up-by-hit-position/273118 "2021-05-17T01:21:52Z")
Hi there, I want to suggest score up by hit position. Is there any idea? I know boost option, but I have no idea to score up by hit position. for example: \[search word 'a'\] largest score 'august' second largest sc… --- ## [Does indices()-\>refresh() wait for the completion of Bulk API?](https://discuss.elastic.co/t/does-indices-refresh-wait-for-the-completion-of-bulk-api/272914)
**Author:** [@Catalin](https://discuss.elastic.co/u/Catalin)\ **Replies:** 1\ **Last updated:** [May 17, 2021, 12:38am UTC](https://discuss.elastic.co/t/does-indices-refresh-wait-for-the-completion-of-bulk-api/272914 "2021-05-17T00:38:12Z")
In order to populate an index I have disabled its refresh\_interval and I'm using the Bulk API for inserting. The problem is I'm doing this in chunks of data and I need that after each chunk all the information is availa… --- ## [Reindex order](https://discuss.elastic.co/t/reindex-order/273114)
**Author:** [@alexs1](https://discuss.elastic.co/u/alexs1)\ **Replies:** 3\ **Last updated:** [May 17, 2021, 12:36am UTC](https://discuss.elastic.co/t/reindex-order/273114 "2021-05-17T00:36:34Z")
Hello, Does the reindex save the original order of the documents? Does the answer the same when using slice? Thank you! --- ## [Setup logstash to stop reading a file after some time](https://discuss.elastic.co/t/setup-logstash-to-stop-reading-a-file-after-some-time/273117)
**Author:** [@Amit\_Singh3](https://discuss.elastic.co/u/Amit_Singh3)\ **Replies:** 1\ **Last updated:** [May 16, 2021, 10:33pm UTC](https://discuss.elastic.co/t/setup-logstash-to-stop-reading-a-file-after-some-time/273117 "2021-05-16T22:33:09Z")
We are using logstsash to read a folder to read logs, due to log rotation tons of files are being created in the folder, what if I want logstash to stop reading from a file if there is no new data in a file for 5 minute… --- ## [Ingest-convert.sh output incorrect for PaloAlto (pawn) Ingest Pipeline](https://discuss.elastic.co/t/ingest-convert-sh-output-incorrect-for-paloalto-pawn-ingest-pipeline/273076)
**Author:** [@metalshanked](https://discuss.elastic.co/u/metalshanked)\ **Replies:** 1\ **Last updated:** [May 16, 2021, 4:38pm UTC](https://discuss.elastic.co/t/ingest-convert-sh-output-incorrect-for-paloalto-pawn-ingest-pipeline/273076 "2021-05-16T16:38:10Z")
Hi, I am planning to use Logstash instead of Filebeats for loading and parsing palo alto logs to Elastic. I setup the Filebeats as a one-time to generate the Ingest Pipeline Definition using the "pawn" Filebeats module… --- ## [Beats not able to connect with Logstash](https://discuss.elastic.co/t/beats-not-able-to-connect-with-logstash/273093)
**Author:** [@robinhood\_lko](https://discuss.elastic.co/u/robinhood_lko)\ **Replies:** 2\ **Last updated:** [May 16, 2021, 4:29pm UTC](https://discuss.elastic.co/t/beats-not-able-to-connect-with-logstash/273093 "2021-05-16T16:29:09Z")
Hi All, I have deployed ELK Stack using OSS versions Elasticsearch and Kibana. While connecting with Beats using Logstash, I am seeing following error on the system. Please can someone help me on this. Thanks \[2021-05-… --- ## [Kibana not accessible anymore when index was close](https://discuss.elastic.co/t/kibana-not-accessible-anymore-when-index-was-close/273075)
**Author:** [@blitzkrieg](https://discuss.elastic.co/u/blitzkrieg)\ **Replies:** 6\ **Last updated:** [May 16, 2021, 2:50pm UTC](https://discuss.elastic.co/t/kibana-not-accessible-anymore-when-index-was-close/273075 "2021-05-16T14:50:37Z")
Hi Guys, I'm new to elasticsearch and would like to ask your expertise about. We are using ECK 7.9.3 and trying to restore a snapshot however, I was advice that make sure that all indices are closed before restoring sn… --- ## [Index policy or Index template for Elasticsearh](https://discuss.elastic.co/t/index-policy-or-index-template-for-elasticsearh/272931)
**Author:** [@KA3AXCTAH](https://discuss.elastic.co/u/KA3AXCTAH)\ **Replies:** 1\ **Last updated:** [May 16, 2021, 2:00pm UTC](https://discuss.elastic.co/t/index-policy-or-index-template-for-elasticsearh/272931 "2021-05-16T14:00:43Z")
I have elasticsearch cluster for storing logs, and i have indices like this logs-2021.01.01 logs-2021.01.02 logs.2021.01.03 ...etc so indices creates at daily basis, and i have index template for this indices PUT \_ind… --- ## [Input file plugin](https://discuss.elastic.co/t/input-file-plugin/273109)
**Author:** [@hsalim](https://discuss.elastic.co/u/hsalim)\ **Replies:** 0\ **Last updated:** [May 16, 2021, 12:14pm UTC](https://discuss.elastic.co/t/input-file-plugin/273109 "2021-05-16T12:14:16Z")
Question 1: Has anyone seen following message with input File plugin? \[2021-05-15T23:26:23,609\]\[DEBUG\]\[logstash.javapipeline \] Shutdown waiting for worker thread {:pipeline\_id=\>"rawdiameter1200", :thread=\>"#\ **Author:** [@Anoop\_kumar\_SRIVASTA](https://discuss.elastic.co/u/Anoop_kumar_SRIVASTA)\ **Replies:** 1\ **Last updated:** [May 16, 2021, 10:42am UTC](https://discuss.elastic.co/t/unable-to-install-output-jdbc-plugin-on-logstash/273062 "2021-05-16T10:42:40Z") Hi I am facing issue while connecting logstash output send to mysql database..below are my configuration setting output { jdbc{ driver\_jar\_path =\> "/app/logstash-CBS/mysql-connector-java-8.0.25.jar" driver\_class =\> … --- ## [Determining custom timestamp for new index does not work](https://discuss.elastic.co/t/determining-custom-timestamp-for-new-index-does-not-work/273106)
**Author:** [@Roy\_Levy](https://discuss.elastic.co/u/Roy_Levy)\ **Replies:** 0\ **Last updated:** [May 16, 2021, 10:27am UTC](https://discuss.elastic.co/t/determining-custom-timestamp-for-new-index-does-not-work/273106 "2021-05-16T10:27:45Z")
Hey, I have an index which is loaded with aggregated data each day at same time, like so: I'm trying to use logstash in order to migrate the data to another ES cluster in order to use machine learning capabilities t… --- ## [Should ordering of items in BulkRequest and BulkResponse match if java client BulkProcessor is used and requests are retried?](https://discuss.elastic.co/t/should-ordering-of-items-in-bulkrequest-and-bulkresponse-match-if-java-client-bulkprocessor-is-used-and-requests-are-retried/273101)
**Author:** [@Chobicus](https://discuss.elastic.co/u/Chobicus)\ **Replies:** 0\ **Last updated:** [May 16, 2021, 7:58am UTC](https://discuss.elastic.co/t/should-ordering-of-items-in-bulkrequest-and-bulkresponse-match-if-java-client-bulkprocessor-is-used-and-requests-are-retried/273101 "2021-05-16T07:58:35Z")
Based on the code that is used for retrying it seems that the ordering of items in BulkRequest and BulkResponse do not match. e.g. BulkRequest might contain items foo1, foo2, foo3... and the BulkResponse, if retry mechan… --- ## [dentityMapCodec has reached 100% capacity {:current\_size=\>20000, :upper\_limit=\>20000} warning: thread "\[main\]\ **Author:** [@Bugsbee](https://discuss.elastic.co/u/Bugsbee)\ **Replies:** 4\ **Last updated:** [May 16, 2021, 4:08am UTC](https://discuss.elastic.co/t/dentitymapcodec-has-reached-100-capacity-current-size-20000-upper-limit-20000-warning-thread-main-file-terminated-with-exception-report-on-exception-is-true/273097 "2021-05-16T04:08:15Z") Hi Team, Community A.Error Need your assistance in this error im getting: dentityMapCodec has reached 100% capacity {:current\_size=\>20000, :upper\_limit=\>20000} warning: thread "\[main\]\ **Author:** [@Felipe\_Fuller](https://discuss.elastic.co/u/Felipe_Fuller)\ **Replies:** 2\ **Last updated:** [May 15, 2021, 8:40pm UTC](https://discuss.elastic.co/t/running-python-script-without-printing-results/271678 "2021-05-15T20:40:28Z") Hi Community! I hope that you're doing great! I've been involved in a project, and we have to process data with a python script and then insert it with Logstash into Elasticsearch. Having that said, I use the exec plugi… --- ## [Index does not appear in kibana](https://discuss.elastic.co/t/index-does-not-appear-in-kibana/273079)
**Author:** [@Bugsbee](https://discuss.elastic.co/u/Bugsbee)\ **Replies:** 4\ **Last updated:** [May 15, 2021, 7:45pm UTC](https://discuss.elastic.co/t/index-does-not-appear-in-kibana/273079 "2021-05-15T19:45:07Z")
Hi Community, I'm a total newbie in ELK and so far learning and loving it. I need some help as my index is not appearing in kibana index management area. For your information I'm using Elastic Cloud and Im able to su… --- ## [FATAL 470 Logstash stopped processing because of an error: (SystemExit) exit](https://discuss.elastic.co/t/fatal-470-logstash-stopped-processing-because-of-an-error-systemexit-exit/273091)
**Author:** [@Selcuk\_Benter](https://discuss.elastic.co/u/Selcuk_Benter)\ **Replies:** 1\ **Last updated:** [May 15, 2021, 7:12pm UTC](https://discuss.elastic.co/t/fatal-470-logstash-stopped-processing-because-of-an-error-systemexit-exit/273091 "2021-05-15T19:12:44Z")
Very basic setup, however keep getting 470 error. any suggestions OS: Windows 10 \[2021-05-15T20:49:31,983\]\[ERROR\]\[logstash.config.sourceloader\] No configuration found in the configured sources. \[2021-05-15T20:49:32,23… --- ## [Kibana ValidationError \["system" is not allowed, "objects" is not allowed\]](https://discuss.elastic.co/t/kibana-validationerror-system-is-not-allowed-objects-is-not-allowed/273073)
**Author:** [@ComfortCurve2000](https://discuss.elastic.co/u/ComfortCurve2000)\ **Replies:** 1\ **Last updated:** [May 15, 2021, 4:07pm UTC](https://discuss.elastic.co/t/kibana-validationerror-system-is-not-allowed-objects-is-not-allowed/273073 "2021-05-15T16:07:44Z")
I tried to put the key for encryptedSavedObjects.encryptionKey into the Kibana keystore and when I tried restarting kibana it said there was an error because value has length \[21\] (This is a separate problem, I put in a … --- ## [Integrating elastic search with other application](https://discuss.elastic.co/t/integrating-elastic-search-with-other-application/272919)
**Author:** [@aishwarya\_Varadaraju](https://discuss.elastic.co/u/aishwarya_Varadaraju)\ **Replies:** 2\ **Last updated:** [May 15, 2021, 4:14pm UTC](https://discuss.elastic.co/t/integrating-elastic-search-with-other-application/272919 "2021-05-15T16:14:01Z")
Hi all, I need to integrate elastic search with our application. whatever keyword that I type in my application, that directly as to be searched in the elastic search. but, its giving CORS policy error. --- ## [Logstash-input-kinesis compression](https://discuss.elastic.co/t/logstash-input-kinesis-compression/273046)
**Author:** [@jvboyle](https://discuss.elastic.co/u/jvboyle)\ **Replies:** 2\ **Last updated:** [May 15, 2021, 3:17pm UTC](https://discuss.elastic.co/t/logstash-input-kinesis-compression/273046 "2021-05-15T15:17:44Z")
When running the logstash-input-kinesis plugin , the logs coming from cloudwatch are zipped and encoded 64. Adding the option to the input ( compression =\> "gzip" ) causes the plugin to no load correct \[2021-05-14T… --- ## [How many processes can update the same index in parallel?](https://discuss.elastic.co/t/how-many-processes-can-update-the-same-index-in-parallel/273051)
**Author:** [@Dmitry\_Reshetnik](https://discuss.elastic.co/u/Dmitry_Reshetnik)\ **Replies:** 5\ **Last updated:** [May 15, 2021, 1:31pm UTC](https://discuss.elastic.co/t/how-many-processes-can-update-the-same-index-in-parallel/273051 "2021-05-15T13:31:43Z")
I have an index in ES that contains 50-100 fields. I'm getting all those fields from 10-15 different data sources (as partial documents). For each data source I want to configure an indexer process(es) that will update… --- ## [Compare two fields](https://discuss.elastic.co/t/compare-two-fields/273069)
**Author:** [@Gal\_Segal](https://discuss.elastic.co/u/Gal_Segal)\ **Replies:** 1\ **Last updated:** [May 15, 2021, 10:41am UTC](https://discuss.elastic.co/t/compare-two-fields/273069 "2021-05-15T10:41:32Z")
Hi, I am new to elastic and was hoping you can help me. I am using elastic to collect logs from both packetbeat to my 'packetbeat' index, and filebeat to my 'filebeat' index. I have an IP field in both of the indexes … --- ## [Mongodb output plugin connection error](https://discuss.elastic.co/t/mongodb-output-plugin-connection-error/273043)
**Author:** [@Roberto\_B](https://discuss.elastic.co/u/Roberto_B)\ **Replies:** 2\ **Last updated:** [May 15, 2021, 10:30am UTC](https://discuss.elastic.co/t/mongodb-output-plugin-connection-error/273043 "2021-05-15T10:30:33Z")
Hi there, i'm tryng to connect on MongoDB Atlas cluster using logstash output. I reach so many errors like this: \[WARN \] 2021-05-14 17:56:55.616 \[Ruby-0-Thread-12: :1\] mongodb - MONGODB | Error running ismaster on clu… --- ## [Elasticsearch: changing thread\_pool.search.max\_queue\_size on a high load cluster](https://discuss.elastic.co/t/elasticsearch-changing-thread-pool-search-max-queue-size-on-a-high-load-cluster/272980)
**Author:** [@cesar.hernandez.a3se](https://discuss.elastic.co/u/cesar.hernandez.a3se)\ **Replies:** 9\ **Last updated:** [May 14, 2021, 10:51am UTC](https://discuss.elastic.co/t/elasticsearch-changing-thread-pool-search-max-queue-size-on-a-high-load-cluster/272980 "2021-05-14T10:51:57Z")
Hi We have a elasticsearch cluster (version 7.8.1) using 7 nodes, every node with 96 cpu core and 192 GB RAM. During a stress test process, using locust software and simulating 1150 concurrent users, every one run a \_s… --- ## [How to individualize the data that has an array objects](https://discuss.elastic.co/t/how-to-individualize-the-data-that-has-an-array-objects/272836)
**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\ **Replies:** 10\ **Last updated:** [May 14, 2021, 7:30pm UTC](https://discuss.elastic.co/t/how-to-individualize-the-data-that-has-an-array-objects/272836 "2021-05-14T19:30:07Z")
I need to be able to extract the data that it brings me in logstash, to be able to graph I have to extract the metrics, but when it sends them to me to kibana I cannot graph because they are in an array, I need help as I… [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=946) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=948)