# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=266 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 267 --- ## [Extracting logs form archive before ingestion to elasticsearch](https://discuss.elastic.co/t/extracting-logs-form-archive-before-ingestion-to-elasticsearch/357120)
**Author:** [@pieke](https://discuss.elastic.co/u/pieke)\ **Replies:** 0\ **Last updated:** [April 10, 2024, 8:45am UTC](https://discuss.elastic.co/t/extracting-logs-form-archive-before-ingestion-to-elasticsearch/357120 "2024-04-10T08:45:44Z")
hello, For a project I am working on i am trying to create a centralized automated logging collection and visualisation solution using elasticstack. for this i need to ingest log files from multiple devices to elasticse… --- ## [Questions about Kibana's CSV output limit（22000）](https://discuss.elastic.co/t/questions-about-kibanas-csv-output-limit-22000/356066)
**Author:** [@YUUTA.INOUE-JPN](https://discuss.elastic.co/u/YUUTA.INOUE-JPN)\ **Replies:** 2\ **Last updated:** [April 10, 2024, 7:13am UTC](https://discuss.elastic.co/t/questions-about-kibanas-csv-output-limit-22000/356066 "2024-04-10T07:13:59Z")
I have a question about the number of Kibana search results "CSV report" output. I am generating a csv on the Kibana screen using the steps below. But these methods can only output up to 22,000 results, which is bother… --- ## [Using ES + Kibana to centralize and compare test runs](https://discuss.elastic.co/t/using-es-kibana-to-centralize-and-compare-test-runs/356963)
**Author:** [@eronidrian](https://discuss.elastic.co/u/eronidrian)\ **Replies:** 2\ **Last updated:** [April 10, 2024, 6:58am UTC](https://discuss.elastic.co/t/using-es-kibana-to-centralize-and-compare-test-runs/356963 "2024-04-10T06:58:41Z")
Hello, I'm experimenting with using ELK Stack in our company to centralize and compare results from test runs, and I'm not sure if ELK Stack is the right tool for us. I'll describe my vision and it would help me to hear… --- ## [Fleet server goes offline right after successfull install](https://discuss.elastic.co/t/fleet-server-goes-offline-right-after-successfull-install/355944)
**Author:** [@MheniMerz](https://discuss.elastic.co/u/MheniMerz)\ **Replies:** 12\ **Last updated:** [April 10, 2024, 6:44am UTC](https://discuss.elastic.co/t/fleet-server-goes-offline-right-after-successfull-install/355944 "2024-04-10T06:44:56Z")
Hi, i followed the steps in kibana and the docs to install a fleet server on premise (generated certificates from the elasticsearch CA), curl -L -O https://artifacts.elastic.co/downloads/beats/elastic-agent/elastic-age… --- ## [PostgreSQL Extraction with Logstash for Postgresql](https://discuss.elastic.co/t/postgresql-extraction-with-logstash-for-postgresql/357105)
**Author:** [@JOPBI\_Digital](https://discuss.elastic.co/u/JOPBI_Digital)\ **Replies:** 0\ **Last updated:** [April 9, 2024, 9:18pm UTC](https://discuss.elastic.co/t/postgresql-extraction-with-logstash-for-postgresql/357105 "2024-04-09T21:18:24Z")
input { jdbc { jdbc\_connection\_string =\> "jdbc:postgresql://db.coa.interno.trans.com.br:7432/trans" jdbc\_user =\> "ana" jdbc\_password =\> "Hbt" jdbc\_driver\_library =\> "/usr/share/logstash/vendor/jar/jdbc/postgresql-42… --- ## [Kibana formula for metric](https://discuss.elastic.co/t/kibana-formula-for-metric/357099)
**Author:** [@Liwei\_Zhang](https://discuss.elastic.co/u/Liwei_Zhang)\ **Replies:** 1\ **Last updated:** [April 9, 2024, 7:46pm UTC](https://discuss.elastic.co/t/kibana-formula-for-metric/357099 "2024-04-09T19:46:15Z")
Hello all, I'm new to Kibana and trying to make a table visualization that the metric would be: The max subscribers for each zip code and sum them for each AOI, the calculation in tableau looks like: {SUM({INCLUDE \[AO… --- ## [Help Understanding how to free space](https://discuss.elastic.co/t/help-understanding-how-to-free-space/357006)
**Author:** [@pbassking](https://discuss.elastic.co/u/pbassking)\ **Replies:** 3\ **Last updated:** [April 9, 2024, 6:49pm UTC](https://discuss.elastic.co/t/help-understanding-how-to-free-space/357006 "2024-04-09T18:49:32Z")
Hi, I inherited this application when the previous admin left the company and I am not well versed in it. At the moment, I have an issue where I can't log into Kibana and two out of the 4 nodes are down. Trying to log… --- ## [Beats 8.13.1 services won't start due to quoting issues](https://discuss.elastic.co/t/beats-8-13-1-services-wont-start-due-to-quoting-issues/356924)
**Author:** [@Aaron\_C\_de\_Bruyn](https://discuss.elastic.co/u/Aaron_C_de_Bruyn)\ **Replies:** 7\ **Last updated:** [April 9, 2024, 6:15pm UTC](https://discuss.elastic.co/t/beats-8-13-1-services-wont-start-due-to-quoting-issues/356924 "2024-04-09T18:15:47Z")
In reference to: It looks like the MSI installers now support passing INSTALLDIR...but it looks like the beats don't handle quoting properly and cause services to fail to start. Just tried to install Auditbeat, Metric… --- ## [Save data from error handler to other index](https://discuss.elastic.co/t/save-data-from-error-handler-to-other-index/357094)
**Author:** [@Observador](https://discuss.elastic.co/u/Observador)\ **Replies:** 0\ **Last updated:** [April 9, 2024, 4:56pm UTC](https://discuss.elastic.co/t/save-data-from-error-handler-to-other-index/357094 "2024-04-09T16:56:20Z")
Hi, I’d like to make an update and save thouse which doesn’t exist in other index. I’ve done an Error Handler but I don’t know how make the call there to write each not existing record data in other index. --- ## [How to make custom synonym analyzer?](https://discuss.elastic.co/t/how-to-make-custom-synonym-analyzer/357001)
**Author:** [@Oerlikon](https://discuss.elastic.co/u/Oerlikon)\ **Replies:** 1\ **Last updated:** [April 9, 2024, 4:26pm UTC](https://discuss.elastic.co/t/how-to-make-custom-synonym-analyzer/357001 "2024-04-09T16:26:41Z")
I got this error Traceback (most recent call last): File "C:\\Users\\User\\PycharmProjects\\pythonProject\_full\_text\\Preprocesing\_slovak\_synonyms.py", line 91, in \ es.indices.create(index=index\_name, body=mappi… --- ## [Can’t get HAPROXY to send stats or info data to Metricbeat](https://discuss.elastic.co/t/can-t-get-haproxy-to-send-stats-or-info-data-to-metricbeat/357019)
**Author:** [@nhdev](https://discuss.elastic.co/u/nhdev)\ **Replies:** 4\ **Last updated:** [April 9, 2024, 4:24pm UTC](https://discuss.elastic.co/t/can-t-get-haproxy-to-send-stats-or-info-data-to-metricbeat/357019 "2024-04-09T16:24:02Z")
\- module: haproxy metricsets: \["info", "stat"\] period: 10s hosts: \["tcp://\[unique\_host\]:14567"\] username : "haproxy" password : "haproxy" enabled: true global log 127.0.0.1 local0 chroot … --- ## [How import self-signed ca for es8.4.2](https://discuss.elastic.co/t/how-import-self-signed-ca-for-es8-4-2/356990)
**Author:** [@YZ\_Xie](https://discuss.elastic.co/u/YZ_Xie)\ **Replies:** 2\ **Last updated:** [April 9, 2024, 3:54pm UTC](https://discuss.elastic.co/t/how-import-self-signed-ca-for-es8-4-2/356990 "2024-04-09T15:54:07Z")
We signed a cert from our internal ca, then xpack.security.transport.ssl configured use this cert, I know need import ca cert to es to solve this problem, but how to import it? I tried below command, but failed keytool… --- ## [How do query in Discover for list hosts if we have fleet agent policy id](https://discuss.elastic.co/t/how-do-query-in-discover-for-list-hosts-if-we-have-fleet-agent-policy-id/357087)
**Author:** [@Love\_all1](https://discuss.elastic.co/u/Love_all1)\ **Replies:** 0\ **Last updated:** [April 9, 2024, 3:34pm UTC](https://discuss.elastic.co/t/how-do-query-in-discover-for-list-hosts-if-we-have-fleet-agent-policy-id/357087 "2024-04-09T15:34:33Z")
I have list of hosts around 1040 i need to query and that list exported to excel. --- ## [Don't override elasticsearch index with null values from logstash pipeline](https://discuss.elastic.co/t/dont-override-elasticsearch-index-with-null-values-from-logstash-pipeline/357069)
**Author:** [@Pedro\_Lopez\_Gonzalez](https://discuss.elastic.co/u/Pedro_Lopez_Gonzalez)\ **Replies:** 1\ **Last updated:** [April 9, 2024, 3:34pm UTC](https://discuss.elastic.co/t/dont-override-elasticsearch-index-with-null-values-from-logstash-pipeline/357069 "2024-04-09T15:34:04Z")
Hi All Im updating an index in logstash pipeline, it's working right, but I need not override the fields with null values. how can i do this? That is my config elasticsearch { hosts =\> \["HOST"\] index =\> "ind… --- ## [How the size of index is related to number of shards?](https://discuss.elastic.co/t/how-the-size-of-index-is-related-to-number-of-shards/356686)
**Author:** [@vincent2mots](https://discuss.elastic.co/u/vincent2mots)\ **Replies:** 2\ **Last updated:** [April 9, 2024, 3:25pm UTC](https://discuss.elastic.co/t/how-the-size-of-index-is-related-to-number-of-shards/356686 "2024-04-09T15:25:38Z")
Hi there, I have some question about number of sharding and size of indexes. I am currently in a single node configuration. I have one index in february : index with 1 shard, size 477 Gb and 600 million of documents … --- ## [Runtime field data in Kibana Document table](https://discuss.elastic.co/t/runtime-field-data-in-kibana-document-table/357074)
**Author:** [@Cinu](https://discuss.elastic.co/u/Cinu)\ **Replies:** 1\ **Last updated:** [April 9, 2024, 2:47pm UTC](https://discuss.elastic.co/t/runtime-field-data-in-kibana-document-table/357074 "2024-04-09T14:47:32Z")
Hi, I've created some runtime fields which show data in Discover, data table etc. But when i use those runtime fields inside document table, they dont show any data, instead simply show '-' only. What could be the rea… --- ## [502 Timeout with Delete by query](https://discuss.elastic.co/t/502-timeout-with-delete-by-query/357053)
**Author:** [@Musled](https://discuss.elastic.co/u/Musled)\ **Replies:** 7\ **Last updated:** [April 9, 2024, 2:43pm UTC](https://discuss.elastic.co/t/502-timeout-with-delete-by-query/357053 "2024-04-09T14:43:15Z")
Hello there ! I have a problem when I run this query: \`POST /logs-nginx.cpcu.prod/\_delete\_by\_query { "query": { "range": { "@timestamp": { "lt": "now-30d" } } } } Basically I w… --- ## [Elasticsearch POST API call gives 401 unauthorized](https://discuss.elastic.co/t/elasticsearch-post-api-call-gives-401-unauthorized/356786)
**Author:** [@ashutos](https://discuss.elastic.co/u/ashutos)\ **Replies:** 11\ **Last updated:** [April 9, 2024, 2:14pm UTC](https://discuss.elastic.co/t/elasticsearch-post-api-call-gives-401-unauthorized/356786 "2024-04-09T14:14:00Z")
Hello, We are using ELasticsearch 6.8 version and have enabled https for same. Accessing the URL is fine and it is also able to communicate with Kibana. However we are trying to send some data using POST method to elas… --- ## [Elasticsearch shards current usage](https://discuss.elastic.co/t/elasticsearch-shards-current-usage/357027)
**Author:** [@Ashwin\_Subramanian](https://discuss.elastic.co/u/Ashwin_Subramanian)\ **Replies:** 0\ **Last updated:** [April 9, 2024, 6:13am UTC](https://discuss.elastic.co/t/elasticsearch-shards-current-usage/357027 "2024-04-09T06:13:41Z")
Hi team, My customer is using Cortex XSOAR with ES. From the UI under ES monitoring, they notice Elasticsearch shard's current usage is 100%. Is it okay to have 100%. Why the shards' current usage is 100% Kindly someon… --- ## [Conditional boosting of results based on the # of conditions that are true](https://discuss.elastic.co/t/conditional-boosting-of-results-based-on-the-of-conditions-that-are-true/357022)
**Author:** [@pekadad](https://discuss.elastic.co/u/pekadad)\ **Replies:** 0\ **Last updated:** [April 8, 2024, 10:27pm UTC](https://discuss.elastic.co/t/conditional-boosting-of-results-based-on-the-of-conditions-that-are-true/357022 "2024-04-08T22:27:45Z")
I am trying to determine if it is feasible to include boosting of results based on a number of conditions that might or might not be true for each result. We have implemented some boosting using a function\_score clause … --- ## [Port 5044 is not opening](https://discuss.elastic.co/t/port-5044-is-not-opening/357067)
**Author:** [@kachavan](https://discuss.elastic.co/u/kachavan)\ **Replies:** 0\ **Last updated:** [April 9, 2024, 12:36pm UTC](https://discuss.elastic.co/t/port-5044-is-not-opening/357067 "2024-04-09T12:36:56Z")
Hi, I have installed elasticsearch, kibana and logstach, and when I have checked the open port list on my server I found all the required ports are open like 9200, 5601 etc except this port 5044. Firewall is also disabl… --- ## [Web Crawler API](https://discuss.elastic.co/t/web-crawler-api/355608)
**Author:** [@Chenko](https://discuss.elastic.co/u/Chenko)\ **Replies:** 1\ **Last updated:** [April 9, 2024, 12:30pm UTC](https://discuss.elastic.co/t/web-crawler-api/355608 "2024-04-09T12:30:54Z")
Hi, I got a couple of questions regarding the Web Crawlers API's (App Search's crawler & Elastic Web Crawler): Why does the more powerful web crawler (Elastic Web Crawler) not have an API while the App Search crawler… --- ## [How to avoid incomplete garbage collection by G1GC causing high cpu usage on Elasticsearch nodes?](https://discuss.elastic.co/t/how-to-avoid-incomplete-garbage-collection-by-g1gc-causing-high-cpu-usage-on-elasticsearch-nodes/357032)
**Author:** [@wangxr1985](https://discuss.elastic.co/u/wangxr1985)\ **Replies:** 6\ **Last updated:** [April 9, 2024, 12:30pm UTC](https://discuss.elastic.co/t/how-to-avoid-incomplete-garbage-collection-by-g1gc-causing-high-cpu-usage-on-elasticsearch-nodes/357032 "2024-04-09T12:30:05Z")
This was an issue I encountered before: I asked the same question on another forum, and someone replied as follows: In the ThreadLocal's ThreadLocalMap, there is a table. Excessive usage can result in most Entry eleme… --- ## [Difference Vector search & Semantic Search](https://discuss.elastic.co/t/difference-vector-search-semantic-search/356969)
**Author:** [@Chenko](https://discuss.elastic.co/u/Chenko)\ **Replies:** 2\ **Last updated:** [April 9, 2024, 12:12pm UTC](https://discuss.elastic.co/t/difference-vector-search-semantic-search/356969 "2024-04-09T12:12:16Z")
Hello, From what can be seen on the Subscription page it seems that Vector Search & Semantic Search are different. Vector Search IS included in the free/basic tier, whereas Semantic Search IS NOT included in the free/b… --- ## [Problem elastic "document\_parsing\_exception" type field](https://discuss.elastic.co/t/problem-elastic-document-parsing-exception-type-field/356690)
**Author:** [@San9](https://discuss.elastic.co/u/San9)\ **Replies:** 14\ **Last updated:** [April 9, 2024, 12:09pm UTC](https://discuss.elastic.co/t/problem-elastic-document-parsing-exception-type-field/356690 "2024-04-09T12:09:12Z")
Hello, I have encountered a common problem that many Elastic users face, but I have not yet found an answer to it and I do not understand how to solve it so that I do not lose messages that are sent by Elastic. I use fi… --- ## [Logstash is updating sincedb but indices are not creating](https://discuss.elastic.co/t/logstash-is-updating-sincedb-but-indices-are-not-creating/356516)
**Author:** [@Theivendram\_Athavan](https://discuss.elastic.co/u/Theivendram_Athavan)\ **Replies:** 12\ **Last updated:** [April 9, 2024, 12:01pm UTC](https://discuss.elastic.co/t/logstash-is-updating-sincedb-but-indices-are-not-creating/356516 "2024-04-09T12:01:08Z")
I am collecting ALB logs from S3 into elasticsearch using logstash. For now I wanted to collect more than one year of data from S3 and ingest into elasticsearch. I am creating indices for everyday with the name of index-… --- ## [Http.json: unexpected end of JSON input](https://discuss.elastic.co/t/http-json-unexpected-end-of-json-input/357061)
**Author:** [@h.d.intodata](https://discuss.elastic.co/u/h.d.intodata)\ **Replies:** 0\ **Last updated:** [April 9, 2024, 11:58am UTC](https://discuss.elastic.co/t/http-json-unexpected-end-of-json-input/357061 "2024-04-09T11:58:12Z")
Hi team, I am trying to get metrics on an API call. My call works on Postman, however, I am getting this error when I run metricbeat: {"log.level":"error","@timestamp":"2024-04-09T11:51:35.572Z","log.origin":{"functio… --- ## [Client request timeout - Sync Elasticsearch with MySQL](https://discuss.elastic.co/t/client-request-timeout-sync-elasticsearch-with-mysql/357057)
**Author:** [@abhinavtyagi](https://discuss.elastic.co/u/abhinavtyagi)\ **Replies:** 0\ **Last updated:** [April 9, 2024, 11:16am UTC](https://discuss.elastic.co/t/client-request-timeout-sync-elasticsearch-with-mysql/357057 "2024-04-09T11:16:29Z")
Hello, I am getting below error while executing the get query on kibana console: Also, if I am executing for another index that one is also taking around 30s. Why it's behaving like this ? docker.yml file: elasti… --- ## [Can Elastic Agent ingest from logstash?](https://discuss.elastic.co/t/can-elastic-agent-ingest-from-logstash/356105)
**Author:** [@dmgeurts](https://discuss.elastic.co/u/dmgeurts)\ **Replies:** 1\ **Last updated:** [April 9, 2024, 10:53am UTC](https://discuss.elastic.co/t/can-elastic-agent-ingest-from-logstash/356105 "2024-04-09T10:53:47Z")
I'm trying to ingest data from MongoDB, not database metrics but the data from a collection stored in MongoDB. There's GitHub - phutchins/logstash-input-mongodb: MongoDB input plugin for Logstash, but it's a bit outdated… --- ## [ElasticSearch With Logstash SSL communication error](https://discuss.elastic.co/t/elasticsearch-with-logstash-ssl-communication-error/356856)
**Author:** [@Blaj\_Dragos](https://discuss.elastic.co/u/Blaj_Dragos)\ **Replies:** 4\ **Last updated:** [April 9, 2024, 10:19am UTC](https://discuss.elastic.co/t/elasticsearch-with-logstash-ssl-communication-error/356856 "2024-04-09T10:19:29Z")
Hi! (version 8.11.1) I keep hitting a problem with my ELK stack configuration and I need some help with it. I needed to enable Kibana login page and I found out that I need to set the ssl on for the elasticsearch conf… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=265) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=267)