# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=856 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 857 --- ## [How to build a JsonData object (JsonGenerator, etc.) to be used in new elasticsearch java api](https://discuss.elastic.co/t/how-to-build-a-jsondata-object-jsongenerator-etc-to-be-used-in-new-elasticsearch-java-api/310224)
**Author:** [@ALX\_DM](https://discuss.elastic.co/u/ALX_DM)\ **Replies:** 3\ **Last updated:** [July 21, 2022, 2:29pm UTC](https://discuss.elastic.co/t/how-to-build-a-jsondata-object-jsongenerator-etc-to-be-used-in-new-elasticsearch-java-api/310224 "2022-07-21T14:29:53Z")
Anybody here encountered RHLC XContentBuilder? How is it in migrating to new ElasticSearch java API client?... Particular implementation is when creating an index. In RHLC, we use XContentBuilder to get information fr… --- ## [Modular pipeline construction with same input plugin (Kafka) but different topic name](https://discuss.elastic.co/t/modular-pipeline-construction-with-same-input-plugin-kafka-but-different-topic-name/310300)
**Author:** [@ibrahim.ramadan](https://discuss.elastic.co/u/ibrahim.ramadan)\ **Replies:** 0\ **Last updated:** [July 21, 2022, 1:26pm UTC](https://discuss.elastic.co/t/modular-pipeline-construction-with-same-input-plugin-kafka-but-different-topic-name/310300 "2022-07-21T13:26:37Z")
Hi, I am trying to construct modular multiple pipeline in logstash. I have the same input plugin from (kafka) in all pipelines but at each one some attributes like topic name and broker address different from each input… --- ## [How to visualize objects in a Data Table](https://discuss.elastic.co/t/how-to-visualize-objects-in-a-data-table/310296)
**Author:** [@Matanueces](https://discuss.elastic.co/u/Matanueces)\ **Replies:** 1\ **Last updated:** [July 21, 2022, 1:37pm UTC](https://discuss.elastic.co/t/how-to-visualize-objects-in-a-data-table/310296 "2022-07-21T13:37:23Z")
Hello, I am new to ElasticStack and I am having a problem in representing this data. I have an "object" with three fields, name, most\_common\_difference and missing\_value\_difference, and I would like to make a table in w… --- ## [EXIST in DQL](https://discuss.elastic.co/t/exist-in-dql/310271)
**Author:** [@Alice\_Ionescu](https://discuss.elastic.co/u/Alice_Ionescu)\ **Replies:** 2\ **Last updated:** [July 21, 2022, 1:35pm UTC](https://discuss.elastic.co/t/exist-in-dql/310271 "2022-07-21T13:35:42Z")
Hello, I am trying to create a TSVB visualization (Table) and I want to a add a filter to it so it returns all the records with one specific fields not empty. How can I do that? I added in filter so that asgnStatus si… --- ## [Custom query in dashboard](https://discuss.elastic.co/t/custom-query-in-dashboard/310165)
**Author:** [@Farah\_Bhr](https://discuss.elastic.co/u/Farah_Bhr)\ **Replies:** 1\ **Last updated:** [July 21, 2022, 1:33pm UTC](https://discuss.elastic.co/t/custom-query-in-dashboard/310165 "2022-07-21T13:33:19Z")
Hello I am a beginner in elastic I want to ask can I transform an advanced search of elasticsearch indices in kibana Dev Tools into a dashboard for example can I transform this get into a kibana dashboard or to a more… --- ## [Navigation link is being removed after searching or changing time range](https://discuss.elastic.co/t/navigation-link-is-being-removed-after-searching-or-changing-time-range/310119)
**Author:** [@i\_sysa](https://discuss.elastic.co/u/i_sysa)\ **Replies:** 1\ **Last updated:** [July 21, 2022, 1:26pm UTC](https://discuss.elastic.co/t/navigation-link-is-being-removed-after-searching-or-changing-time-range/310119 "2022-07-21T13:26:56Z")
Hi team, can anybody help me to get through issue? Unfortunately, i could not deal on my own. I am developing plugin based on 'state\_container\_examples/with\_data\_services' example from 7.10.2. And i have navigation links… --- ## [Set up basic security for the Elastic Stack plus secured HTTPS traffic |](https://discuss.elastic.co/t/set-up-basic-security-for-the-elastic-stack-plus-secured-https-traffic/309857)
**Author:** [@AGiles102](https://discuss.elastic.co/u/AGiles102)\ **Replies:** 4\ **Last updated:** [July 21, 2022, 1:18pm UTC](https://discuss.elastic.co/t/set-up-basic-security-for-the-elastic-stack-plus-secured-https-traffic/309857 "2022-07-21T13:18:28Z")
Hi all, I have set up two of the three security layers of Elasticsearch. I am now trying to implement HTTPS, and after speaking to our in-house infrastructure, they can't offer us "Sign certificates with a central CA"… --- ## [Visualizing sql query in Kibana](https://discuss.elastic.co/t/visualizing-sql-query-in-kibana/310145)
**Author:** [@random\_dash](https://discuss.elastic.co/u/random_dash)\ **Replies:** 1\ **Last updated:** [July 21, 2022, 1:12pm UTC](https://discuss.elastic.co/t/visualizing-sql-query-in-kibana/310145 "2022-07-21T13:12:15Z")
Hello! I have some indices with following fields status: \["Failed", "Succeeded", "None"\] user\_id: user\_id I want to get events with status None if they are not in Succeeded set. This can be checked by user\_id. So I n… --- ## [GCP PubSub input stops suddenly due to RST\_STREAM](https://discuss.elastic.co/t/gcp-pubsub-input-stops-suddenly-due-to-rst-stream/310194)
**Author:** [@stevensim226](https://discuss.elastic.co/u/stevensim226)\ **Replies:** 1\ **Last updated:** [July 21, 2022, 12:57pm UTC](https://discuss.elastic.co/t/gcp-pubsub-input-stops-suddenly-due-to-rst-stream/310194 "2022-07-21T12:57:02Z")
I'm currently using Filebeat 7.17.5 in Docker pulled from the official docker repository I keep getting this error at random intervals since 19th July 2022 (I have been using Filebeat for \>1 year) which stops pubsub log… --- ## [Filebeat 8.3.2 module and file stream issues](https://discuss.elastic.co/t/filebeat-8-3-2-module-and-file-stream-issues/310192)
**Author:** [@CynorSense](https://discuss.elastic.co/u/CynorSense)\ **Replies:** 1\ **Last updated:** [July 21, 2022, 12:55pm UTC](https://discuss.elastic.co/t/filebeat-8-3-2-module-and-file-stream-issues/310192 "2022-07-21T12:55:58Z")
Modules in filebeat 8.3.2 had changed the file input to filestream and indexing is happening through filestream. When we enable modules. It is not working at all. We tried to enable manually using filebeat setup --pip… --- ## [Need to drop the commented lines and some lines matching the specified string](https://discuss.elastic.co/t/need-to-drop-the-commented-lines-and-some-lines-matching-the-specified-string/310120)
**Author:** [@dhanu1](https://discuss.elastic.co/u/dhanu1)\ **Replies:** 2\ **Last updated:** [July 21, 2022, 12:55pm UTC](https://discuss.elastic.co/t/need-to-drop-the-commented-lines-and-some-lines-matching-the-specified-string/310120 "2022-07-21T12:55:45Z")
I have installed ELK in one server and filebeat in other server where logs resides. My logs are moved and able to view in Kibana. But I dont need the commented lines and lines with certains text to be displayed in kibana… --- ## [Auto authentication users using embedded kibana link in custom website](https://discuss.elastic.co/t/auto-authentication-users-using-embedded-kibana-link-in-custom-website/309890)
**Author:** [@PRASHANT\_MEHTA](https://discuss.elastic.co/u/PRASHANT_MEHTA)\ **Replies:** 1\ **Last updated:** [July 21, 2022, 6:10am UTC](https://discuss.elastic.co/t/auto-authentication-users-using-embedded-kibana-link-in-custom-website/309890 "2022-07-21T06:10:39Z")
Continuing the discussion from Auto authenticate users when using embedded kibana link: Hello All, I'm trying to figure out a way in which I need to auto aunthenticate user i.e In custom web UI it should authencicate g… --- ## [Reaching elasticsearch from jupyter notebook](https://discuss.elastic.co/t/reaching-elasticsearch-from-jupyter-notebook/310290)
**Author:** [@kosmylo](https://discuss.elastic.co/u/kosmylo)\ **Replies:** 0\ **Last updated:** [July 21, 2022, 12:51pm UTC](https://discuss.elastic.co/t/reaching-elasticsearch-from-jupyter-notebook/310290 "2022-07-21T12:51:25Z")
I am running elasticsearch from docker-compose and I want to connect python to it and test it. The docker-compose has the following form: version: '3.2' services: elasticsearch: container\_name: elasticsearch … --- ## [Logstash date filter error](https://discuss.elastic.co/t/logstash-date-filter-error/310268)
**Author:** [@yugeeklab](https://discuss.elastic.co/u/yugeeklab)\ **Replies:** 1\ **Last updated:** [July 21, 2022, 12:48pm UTC](https://discuss.elastic.co/t/logstash-date-filter-error/310268 "2022-07-21T12:48:35Z")
filter { if "client" in \[tags\] { grok { match =\> { "message" =\> "%{TIMESTAMP\_ISO8601:timestamp} MysqlClient:SYSTEM\_USER:%{QS:mysql\_client.system\_user}, MYSQL\_USER:%{QS:mysql\_client.mysql\_user}… --- ## [Elasticsearch-does-not-send-logs-to-filebeat-and-or-logstash](https://discuss.elastic.co/t/elasticsearch-does-not-send-logs-to-filebeat-and-or-logstash/310010)
**Author:** [@Nguy\_n\_H\_u\_Phu](https://discuss.elastic.co/u/Nguy_n_H_u_Phu)\ **Replies:** 2\ **Last updated:** [July 21, 2022, 12:47pm UTC](https://discuss.elastic.co/t/elasticsearch-does-not-send-logs-to-filebeat-and-or-logstash/310010 "2022-07-21T12:47:48Z")
I have input but cant show output! I need help! filebeat.yml filebeat.inputs: type: filestream id: router1 enabled: true paths: /u01/redis\_app/run/tomcat-deploy-camidlog/logs/report\_log/report.log output.logstash: … --- ## [PANOS filebeat doesn't parse VPN logs](https://discuss.elastic.co/t/panos-filebeat-doesnt-parse-vpn-logs/310289)
**Author:** [@anubisg1](https://discuss.elastic.co/u/anubisg1)\ **Replies:** 0\ **Last updated:** [July 21, 2022, 12:35pm UTC](https://discuss.elastic.co/t/panos-filebeat-doesnt-parse-vpn-logs/310289 "2022-07-21T12:35:21Z")
as per title, the following is an example of logs received and parsed by panos beat. Notice that event.original has been preserved but it's content related to the actual message is lost after parsing. { "\_index": ".d… --- ## [Elasticsearch security permission for logstash](https://discuss.elastic.co/t/elasticsearch-security-permission-for-logstash/310015)
**Author:** [@ciaroda](https://discuss.elastic.co/u/ciaroda)\ **Replies:** 1\ **Last updated:** [July 21, 2022, 12:27pm UTC](https://discuss.elastic.co/t/elasticsearch-security-permission-for-logstash/310015 "2022-07-21T12:27:21Z")
Hi all, I played with ELK stack for a week or so... After installing elasticsearch and kibana (7.17 version), I enabled simple security following this guide. Later I installed logstash (version 7.17) with security con… --- ## [AWS, es-hadoop and 429](https://discuss.elastic.co/t/aws-es-hadoop-and-429/310124)
**Author:** [@matze79](https://discuss.elastic.co/u/matze79)\ **Replies:** 5\ **Last updated:** [July 21, 2022, 12:18pm UTC](https://discuss.elastic.co/t/aws-es-hadoop-and-429/310124 "2022-07-21T12:18:51Z")
Hi forum, I'm on AWS and trying to write ~ 1.2mio documents from an AWS Glue job Python / pyspark job to a managed ElasticSearch. To be fair mentioning that I'm using AWS OpenSearch 1.2 but my question is more or less … --- ## [Csv plugin cooperating with multiplying pattern](https://discuss.elastic.co/t/csv-plugin-cooperating-with-multiplying-pattern/309865)
**Author:** [@INS](https://discuss.elastic.co/u/INS)\ **Replies:** 13\ **Last updated:** [July 21, 2022, 12:01pm UTC](https://discuss.elastic.co/t/csv-plugin-cooperating-with-multiplying-pattern/309865 "2022-07-21T12:01:01Z")
Hi @Badger I need to continue below topic: referring to above I have a question how I can mark in this code pattern, also count of records is not regular (once it's more once it's less) a place with different kind o… --- ## [How to connect postgresql with kibana](https://discuss.elastic.co/t/how-to-connect-postgresql-with-kibana/310273)
**Author:** [@Khadija\_BOUDINAR](https://discuss.elastic.co/u/Khadija_BOUDINAR)\ **Replies:** 3\ **Last updated:** [July 21, 2022, 11:56am UTC](https://discuss.elastic.co/t/how-to-connect-postgresql-with-kibana/310273 "2022-07-21T11:56:45Z")
Hi all, Can postgres connect to kibana --- ## [Custom Timestamp in Kibana is 2 hours off](https://discuss.elastic.co/t/custom-timestamp-in-kibana-is-2-hours-off/309650)
**Author:** [@azeiner](https://discuss.elastic.co/u/azeiner)\ **Replies:** 12\ **Last updated:** [July 21, 2022, 11:51am UTC](https://discuss.elastic.co/t/custom-timestamp-in-kibana-is-2-hours-off/309650 "2022-07-21T11:51:25Z")
I'm importing and converting data from a textfile into elastic via the PHP API which is provided by elastic. Now i'm encountering that the data is 2 hours off (depending on summertime settings) in kibana, not when i'm s… --- ## [Json file not parsing getting error unexpected character (':'' (code 58))](https://discuss.elastic.co/t/json-file-not-parsing-getting-error-unexpected-character-code-58/309323)
**Author:** [@Mary2022](https://discuss.elastic.co/u/Mary2022)\ **Replies:** 5\ **Last updated:** [July 21, 2022, 10:58am UTC](https://discuss.elastic.co/t/json-file-not-parsing-getting-error-unexpected-character-code-58/309323 "2022-07-21T10:58:09Z")
I have json files coming in the following format: \[ { "user": "Beta", "percent": 28, "startTime": "2022-07-07T11:31:45", "type": "CPU", "total": 1072987793, "Location": "locationB", "desk": "MAC" }, { … --- ## [Not Getting perfect results using multi\_match](https://discuss.elastic.co/t/not-getting-perfect-results-using-multi-match/310272)
**Author:** [@RohitBR\_K](https://discuss.elastic.co/u/RohitBR_K)\ **Replies:** 0\ **Last updated:** [July 21, 2022, 10:38am UTC](https://discuss.elastic.co/t/not-getting-perfect-results-using-multi-match/310272 "2022-07-21T10:38:01Z")
am searching milk but am getting some 5 matched products and getting some other products starting with mi such as milano cigarettes etc --- ## [Upgrading Integration Policy resets existing values to defaults sometimes](https://discuss.elastic.co/t/upgrading-integration-policy-resets-existing-values-to-defaults-sometimes/310267)
**Author:** [@matled](https://discuss.elastic.co/u/matled)\ **Replies:** 0\ **Last updated:** [July 21, 2022, 10:18am UTC](https://discuss.elastic.co/t/upgrading-integration-policy-resets-existing-values-to-defaults-sometimes/310267 "2022-07-21T10:18:11Z")
Recently we have encountered a phenomenon wehere values where reset while upgrading different integration policies from one version to another. :thinking: I'm not sure if this is intended but it is also not consistent w… --- ## [Kibana Dashboard Field number format](https://discuss.elastic.co/t/kibana-dashboard-field-number-format/310247)
**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\ **Replies:** 3\ **Last updated:** [July 21, 2022, 10:12am UTC](https://discuss.elastic.co/t/kibana-dashboard-field-number-format/310247 "2022-07-21T10:12:02Z")
Hi all, I'm using fields with number format in my kibana dashboards. I'm stuck with International numeric system which gives results in 1,000,000,000. I want to use indian numeric system which gives results in 1,00,00… --- ## [Elasticsearch Data Nodes](https://discuss.elastic.co/t/elasticsearch-data-nodes/310170)
**Author:** [@Farah\_Bhr](https://discuss.elastic.co/u/Farah_Bhr)\ **Replies:** 2\ **Last updated:** [July 21, 2022, 9:27am UTC](https://discuss.elastic.co/t/elasticsearch-data-nodes/310170 "2022-07-21T09:27:00Z")
Hello I am a beginner at elastic I want to know what are the limits of an elasticsearch cluster, meaning what is the criteria to add another node into the elasticsearch cluster to scale horizontally for example an el… --- ## [5.6 script\_fields painless extract ipaddress then aggregate](https://discuss.elastic.co/t/5-6-script-fields-painless-extract-ipaddress-then-aggregate/310263)
**Author:** [@wachiuri](https://discuss.elastic.co/u/wachiuri)\ **Replies:** 1\ **Last updated:** [July 21, 2022, 9:26am UTC](https://discuss.elastic.co/t/5-6-script-fields-painless-extract-ipaddress-then-aggregate/310263 "2022-07-21T09:26:53Z")
I'm trying to extract a term using a pattern from a text field using a painless script on elasticsearch 5.6. and then I want to aggregate using that scripted field GET \_search { "size": 5, "script\_fie… --- ## [Using the elasticsearch .net NEST client API to get snapshots with query parameters](https://discuss.elastic.co/t/using-the-elasticsearch-net-nest-client-api-to-get-snapshots-with-query-parameters/310021)
**Author:** [@amirmono](https://discuss.elastic.co/u/amirmono)\ **Replies:** 3\ **Last updated:** [July 21, 2022, 8:43am UTC](https://discuss.elastic.co/t/using-the-elasticsearch-net-nest-client-api-to-get-snapshots-with-query-parameters/310021 "2022-07-21T08:43:37Z")
I'm using the Nest client c# API (version 7.0.0.0) to get elasticsearch (8.2.2) snapshots information. response = \_elasticClient.Snapshot.Get( "repository\_name", "\*" ); I… --- ## [Problem migrating HLRC from 7.17.X to 8.X](https://discuss.elastic.co/t/problem-migrating-hlrc-from-7-17-x-to-8-x/310195)
**Author:** [@Gilles\_HURON](https://discuss.elastic.co/u/Gilles_HURON)\ **Replies:** 1\ **Last updated:** [July 21, 2022, 7:54am UTC](https://discuss.elastic.co/t/problem-migrating-hlrc-from-7-17-x-to-8-x/310195 "2022-07-21T07:54:06Z")
Hello I am in this situation: big project using elasticsearch rest high level client, 7.16.X, and want to migrate to 8.2.X or later, so I follow these guidelines Migrating from the High Level Rest Client | Elasticsearch… --- ## [Filebeat over a shared network](https://discuss.elastic.co/t/filebeat-over-a-shared-network/310157)
**Author:** [@Steve666](https://discuss.elastic.co/u/Steve666)\ **Replies:** 4\ **Last updated:** [July 21, 2022, 7:44am UTC](https://discuss.elastic.co/t/filebeat-over-a-shared-network/310157 "2022-07-21T07:44:39Z")
Hi, I have a setup with 5 machines (5 pc's) that makes their own logfiles. All those 5 machines are connected to one (another) PC that runs filebeat. Filebeat processes all logfiles from the 5 machines but when I rest… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=855) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=857)