# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=886 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 887 --- ## [Migrate data from current production Elasticsearch nodes to a new hardware](https://discuss.elastic.co/t/migrate-data-from-current-production-elasticsearch-nodes-to-a-new-hardware/237682)
**Author:** [@kaushalshriyan](https://discuss.elastic.co/u/kaushalshriyan)\ **Replies:** 3\ **Last updated:** [June 19, 2020, 3:35am UTC](https://discuss.elastic.co/t/migrate-data-from-current-production-elasticsearch-nodes-to-a-new-hardware/237682 "2020-06-19T03:35:42Z")
Hi, I am currently running ES (version 7.5.1) three nodes in the cluster mode. ES Node1:- 192.168.0.10 ES Node2 :- 192.168.0.11 ES Node3 :- 192.168.0.12 I want to migrate the data from the above running production clu… --- ## [Add Nested document into the elasticsearch via logstash](https://discuss.elastic.co/t/add-nested-document-into-the-elasticsearch-via-logstash/237660)
**Author:** [@Siva\_Samraj](https://discuss.elastic.co/u/Siva_Samraj)\ **Replies:** 1\ **Last updated:** [June 19, 2020, 3:20am UTC](https://discuss.elastic.co/t/add-nested-document-into-the-elasticsearch-via-logstash/237660 "2020-06-19T03:20:58Z")
\` I have a problem, multiple events will come from Kafka for the same message-id. I want to use logstash to push the events into elastic search in a nested documents. How we can push the data into elasticsearch via logst… --- ## [Trying to rename a field, getting "object mapping for \[\\] tried to parse field \[\\] as object, but found a concrete value](https://discuss.elastic.co/t/trying-to-rename-a-field-getting-object-mapping-for-name-of-field-tried-to-parse-field-name-of-field-as-object-but-found-a-concrete-value/237719)
**Author:** [@Casie\_Schuller](https://discuss.elastic.co/u/Casie_Schuller)\ **Replies:** 0\ **Last updated:** [June 19, 2020, 1:47am UTC](https://discuss.elastic.co/t/trying-to-rename-a-field-getting-object-mapping-for-name-of-field-tried-to-parse-field-name-of-field-as-object-but-found-a-concrete-value/237719 "2020-06-19T01:47:39Z")
Hi, I'm trying to rename data that is in this shape: using this: POST r\_xair\_signals-2020-06/\_update/2020-06-15T22:23:00Z\_-1344027716 { "doc" : { "Customer ImpactedNested" : "CustomerImpactedNested" } … --- ## [Is there a GUI / tool that visualizes explained queries?](https://discuss.elastic.co/t/is-there-a-gui-tool-that-visualizes-explained-queries/237711)
**Author:** [@username1234](https://discuss.elastic.co/u/username1234)\ **Replies:** 0\ **Last updated:** [June 19, 2020, 12:58am UTC](https://discuss.elastic.co/t/is-there-a-gui-tool-that-visualizes-explained-queries/237711 "2020-06-19T00:58:24Z")
When setting explain: true, the results can be very hard to read even with JSON pretty printing. Are there any tools to help visualize and make sense of the data that explain adds? --- ## [Ingest SQL Server data on another server through logstash](https://discuss.elastic.co/t/ingest-sql-server-data-on-another-server-through-logstash/237697)
**Author:** [@FernandoMOTA](https://discuss.elastic.co/u/FernandoMOTA)\ **Replies:** 4\ **Last updated:** [June 18, 2020, 11:12pm UTC](https://discuss.elastic.co/t/ingest-sql-server-data-on-another-server-through-logstash/237697 "2020-06-18T23:12:26Z")
I want to send data from my DB Sql server to ES, the database is on another server, only the local host I received --- ## [Merging documents in elasticsearch](https://discuss.elastic.co/t/merging-documents-in-elasticsearch/237704)
**Author:** [@Gauti](https://discuss.elastic.co/u/Gauti)\ **Replies:** 0\ **Last updated:** [June 18, 2020, 9:27pm UTC](https://discuss.elastic.co/t/merging-documents-in-elasticsearch/237704 "2020-06-18T21:27:35Z")
Hi All, We are pulling data from servicenow using logstash http poller. The rest api which I am using has a field call location, which is a location name(chennai, India) I doesnot have latitude and longitude field. We … --- ## [Zipkin UI taking lot of time to load](https://discuss.elastic.co/t/zipkin-ui-taking-lot-of-time-to-load/237569)
**Author:** [@ishan\_ji\_Gupta](https://discuss.elastic.co/u/ishan_ji_Gupta)\ **Replies:** 7\ **Last updated:** [June 18, 2020, 6:37pm UTC](https://discuss.elastic.co/t/zipkin-ui-taking-lot-of-time-to-load/237569 "2020-06-18T18:37:39Z")
Zipkin UI taking lot of time to load when increasing the limit to more than 100 and beyond 300 it is showing timeout. --- ## [Generate grok custom pattern to message filed](https://discuss.elastic.co/t/generate-grok-custom-pattern-to-message-filed/237400)
**Author:** [@Mohan\_vel](https://discuss.elastic.co/u/Mohan_vel)\ **Replies:** 8\ **Last updated:** [June 18, 2020, 6:12pm UTC](https://discuss.elastic.co/t/generate-grok-custom-pattern-to-message-filed/237400 "2020-06-18T18:12:40Z")
Hi All, I am having a query related to grok processor. For example this is my message filed { "message":"agentId:agent003" } I want to Grok this and my output should me something like this { "message":"agentId:agent0… --- ## [High CPU after data loaded into memory](https://discuss.elastic.co/t/high-cpu-after-data-loaded-into-memory/237689)
**Author:** [@bhuvaneshdct](https://discuss.elastic.co/u/bhuvaneshdct)\ **Replies:** 0\ **Last updated:** [June 18, 2020, 6:10pm UTC](https://discuss.elastic.co/t/high-cpu-after-data-loaded-into-memory/237689 "2020-06-18T18:10:14Z")
I have an elastic cluster (7.4). 48 core CPU, 380GB memory, SSD Disk, 2 nodes Total data: 3TB/per node Heal 32GB thread\_pool.search.size: 50 thread\_pool.search.queue\_size: 200 indices.memory.index\_buffer\_size: 10% … --- ## [How to add elasticsearch as datasource in jasper reports tool?](https://discuss.elastic.co/t/how-to-add-elasticsearch-as-datasource-in-jasper-reports-tool/237687)
**Author:** [@Venkat\_Raj](https://discuss.elastic.co/u/Venkat_Raj)\ **Replies:** 0\ **Last updated:** [June 18, 2020, 6:02pm UTC](https://discuss.elastic.co/t/how-to-add-elasticsearch-as-datasource-in-jasper-reports-tool/237687 "2020-06-18T18:02:38Z")
I have a requirement to generate PDF reports of the datas from Elasticsearch indexes. I have seen few blogs about Jasper reports as the widely used tool to generate PDF reports. Is there any plugin to be used to establi… --- ## [Cross cluster: how to list remote cluster indices and get index mapping?](https://discuss.elastic.co/t/cross-cluster-how-to-list-remote-cluster-indices-and-get-index-mapping/237685)
**Author:** [@stoneflower](https://discuss.elastic.co/u/stoneflower)\ **Replies:** 0\ **Last updated:** [June 18, 2020, 5:56pm UTC](https://discuss.elastic.co/t/cross-cluster-how-to-list-remote-cluster-indices-and-get-index-mapping/237685 "2020-06-18T17:56:50Z")
We have two ES clusters, A and B. B has no Kibana, and we set up B as remote cluster. We use cluster A's Kibana to access cluster B. But seems no way to list all indices on remote cluster from this https://github.com/ela… --- ## [Monitor current system resources utilisation of production ES nodes](https://discuss.elastic.co/t/monitor-current-system-resources-utilisation-of-production-es-nodes/237683)
**Author:** [@kaushalshriyan](https://discuss.elastic.co/u/kaushalshriyan)\ **Replies:** 1\ **Last updated:** [June 18, 2020, 5:42pm UTC](https://discuss.elastic.co/t/monitor-current-system-resources-utilisation-of-production-es-nodes/237683 "2020-06-18T17:42:24Z")
Hi, Is there a way to monitor the current system resources like CPU, Computing Load and Memory utilization for the current ES production cluster nodes (3 nodes)? Best Regards, Kaushal --- ## [Security\_exception: action \[indices:admin/rollover\] is unauthorized for user \[\\]](https://discuss.elastic.co/t/security-exception-action-indices-admin-rollover-is-unauthorized-for-user-user-name/237328)
**Author:** [@Ryan\_Downey](https://discuss.elastic.co/u/Ryan_Downey)\ **Replies:** 1\ **Last updated:** [June 18, 2020, 5:37pm UTC](https://discuss.elastic.co/t/security-exception-action-indices-admin-rollover-is-unauthorized-for-user-user-name/237328 "2020-06-18T17:37:00Z")
What am I missing in this deployment that's throwing this error? The deployment is 7.7.0 and the user and role information is below. security\_exception: action \[indices:admin/rollover\] is unauthorized for user \[\ **Author:** [@nmoham](https://discuss.elastic.co/u/nmoham)\ **Replies:** 2\ **Last updated:** [June 18, 2020, 4:59pm UTC](https://discuss.elastic.co/t/ingest-pipeline-kv-processor-pattern-failures/237558 "2020-06-18T16:59:26Z") Trying to parse syslogs with several KV pairs . The values contain special characters & spaces. Examples Events- sev="INFO" msg="Audit access" cat="\\\[AUDIT\\\]" pol="ENC104456DB\_SQL\_Operational" uinfo="SQLService\\\\UnPriv… --- ## [Repository Error](https://discuss.elastic.co/t/repository-error/237236)
**Author:** [@Dev\_Chakraborty](https://discuss.elastic.co/u/Dev_Chakraborty)\ **Replies:** 0\ **Last updated:** [June 16, 2020, 7:19am UTC](https://discuss.elastic.co/t/repository-error/237236 "2020-06-16T07:19:19Z")
Hello Team, I have snapshot scheduled from my Linux instance to S3 bucket and its happening perfectly fine, But I could see that in kibana it shows an error "Some repositories contain errors Snapshots might load slowly.… --- ## [Logstash date field error](https://discuss.elastic.co/t/logstash-date-field-error/236463)
**Author:** [@bdn](https://discuss.elastic.co/u/bdn)\ **Replies:** 5\ **Last updated:** [June 18, 2020, 3:34pm UTC](https://discuss.elastic.co/t/logstash-date-field-error/236463 "2020-06-18T15:34:49Z")
I have log files from where I've to query documents through the date field. Here is the log date format. 2020-06-10 14:01:26 I've defined a grok pattern like below in Logstash for the log. filter { grok { … --- ## [Hyphen(-) is not matching using elasticsearch query](https://discuss.elastic.co/t/hyphen-is-not-matching-using-elasticsearch-query/237668)
**Author:** [@suresh123](https://discuss.elastic.co/u/suresh123)\ **Replies:** 0\ **Last updated:** [June 18, 2020, 3:29pm UTC](https://discuss.elastic.co/t/hyphen-is-not-matching-using-elasticsearch-query/237668 "2020-06-18T15:29:05Z")
Hi Team, Am trying to fetch data "/This is/my-query" am not able to fetch my-query. Hyphen is not matching . Can you please provide elasticsearch regex patterns Below is my query { "query": { "regexp": { "reques… --- ## [Security settings make my ES not start](https://discuss.elastic.co/t/security-settings-make-my-es-not-start/237522)
**Author:** [@FernandoMOTA](https://discuss.elastic.co/u/FernandoMOTA)\ **Replies:** 15\ **Last updated:** [June 18, 2020, 2:44pm UTC](https://discuss.elastic.co/t/security-settings-make-my-es-not-start/237522 "2020-06-18T14:44:00Z")
I made the security settings and added the following to the yml file: xpack.security.enabled: true xpack.security.transport.ssl.enabled: true xpack.security.transport.ssl.verification\_mode: certificate xpack.security.tr… --- ## [Better French and German stemming?](https://discuss.elastic.co/t/better-french-and-german-stemming/236283)
**Author:** [@bkazez](https://discuss.elastic.co/u/bkazez)\ **Replies:** 3\ **Last updated:** [June 18, 2020, 2:12pm UTC](https://discuss.elastic.co/t/better-french-and-german-stemming/236283 "2020-06-18T14:12:32Z")
Hello, I'm using cloud.elastic.co to index metadata about German and French baroque vocal music. I need to treat inflected and uninflected forms as equivalent, so someone can search "schlummer" and find the lovely Bach … --- ## [Big uncommitted segments to disk reported by GET /myIndex/\_segments API (ES version 6.3)](https://discuss.elastic.co/t/big-uncommitted-segments-to-disk-reported-by-get-myindex-segments-api-es-version-6-3/237648)
**Author:** [@Spico\_Florin](https://discuss.elastic.co/u/Spico_Florin)\ **Replies:** 0\ **Last updated:** [June 18, 2020, 1:32pm UTC](https://discuss.elastic.co/t/big-uncommitted-segments-to-disk-reported-by-get-myindex-segments-api-es-version-6-3/237648 "2020-06-18T13:32:48Z")
Hello! WE are using ElasticSearch version 6.3. We have one situation were the GET /myIndex/\_segments API reported some big size files that are uncommitted to disk (the committed field of the mentioned API is false, see … --- ## [Error in script fields](https://discuss.elastic.co/t/error-in-script-fields/237645)
**Author:** [@hiba](https://discuss.elastic.co/u/hiba)\ **Replies:** 0\ **Last updated:** [June 18, 2020, 1:22pm UTC](https://discuss.elastic.co/t/error-in-script-fields/237645 "2020-06-18T13:22:57Z")
Hi , why i can't get the result of the script : GET /test\_bookings\_v2/\_search?size=0 { "script\_fields": { "avg\_price": { "script": { "lang": "expression", "source": "doc\['price'\].avg()" } } } } i use ELK :… --- ## [FScrawler: perform OCR selectively only on PDF files that do not have text](https://discuss.elastic.co/t/fscrawler-perform-ocr-selectively-only-on-pdf-files-that-do-not-have-text/236016)
**Author:** [@equj](https://discuss.elastic.co/u/equj)\ **Replies:** 5\ **Last updated:** [June 18, 2020, 1:14pm UTC](https://discuss.elastic.co/t/fscrawler-perform-ocr-selectively-only-on-pdf-files-that-do-not-have-text/236016 "2020-06-18T13:14:36Z")
Hello, I'm using FScrawler (2.7) to load text from PDFs into Elasticsearch (7.6.x). Most of PDF files have text, but some of PDF files contain images of scanned text and need to be OCRed. Is there a way to configure FSc… --- ## [Find one term result, or a list of match results](https://discuss.elastic.co/t/find-one-term-result-or-a-list-of-match-results/237472)
**Author:** [@darraghenright](https://discuss.elastic.co/u/darraghenright)\ **Replies:** 2\ **Last updated:** [June 18, 2020, 12:49pm UTC](https://discuss.elastic.co/t/find-one-term-result-or-a-list-of-match-results/237472 "2020-06-18T12:49:51Z")
Hi there :wave: Sorry, this is undoubtedly a bit of noob question but I am still trying to get to grips with compound queries in Elasticsearch. In my example, each document has a name field and we can assume that each n… --- ## [Problem with @timestamp](https://discuss.elastic.co/t/problem-with-timestamp/237587)
**Author:** [@Youssef\_SBAI](https://discuss.elastic.co/u/Youssef_SBAI)\ **Replies:** 6\ **Last updated:** [June 18, 2020, 12:44pm UTC](https://discuss.elastic.co/t/problem-with-timestamp/237587 "2020-06-18T12:44:53Z")
I use logstash for ingest in elasstic a CSV file, i have a error from the time stamps is not the daily date my config logstash is input { file { path =\> "/data/volumes/monitoring/logstash/logCtrlM/stock.csv" … --- ## [Best practice for Index and Shard Size](https://discuss.elastic.co/t/best-practice-for-index-and-shard-size/237627)
**Author:** [@defalt](https://discuss.elastic.co/u/defalt)\ **Replies:** 0\ **Last updated:** [June 18, 2020, 12:04pm UTC](https://discuss.elastic.co/t/best-practice-for-index-and-shard-size/237627 "2020-06-18T12:04:06Z")
Hi, what is the best practice for index and shard size? I found sources that state that a good shard size is 10-30GB. But what is a good index size? I have timeseries data of over 300 GB split into 5 Indices and I am r… --- ## [Make the Benchmark dashboards available to all to be imported in kibana](https://discuss.elastic.co/t/make-the-benchmark-dashboards-available-to-all-to-be-imported-in-kibana/237527)
**Author:** [@micas](https://discuss.elastic.co/u/micas)\ **Replies:** 0\ **Last updated:** [June 17, 2020, 7:28pm UTC](https://discuss.elastic.co/t/make-the-benchmark-dashboards-available-to-all-to-be-imported-in-kibana/237527 "2020-06-17T19:28:31Z")
Even though i can run the esrally it would be useful if you guys can share the dashboards you have created: https://elasticsearch-benchmark-analytics.elastic.co/app/kibana#/dashboard/d02cc8e5-3f42-482a-a3d9-d09956db3040 … --- ## [Can we use nested object in the parent-child relationship in elasticsearch?](https://discuss.elastic.co/t/can-we-use-nested-object-in-the-parent-child-relationship-in-elasticsearch/237625)
**Author:** [@sharathnasa](https://discuss.elastic.co/u/sharathnasa)\ **Replies:** 0\ **Last updated:** [June 18, 2020, 11:32am UTC](https://discuss.elastic.co/t/can-we-use-nested-object-in-the-parent-child-relationship-in-elasticsearch/237625 "2020-06-18T11:32:59Z")
i'm creating the mapping in elasticsearch. I have a four objects such as customer, promotion, product and agreement Customer - parent and promotion - child(child of customer) Promotion - parent and product - child(chil… --- ## [Missing documents when using partitions on a term aggregation](https://discuss.elastic.co/t/missing-documents-when-using-partitions-on-a-term-aggregation/237483)
**Author:** [@jsvac](https://discuss.elastic.co/u/jsvac)\ **Replies:** 2\ **Last updated:** [June 18, 2020, 11:25am UTC](https://discuss.elastic.co/t/missing-documents-when-using-partitions-on-a-term-aggregation/237483 "2020-06-18T11:25:07Z")
Hi all, I have a relatively small index (about 5M docs) and each document has an organization\_id field. I need to list all the unique values for this field and I've implemented this using partitions by following this: h… --- ## [How to recover streaming data even if the connection lost with Python client Elasticsearch?](https://discuss.elastic.co/t/how-to-recover-streaming-data-even-if-the-connection-lost-with-python-client-elasticsearch/237273)
**Author:** [@New\_user](https://discuss.elastic.co/u/New_user)\ **Replies:** 4\ **Last updated:** [June 18, 2020, 10:12am UTC](https://discuss.elastic.co/t/how-to-recover-streaming-data-even-if-the-connection-lost-with-python-client-elasticsearch/237273 "2020-06-18T10:12:44Z")
I stream RESTful API data from https://www.n2yo.com/api/ which for tracking satellite positions. I use python client with Elasticsearch. I save the streamed data to ES every 10 seconds and visualized by Kibana. My ES ves… --- ## [Elastic Rollup Job , Error while creating visualization](https://discuss.elastic.co/t/elastic-rollup-job-error-while-creating-visualization/237577)
**Author:** [@brijeshpallath](https://discuss.elastic.co/u/brijeshpallath)\ **Replies:** 0\ **Last updated:** [June 18, 2020, 7:10am UTC](https://discuss.elastic.co/t/elastic-rollup-job-error-while-creating-visualization/237577 "2020-06-18T07:10:53Z")
Hi I have created rollup Job as per the specification given below. This will roll up data on an hourly basis. I have also created a rollup index pattern combining the rollup index and source/original index pattern. Pl… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=885) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=887)