# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1328 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1329 --- ## [Bulk import of IP addresses and showing a map with geo-location : No Compatible Fields](https://discuss.elastic.co/t/bulk-import-of-ip-addresses-and-showing-a-map-with-geo-location-no-compatible-fields/177122)
**Author:** [@mayer](https://discuss.elastic.co/u/mayer)\ **Replies:** 1\ **Last updated:** [April 17, 2019, 4:36pm UTC](https://discuss.elastic.co/t/bulk-import-of-ip-addresses-and-showing-a-map-with-geo-location-no-compatible-fields/177122 "2019-04-17T16:36:05Z")
Dear All, My environment ELK 6.6.1 I try to import data and want to show a map with the locations. I create the index with PUT /spamcalcgrp { "settings": { "index.mapping.total\_fields.limit": 1500, "number\_… --- ## [Ingest pipeline : error if field does not exist - record missing](https://discuss.elastic.co/t/ingest-pipeline-error-if-field-does-not-exist-record-missing/177343)
**Author:** [@mayer](https://discuss.elastic.co/u/mayer)\ **Replies:** 0\ **Last updated:** [April 17, 2019, 4:32pm UTC](https://discuss.elastic.co/t/ingest-pipeline-error-if-field-does-not-exist-record-missing/177343 "2019-04-17T16:32:36Z")
Dear All, my environment ELK 6.6.1 I have data with IP addresses which I want to load in a bulk. I wrote a ingest pipeline which converts IP to "geo\_point". This works generally fine but if the record doesn't have thi… --- ## [RestHighLevelClient catching IndexNotFoundException](https://discuss.elastic.co/t/resthighlevelclient-catching-indexnotfoundexception/177339)
**Author:** [@gormanst](https://discuss.elastic.co/u/gormanst)\ **Replies:** 0\ **Last updated:** [April 17, 2019, 4:02pm UTC](https://discuss.elastic.co/t/resthighlevelclient-catching-indexnotfoundexception/177339 "2019-04-17T16:02:22Z")
I have searched around looking for the right way to catch this exception from the RestHighLevelClient. When my cluster comes up there are no indexes initially. I don't want to change this behavior. I could like to captur… --- ## [Token count query and its correlation with field](https://discuss.elastic.co/t/token-count-query-and-its-correlation-with-field/177332)
**Author:** [@pokaleshrey](https://discuss.elastic.co/u/pokaleshrey)\ **Replies:** 0\ **Last updated:** [April 17, 2019, 3:26pm UTC](https://discuss.elastic.co/t/token-count-query-and-its-correlation-with-field/177332 "2019-04-17T15:26:42Z")
I have a mapping as below. The text field below is actually an array of different values of different word length. { "docs": { "mappings": { "doc": { "properties": { "name": { "type": "text", "fields": { "lengt… --- ## [Must not apply in must query result](https://discuss.elastic.co/t/must-not-apply-in-must-query-result/177042)
**Author:** [@Dilip\_Kumar](https://discuss.elastic.co/u/Dilip_Kumar)\ **Replies:** 13\ **Last updated:** [April 17, 2019, 3:09pm UTC](https://discuss.elastic.co/t/must-not-apply-in-must-query-result/177042 "2019-04-17T15:09:45Z")
Need to filter apply document having must FE=5 but if some FE=5 also having FE=17, then ignore those document. Please suggest "query": { "bool": { "must": \[ { "term": { "FE": { "value": "5" } } }, { "range": … --- ## [What will be mapping format for date?](https://discuss.elastic.co/t/what-will-be-mapping-format-for-date/177227)
**Author:** [@Ankita\_Ghosh](https://discuss.elastic.co/u/Ankita_Ghosh)\ **Replies:** 1\ **Last updated:** [April 17, 2019, 2:47pm UTC](https://discuss.elastic.co/t/what-will-be-mapping-format-for-date/177227 "2019-04-17T14:47:18Z")
2018-08-23 06:39:53.821362+00 for this format I am creating mapping "date": { "type": "date", "format" : "yyyy-MM-dd hh:mm:ss.SSSSSS+00" } giving format exception --- ## [I/O Scheduler type](https://discuss.elastic.co/t/i-o-scheduler-type/173168)
**Author:** [@y3046308](https://discuss.elastic.co/u/y3046308)\ **Replies:** 2\ **Last updated:** [April 17, 2019, 2:45pm UTC](https://discuss.elastic.co/t/i-o-scheduler-type/173168 "2019-04-17T14:45:09Z")
Hi I read from the documentation about how changing I/O Scheduler may significantly boost the performance of my cluster. When I checked /sys/block/nvme0n1/queue/scheduler , it was set to along with other options mq-de… --- ## [Forcemerge API max\_num\_segments=1 ok for my index?](https://discuss.elastic.co/t/forcemerge-api-max-num-segments-1-ok-for-my-index/177215)
**Author:** [@Dilip\_Kumar](https://discuss.elastic.co/u/Dilip_Kumar)\ **Replies:** 1\ **Last updated:** [April 17, 2019, 2:29pm UTC](https://discuss.elastic.co/t/forcemerge-api-max-num-segments-1-ok-for-my-index/177215 "2019-04-17T14:29:31Z")
I have index (myindex) in cluster with two nodes, i am deleting some records with delete\_by\_query. Now i want to use curl -XPOST 192.168.1.111:9200/myindex/\_forcemerge?max\_num\_segments=1 to free disk space and mke light… --- ## [Pipeline not applied to all documents](https://discuss.elastic.co/t/pipeline-not-applied-to-all-documents/177230)
**Author:** [@Marc\_Zahn](https://discuss.elastic.co/u/Marc_Zahn)\ **Replies:** 2\ **Last updated:** [April 17, 2019, 2:14pm UTC](https://discuss.elastic.co/t/pipeline-not-applied-to-all-documents/177230 "2019-04-17T14:14:14Z")
Hi, I implemented a script pipeline to finally convert some fields programmatically. First I wanted to test it and it turned out that the pipeline is not applied to all documents but only to a few. This is my pipeline: … --- ## [ES cluster won't start](https://discuss.elastic.co/t/es-cluster-wont-start/177300)
**Author:** [@gavin.mcmenemy](https://discuss.elastic.co/u/gavin.mcmenemy)\ **Replies:** 2\ **Last updated:** [April 17, 2019, 1:32pm UTC](https://discuss.elastic.co/t/es-cluster-wont-start/177300 "2019-04-17T13:32:34Z")
After updating our single node environment to 6.7.0 we've been unable to get it started. I'm seeing this error below. I've been googling but I have no idea what it means or what has gone wrong with the update. This isn'… --- ## [Backup/restore ES data](https://discuss.elastic.co/t/backup-restore-es-data/177273)
**Author:** [@blueren](https://discuss.elastic.co/u/blueren)\ **Replies:** 2\ **Last updated:** [April 17, 2019, 12:35pm UTC](https://discuss.elastic.co/t/backup-restore-es-data/177273 "2019-04-17T12:35:38Z")
I have an ES instance + replica running on a machine. I would like to move it all to a separate machine. I was able to do it using elasticdump - However, before proceeding with moving all of the data, I want to know if I… --- ## [Curator and elasticsearch 7.0.0](https://discuss.elastic.co/t/curator-and-elasticsearch-7-0-0/177262)
**Author:** [@Imad\_Bouchakour](https://discuss.elastic.co/u/Imad_Bouchakour)\ **Replies:** 1\ **Last updated:** [April 17, 2019, 12:13pm UTC](https://discuss.elastic.co/t/curator-and-elasticsearch-7-0-0/177262 "2019-04-17T12:13:47Z")
hello, my version of curator don't work with elasticsearch 7.0.0, curator.exceptions.CuratorException: Elasticsearch version 7.0.0 incompatible with this version of Curator (5.5.4) --- ## [How do I change the File system storage types?](https://discuss.elastic.co/t/how-do-i-change-the-file-system-storage-types/172974)
**Author:** [@azuresky11](https://discuss.elastic.co/u/azuresky11)\ **Replies:** 11\ **Last updated:** [April 17, 2019, 10:53am UTC](https://discuss.elastic.co/t/how-do-i-change-the-file-system-storage-types/172974 "2019-04-17T10:53:29Z")
hi,all When I turn on Es and I don't want to restart，Can I change the File system storage types? --- ## [Elasticsearch sizing: Number of nodes, RAM needed](https://discuss.elastic.co/t/elasticsearch-sizing-number-of-nodes-ram-needed/177186)
**Author:** [@thangld](https://discuss.elastic.co/u/thangld)\ **Replies:** 2\ **Last updated:** [April 17, 2019, 10:30am UTC](https://discuss.elastic.co/t/elasticsearch-sizing-number-of-nodes-ram-needed/177186 "2019-04-17T10:30:39Z")
I am trying to build an ES cluster to handle storing and searching event logs from security devices with following requirements: 25000 EPS, 1000 bytes/event, using hot/warm architecture with 4 days of hot and 90 days of … --- ## [Normalized pivot tables](https://discuss.elastic.co/t/normalized-pivot-tables/176948)
**Author:** [@Kossinator](https://discuss.elastic.co/u/Kossinator)\ **Replies:** 1\ **Last updated:** [April 17, 2019, 10:13am UTC](https://discuss.elastic.co/t/normalized-pivot-tables/176948 "2019-04-17T10:13:45Z")
Good evening everyone. I am currently looking for a performant way to create normalized pivot tables based on three different fields. We have several thousends / millions of documents with the following JSON structure i… --- ## [Need to know or be notified that all the nodes have been initialized successfully using Elastic Search Sniffer](https://discuss.elastic.co/t/need-to-know-or-be-notified-that-all-the-nodes-have-been-initialized-successfully-using-elastic-search-sniffer/177232)
**Author:** [@zqzhao5](https://discuss.elastic.co/u/zqzhao5)\ **Replies:** 0\ **Last updated:** [April 17, 2019, 8:27am UTC](https://discuss.elastic.co/t/need-to-know-or-be-notified-that-all-the-nodes-have-been-initialized-successfully-using-elastic-search-sniffer/177232 "2019-04-17T08:27:20Z")
I use a proxy server to determine how to route request to the backend elastic search clusters. The client makes request directly to the proxy server, so I need to implement some kind of service discovery mechanism in the… --- ## [Not starting Elasticsearch for some reason I can't undestand](https://discuss.elastic.co/t/not-starting-elasticsearch-for-some-reason-i-cant-undestand/177092)
**Author:** [@HikariNTB](https://discuss.elastic.co/u/HikariNTB)\ **Replies:** 3\ **Last updated:** [April 17, 2019, 8:59am UTC](https://discuss.elastic.co/t/not-starting-elasticsearch-for-some-reason-i-cant-undestand/177092 "2019-04-17T08:59:11Z")
Hi, I'm new with this software and I had installed 6.5.0 version months ago, but, when I tried to update I had problems, so I reset the CentOS 7 machine and try it again with this 7.0.0 version. I could make everything … --- ## [About store compression,Does es\`current compression algorithm suppot only lz4 and deflate?](https://discuss.elastic.co/t/about-store-compression-does-es-current-compression-algorithm-suppot-only-lz4-and-deflate/177185)
**Author:** [@azuresky11](https://discuss.elastic.co/u/azuresky11)\ **Replies:** 7\ **Last updated:** [April 17, 2019, 8:23am UTC](https://discuss.elastic.co/t/about-store-compression-does-es-current-compression-algorithm-suppot-only-lz4-and-deflate/177185 "2019-04-17T08:23:01Z")
Does es\`current compression algorithm suppot only lz4 and deflate?Whether it supports other open source algorithms,or custom algorithms? --- ## [Index action, index search output as multiple documents](https://discuss.elastic.co/t/index-action-index-search-output-as-multiple-documents/177058)
**Author:** [@agone](https://discuss.elastic.co/u/agone)\ **Replies:** 2\ **Last updated:** [April 17, 2019, 7:58am UTC](https://discuss.elastic.co/t/index-action-index-search-output-as-multiple-documents/177058 "2019-04-17T07:58:43Z")
Hi! I need to create a watch, that will search through several indicies for certain events and then save each doc as a separate event to a new index. I have already read this topic, got the idea but still hunting for w… --- ## [Data loss- injection using transport client](https://discuss.elastic.co/t/data-loss-injection-using-transport-client/177209)
**Author:** [@hen\_kling](https://discuss.elastic.co/u/hen_kling)\ **Replies:** 1\ **Last updated:** [April 17, 2019, 7:52am UTC](https://discuss.elastic.co/t/data-loss-injection-using-transport-client/177209 "2019-04-17T07:52:45Z")
Hi, I sent bluk to elasticsearch via Nifi using PutElasticsearch5 processor. In the Nifi processor code: When sent to elastic sesrch using transport client, i got an array of responses for each in the bulk. I checked… --- ## [\[10:20\] unable to parse BaseAggregationBuilder with name \[query\]: parser not found](https://discuss.elastic.co/t/10-20-unable-to-parse-baseaggregationbuilder-with-name-query-parser-not-found/177220)
**Author:** [@Sagar\_Kayasth](https://discuss.elastic.co/u/Sagar_Kayasth)\ **Replies:** 1\ **Last updated:** [April 17, 2019, 7:49am UTC](https://discuss.elastic.co/t/10-20-unable-to-parse-baseaggregationbuilder-with-name-query-parser-not-found/177220 "2019-04-17T07:49:13Z")
Hi everyone, I'm facing a strange issue when performing a search on an nested field on multiple fields with aggregation. { "size": 0, "aggs": { "Attributes": { "nested": { "path": "Attributes" }, "aggs": { "Att… --- ## [Elasticsearch Max document length for indexing files](https://discuss.elastic.co/t/elasticsearch-max-document-length-for-indexing-files/177126)
**Author:** [@rahulnama](https://discuss.elastic.co/u/rahulnama)\ **Replies:** 3\ **Last updated:** [April 17, 2019, 7:48am UTC](https://discuss.elastic.co/t/elasticsearch-max-document-length-for-indexing-files/177126 "2019-04-17T07:48:21Z")
Hi Team I'm indexing pdf files into Elasticsearch. I'm converting each file to text with python and i'm pushing it to Elasticsearch. content of one pdf file represents one document in Elasticsearch. If my file is 10mb … --- ## [Nodes with CPU high running Elasticsearch 5.2.2, suspect it to be segments merging issue as we found a huge number of deleted document, which might be running slow and causing CPU to hang on to 98-99%?](https://discuss.elastic.co/t/nodes-with-cpu-high-running-elasticsearch-5-2-2-suspect-it-to-be-segments-merging-issue-as-we-found-a-huge-number-of-deleted-document-which-might-be-running-slow-and-causing-cpu-to-hang-on-to-98-99/175820)
**Author:** [@Adil](https://discuss.elastic.co/u/Adil)\ **Replies:** 0\ **Last updated:** [April 8, 2019, 11:09am UTC](https://discuss.elastic.co/t/nodes-with-cpu-high-running-elasticsearch-5-2-2-suspect-it-to-be-segments-merging-issue-as-we-found-a-huge-number-of-deleted-document-which-might-be-running-slow-and-causing-cpu-to-hang-on-to-98-99/175820 "2019-04-08T11:09:16Z")
We have (4core,32gb, and 600GB SSD x 9 machines) with index-A 15 Primary and 2Replicas and 2355 segments with the highest segment sizing 6.8gb, Index-B 15 Primary and 2Replicas and 1354 segments with the highest segment… --- ## [Help me with query large data](https://discuss.elastic.co/t/help-me-with-query-large-data/177200)
**Author:** [@Roger\_Yang\_Wei](https://discuss.elastic.co/u/Roger_Yang_Wei)\ **Replies:** 0\ **Last updated:** [April 17, 2019, 6:45am UTC](https://discuss.elastic.co/t/help-me-with-query-large-data/177200 "2019-04-17T06:45:43Z")
Hi, I have an indexed document and I am query the field from the index with a size of 600k. And it run into an error showing as below: {u'status': 400, u'error': {u'root\_cause': \[{u'reason': u'ReleasableBytesStreamOutpu… --- ## [Graylog, not showing logs](https://discuss.elastic.co/t/graylog-not-showing-logs/177196)
**Author:** [@contact\_coolin](https://discuss.elastic.co/u/contact_coolin)\ **Replies:** 0\ **Last updated:** [April 17, 2019, 6:39am UTC](https://discuss.elastic.co/t/graylog-not-showing-logs/177196 "2019-04-17T06:39:40Z")
Please could you help point me in the right direction for help with an issue I'm having with Graylog. The issue is that Graylog shows event log messages being received, but I am unable to view them. It sticks in a loop … --- ## [How to run specific subprojects of elasticsearch source code](https://discuss.elastic.co/t/how-to-run-specific-subprojects-of-elasticsearch-source-code/172243)
**Author:** [@MKU](https://discuss.elastic.co/u/MKU)\ **Replies:** 16\ **Last updated:** [April 17, 2019, 6:02am UTC](https://discuss.elastic.co/t/how-to-run-specific-subprojects-of-elasticsearch-source-code/172243 "2019-04-17T06:02:59Z")
Is there a way to rebuild only the file or sub-projects which i modify.So that i need not build the whole project again. Also every time i make a change in file,i had to restart my windows to delete .lock file,there has… --- ## [What to do so Elastic Search doesn't consume so much resources?](https://discuss.elastic.co/t/what-to-do-so-elastic-search-doesnt-consume-so-much-resources/177149)
**Author:** [@Jorge\_Hernandez](https://discuss.elastic.co/u/Jorge_Hernandez)\ **Replies:** 6\ **Last updated:** [April 17, 2019, 5:22am UTC](https://discuss.elastic.co/t/what-to-do-so-elastic-search-doesnt-consume-so-much-resources/177149 "2019-04-17T05:22:46Z")
I just wished Elastic Search did not use Java, we have a server running Elastic Search Agent using 75G+ of Virtual Memory and I would like it not to use that much, I know Java is a very hungry Programming Language, but 7… --- ## [Help with query. Remove top level buckets using child terms counts](https://discuss.elastic.co/t/help-with-query-remove-top-level-buckets-using-child-terms-counts/177182)
**Author:** [@digitalpacman](https://discuss.elastic.co/u/digitalpacman)\ **Replies:** 0\ **Last updated:** [April 17, 2019, 4:01am UTC](https://discuss.elastic.co/t/help-with-query-remove-top-level-buckets-using-child-terms-counts/177182 "2019-04-17T04:01:22Z")
I cannot seem to write this query. It's very advanced for what I am used to doing. Here is a pseudo representation of what I am trying to accomplish: terms SerialNumber terms SuccessCode only keeps terms if SerialNu… --- ## [Add weekend field via ingest pipeline](https://discuss.elastic.co/t/add-weekend-field-via-ingest-pipeline/177039)
**Author:** [@jasony](https://discuss.elastic.co/u/jasony)\ **Replies:** 2\ **Last updated:** [April 17, 2019, 2:19am UTC](https://discuss.elastic.co/t/add-weekend-field-via-ingest-pipeline/177039 "2019-04-17T02:19:50Z")
Hello, i need to add a field to check whether the date field is weekend or not. I found below script for weekend identification. doc\[alrm\_occr\_ddt'\].date.dayOfWeek == 6 || doc\[alrm\_occr\_ddt'\].date.dayOfWeek == 7" so … --- ## [How to make Elasticsearch can search from another field when have some specific keyword](https://discuss.elastic.co/t/how-to-make-elasticsearch-can-search-from-another-field-when-have-some-specific-keyword/177143)
**Author:** [@LinJIngYun](https://discuss.elastic.co/u/LinJIngYun)\ **Replies:** 1\ **Last updated:** [April 17, 2019, 1:58am UTC](https://discuss.elastic.co/t/how-to-make-elasticsearch-can-search-from-another-field-when-have-some-specific-keyword/177143 "2019-04-17T01:58:44Z")
Hello, This is my example data about event or meeting organization. I want to perform searching like "Songkarn holiday in Bangkok" and Elasticsearch will know automatically that "in \[Bangkok\]" is it mean my location f… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1327) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1329)