# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1813 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1814 --- ## [Indexing to Elasticsearch elasticsearch 5.6.3 from Apache Nutch](https://discuss.elastic.co/t/indexing-to-elasticsearch-elasticsearch-5-6-3-from-apache-nutch/117278)
**Author:** [@adimora](https://discuss.elastic.co/u/adimora)\ **Replies:** 0\ **Last updated:** [January 27, 2018, 12:20am UTC](https://discuss.elastic.co/t/indexing-to-elasticsearch-elasticsearch-5-6-3-from-apache-nutch/117278 "2018-01-27T00:20:35Z")
Hello, Does anyone know of any version of Apache Nutch that can index to Elasticsearch 5.6.3? I would like to crawl my website and index the result directly to Elasticsearch but I have not been able to find a version of … --- ## [Fulltext search with fuzziness on strings containing numbers](https://discuss.elastic.co/t/fulltext-search-with-fuzziness-on-strings-containing-numbers/116034)
**Author:** [@nampord](https://discuss.elastic.co/u/nampord)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 11:40pm UTC](https://discuss.elastic.co/t/fulltext-search-with-fuzziness-on-strings-containing-numbers/116034 "2018-01-26T23:40:20Z")
I have a use case where I need to match address strings. Since the addresses come in many different shapes and forms I decided to put all fields in one string and do a full text search. The main match will be done on t… --- ## [What permission is needed to refresh field lists?](https://discuss.elastic.co/t/what-permission-is-needed-to-refresh-field-lists/116556)
**Author:** [@Nick\_Peterson](https://discuss.elastic.co/u/Nick_Peterson)\ **Replies:** 2\ **Last updated:** [January 26, 2018, 9:14pm UTC](https://discuss.elastic.co/t/what-permission-is-needed-to-refresh-field-lists/116556 "2018-01-26T21:14:58Z")
Hi, What permission is needed to refresh field lists? Thanks! Nick --- ## [Architecture related question](https://discuss.elastic.co/t/architecture-related-question/117205)
**Author:** [@Prakash\_Punj](https://discuss.elastic.co/u/Prakash_Punj)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 8:59pm UTC](https://discuss.elastic.co/t/architecture-related-question/117205 "2018-01-26T20:59:43Z")
Folks - Thank you so much for helping newbie like me on ELK. Currently I am evaluating ELK and soon may be going production with it. Have some basic question. 1.) Data ingestion: After initial ingestion of a CSV file to… --- ## [Free/Libre Open-Source (FLOSS) and Elastic](https://discuss.elastic.co/t/free-libre-open-source-floss-and-elastic/117247)
**Author:** [@chlarsen](https://discuss.elastic.co/u/chlarsen)\ **Replies:** 2\ **Last updated:** [January 26, 2018, 8:27pm UTC](https://discuss.elastic.co/t/free-libre-open-source-floss-and-elastic/117247 "2018-01-26T20:27:05Z")
Dear All, I have been monitoring, if that is the right expression, Elastic's core component, i.e. LogStash, Elasticsearch and Kibana for a number of years now, and have started using them more intensively recently. Whil… --- ## [Does Elasticsearch support TLS in FIPS mode?](https://discuss.elastic.co/t/does-elasticsearch-support-tls-in-fips-mode/117109)
**Author:** [@GSCully](https://discuss.elastic.co/u/GSCully)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 7:01pm UTC](https://discuss.elastic.co/t/does-elasticsearch-support-tls-in-fips-mode/117109 "2018-01-26T19:01:30Z")
Trying to be FIPS compliant and the question came up, Does Elasticsearch support TLS in FIPS mode? --- ## [Query performance drop while doing a snapshot](https://discuss.elastic.co/t/query-performance-drop-while-doing-a-snapshot/117052)
**Author:** [@Alexander\_Iliev](https://discuss.elastic.co/u/Alexander_Iliev)\ **Replies:** 12\ **Last updated:** [January 26, 2018, 5:48pm UTC](https://discuss.elastic.co/t/query-performance-drop-while-doing-a-snapshot/117052 "2018-01-26T17:48:17Z")
We are running a 6-node Elasticsearch cluster with a single (not really single, but the only one that is actively used) index which is 3.5TB in size (51 shards, 25 primary). We have a NFS share mounted on all nodes and … --- ## [Painless Debug.explain is NOT a println](https://discuss.elastic.co/t/painless-debug-explain-is-not-a-println/117146)
**Author:** [@luis1](https://discuss.elastic.co/u/luis1)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 5:05pm UTC](https://discuss.elastic.co/t/painless-debug-explain-is-not-a-println/117146 "2018-01-26T17:05:19Z")
Painless Debug.explain is NOT a println because interrupts the flow. Is there any way I can print a variable without interrupting the scoring for the document? Thanks. --- ## [Unexpected behaviour with script query (script executed twice)](https://discuss.elastic.co/t/unexpected-behaviour-with-script-query-script-executed-twice/116420)
**Author:** [@luis1](https://discuss.elastic.co/u/luis1)\ **Replies:** 7\ **Last updated:** [January 26, 2018, 5:01pm UTC](https://discuss.elastic.co/t/unexpected-behaviour-with-script-query-script-executed-twice/116420 "2018-01-26T17:01:54Z")
Hi, all. I found some unexpected behaviour with script query (script is executing twice in a simple query). The steps to reproduce the issue: My elastic search version: 2.4.6 My elasticsearch.yml: script.indexed: true… --- ## [Is it possible to reindex some data using previous template?](https://discuss.elastic.co/t/is-it-possible-to-reindex-some-data-using-previous-template/117235)
**Author:** [@jpereira](https://discuss.elastic.co/u/jpereira)\ **Replies:** 0\ **Last updated:** [January 26, 2018, 4:49pm UTC](https://discuss.elastic.co/t/is-it-possible-to-reindex-some-data-using-previous-template/117235 "2018-01-26T16:49:38Z")
Hi there, A few days ago I decided to try the fileBeat, but it was a disaster due to the default option that loads the new templates overwriting the current templates. either way. The problem is: I have the ES with … --- ## [High CPU Utilization after bulk data load](https://discuss.elastic.co/t/high-cpu-utilization-after-bulk-data-load/117227)
**Author:** [@Ramesh\_Natarajan](https://discuss.elastic.co/u/Ramesh_Natarajan)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 4:23pm UTC](https://discuss.elastic.co/t/high-cpu-utilization-after-bulk-data-load/117227 "2018-01-26T16:23:59Z")
My elastic search cluster contains 3 nodes running JVM: 1.8.0\_144 ES: 6.1.2 My nodes information is below: ip heap.percent ram.percent cpu load\_1m load\_5m load\_15m node.role master name 172.30.0.175 55 99 55 2.… --- ## [Possible host awareness when doing shard relocation?](https://discuss.elastic.co/t/possible-host-awareness-when-doing-shard-relocation/116973)
**Author:** [@zjxian](https://discuss.elastic.co/u/zjxian)\ **Replies:** 2\ **Last updated:** [January 26, 2018, 4:17pm UTC](https://discuss.elastic.co/t/possible-host-awareness-when-doing-shard-relocation/116973 "2018-01-26T16:17:51Z")
We're running a cluster that each host (physical machine) has 2 es nodes running. On each host, 1 node (hot ) uses the SSD as storage while another ( stale ) uses SATA as storage. We are using shard allocation filter … --- ## [Regexp query for url matching](https://discuss.elastic.co/t/regexp-query-for-url-matching/116770)
**Author:** [@BK1](https://discuss.elastic.co/u/BK1)\ **Replies:** 3\ **Last updated:** [January 26, 2018, 3:05pm UTC](https://discuss.elastic.co/t/regexp-query-for-url-matching/116770 "2018-01-26T15:05:04Z")
Hi there! I’ve trouble using the regexp query of elasticsearch. I want to identify records looking likes this: "parsed\_message": "GET https://server/different-endpoints/fix-endpoint/library.js?m=15f2fe2ddf0, Referrer=… --- ## [Derive new fields from existing fields](https://discuss.elastic.co/t/derive-new-fields-from-existing-fields/117197)
**Author:** [@ramchjob](https://discuss.elastic.co/u/ramchjob)\ **Replies:** 2\ **Last updated:** [January 26, 2018, 2:59pm UTC](https://discuss.elastic.co/t/derive-new-fields-from-existing-fields/117197 "2018-01-26T14:59:17Z")
Dear Gurus, I am looking dynamic mapping of the fields from the existing fields. Ex: I have below document currently. { "id": "1b2b3c4d5e", "active": true, "lastName": "Mike", "firstName": "Walter", "gender": "m… --- ## [Troubles with complex span query term boosting](https://discuss.elastic.co/t/troubles-with-complex-span-query-term-boosting/116106)
**Author:** [@vglazkov](https://discuss.elastic.co/u/vglazkov)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 2:22pm UTC](https://discuss.elastic.co/t/troubles-with-complex-span-query-term-boosting/116106 "2018-01-26T14:22:32Z")
Hi, I have a troubles with boosting of complex term span queries to the elasticsearch. Here's the toy example: Mapping: PUT my\_index { "mappings": { "my\_type": { "properties": { "text": { … --- ## [Format field as url](https://discuss.elastic.co/t/format-field-as-url/117199)
**Author:** [@jesusgn90](https://discuss.elastic.co/u/jesusgn90)\ **Replies:** 0\ **Last updated:** [January 26, 2018, 1:43pm UTC](https://discuss.elastic.co/t/format-field-as-url/117199 "2018-01-26T13:43:13Z")
Hi Elastic folks, I already know how to format a string field that in fact is an url as link, to be "clicable" on the discover and it works, ok. But my trouble just now is to set the format when I put my template on Elas… --- ## [What is the status of resiliency with the latest ES version?](https://discuss.elastic.co/t/what-is-the-status-of-resiliency-with-the-latest-es-version/116490)
**Author:** [@ddmichael](https://discuss.elastic.co/u/ddmichael)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 1:42pm UTC](https://discuss.elastic.co/t/what-is-the-status-of-resiliency-with-the-latest-es-version/116490 "2018-01-26T13:42:49Z")
I found this, but didn't figure much out. How safe is it (in terms of data loss) to use ES 6.1.2 as primary data store? --- ## [Very slow searches on a very large shard](https://discuss.elastic.co/t/very-slow-searches-on-a-very-large-shard/116945)
**Author:** [@mabn0](https://discuss.elastic.co/u/mabn0)\ **Replies:** 3\ **Last updated:** [January 26, 2018, 1:08pm UTC](https://discuss.elastic.co/t/very-slow-searches-on-a-very-large-shard/116945 "2018-01-26T13:08:37Z")
I have a 3 node cluster with an index which contains 72 shards. There are 330M documents amounting to 100GB according to \_cat/indices. This index has ~1000 fields, but each document has no more than 30. Routing by custo… --- ## [\[SOLVED\] Parser-excel-elasticsearch - connection refused](https://discuss.elastic.co/t/solved-parser-excel-elasticsearch-connection-refused/116462)
**Author:** [@syiannop](https://discuss.elastic.co/u/syiannop)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 12:58pm UTC](https://discuss.elastic.co/t/solved-parser-excel-elasticsearch-connection-refused/116462 "2018-01-26T12:58:28Z")
I was searching for a plugin to parse excel files into elasticsearch and I found this one. Running the application with the command written on github: java -Xmx1g -jar excelastic-1.2.3.jar \ \ \ … --- ## [Problem with too long query time](https://discuss.elastic.co/t/problem-with-too-long-query-time/116417)
**Author:** [@chuckoh](https://discuss.elastic.co/u/chuckoh)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 12:57pm UTC](https://discuss.elastic.co/t/problem-with-too-long-query-time/116417 "2018-01-26T12:57:56Z")
A ES newbie here. I've got documents in the following format and basically try to loop through all users data to find 2000 users within 100Km from his location excluding any users associated with the blocked\_ids. { … --- ## [How expensive is querying the cluster health](https://discuss.elastic.co/t/how-expensive-is-querying-the-cluster-health/116340)
**Author:** [@JeroenSoeters](https://discuss.elastic.co/u/JeroenSoeters)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 12:54pm UTC](https://discuss.elastic.co/t/how-expensive-is-querying-the-cluster-health/116340 "2018-01-26T12:54:34Z")
I would like to understand better how expensive the client.admin().cluster().prepareHealth().get().getStatus() is. Is this something you can do every 10 seconds, every second, multiple times per second? What is the impac… --- ## [Gdpr- compliance-tls-certgen-xpack](https://discuss.elastic.co/t/gdpr-compliance-tls-certgen-xpack/117170)
**Author:** [@Raj\_Kumar](https://discuss.elastic.co/u/Raj_Kumar)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 12:34pm UTC](https://discuss.elastic.co/t/gdpr-compliance-tls-certgen-xpack/117170 "2018-01-26T12:34:30Z")
Hi all, Iam have query with related to GDPR with certgen generated certificates, if we use the self signed certificates generated by xpack certgen among the elasticsearch nodes and for kibana are we complaint with GDPR … --- ## [Displaying documents in result multiple times with sorting](https://discuss.elastic.co/t/displaying-documents-in-result-multiple-times-with-sorting/116264)
**Author:** [@pszegvari](https://discuss.elastic.co/u/pszegvari)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 11:32am UTC](https://discuss.elastic.co/t/displaying-documents-in-result-multiple-times-with-sorting/116264 "2018-01-26T11:32:06Z")
Let's say that a nested document about a person can store data of type birthData, deathData, etc. We want to get ES documents sorted by \[MONTH-DAY DESC\], \[YEAR ASC\]. Filtering and sorting by a single event type is a pie… --- ## [Problem on production after elasticsearch upgrade from 2.3 to 5.6.1](https://discuss.elastic.co/t/problem-on-production-after-elasticsearch-upgrade-from-2-3-to-5-6-1/116234)
**Author:** [@Aparna\_Vodapalli](https://discuss.elastic.co/u/Aparna_Vodapalli)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 11:30am UTC](https://discuss.elastic.co/t/problem-on-production-after-elasticsearch-upgrade-from-2-3-to-5-6-1/116234 "2018-01-26T11:30:31Z")
Hi, I have problems which our production setup of elasticsearch stack, I updated it from elasticsearch 2.3 to 5.6.1, We are using now ELK 5.6.1 for elasticsearch, logstash and kibana. and Elasticsearch is collecting all… --- ## [Issue with saving an object to ES](https://discuss.elastic.co/t/issue-with-saving-an-object-to-es/117179)
**Author:** [@Nikita\_Krasnov](https://discuss.elastic.co/u/Nikita_Krasnov)\ **Replies:** 7\ **Last updated:** [January 26, 2018, 11:27am UTC](https://discuss.elastic.co/t/issue-with-saving-an-object-to-es/117179 "2018-01-26T11:27:12Z")
Try to save object due to such json: { "header": "test Header", "timeStamp":"2018-01-26T09:45:00.000+02:00", "message":"test message 3", "level":"INFO", "node": "first node", "system": "super system 1", "port": 9… --- ## [ElasticSearch integration with ManifoldCf](https://discuss.elastic.co/t/elasticsearch-integration-with-manifoldcf/116161)
**Author:** [@gautam\_gro](https://discuss.elastic.co/u/gautam_gro)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 11:14am UTC](https://discuss.elastic.co/t/elasticsearch-integration-with-manifoldcf/116161 "2018-01-26T11:14:43Z")
I am trying to create outpout connector in ManifoldCf for ElasticSearch. As per configuartion in ManifoldCf, we have to use Mapper Attachment. But as per ElasticSearch documentation Mapper Attachment plugin is obsolete … --- ## [Elasticsearch Java.security.policy](https://discuss.elastic.co/t/elasticsearch-java-security-policy/116124)
**Author:** [@Bruno\_Buenos\_Aires](https://discuss.elastic.co/u/Bruno_Buenos_Aires)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 11:12am UTC](https://discuss.elastic.co/t/elasticsearch-java-security-policy/116124 "2018-01-26T11:12:53Z")
Hi Guys, My name is Bruno, and i get that problem. i dont know how to fix that. the result from "service elasticsearch status" elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/system/elasticsear… --- ## [Is it possibile to compare fields of different indexes and work on them?](https://discuss.elastic.co/t/is-it-possibile-to-compare-fields-of-different-indexes-and-work-on-them/116101)
**Author:** [@Marchese\_De\_Sade](https://discuss.elastic.co/u/Marchese_De_Sade)\ **Replies:** 1\ **Last updated:** [January 26, 2018, 10:57am UTC](https://discuss.elastic.co/t/is-it-possibile-to-compare-fields-of-different-indexes-and-work-on-them/116101 "2018-01-26T10:57:40Z")
Hi everyone! First of all, I apologize for my bad english. Now, the question! I'm new to Elastic and I'm following the online guide, but I still have a few unsolved doubts: I have two different indexes: "jobs" and "s… --- ## [Elasticserach6.1.1 restart and i got "all shards failed"](https://discuss.elastic.co/t/elasticserach6-1-1-restart-and-i-got-all-shards-failed/117155)
**Author:** [@foolcage](https://discuss.elastic.co/u/foolcage)\ **Replies:** 3\ **Last updated:** [January 26, 2018, 10:31am UTC](https://discuss.elastic.co/t/elasticserach6-1-1-restart-and-i-got-all-shards-failed/117155 "2018-01-26T10:31:12Z")
➜ ~ curl -XGET 'localhost:9200/\_cluster/health/balance\_sheet?pretty' { "cluster\_name" : "elasticsearch", "status" : "red", "timed\_out" : false, "number\_of\_nodes" : 1, "numb… --- ## [Cant use environment variables in elasticsearch.yml](https://discuss.elastic.co/t/cant-use-environment-variables-in-elasticsearch-yml/117093)
**Author:** [@red888](https://discuss.elastic.co/u/red888)\ **Replies:** 2\ **Last updated:** [January 26, 2018, 10:26am UTC](https://discuss.elastic.co/t/cant-use-environment-variables-in-elasticsearch-yml/117093 "2018-01-26T10:26:40Z")
My variable is set # echo $ESCLUSTER es-datanode-01,es-datanode-02 In ES config I have: discovery.zen.ping.unicast.hosts: "${ESCLUSTER}" The service won't start. If I add the string explicitly it does start: disco… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1812) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1814)