# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1424 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1425 --- ## [New index file for every log file getting transferred to ElasticSearch](https://discuss.elastic.co/t/new-index-file-for-every-log-file-getting-transferred-to-elasticsearch/164422)
**Author:** [@hemenkotecha](https://discuss.elastic.co/u/hemenkotecha)\ **Replies:** 3\ **Last updated:** [January 16, 2019, 9:30am UTC](https://discuss.elastic.co/t/new-index-file-for-every-log-file-getting-transferred-to-elasticsearch/164422 "2019-01-16T09:30:59Z")
We use elasticsearch for the EMC Networker Log analysis.. So we transfer Networker server daemon logs to ES.. These are log files are generally huge in size... So for the better analysis perspective, we need new indices … --- ## [Should I give my machines more ram or put a new machine into the cluster?](https://discuss.elastic.co/t/should-i-give-my-machines-more-ram-or-put-a-new-machine-into-the-cluster/164414)
**Author:** [@McElroy](https://discuss.elastic.co/u/McElroy)\ **Replies:** 2\ **Last updated:** [January 16, 2019, 9:09am UTC](https://discuss.elastic.co/t/should-i-give-my-machines-more-ram-or-put-a-new-machine-into-the-cluster/164414 "2019-01-16T09:09:43Z")
Hi, I have a cluster with four data nodes. Those nodes have 6 cpus and 16gb of ram. I have 15098 active shards in this cluster. Should I put more ram in my machines or set up a new host for this cluster? The problem … --- ## [Upgrading Elasticsearch on Windows from zip install](https://discuss.elastic.co/t/upgrading-elasticsearch-on-windows-from-zip-install/164354)
**Author:** [@nahallac](https://discuss.elastic.co/u/nahallac)\ **Replies:** 3\ **Last updated:** [January 16, 2019, 8:52am UTC](https://discuss.elastic.co/t/upgrading-elasticsearch-on-windows-from-zip-install/164354 "2019-01-16T08:52:28Z")
Hi all, I am in the process of planning an upgrade from an Elastic Stack installed before my time. I've got all of the relevant upgrade docs (starting with the upgrade guide), but have a question about upgrading using t… --- ## [SpanNearQuery bug?](https://discuss.elastic.co/t/spannearquery-bug/164416)
**Author:** [@bwats](https://discuss.elastic.co/u/bwats)\ **Replies:** 1\ **Last updated:** [January 16, 2019, 8:17am UTC](https://discuss.elastic.co/t/spannearquery-bug/164416 "2019-01-16T08:17:00Z")
I have two fields, and would like to match terms in the field IF in the same position i.e. span near query with zero slop. However, the spannear query is matching WHEN IT SHOULDN'T - i.e. based on my own design AND certi… --- ## [Am getting Unsupported Java version error when am trying to run any plugin in Elasticsearch 6.4.3](https://discuss.elastic.co/t/am-getting-unsupported-java-version-error-when-am-trying-to-run-any-plugin-in-elasticsearch-6-4-3/164415)
**Author:** [@sadiesh](https://discuss.elastic.co/u/sadiesh)\ **Replies:** 1\ **Last updated:** [January 16, 2019, 8:13am UTC](https://discuss.elastic.co/t/am-getting-unsupported-java-version-error-when-am-trying-to-run-any-plugin-in-elasticsearch-6-4-3/164415 "2019-01-16T08:13:42Z")
Exception in thread "main" java.lang.UnsupportedClassVersion Error. --- ## [The location of syslog logs?](https://discuss.elastic.co/t/the-location-of-syslog-logs/164412)
**Author:** [@exevolium](https://discuss.elastic.co/u/exevolium)\ **Replies:** 0\ **Last updated:** [January 16, 2019, 6:50am UTC](https://discuss.elastic.co/t/the-location-of-syslog-logs/164412 "2019-01-16T06:50:46Z")
Hello, Where is the location of the syslog logs from the server? I need to sign those logs. I need the place where the logs I see in the graylog web interface are kept as files. The structure I built is as follows: Gr… --- ## [Shrink on multi path is not working](https://discuss.elastic.co/t/shrink-on-multi-path-is-not-working/164280)
**Author:** [@Izek](https://discuss.elastic.co/u/Izek)\ **Replies:** 1\ **Last updated:** [January 16, 2019, 4:38am UTC](https://discuss.elastic.co/t/shrink-on-multi-path-is-not-working/164280 "2019-01-16T04:38:15Z")
I am try to reduce the number of shards on my cluster. But there have multi data.path in my elasticsearch.yml file. I saw this post https://discuss.elastic.co/t/curator-fails-to-shrink-index/100010/3?u=izek I know it … --- ## [Elasticsearch php api is very slow](https://discuss.elastic.co/t/elasticsearch-php-api-is-very-slow/164263)
**Author:** [@auglkev](https://discuss.elastic.co/u/auglkev)\ **Replies:** 3\ **Last updated:** [January 16, 2019, 2:21am UTC](https://discuss.elastic.co/t/elasticsearch-php-api-is-very-slow/164263 "2019-01-16T02:21:44Z")
I'm using elasticsearch-php api version 6.0 and find it very slow to index or get a document.it always take 7-10 secs to perform a request. However when I'm using raw curl request,it only takes 100ms. I wonder why is thi… --- ## [Deprecated field \[inline\] used, expected \[source\] instead & Deprecated field \[all\_fields\] used, replaced by \[Set \[fields\] to \`\*\` instead\]](https://discuss.elastic.co/t/deprecated-field-inline-used-expected-source-instead-deprecated-field-all-fields-used-replaced-by-set-fields-to-instead/164396)
**Author:** [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\ **Replies:** 0\ **Last updated:** [January 16, 2019, 1:19am UTC](https://discuss.elastic.co/t/deprecated-field-inline-used-expected-source-instead-deprecated-field-all-fields-used-replaced-by-set-fields-to-instead/164396 "2019-01-16T01:19:11Z")
Hi, Elasticsearch 6.5.4 I was going over the Elastic cloud logs today and found these two warnings reoccurring. I did some googling but couldn't find a root case. Deprecated field \[inline\] used, expected \[source\] inst… --- ## [Load Data In to New Index or Add Create Date to Document](https://discuss.elastic.co/t/load-data-in-to-new-index-or-add-create-date-to-document/164389)
**Author:** [@MajorWalrus](https://discuss.elastic.co/u/MajorWalrus)\ **Replies:** 0\ **Last updated:** [January 15, 2019, 11:43pm UTC](https://discuss.elastic.co/t/load-data-in-to-new-index-or-add-create-date-to-document/164389 "2019-01-15T23:43:28Z")
Hi, I'm looking for recommendations on how to load business-generated data in to ES for app search. I have data which is created by a business process which is only available after an over night batch process. When sea… --- ## [Create index based in filename in Elasticsearch](https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379)
**Author:** [@vijayakrishna.rg](https://discuss.elastic.co/u/vijayakrishna.rg)\ **Replies:** 8\ **Last updated:** [January 15, 2019, 10:47pm UTC](https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379 "2019-01-15T22:47:07Z")
Hi, We have new log files get created every time when we run load test on jenkins machine. Ex: Load test1 creates file called: /jenkins/var/lib/simulation-1.log Load test2 Creates file: jenkins/var/lib/simulation-2.l… --- ## [Multi Filebeat prospector paths and Filebeat pipelines in one Logstash config file for ES/Kibana](https://discuss.elastic.co/t/multi-filebeat-prospector-paths-and-filebeat-pipelines-in-one-logstash-config-file-for-es-kibana/163908)
**Author:** [@Datakids](https://discuss.elastic.co/u/Datakids)\ **Replies:** 4\ **Last updated:** [January 15, 2019, 9:58pm UTC](https://discuss.elastic.co/t/multi-filebeat-prospector-paths-and-filebeat-pipelines-in-one-logstash-config-file-for-es-kibana/163908 "2019-01-15T21:58:35Z")
Hi, hope youre all doing fine. I'm quite new to the elastic stack and in learning progress. I play with the plugins and datasets to become more familar about this fantastic tools. This is my 2nd post :slight\_smile: I… --- ## [Nodes not linking up in cluster](https://discuss.elastic.co/t/nodes-not-linking-up-in-cluster/164206)
**Author:** [@jwalls](https://discuss.elastic.co/u/jwalls)\ **Replies:** 4\ **Last updated:** [January 15, 2019, 9:29pm UTC](https://discuss.elastic.co/t/nodes-not-linking-up-in-cluster/164206 "2019-01-15T21:29:50Z")
Hello again, I'm setting up a 3 node cluster across 3 separate IPs, however the status shows that none are connected to each other. Here's the curl -uelastic -XGET 'cec-es-master:9200/\_cluster/health?pretty' output: … --- ## [\[6.2.2\] datafeed not working with scripted field because mapping issue](https://discuss.elastic.co/t/6-2-2-datafeed-not-working-with-scripted-field-because-mapping-issue/163743)
**Author:** [@dao](https://discuss.elastic.co/u/dao)\ **Replies:** 2\ **Last updated:** [January 15, 2019, 9:26pm UTC](https://discuss.elastic.co/t/6-2-2-datafeed-not-working-with-scripted-field-because-mapping-issue/163743 "2019-01-15T21:26:05Z")
Hello, I run some ML jobs on scripted fields. I use a regex for the index pattern that matches several indices. In some cases, the fields involved in the scripted field are not mapped. Up to now, it was not a big deal, … --- ## [Does specifying the order makes a performance difference for term aggregation?](https://discuss.elastic.co/t/does-specifying-the-order-makes-a-performance-difference-for-term-aggregation/164373)
**Author:** [@Daniel\_Rodriguez\_a](https://discuss.elastic.co/u/Daniel_Rodriguez_a)\ **Replies:** 0\ **Last updated:** [January 15, 2019, 8:39pm UTC](https://discuss.elastic.co/t/does-specifying-the-order-makes-a-performance-difference-for-term-aggregation/164373 "2019-01-15T20:39:07Z")
Hello there. I am aware that ascending sort order is not accurate for term aggregation, but that is not what I want to discuss now. By default on term aggregation, buckets are sorted descending by doc\_count. I have a f… --- ## [Highlighting is not applying to all results](https://discuss.elastic.co/t/highlighting-is-not-applying-to-all-results/164350)
**Author:** [@anveshdd](https://discuss.elastic.co/u/anveshdd)\ **Replies:** 0\ **Last updated:** [January 15, 2019, 5:29pm UTC](https://discuss.elastic.co/t/highlighting-is-not-applying-to-all-results/164350 "2019-01-15T17:29:03Z")
Working on elastic search 6.5.2. Applying the highlight functionality. When I check the results the highlight is applying to the first few records perfectly and after that highlight is not applying to title field. Any so… --- ## [Elasticsearch cluster / nodes / shards conf](https://discuss.elastic.co/t/elasticsearch-cluster-nodes-shards-conf/164310)
**Author:** [@thiagotankian](https://discuss.elastic.co/u/thiagotankian)\ **Replies:** 4\ **Last updated:** [January 15, 2019, 4:58pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-nodes-shards-conf/164310 "2019-01-15T16:58:21Z")
Hi, I need to import around 400GB of a json log file (which has about 300 million records) in order to make some searches and visualization using kibana. I did some research in order to understand how is the better con… --- ## [Elasticsearch - Why does Elastic does not support Phrase with fuzziness](https://discuss.elastic.co/t/elasticsearch-why-does-elastic-does-not-support-phrase-with-fuzziness/162205)
**Author:** [@Nikesh](https://discuss.elastic.co/u/Nikesh)\ **Replies:** 3\ **Last updated:** [January 15, 2019, 4:42pm UTC](https://discuss.elastic.co/t/elasticsearch-why-does-elastic-does-not-support-phrase-with-fuzziness/162205 "2019-01-15T16:42:30Z")
Hi, I have done sufficient research for applying fuzziness to a phrase but ended up with nothing. I also find few MNC's that use Elasticsearch also fail to apply fuzziness to a phrase. Athough, I can achieve this by spa… --- ## [Unknown char\_filter type \[mapping\] for \[remove\_punctuation\]](https://discuss.elastic.co/t/unknown-char-filter-type-mapping-for-remove-punctuation/164346)
**Author:** [@jachandler](https://discuss.elastic.co/u/jachandler)\ **Replies:** 0\ **Last updated:** [January 15, 2019, 4:38pm UTC](https://discuss.elastic.co/t/unknown-char-filter-type-mapping-for-remove-punctuation/164346 "2019-01-15T16:38:19Z")
Hi all, I'm bashing my head against this but getting a whole lot of nowhere. My business is currently working on upgrading our ES clusters from 2.1.1 (!!) up to something in the 6 range. Our Elastics are running in Kube… --- ## [Fuzziness parameter with a more\_like\_this query - deprecated?](https://discuss.elastic.co/t/fuzziness-parameter-with-a-more-like-this-query-deprecated/164191)
**Author:** [@pgodzin](https://discuss.elastic.co/u/pgodzin)\ **Replies:** 0\ **Last updated:** [January 14, 2019, 7:28pm UTC](https://discuss.elastic.co/t/fuzziness-parameter-with-a-more-like-this-query-deprecated/164191 "2019-01-14T19:28:17Z")
According to https://www.elastic.co/guide/en/elasticsearch/reference/6.5/query-dsl-flt-query.html, the fuzzy\_like\_this query is deprecated, but the fuzziness field can be used with the MLT query. However, https://www.el… --- ## [Cannot set thread\_pool setting in Elastic Cloud user settings](https://discuss.elastic.co/t/cannot-set-thread-pool-setting-in-elastic-cloud-user-settings/164239)
**Author:** [@CapitanRedBeard](https://discuss.elastic.co/u/CapitanRedBeard)\ **Replies:** 4\ **Last updated:** [January 15, 2019, 4:29pm UTC](https://discuss.elastic.co/t/cannot-set-thread-pool-setting-in-elastic-cloud-user-settings/164239 "2019-01-15T16:29:04Z")
Using ES v6.4.3 I'm getting a bunch of TransportService errors when writing a high volume of transactions. The exact error is: StatusCodeError: 429 - {"error":{"root\_cause":\[{"type":"remote\_transport\_exception","reason… --- ## [Search inner\_hits using a script](https://discuss.elastic.co/t/search-inner-hits-using-a-script/164321)
**Author:** [@randel](https://discuss.elastic.co/u/randel)\ **Replies:** 1\ **Last updated:** [January 15, 2019, 4:15pm UTC](https://discuss.elastic.co/t/search-inner-hits-using-a-script/164321 "2019-01-15T16:15:34Z")
According to the documentation of inner\_hits it should be possible to use a script to sort the nested inner\_hits of a document. But I can't get it to work - the \_score turns NULL as soon as I use it in an script. An ex… --- ## [Rollover doesn't actually roll in the Python Elasticseach API](https://discuss.elastic.co/t/rollover-doesnt-actually-roll-in-the-python-elasticseach-api/163941)
**Author:** [@mehdi-gital](https://discuss.elastic.co/u/mehdi-gital)\ **Replies:** 4\ **Last updated:** [January 15, 2019, 3:19pm UTC](https://discuss.elastic.co/t/rollover-doesnt-actually-roll-in-the-python-elasticseach-api/163941 "2019-01-15T15:19:41Z")
It's my first time trying to create a rollover and I've read a bunch of posts with similar topics but nothing quite answers mine. from elasticsearch import Elasticsearch, helpers es = Elasticsearch(\[{'host': 'localhost… --- ## [How much Disk I need To store 100GB/day with 1 Replica for 1 year?](https://discuss.elastic.co/t/how-much-disk-i-need-to-store-100gb-day-with-1-replica-for-1-year/164313)
**Author:** [@vikas\_gopal](https://discuss.elastic.co/u/vikas_gopal)\ **Replies:** 3\ **Last updated:** [January 15, 2019, 2:11pm UTC](https://discuss.elastic.co/t/how-much-disk-i-need-to-store-100gb-day-with-1-replica-for-1-year/164313 "2019-01-15T14:11:05Z")
Hi Experts, I have checked Elasticsearch docs and many blogs and this is what my understanding says . Please correct me if this calculation is wrong Daily Data volume :- 100 GB Retention period :- 1 year Replica:- 1 … --- ## [Highlight nested objects with no position gap](https://discuss.elastic.co/t/highlight-nested-objects-with-no-position-gap/164317)
**Author:** [@sean92](https://discuss.elastic.co/u/sean92)\ **Replies:** 0\ **Last updated:** [January 15, 2019, 1:45pm UTC](https://discuss.elastic.co/t/highlight-nested-objects-with-no-position-gap/164317 "2019-01-15T13:45:41Z")
My issue is reasonably close to this highlight-field-type-object-or-custom-highlight. Given a document: { "id": 1, "doc\_id": 'adef-2321-321' "lines":\[ "I would like Elasticsearch to search", … --- ## [Blogpost about Clean Code in Elasticsearch](https://discuss.elastic.co/t/blogpost-about-clean-code-in-elasticsearch/164300)
**Author:** [@djuelg](https://discuss.elastic.co/u/djuelg)\ **Replies:** 2\ **Last updated:** [January 15, 2019, 12:29pm UTC](https://discuss.elastic.co/t/blogpost-about-clean-code-in-elasticsearch/164300 "2019-01-15T12:29:48Z")
Hi! I've calculated some metrics regarding Clean Code for Elasticsearch 6.5 and wrote a blogpost about it. Maybe the results are interesting for your next renovation :slight\_smile: Clean Code: The hard facts and figur… --- ## [Giving Fields Different Weights in a Multi-Match Query Using Cross-Fields Technique](https://discuss.elastic.co/t/giving-fields-different-weights-in-a-multi-match-query-using-cross-fields-technique/164268)
**Author:** [@maryam\_abdullah](https://discuss.elastic.co/u/maryam_abdullah)\ **Replies:** 5\ **Last updated:** [January 15, 2019, 12:22pm UTC](https://discuss.elastic.co/t/giving-fields-different-weights-in-a-multi-match-query-using-cross-fields-technique/164268 "2019-01-15T12:22:58Z")
Hello, I hope someone can help me. I was wondering if it's possible to use the cross-fields technique and still give different weights to the fields, cause based on what I've read, it's not possible. What do you think… --- ## [\[FATAL\] Elasticsearch BulkHandler: Unrecoverable indexing failure \[400\]](https://discuss.elastic.co/t/fatal-elasticsearch-bulkhandler-unrecoverable-indexing-failure-400/163957)
**Author:** [@netops](https://discuss.elastic.co/u/netops)\ **Replies:** 7\ **Last updated:** [January 15, 2019, 12:22pm UTC](https://discuss.elastic.co/t/fatal-elasticsearch-bulkhandler-unrecoverable-indexing-failure-400/163957 "2019-01-15T12:22:38Z")
Hello, We are using Elasticesearch 6.5.4 with SugarCRM Professional version 8.0.2 on site version Global search is working fine within Sugar, but we are seeing this in the elasticesearch.log It is showing the same ind… --- ## [Multiple errors; "Failed to list store metadata for shard"](https://discuss.elastic.co/t/multiple-errors-failed-to-list-store-metadata-for-shard/164298)
**Author:** [@Jakub500](https://discuss.elastic.co/u/Jakub500)\ **Replies:** 1\ **Last updated:** [January 15, 2019, 11:39am UTC](https://discuss.elastic.co/t/multiple-errors-failed-to-list-store-metadata-for-shard/164298 "2019-01-15T11:39:10Z")
Hi all, I have a problem with my elasticsearch cluster with logging a large number of errors. In the night, when import is ongoing I receive many errors: \[2019-01-15T03:28:54,372\]\[WARN \]\[o.e.g.GatewayAllocator$Interna… --- ## [Need to create a map in kibana by taking latitude and longitude from mysql db by logstash](https://discuss.elastic.co/t/need-to-create-a-map-in-kibana-by-taking-latitude-and-longitude-from-mysql-db-by-logstash/164296)
**Author:** [@saroj.moharana](https://discuss.elastic.co/u/saroj.moharana)\ **Replies:** 0\ **Last updated:** [January 15, 2019, 10:49am UTC](https://discuss.elastic.co/t/need-to-create-a-map-in-kibana-by-taking-latitude-and-longitude-from-mysql-db-by-logstash/164296 "2019-01-15T10:49:19Z")
Hi Team, I have latitude and longitude information in my mysql db and I want to push these information to elastic-search and want to create a map in kibana by taking these values. I have browsed different discussion bu… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1423) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1425)