# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1749 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1750 --- ## [Index size on disk](https://discuss.elastic.co/t/index-size-on-disk/124224)
**Author:** [@chhavi\_bahekar](https://discuss.elastic.co/u/chhavi_bahekar)\ **Replies:** 7\ **Last updated:** [March 19, 2018, 5:20am UTC](https://discuss.elastic.co/t/index-size-on-disk/124224 "2018-03-19T05:20:49Z")
Hi All, I am small query related to raw data vs size of disk.I am using es 5.7 and below is the observation. Can someone please help me to understand this size factor. Here raw data is having 1.5 KB data but when i am… --- ## [Elasticsearch query for two logs into one log](https://discuss.elastic.co/t/elasticsearch-query-for-two-logs-into-one-log/124477)
**Author:** [@shwesinhan](https://discuss.elastic.co/u/shwesinhan)\ **Replies:** 0\ **Last updated:** [March 19, 2018, 3:15am UTC](https://discuss.elastic.co/t/elasticsearch-query-for-two-logs-into-one-log/124477 "2018-03-19T03:15:37Z")
hi there! could i have any idea for below situation. i have these two logs 2018-03-19 09:51:04,500 (null) 19 WARN : mypage: TEST :: mnost2bj2pnqdzjajkvio20u :: Frontend Response : \\9.1\\ **Author:** [@ChopperLee2011](https://discuss.elastic.co/u/ChopperLee2011)\ **Replies:** 0\ **Last updated:** [March 19, 2018, 1:47am UTC](https://discuss.elastic.co/t/updatebyquery-only-success-on-the-2nd-run/124472 "2018-03-19T01:47:31Z") I am using the javascript SDK version 6.1, and when I calling updateByQuery method, it is strange that it do return a success result with version\_conflicts: 1 field, but do not update my data. and the 2nd time running t… --- ## [How to resolve search context missing exception?](https://discuss.elastic.co/t/how-to-resolve-search-context-missing-exception/124465)
**Author:** [@majid\_zarrin](https://discuss.elastic.co/u/majid_zarrin)\ **Replies:** 0\ **Last updated:** [March 19, 2018, 12:10am UTC](https://discuss.elastic.co/t/how-to-resolve-search-context-missing-exception/124465 "2018-03-19T00:10:03Z")
Hello guys I need to create an Index by manipulating another index with java. here is my cluster specification: ES version: 6.1 source Index documents count: 1.4 billion the cluster had 2 nodes. both of them are dat… --- ## [How to avoid sending data to a node close to its disk space limit?](https://discuss.elastic.co/t/how-to-avoid-sending-data-to-a-node-close-to-its-disk-space-limit/123937)
**Author:** [@fmind](https://discuss.elastic.co/u/fmind)\ **Replies:** 3\ **Last updated:** [March 18, 2018, 8:56pm UTC](https://discuss.elastic.co/t/how-to-avoid-sending-data-to-a-node-close-to-its-disk-space-limit/123937 "2018-03-18T20:56:56Z")
Hello, My elasticsearch cluster has 4 nodes, but one node is close to its disk space limit. I cannot add new nodes to my cluster due to budget constraints. So, I have to use space remaining on the other nodes. What wo… --- ## [Ordering aggregations by geo distance and score](https://discuss.elastic.co/t/ordering-aggregations-by-geo-distance-and-score/124459)
**Author:** [@woshitom](https://discuss.elastic.co/u/woshitom)\ **Replies:** 0\ **Last updated:** [March 18, 2018, 8:55pm UTC](https://discuss.elastic.co/t/ordering-aggregations-by-geo-distance-and-score/124459 "2018-03-18T20:55:15Z")
My mapping is the following: PUT places { "mappings": { "test": { "properties": { "id\_product": { "type": "keyword" }, "id\_product\_unique": { "type": "integer" }, "location": { "type"… --- ## [Replica shards do not get assigned (not consistent), even though they can](https://discuss.elastic.co/t/replica-shards-do-not-get-assigned-not-consistent-even-though-they-can/123968)
**Author:** [@bviz](https://discuss.elastic.co/u/bviz)\ **Replies:** 9\ **Last updated:** [March 18, 2018, 8:47pm UTC](https://discuss.elastic.co/t/replica-shards-do-not-get-assigned-not-consistent-even-though-they-can/123968 "2018-03-18T20:47:27Z")
Hey, I've been having a shard-assignment issue with my Elastic 5.4.0 ever since I started using it, a problem that also happened in the previous version we used, 1.7. We have 6 nodes in the cluster, 3 of them are dedic… --- ## [Curator to add alias for today's index](https://discuss.elastic.co/t/curator-to-add-alias-for-todays-index/124165)
**Author:** [@jclose](https://discuss.elastic.co/u/jclose)\ **Replies:** 1\ **Last updated:** [March 18, 2018, 5:04pm UTC](https://discuss.elastic.co/t/curator-to-add-alias-for-todays-index/124165 "2018-03-18T17:04:26Z")
I am trying to get curator to create an index where it uses today's date within the alias name, all based upon a date. So if I have an index called iis\_logs-2018.03.15 created today, I also want an alias created called a… --- ## [Why is my \_delete\_by\_query being ignored?](https://discuss.elastic.co/t/why-is-my-delete-by-query-being-ignored/124409)
**Author:** [@jordanglassman](https://discuss.elastic.co/u/jordanglassman)\ **Replies:** 3\ **Last updated:** [March 18, 2018, 3:50pm UTC](https://discuss.elastic.co/t/why-is-my-delete-by-query-being-ignored/124409 "2018-03-18T15:50:29Z")
I understand that \_delete\_by\_query is now added to core, and no longer requires a plugin. Using org.elasticsearch:elasticsearch:5.5.2, I am starting a org.elasticsearch.node.Node with: public void before() throws Excep… --- ## [Elasticsearch json response to SearchResponse object](https://discuss.elastic.co/t/elasticsearch-json-response-to-searchresponse-object/124394)
**Author:** [@Monte\_A](https://discuss.elastic.co/u/Monte_A)\ **Replies:** 5\ **Last updated:** [March 18, 2018, 3:14pm UTC](https://discuss.elastic.co/t/elasticsearch-json-response-to-searchresponse-object/124394 "2018-03-18T15:14:43Z")
Hi There, Could someone help to get it working? So far I got the solution below. This works for simple queries, however it doesn't work for aggregations and I am getting exception ParsingException "Could not parse aggr… --- ## [How much overhead stuff is stored with each document?](https://discuss.elastic.co/t/how-much-overhead-stuff-is-stored-with-each-document/124440)
**Author:** [@yishain11](https://discuss.elastic.co/u/yishain11)\ **Replies:** 4\ **Last updated:** [March 18, 2018, 2:53pm UTC](https://discuss.elastic.co/t/how-much-overhead-stuff-is-stored-with-each-document/124440 "2018-03-18T14:53:45Z")
Hi, I have some quetions regarding the memory usage and storage of documents in Elasticsearch. Lets say I have JSON doc with the size of X kb. If I ship it to Elasticsearch with Logstash and analyze it as a JSON, In wha… --- ## [Return unique result by field values](https://discuss.elastic.co/t/return-unique-result-by-field-values/124441)
**Author:** [@woshitom](https://discuss.elastic.co/u/woshitom)\ **Replies:** 3\ **Last updated:** [March 18, 2018, 1:47pm UTC](https://discuss.elastic.co/t/return-unique-result-by-field-values/124441 "2018-03-18T13:47:10Z")
I have 3 "places" having each a type and a location: PUT places/1 { "type" : "A", "location": { "lat": 1.378446, "lon": 103.763427 } } PUT places/2 { "type" : "B", "location": { "lat": … --- ## [Comparing data from csv (imported in Elastic) and indexed events in filters](https://discuss.elastic.co/t/comparing-data-from-csv-imported-in-elastic-and-indexed-events-in-filters/124430)
**Author:** [@radheraj1431](https://discuss.elastic.co/u/radheraj1431)\ **Replies:** 1\ **Last updated:** [March 18, 2018, 7:31am UTC](https://discuss.elastic.co/t/comparing-data-from-csv-imported-in-elastic-and-indexed-events-in-filters/124430 "2018-03-18T07:31:52Z")
Hello All, We have imported some csv files in Elastic. Now we want to compare some event fields with the values of the fields in csv and use it in filter for various purpose. For example, we have imported csv of domain… --- ## [Snapshot from red cluster](https://discuss.elastic.co/t/snapshot-from-red-cluster/124433)
**Author:** [@hamid\_bayat](https://discuss.elastic.co/u/hamid_bayat)\ **Replies:** 0\ **Last updated:** [March 18, 2018, 7:24am UTC](https://discuss.elastic.co/t/snapshot-from-red-cluster/124433 "2018-03-18T07:24:18Z")
Hi, Is there any possible way to snapshot from red cluster? i have a corrupted shard that before trying to reroute it, i want to take snapshot from index. Thanks! --- ## [Latency spike after big merge](https://discuss.elastic.co/t/latency-spike-after-big-merge/124290)
**Author:** [@hermes](https://discuss.elastic.co/u/hermes)\ **Replies:** 1\ **Last updated:** [March 17, 2018, 4:50pm UTC](https://discuss.elastic.co/t/latency-spike-after-big-merge/124290 "2018-03-17T16:50:37Z")
I'm trying to figure out why in the below use case there is a latency spike after a big merge - one that creates an 8M docs segment. What I'm observing is that immediately after the merge, queries that used to take 4ms i… --- ## [Can I create a ServiceNow ticket from Watcher](https://discuss.elastic.co/t/can-i-create-a-servicenow-ticket-from-watcher/124243)
**Author:** [@Umer\_Munir](https://discuss.elastic.co/u/Umer_Munir)\ **Replies:** 3\ **Last updated:** [March 17, 2018, 3:20pm UTC](https://discuss.elastic.co/t/can-i-create-a-servicenow-ticket-from-watcher/124243 "2018-03-17T15:20:15Z")
Hi, Can I create a ServiceNow ticket from Watcher? Regards, Umer --- ## [How to extract the Exact strings or 80% of matched strings from elastic search](https://discuss.elastic.co/t/how-to-extract-the-exact-strings-or-80-of-matched-strings-from-elastic-search/124396)
**Author:** [@Shaik\_Thowsif](https://discuss.elastic.co/u/Shaik_Thowsif)\ **Replies:** 5\ **Last updated:** [March 17, 2018, 1:27pm UTC](https://discuss.elastic.co/t/how-to-extract-the-exact-strings-or-80-of-matched-strings-from-elastic-search/124396 "2018-03-17T13:27:17Z")
HI guys, Actually i want to build an suggestion box, for that i need to suggest the exact String or equivalent to 80% matched strings only.. I have used Auto complete filter, it is providing more irrelevant data to sear… --- ## [The queries for numeric fields are slower after upgraded the cluster from 2.4.5 to 5.6.3](https://discuss.elastic.co/t/the-queries-for-numeric-fields-are-slower-after-upgraded-the-cluster-from-2-4-5-to-5-6-3/121620)
**Author:** [@Zzzxf](https://discuss.elastic.co/u/Zzzxf)\ **Replies:** 3\ **Last updated:** [March 17, 2018, 11:45am UTC](https://discuss.elastic.co/t/the-queries-for-numeric-fields-are-slower-after-upgraded-the-cluster-from-2-4-5-to-5-6-3/121620 "2018-03-17T11:45:05Z")
Cluster info PS: two cluster with same nodes,docs Elasticsearch version : 2.4.5/5.6.3 JVM version : java8 OS version: Linux CentOS 6 Nodes: 32(data/master) Problem The queries for numeric fields are slower after upg… --- ## [Xpack Alerting is free or must we buy it?](https://discuss.elastic.co/t/xpack-alerting-is-free-or-must-we-buy-it/124389)
**Author:** [@omid](https://discuss.elastic.co/u/omid)\ **Replies:** 3\ **Last updated:** [March 17, 2018, 9:25am UTC](https://discuss.elastic.co/t/xpack-alerting-is-free-or-must-we-buy-it/124389 "2018-03-17T09:25:00Z")
hi im used xpack and xpack alerting spack is free or purchase ? --- ## [What end user case démo exist](https://discuss.elastic.co/t/what-end-user-case-demo-exist/124390)
**Author:** [@Estelle](https://discuss.elastic.co/u/Estelle)\ **Replies:** 1\ **Last updated:** [March 17, 2018, 9:20am UTC](https://discuss.elastic.co/t/what-end-user-case-demo-exist/124390 "2018-03-17T09:20:07Z")
Hi there, I wrote down a concept asking developers if they could drive me the best platform to design what I wanted. They all drove me to kibana and elasticsearch. At this moment in time I would like to understand why… --- ## [Painless script - check for null](https://discuss.elastic.co/t/painless-script-check-for-null/122176)
**Author:** [@bluemalkin](https://discuss.elastic.co/u/bluemalkin)\ **Replies:** 5\ **Last updated:** [March 17, 2018, 6:23am UTC](https://discuss.elastic.co/t/painless-script-check-for-null/122176 "2018-03-17T06:23:46Z")
Hi, I have a painless script custom field using regex: if (doc\['message.keyword'\].value != null) { def m = /((GET|POST|PUT)\\s{1}(/v1/\[\\w/-\]+))(?|\\s){1}/.matcher(doc\['message.keyword'\].value); if (m.find()) { return … --- ## [Script Look and research (6.2)](https://discuss.elastic.co/t/script-look-and-research-6-2/123056)
**Author:** [@Varan](https://discuss.elastic.co/u/Varan)\ **Replies:** 1\ **Last updated:** [March 17, 2018, 4:53am UTC](https://discuss.elastic.co/t/script-look-and-research-6-2/123056 "2018-03-17T04:53:04Z")
Hi, Let's say that I have two index. "Main" and "Daily". Main contain a lot of field but is almost never updated. Daily contain few field but is frequently subject to update. Could I use a script to look for an entit… --- ## [Compressions while reading from ES](https://discuss.elastic.co/t/compressions-while-reading-from-es/123342)
**Author:** [@lbadi](https://discuss.elastic.co/u/lbadi)\ **Replies:** 1\ **Last updated:** [March 17, 2018, 12:25am UTC](https://discuss.elastic.co/t/compressions-while-reading-from-es/123342 "2018-03-17T00:25:28Z")
Hi guys! We are moving data between clouds using spark and ES. Is there anyway to read using gzip compressions ? Any advice how we can move daily big amount of data from an active index to a spark cluster hosted in ano… --- ## [Best practise to read ES from PySpark](https://discuss.elastic.co/t/best-practise-to-read-es-from-pyspark/118372)
**Author:** [@cts](https://discuss.elastic.co/u/cts)\ **Replies:** 4\ **Last updated:** [March 17, 2018, 12:17am UTC](https://discuss.elastic.co/t/best-practise-to-read-es-from-pyspark/118372 "2018-03-17T00:17:25Z")
I am trying to find the best way to read data from Elastic Search ( V: 5.1.1) through Apache Spark ( V: 2.2.1). I am using driver jar version ( elasticsearch-spark-20\_2.11-5.3.1.jar). My question is mainly around readin… --- ## [Does es-hadoop connector 6.1.2 support update mode in spark structured streaming?](https://discuss.elastic.co/t/does-es-hadoop-connector-6-1-2-support-update-mode-in-spark-structured-streaming/118598)
**Author:** [@kant\_kodali](https://discuss.elastic.co/u/kant_kodali)\ **Replies:** 3\ **Last updated:** [March 17, 2018, 12:15am UTC](https://discuss.elastic.co/t/does-es-hadoop-connector-6-1-2-support-update-mode-in-spark-structured-streaming/118598 "2018-03-17T00:15:25Z")
Does es-hadoop connector 6.1.2 support update mode in spark structured streaming? so I can do df.writeStream().outputMode("update").start() Looks to me that it doesn't. If so when can we expect? --- ## [How to use optional parameters?](https://discuss.elastic.co/t/how-to-use-optional-parameters/121931)
**Author:** [@Mehmet\_KURT](https://discuss.elastic.co/u/Mehmet_KURT)\ **Replies:** 3\ **Last updated:** [March 17, 2018, 12:12am UTC](https://discuss.elastic.co/t/how-to-use-optional-parameters/121931 "2018-03-17T00:12:11Z")
How to use C# Optional Parameters In Search Query? public virtual List\ SearchProducts( bool? isFeatured = null, bool? sameDayShipping = null, bool? isMostAdvantage = null, … --- ## [Authentication Clarification for Elasticsearch 6+](https://discuss.elastic.co/t/authentication-clarification-for-elasticsearch-6/124344)
**Author:** [@Airn5475](https://discuss.elastic.co/u/Airn5475)\ **Replies:** 6\ **Last updated:** [March 17, 2018, 12:10am UTC](https://discuss.elastic.co/t/authentication-clarification-for-elasticsearch-6/124344 "2018-03-17T00:10:26Z")
I am attempting to upgrade to 6.2.2 from 5.2.1. Thankfully I can just install a clean version, no upgrade. I am using just the Basic License. I believe that the basic authentication from version 5 is no longer availab… --- ## [CLOSE THIS TOPIC - Failed to connect: 404 Not Found - Indexes are not being created](https://discuss.elastic.co/t/close-this-topic-failed-to-connect-404-not-found-indexes-are-not-being-created/123571)
**Author:** [@Kernel\_Panic](https://discuss.elastic.co/u/Kernel_Panic)\ **Replies:** 8\ **Last updated:** [March 17, 2018, 12:04am UTC](https://discuss.elastic.co/t/close-this-topic-failed-to-connect-404-not-found-indexes-are-not-being-created/123571 "2018-03-17T00:04:21Z")
Hello I installed ES Kibana and MB 6.2, started ES and started kibana so far, I can access KB dashboard, so fa so good , then I installed metricbeat with the following configuration metricbeat.config.modules: path: … --- ## [Elasticsearch-Hadoop formatting multi resouce writes issue](https://discuss.elastic.co/t/elasticsearch-hadoop-formatting-multi-resouce-writes-issue/122503)
**Author:** [@petroslamb](https://discuss.elastic.co/u/petroslamb)\ **Replies:** 1\ **Last updated:** [March 16, 2018, 11:59pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-formatting-multi-resouce-writes-issue/122503 "2018-03-16T23:59:23Z")
I am interfacing Elasticsearch with Spark, using the Elasticsearch-Hadoop plugin and I am having difficulty writing a dataframe with a timestamp type column to Elasticsearch. The problem is when I try to write using dyn… --- ## [Types of nodes that need the Watcher plugin enabled](https://discuss.elastic.co/t/types-of-nodes-that-need-the-watcher-plugin-enabled/124367)
**Author:** [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\ **Replies:** 4\ **Last updated:** [March 16, 2018, 9:33pm UTC](https://discuss.elastic.co/t/types-of-nodes-that-need-the-watcher-plugin-enabled/124367 "2018-03-16T21:33:27Z")
Hello, I'm planning in start to use Watcher, but I have a question about where do I need to install it. Currently I have four nodes, where three of them have all the roles (master, data, ml etc) and one is used only as… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1748) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1750)