# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1950 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1951 --- ## [When to use kafka or redis](https://discuss.elastic.co/t/when-to-use-kafka-or-redis/100378)
**Author:** [@Rob\_Davidson](https://discuss.elastic.co/u/Rob_Davidson)\ **Replies:** 1\ **Last updated:** [September 13, 2017, 8:54pm UTC](https://discuss.elastic.co/t/when-to-use-kafka-or-redis/100378 "2017-09-13T20:54:56Z")
My current setup looks like this springbootApp -\> log.json -\> filebeat -\>logstash -\>elastic -\>kibana I am seeing examples where people use Kafka or Redis. When should I be considering using kafka and when is it not … --- ## [Adding Multiple Indexes to a Template](https://discuss.elastic.co/t/adding-multiple-indexes-to-a-template/100383)
**Author:** [@bt\_scotth](https://discuss.elastic.co/u/bt_scotth)\ **Replies:** 1\ **Last updated:** [September 13, 2017, 8:49pm UTC](https://discuss.elastic.co/t/adding-multiple-indexes-to-a-template/100383 "2017-09-13T20:49:29Z")
I am looking to define a template for 3 indexes: clients-MM-DD-YYYY servers-MM-DD-YYYY ps-MM-DD-YYYY But I can't apply the template to all three indexes without using the "\*" wildcard, which I don't want to do since … --- ## [Is the execution order guaranteed in a single\_bulk request?](https://discuss.elastic.co/t/is-the-execution-order-guaranteed-in-a-single-bulk-request/100412)
**Author:** [@WoJ](https://discuss.elastic.co/u/WoJ)\ **Replies:** 1\ **Last updated:** [September 13, 2017, 8:35pm UTC](https://discuss.elastic.co/t/is-the-execution-order-guaranteed-in-a-single-bulk-request/100412 "2017-09-13T20:35:39Z")
Continuing the discussion from Are bulk index operations serialized?: Is this also true for several elements of one \_bulk command? If my request (one request) has action A, then B and then C (in this order) don't I hav… --- ## [Elastic Search PHP Index Process Stalled](https://discuss.elastic.co/t/elastic-search-php-index-process-stalled/100404)
**Author:** [@Ethan\_McDonald](https://discuss.elastic.co/u/Ethan_McDonald)\ **Replies:** 0\ **Last updated:** [September 13, 2017, 7:26pm UTC](https://discuss.elastic.co/t/elastic-search-php-index-process-stalled/100404 "2017-09-13T19:26:13Z")
We have Elasticsearch installed on our PHP based Intranet. Unfortunately the Index process seems to have stalled out about 3 months ago. So the Elasticsearch index not pulling in new information or indexing anything at… --- ## [Data and ingest nodes aren't detected by master node on elasticsearch](https://discuss.elastic.co/t/data-and-ingest-nodes-arent-detected-by-master-node-on-elasticsearch/100407)
**Author:** [@iam.Carrot](https://discuss.elastic.co/u/iam.Carrot)\ **Replies:** 0\ **Last updated:** [September 13, 2017, 7:30pm UTC](https://discuss.elastic.co/t/data-and-ingest-nodes-arent-detected-by-master-node-on-elasticsearch/100407 "2017-09-13T19:30:57Z")
Hi, I've been working on a production set up of my elasticsearch and going for the dedicated master, data and client (now ingest node) nodes. The issue I am facing is rather odd, my client/ingest nodes and my data nodes … --- ## [Pipelines via a Java API](https://discuss.elastic.co/t/pipelines-via-a-java-api/100401)
**Author:** [@Tameem](https://discuss.elastic.co/u/Tameem)\ **Replies:** 0\ **Last updated:** [September 13, 2017, 6:49pm UTC](https://discuss.elastic.co/t/pipelines-via-a-java-api/100401 "2017-09-13T18:49:57Z")
Hi! I'm trying to create a timestamp to attach to any documents that are indexed. I know this is possible in Query DSL via the below set of commands. I cannot find out how to do so through the Java API. Have any of you … --- ## [Configurations For Heavy index scenarios](https://discuss.elastic.co/t/configurations-for-heavy-index-scenarios/100395)
**Author:** [@hossein\_ey](https://discuss.elastic.co/u/hossein_ey)\ **Replies:** 0\ **Last updated:** [September 13, 2017, 6:01pm UTC](https://discuss.elastic.co/t/configurations-for-heavy-index-scenarios/100395 "2017-09-13T18:01:49Z")
based on my search this parameters is very important for increase performance of index in projects that have heavy write. JVM Heap Size(32 GB) disabling \_all filed using bulk mechanism and multi thread mechanism for lo… --- ## [Document count and includes\_action\_and\_meta\_data](https://discuss.elastic.co/t/document-count-and-includes-action-and-meta-data/100289)
**Author:** [@sharathr83](https://discuss.elastic.co/u/sharathr83)\ **Replies:** 2\ **Last updated:** [September 13, 2017, 5:50pm UTC](https://discuss.elastic.co/t/document-count-and-includes-action-and-meta-data/100289 "2017-09-13T17:50:17Z")
I have a custom rally track where I am bulk indexing data. My data is in the action\_and\_meta\_data\\n source\\n format, which means that I have 2 lines for each document. My types have 'includes\_action\_and\_meta\_data' set… --- ## [Records disappearing while using custom document\_id](https://discuss.elastic.co/t/records-disappearing-while-using-custom-document-id/100174)
**Author:** [@karnamonkster](https://discuss.elastic.co/u/karnamonkster)\ **Replies:** 3\ **Last updated:** [September 13, 2017, 5:12pm UTC](https://discuss.elastic.co/t/records-disappearing-while-using-custom-document-id/100174 "2017-09-13T17:12:40Z")
Hello, We are trying to use a "Document\_id" within ES output configuration (using multiple field columns from the Oracle Database table for example: document\_id =\> %{field1}%{field2} Reason being to be able to have on… --- ## [Loading Wikipedia's Search Index For Testing - Sep. 2017 Update](https://discuss.elastic.co/t/loading-wikipedias-search-index-for-testing-sep-2017-update/100389)
**Author:** [@Palisand](https://discuss.elastic.co/u/Palisand)\ **Replies:** 0\ **Last updated:** [September 13, 2017, 4:39pm UTC](https://discuss.elastic.co/t/loading-wikipedias-search-index-for-testing-sep-2017-update/100389 "2017-09-13T16:39:32Z")
You can still follow Loading Wikipedia's Search Index For Testing for the most part, just make the following adjustments to Step 2 if you are attempting to load enwiki-$date-cirrussearch-content.json.gz: Install Wikime… --- ## [Huge difference in index size when bulk indexing geoshapes across ES versions](https://discuss.elastic.co/t/huge-difference-in-index-size-when-bulk-indexing-geoshapes-across-es-versions/97137)
**Author:** [@sbocconi](https://discuss.elastic.co/u/sbocconi)\ **Replies:** 4\ **Last updated:** [September 13, 2017, 3:34pm UTC](https://discuss.elastic.co/t/huge-difference-in-index-size-when-bulk-indexing-geoshapes-across-es-versions/97137 "2017-09-13T15:34:04Z")
I get huge differences in index size when bulk indexing large MultiPolygons across version of ES (1.5.2 and 5.5.0) with the following mapping: { "settings": { "number\_of\_shards": 5, "number… --- ## [MySQL Like](https://discuss.elastic.co/t/mysql-like/100376)
**Author:** [@Michael\_Gartner](https://discuss.elastic.co/u/Michael_Gartner)\ **Replies:** 1\ **Last updated:** [September 13, 2017, 3:21pm UTC](https://discuss.elastic.co/t/mysql-like/100376 "2017-09-13T15:21:00Z")
We would like to achieve this result WHERE text LIKE "%quick%" AND text LIKE "%brown%" AND text LIKE "%fox%" Example Searching for 'fein multi master' should product the same results as 'fein multimaster' It seems … --- ## [Highlighters Executed Twice](https://discuss.elastic.co/t/highlighters-executed-twice/100080)
**Author:** [@mkrauklis](https://discuss.elastic.co/u/mkrauklis)\ **Replies:** 4\ **Last updated:** [September 13, 2017, 3:16pm UTC](https://discuss.elastic.co/t/highlighters-executed-twice/100080 "2017-09-13T15:16:21Z")
We're running ES 5.1.1 and are using a custom highlighter, although we've tested and this effects the plain highlighter (and I would imagine any highlighter) as well. In short, it would appear our highlighter is being c… --- ## [Keyword type schema difference Elasticsearch 5.1 with 5.5](https://discuss.elastic.co/t/keyword-type-schema-difference-elasticsearch-5-1-with-5-5/100173)
**Author:** [@sharon.c](https://discuss.elastic.co/u/sharon.c)\ **Replies:** 5\ **Last updated:** [September 13, 2017, 3:12pm UTC](https://discuss.elastic.co/t/keyword-type-schema-difference-elasticsearch-5-1-with-5-5/100173 "2017-09-13T15:12:12Z")
I have been using elasticsearch 2.X to 5.1 for quite some time for aggregation. The business logic does not need the string fields to be analysed. In 5.1 when I set the field type as follows in the mapping template: … --- ## [Nginx forwarding IP to elasticsearch](https://discuss.elastic.co/t/nginx-forwarding-ip-to-elasticsearch/100373)
**Author:** [@craigvphillips](https://discuss.elastic.co/u/craigvphillips)\ **Replies:** 0\ **Last updated:** [September 13, 2017, 3:05pm UTC](https://discuss.elastic.co/t/nginx-forwarding-ip-to-elasticsearch/100373 "2017-09-13T15:05:11Z")
Have an nginx proxy setup because people can't remember ports around here, has anyone setup something similar and had it forward ip's properly? server { listen 80; server\_name elastic.awesome.com; loca… --- ## [Write queries using RestClient JAVA](https://discuss.elastic.co/t/write-queries-using-restclient-java/100355)
**Author:** [@vaibhav2903](https://discuss.elastic.co/u/vaibhav2903)\ **Replies:** 1\ **Last updated:** [September 13, 2017, 2:02pm UTC](https://discuss.elastic.co/t/write-queries-using-restclient-java/100355 "2017-09-13T14:02:33Z")
Elasticsearch 5.6 has got released and it has released builders for the restClient. How can we build queries for searching purpose? There is no documentation given/ examples anywhere on how to use these builders. --- ## [Delete Index and How to free up disk space](https://discuss.elastic.co/t/delete-index-and-how-to-free-up-disk-space/100354)
**Author:** [@swlee](https://discuss.elastic.co/u/swlee)\ **Replies:** 8\ **Last updated:** [September 13, 2017, 1:48pm UTC](https://discuss.elastic.co/t/delete-index-and-how-to-free-up-disk-space/100354 "2017-09-13T13:48:58Z")
using elastic 5.3.0 i was delete indices because "high disk watermark \[90%\]" warn. but disk space did not free up yet there is no "\_optimze" method.. how to free up? please help --- ## [Elasticsearch.yml](https://discuss.elastic.co/t/elasticsearch-yml/100350)
**Author:** [@Invictus](https://discuss.elastic.co/u/Invictus)\ **Replies:** 5\ **Last updated:** [September 13, 2017, 1:24pm UTC](https://discuss.elastic.co/t/elasticsearch-yml/100350 "2017-09-13T13:24:02Z")
Whenever I change the Elasticsearch.yml (cluster.name, node.name etc.) in notepad++ and save the actual version, the http://localhost:9200/ isn't available anymore. When I uncomment the commands in Elasticsearch.yml the… --- ## [Basic license](https://discuss.elastic.co/t/basic-license/100347)
**Author:** [@Jonesthomas](https://discuss.elastic.co/u/Jonesthomas)\ **Replies:** 2\ **Last updated:** [September 13, 2017, 12:01pm UTC](https://discuss.elastic.co/t/basic-license/100347 "2017-09-13T12:01:33Z")
i have the basic license , how to implement in elasticsearch.. --- ## [Bulk index - partial success](https://discuss.elastic.co/t/bulk-index-partial-success/100325)
**Author:** [@Alex\_Davidovich](https://discuss.elastic.co/u/Alex_Davidovich)\ **Replies:** 2\ **Last updated:** [September 13, 2017, 11:49am UTC](https://discuss.elastic.co/t/bulk-index-partial-success/100325 "2017-09-13T11:49:06Z")
When can I expect to get partial success when indexing a bulk? Meaning, some documents are indexed and some are not. I know one reason to get a document rejected in a bulk: duplicate ID. Are there more reasons to get t… --- ## [Can I use comments in JSON request to ES?](https://discuss.elastic.co/t/can-i-use-comments-in-json-request-to-es/100312)
**Author:** [@Freyja](https://discuss.elastic.co/u/Freyja)\ **Replies:** 2\ **Last updated:** [September 13, 2017, 11:12am UTC](https://discuss.elastic.co/t/can-i-use-comments-in-json-request-to-es/100312 "2017-09-13T11:12:05Z")
I created a quite complicated request to ES (I send it via curl), so I wanted to add a bit of documentation to it. I read that JSON does not allow comments, but I put a comment of type /\* ... \*/ inside the request and i… --- ## [Dynamic mappings](https://discuss.elastic.co/t/dynamic-mappings/98070)
**Author:** [@Hitesh\_Baldaniya](https://discuss.elastic.co/u/Hitesh_Baldaniya)\ **Replies:** 4\ **Last updated:** [September 13, 2017, 11:09am UTC](https://discuss.elastic.co/t/dynamic-mappings/98070 "2017-09-13T11:09:18Z")
Hi All, Thanks in advance for the solution or suggestions. I have platform where we store user’s content(schema based content) as applications such as website data, mobile data, IOT data etc. To, search on this data w… --- ## [Reindexing billions of documents](https://discuss.elastic.co/t/reindexing-billions-of-documents/100339)
**Author:** [@an.secure](https://discuss.elastic.co/u/an.secure)\ **Replies:** 0\ **Last updated:** [September 13, 2017, 10:38am UTC](https://discuss.elastic.co/t/reindexing-billions-of-documents/100339 "2017-09-13T10:38:41Z")
We are trying to re-index our documents because of a mapping change, the index is likely to grow to billions of documents in future consuming TBs of data. What would be the best way in terms of performance to carry out t… --- ## [Get all ID data](https://discuss.elastic.co/t/get-all-id-data/100334)
**Author:** [@irfanh94](https://discuss.elastic.co/u/irfanh94)\ **Replies:** 2\ **Last updated:** [September 13, 2017, 10:31am UTC](https://discuss.elastic.co/t/get-all-id-data/100334 "2017-09-13T10:31:20Z")
Hi folks, how I can get all data of certain index ID, except only getting the source ? --- ## [Event from logstash not published in ES](https://discuss.elastic.co/t/event-from-logstash-not-published-in-es/100332)
**Author:** [@tomer](https://discuss.elastic.co/u/tomer)\ **Replies:** 0\ **Last updated:** [September 13, 2017, 10:16am UTC](https://discuss.elastic.co/t/event-from-logstash-not-published-in-es/100332 "2017-09-13T10:16:14Z")
Hi, In logstash I get: \[image\] but in ES when I do: \[image\] The result is 0 hits. How can this be, why ES is not able to receive this info? The LogStash sends other logs and are received inside the machine, this l… --- ## [Snapshot between 5.4.x versions](https://discuss.elastic.co/t/snapshot-between-5-4-x-versions/100193)
**Author:** [@magrossi](https://discuss.elastic.co/u/magrossi)\ **Replies:** 5\ **Last updated:** [September 13, 2017, 10:00am UTC](https://discuss.elastic.co/t/snapshot-between-5-4-x-versions/100193 "2017-09-13T10:00:31Z")
Hi, I have a 5.4.1 Elastic cluster that takes snapshots for backup. In case of a disaster (ie. our current cloud provider goes offline) we would need to quickly move to a different cloud provider. I'm looking into movin… --- ## [About segment merge](https://discuss.elastic.co/t/about-segment-merge/100299)
**Author:** [@elton](https://discuss.elastic.co/u/elton)\ **Replies:** 6\ **Last updated:** [September 13, 2017, 9:26am UTC](https://discuss.elastic.co/t/about-segment-merge/100299 "2017-09-13T09:26:02Z")
Hello, I have a heavily indexed elasticsearch cluster, about 20K lines per second, and one index per day. Each index has about 300 segments. For example, segment info of some index (2017-08-19) is partially list below: … --- ## [Where to know the datanode name like "2XK4x5-tRHyLhpPB7XTdXg" in tasks](https://discuss.elastic.co/t/where-to-know-the-datanode-name-like-2xk4x5-trhylhppb7xtdxg-in-tasks/100272)
**Author:** [@zqc0512](https://discuss.elastic.co/u/zqc0512)\ **Replies:** 7\ **Last updated:** [September 13, 2017, 9:02am UTC](https://discuss.elastic.co/t/where-to-know-the-datanode-name-like-2xk4x5-trhylhppb7xtdxg-in-tasks/100272 "2017-09-13T09:02:49Z")
where to know the datanode name or ip addr like "2XK4x5-tRHyLhpPB7XTdXg" in tasks "tasks" : { "Qb03E91zSCG1tBvhmfWqzg:96694" : { "node" : "Qb03E91zSCG1tBvhmfWqzg", "id" : 96694, "type" : "netty"… --- ## [How to properly configure Log4J 2?](https://discuss.elastic.co/t/how-to-properly-configure-log4j-2/100311)
**Author:** [@Jenia](https://discuss.elastic.co/u/Jenia)\ **Replies:** 1\ **Last updated:** [September 13, 2017, 8:59am UTC](https://discuss.elastic.co/t/how-to-properly-configure-log4j-2/100311 "2017-09-13T08:59:25Z")
Hi, I’m trying to configure Log4J2 in Java project after getting this message: “No log4j2 configuration file found. Using default configuration: logging only errors to the console. Set system property 'log4j2.debug' to… --- ## [If I upgrade my es cluster, will old indexes still work?](https://discuss.elastic.co/t/if-i-upgrade-my-es-cluster-will-old-indexes-still-work/100304)
**Author:** [@shijiebei2009](https://discuss.elastic.co/u/shijiebei2009)\ **Replies:** 3\ **Last updated:** [September 13, 2017, 8:58am UTC](https://discuss.elastic.co/t/if-i-upgrade-my-es-cluster-will-old-indexes-still-work/100304 "2017-09-13T08:58:44Z")
just like v 2.x -\> v 5.x or v 5.x -\> v 5.y (y\>x) will old indexes still work ? [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1949) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1951)