# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1190

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1191

---

## [Load Json to Elasticsearch](https://discuss.elastic.co/t/load-json-to-elasticsearch/195235)

<div class="topic-metadata">

**Author:** [@mkajdos](https://discuss.elastic.co/u/mkajdos)\
**Replies:** 4\
**Last updated:** [August 15, 2019, 2:34pm UTC](https://discuss.elastic.co/t/load-json-to-elasticsearch/195235 "2019-08-15T14:34:45Z")

</div>

I am new to Elasticseach and I am on the 7.3.0 release. On the documentation page: https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started-explore-data.html there is command to load the "account…

---

## [Fetching large data from Elasticsearch in Node.js](https://discuss.elastic.co/t/fetching-large-data-from-elasticsearch-in-node-js/195352)

<div class="topic-metadata">

**Author:** [@purple](https://discuss.elastic.co/u/purple)\
**Replies:** 0\
**Last updated:** [August 15, 2019, 2:09pm UTC](https://discuss.elastic.co/t/fetching-large-data-from-elasticsearch-in-node-js/195352 "2019-08-15T14:09:49Z")

</div>

I am fetching about 60,000 documents from an index ABC in Elasticsearch (v7) through their Node.js client. I tried using their recommended Scroll API but it took almost 20s to do so. Next, I increased the max\_wind…

---

## [Dedicated data and ingest node](https://discuss.elastic.co/t/dedicated-data-and-ingest-node/195347)

<div class="topic-metadata">

**Author:** [@newbie1](https://discuss.elastic.co/u/newbie1)\
**Replies:** 2\
**Last updated:** [August 15, 2019, 1:33pm UTC](https://discuss.elastic.co/t/dedicated-data-and-ingest-node/195347 "2019-08-15T13:33:01Z")

</div>

I have to defined a dedicated data and ingest node, I set node.master to false, do I have to set node.data and node.ingest to true since this is the default ? Note : I looked quickly on the forum and did not see an answ…

---

## [Remove or disable default fields](https://discuss.elastic.co/t/remove-or-disable-default-fields/195336)

<div class="topic-metadata">

**Author:** [@zbawio](https://discuss.elastic.co/u/zbawio)\
**Replies:** 2\
**Last updated:** [August 15, 2019, 12:30pm UTC](https://discuss.elastic.co/t/remove-or-disable-default-fields/195336 "2019-08-15T12:30:50Z")

</div>

Hi i want to know that if we can remove default fields or not in elasticsearch i mean : "\_index" : "iislogs", "\_type" : "\_doc", "\_id" : "G2\_plGwB4leTdzHx29fX",\*\* "\_score" : 1.0, "\_source" :{ "S-Port" : "624…

---

## [How to fetch data from multi indices based on condition](https://discuss.elastic.co/t/how-to-fetch-data-from-multi-indices-based-on-condition/195006)

<div class="topic-metadata">

**Author:** [@rameshkr1994](https://discuss.elastic.co/u/rameshkr1994)\
**Replies:** 5\
**Last updated:** [August 15, 2019, 11:41am UTC](https://discuss.elastic.co/t/how-to-fetch-data-from-multi-indices-based-on-condition/195006 "2019-08-15T11:41:22Z")

</div>

Dear All. i have two indices Index01 and index02. Condition 01:-1: in index01 have ducument/column id(1211) that is matching with index02. Condition 02:-1: in index02 we have same document/column id(1211) but i wan…

---

## [Index Lifecycle Policy requires rollover and adjacent settings even when rollover is disabled](https://discuss.elastic.co/t/index-lifecycle-policy-requires-rollover-and-adjacent-settings-even-when-rollover-is-disabled/194588)

<div class="topic-metadata">

**Author:** [@oysteila](https://discuss.elastic.co/u/oysteila)\
**Replies:** 2\
**Last updated:** [August 15, 2019, 11:06am UTC](https://discuss.elastic.co/t/index-lifecycle-policy-requires-rollover-and-adjacent-settings-even-when-rollover-is-disabled/194588 "2019-08-15T11:06:34Z")

</div>

It would appear that ILM is broken once you decide you wish to use ILM without rollover. Note that I do not under any circumstance wish to activate rollover. We use daily indices. Please do not suggest I activate rollo…

---

## [Unable to log in kibana with the created user](https://discuss.elastic.co/t/unable-to-log-in-kibana-with-the-created-user/195322)

<div class="topic-metadata">

**Author:** [@JasonJay](https://discuss.elastic.co/u/JasonJay)\
**Replies:** 1\
**Last updated:** [August 15, 2019, 9:26am UTC](https://discuss.elastic.co/t/unable-to-log-in-kibana-with-the-created-user/195322 "2019-08-15T09:26:59Z")

</div>

I followed the doc to create a new user: configuring-security and I performed the following two requests curl -XPOST -u elastic 'localhost:9200/\_security/role/events\_admin' -H "Content-Type: application/json" -d '{ "…

---

## [Action \[indices:admin/create\] is unauthorized for user \[admin\]](https://discuss.elastic.co/t/action-indices-admin-create-is-unauthorized-for-user-admin/195175)

<div class="topic-metadata">

**Author:** [@masterThomas](https://discuss.elastic.co/u/masterThomas)\
**Replies:** 1\
**Last updated:** [August 15, 2019, 9:23am UTC](https://discuss.elastic.co/t/action-indices-admin-create-is-unauthorized-for-user-admin/195175 "2019-08-15T09:23:27Z")

</div>

Hi team, my custom endpoint makes bulk update request. I have got the error when i send my data to custom endpoint via Postman(admin/password authorized). Admin has superuser power. { "update": { …

---

## [Elasticsearch.net help with mapping - C#](https://discuss.elastic.co/t/elasticsearch-net-help-with-mapping-c/194973)

<div class="topic-metadata">

**Author:** [@Bluesky](https://discuss.elastic.co/u/Bluesky)\
**Replies:** 1\
**Last updated:** [August 15, 2019, 8:35am UTC](https://discuss.elastic.co/t/elasticsearch-net-help-with-mapping-c/194973 "2019-08-15T08:35:44Z")

</div>

Hey there. I've a problem when i'm trying to mapping the following DSL query, in Visual Studio using Elasticsearch.net { "\_source": { "includes": \[ "Vrvirksomhed.cvrNummer", "Vrvirksomhed.virksomhedMetadata.nyesteNavn.…

---

## [Upgrade from 6 to 7](https://discuss.elastic.co/t/upgrade-from-6-to-7/195311)

<div class="topic-metadata">

**Author:** [@garryrobertson](https://discuss.elastic.co/u/garryrobertson)\
**Replies:** 1\
**Last updated:** [August 15, 2019, 8:28am UTC](https://discuss.elastic.co/t/upgrade-from-6-to-7/195311 "2019-08-15T08:28:14Z")

</div>

Hi, If we were to upgrade from 6.2 to 7.x do we need to also upgrade all our filebeat/winlogbeat installs as well? Or is 7.x backwards compatible with these beats?

---

## [How to pass JSON request body data to Elasticsearch query for search opeartion?](https://discuss.elastic.co/t/how-to-pass-json-request-body-data-to-elasticsearch-query-for-search-opeartion/195137)

<div class="topic-metadata">

**Author:** [@Ramesh\_Kanakarajan](https://discuss.elastic.co/u/Ramesh_Kanakarajan)\
**Replies:** 2\
**Last updated:** [August 15, 2019, 8:16am UTC](https://discuss.elastic.co/t/how-to-pass-json-request-body-data-to-elasticsearch-query-for-search-opeartion/195137 "2019-08-15T08:16:33Z")

</div>

Initially I do by iterate the JSON object get the key and value out, do concatenation with dot between keys and then pass to the matchquery.

---

## [Constructing custom analyser for full-text queries](https://discuss.elastic.co/t/constructing-custom-analyser-for-full-text-queries/195304)

<div class="topic-metadata">

**Author:** [@MinHan](https://discuss.elastic.co/u/MinHan)\
**Replies:** 2\
**Last updated:** [August 15, 2019, 7:43am UTC](https://discuss.elastic.co/t/constructing-custom-analyser-for-full-text-queries/195304 "2019-08-15T07:43:10Z")

</div>

Hi everyone. I'm having a little confusion with the general flow of constructing custom analyzers and mappings, during document indexing time and at query time. The reason I'm asking all of this is that I'm trying to co…

---

## [Increase the score of the last resource of each type](https://discuss.elastic.co/t/increase-the-score-of-the-last-resource-of-each-type/191846)

<div class="topic-metadata">

**Author:** [@raphael.m](https://discuss.elastic.co/u/raphael.m)\
**Replies:** 2\
**Last updated:** [August 15, 2019, 7:33am UTC](https://discuss.elastic.co/t/increase-the-score-of-the-last-resource-of-each-type/191846 "2019-08-15T07:33:43Z")

</div>

Hello friends, I'm facing a problem and i really don't know how handle it. Actually I have a "simple" research on a class called "Resource". These resources have a specific type but are show in a unique list with all t…

---

## [Is it possible to fetch a document by term ID within a search/rescore plugin?](https://discuss.elastic.co/t/is-it-possible-to-fetch-a-document-by-term-id-within-a-search-rescore-plugin/195282)

<div class="topic-metadata">

**Author:** [@zcharli](https://discuss.elastic.co/u/zcharli)\
**Replies:** 1\
**Last updated:** [August 15, 2019, 7:27am UTC](https://discuss.elastic.co/t/is-it-possible-to-fetch-a-document-by-term-id-within-a-search-rescore-plugin/195282 "2019-08-15T07:27:40Z")

</div>

Hi, I have a concept that I'm thinking about implementing, but before I get my hands dirty, I would like to ask if this is possible. Advisory: Elasticsearch is new to me. Suppose I have a index cars with document term i…

---

## [How do you configure Elasticsearch on Ubuntu Bash for Windows 10?](https://discuss.elastic.co/t/how-do-you-configure-elasticsearch-on-ubuntu-bash-for-windows-10/194888)

<div class="topic-metadata">

**Author:** [@zachary\_baker](https://discuss.elastic.co/u/zachary_baker)\
**Replies:** 3\
**Last updated:** [August 15, 2019, 7:15am UTC](https://discuss.elastic.co/t/how-do-you-configure-elasticsearch-on-ubuntu-bash-for-windows-10/194888 "2019-08-15T07:15:56Z")

</div>

Hi everyone! I am relatively new to Elasticsearch and was wondering about configuring it for the Ubuntu bash app for Windows 10. Is it possible and if so, what would I have to configure. I have seen it run on an Ubuntu …

---

## [Alerting in elastic by filtering a field in it](https://discuss.elastic.co/t/alerting-in-elastic-by-filtering-a-field-in-it/194288)

<div class="topic-metadata">

**Author:** [@Karthik2411](https://discuss.elastic.co/u/Karthik2411)\
**Replies:** 3\
**Last updated:** [August 15, 2019, 7:15am UTC](https://discuss.elastic.co/t/alerting-in-elastic-by-filtering-a-field-in-it/194288 "2019-08-15T07:15:48Z")

</div>

I have a log with a number of fields. i am trying to alert whenever i see a text and the script is something like this : { "trigger": { "schedule": { "interval": "5m" } }, "input": { "search": { "request": { "s…

---

## [How to dynamically create scriting parameters based on another query?](https://discuss.elastic.co/t/how-to-dynamically-create-scriting-parameters-based-on-another-query/195126)

<div class="topic-metadata">

**Author:** [@aniruddha.raje](https://discuss.elastic.co/u/aniruddha.raje)\
**Replies:** 3\
**Last updated:** [August 15, 2019, 7:13am UTC](https://discuss.elastic.co/t/how-to-dynamically-create-scriting-parameters-based-on-another-query/195126 "2019-08-15T07:13:09Z")

</div>

I have a query which contains a script for supporting sorting operation on an index, The script requires few parameters, which I'm currently constructing in code These parameters are being fetched from another index …

---

## [Different filter on multiple indexes](https://discuss.elastic.co/t/different-filter-on-multiple-indexes/195151)

<div class="topic-metadata">

**Author:** [@David\_T](https://discuss.elastic.co/u/David_T)\
**Replies:** 2\
**Last updated:** [August 15, 2019, 5:13am UTC](https://discuss.elastic.co/t/different-filter-on-multiple-indexes/195151 "2019-08-15T05:13:49Z")

</div>

Hello everyone, i have a question about multi indexes search. I want search multi indexes and sort by score, now i use \_msearch query, like this get \_msearch {"index" : "user"} {"query" : {"match" : {"global" : "keywo…

---

## [Is the new helm chart repository beta or not?](https://discuss.elastic.co/t/is-the-new-helm-chart-repository-beta-or-not/194249)

<div class="topic-metadata">

**Author:** [@Stancho](https://discuss.elastic.co/u/Stancho)\
**Replies:** 2\
**Last updated:** [August 15, 2019, 3:57am UTC](https://discuss.elastic.co/t/is-the-new-helm-chart-repository-beta-or-not/194249 "2019-08-15T03:57:16Z")

</div>

Hi, there was already a topic about which helm repository should be used https://discuss.elastic.co/t/which-helm-repo/183188 . It was recommended to use the new one https://github.com/elastic/helm-charts , but in the el…

---

## [Multiple Aggregation Query](https://discuss.elastic.co/t/multiple-aggregation-query/195201)

<div class="topic-metadata">

**Author:** [@codeboy](https://discuss.elastic.co/u/codeboy)\
**Replies:** 1\
**Last updated:** [August 15, 2019, 3:32am UTC](https://discuss.elastic.co/t/multiple-aggregation-query/195201 "2019-08-15T03:32:30Z")

</div>

We are running a query that looks for the equivalent "select distinct f1,f2,f3 from myindex". The resulting query is implemented with nested aggregations. Since we are returning a LOT of data, the performance with 2 t…

---

## [Why elasticsearch has separate JNA library](https://discuss.elastic.co/t/why-elasticsearch-has-separate-jna-library/194986)

<div class="topic-metadata">

**Author:** [@Hirik](https://discuss.elastic.co/u/Hirik)\
**Replies:** 3\
**Last updated:** [August 14, 2019, 10:00pm UTC](https://discuss.elastic.co/t/why-elasticsearch-has-separate-jna-library/194986 "2019-08-14T22:00:54Z")

</div>

Hi, Why do we maintain separate JNA library for elasticsearch? Found this repo in maven dependency: https://mvnrepository.com/artifact/org.elasticsearch/jna

---

## [ES(ECE 2.2) - HADOOP Connectivity](https://discuss.elastic.co/t/es-ece-2-2-hadoop-connectivity/194461)

<div class="topic-metadata">

**Author:** [@rijash](https://discuss.elastic.co/u/rijash)\
**Replies:** 2\
**Last updated:** [August 14, 2019, 8:58pm UTC](https://discuss.elastic.co/t/es-ece-2-2-hadoop-connectivity/194461 "2019-08-14T20:58:28Z")

</div>

Hi, I am getting the below error while trying to ingest data to ES (ECE) from hadoop (HIVE) query. =============== 2019-08-08 13:55:24,957 INFO \[main\]: httpclient.HttpMethodDirector (HttpMethodDirector.java:executeWit…

---

## [How to create daily Indices in elastic search 7.1.0?](https://discuss.elastic.co/t/how-to-create-daily-indices-in-elastic-search-7-1-0/193338)

<div class="topic-metadata">

**Author:** [@irobot678](https://discuss.elastic.co/u/irobot678)\
**Replies:** 4\
**Last updated:** [August 14, 2019, 7:48pm UTC](https://discuss.elastic.co/t/how-to-create-daily-indices-in-elastic-search-7-1-0/193338 "2019-08-14T19:48:58Z")

</div>

Hi, I am using ELK stack version 7.1.0 and i send my logs using logstash. Now, All my logs are getting into one index. I want create index daily basis and store those logs of that particular day in that particular ind…

---

## [Caused by: org.apache.spark.SparkException: Data of type java.util.GregorianCalendar cannot be used](https://discuss.elastic.co/t/caused-by-org-apache-spark-sparkexception-data-of-type-java-util-gregoriancalendar-cannot-be-used/194471)

<div class="topic-metadata">

**Author:** [@Mayukh](https://discuss.elastic.co/u/Mayukh)\
**Replies:** 1\
**Last updated:** [August 14, 2019, 7:25pm UTC](https://discuss.elastic.co/t/caused-by-org-apache-spark-sparkexception-data-of-type-java-util-gregoriancalendar-cannot-be-used/194471 "2019-08-14T19:25:51Z")

</div>

Hi, I am trying to write a PySpark RDD into Elasticsearch, however I am getting the GregorianCalendar error. Any suggestions or help would be appreciated. es\_fault\_df = sqlContext.sql("select \* from fault\_search\_all li…

---

## [Cannot detect ES version - typically this happens if the network/Elasticsearch cluster is not accessible (HIVE) es.nodes.wan.only](https://discuss.elastic.co/t/cannot-detect-es-version-typically-this-happens-if-the-network-elasticsearch-cluster-is-not-accessible-hive-es-nodes-wan-only/191713)

<div class="topic-metadata">

**Author:** [@Marcos\_Peralta](https://discuss.elastic.co/u/Marcos_Peralta)\
**Replies:** 1\
**Last updated:** [August 14, 2019, 7:24pm UTC](https://discuss.elastic.co/t/cannot-detect-es-version-typically-this-happens-if-the-network-elasticsearch-cluster-is-not-accessible-hive-es-nodes-wan-only/191713 "2019-08-14T19:24:25Z")

</div>

I'm currently trying to execute only a "SELECT \* FROM table" from Hive to ElasticSearch after create my external table. I'm using cloudera CDH 6.0.1. I've already added the elasticsearch-hadoop-hive-7.1.1 jar to my hive …

---

## [Integration of hadoop (specifically HDFS files) with ELK stack](https://discuss.elastic.co/t/integration-of-hadoop-specifically-hdfs-files-with-elk-stack/192596)

<div class="topic-metadata">

**Author:** [@Yukti\_Agrawal](https://discuss.elastic.co/u/Yukti_Agrawal)\
**Replies:** 1\
**Last updated:** [August 14, 2019, 7:07pm UTC](https://discuss.elastic.co/t/integration-of-hadoop-specifically-hdfs-files-with-elk-stack/192596 "2019-08-14T19:07:12Z")

</div>

I am trying to integrate hadoop with ELK stack. My use case is " i have to get a data from a file present in HDFS path (AVRO format) and show the contents on kibana dashboard" Anybody is having any article with step by …

---

## [Search a string in Kibana](https://discuss.elastic.co/t/search-a-string-in-kibana/193761)

<div class="topic-metadata">

**Author:** [@koushickvikram](https://discuss.elastic.co/u/koushickvikram)\
**Replies:** 1\
**Last updated:** [August 14, 2019, 6:27pm UTC](https://discuss.elastic.co/t/search-a-string-in-kibana/193761 "2019-08-14T18:27:51Z")

</div>

Hi, I need a DSL query to filter some value from the requests. From the below requests i need to exclude requests which contains .html,.gif,.css,.jpg at the ending. i need only the requests which are without those exte…

---

## [Missing aggregations field in response](https://discuss.elastic.co/t/missing-aggregations-field-in-response/193189)

<div class="topic-metadata">

**Author:** [@julioolvr](https://discuss.elastic.co/u/julioolvr)\
**Replies:** 2\
**Last updated:** [August 14, 2019, 5:15pm UTC](https://discuss.elastic.co/t/missing-aggregations-field-in-response/193189 "2019-08-14T17:15:55Z")

</div>

Hi, We ran into an error where a query to ElasticSearch that included aggregations didn't return the aggregations field in the response at all. So for a query like this: { "size": 0, "query": { "bool"…

---

## [Why isn't the RestHighLevelClient class included in Elasticsearch 7.3.0?](https://discuss.elastic.co/t/why-isnt-the-resthighlevelclient-class-included-in-elasticsearch-7-3-0/195081)

<div class="topic-metadata">

**Author:** [@mathwin](https://discuss.elastic.co/u/mathwin)\
**Replies:** 4\
**Last updated:** [August 14, 2019, 5:10pm UTC](https://discuss.elastic.co/t/why-isnt-the-resthighlevelclient-class-included-in-elasticsearch-7-3-0/195081 "2019-08-14T17:10:05Z")

</div>

Let me see if I understand the situation fully. The 7.0.0 release of Elastic has deprecated the old TransportClient class, and the NodeClient class was deprecated all the way back in 2016. No alternative is present in …

---

## [How to measure an 'Empty' operation](https://discuss.elastic.co/t/how-to-measure-an-empty-operation/195122)

<div class="topic-metadata">

**Author:** [@David\_Samokovlisky](https://discuss.elastic.co/u/David_Samokovlisky)\
**Replies:** 5\
**Last updated:** [August 14, 2019, 4:10pm UTC](https://discuss.elastic.co/t/how-to-measure-an-empty-operation/195122 "2019-08-14T16:10:50Z")

</div>

Hi Because esrally doesn't support upsert's I want to try a different approach, as to use esrally only for measurements, and do the operation externally. My question is, is there a way to make an empty operation, that …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1189)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1191)
