# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=654

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 655

---

## [Filter by categories](https://discuss.elastic.co/t/filter-by-categories/271788)

<div class="topic-metadata">

**Author:** [@ehsan\_kabiri\_33](https://discuss.elastic.co/u/ehsan_kabiri_33)\
**Replies:** 0\
**Last updated:** [April 30, 2021, 1:49pm UTC](https://discuss.elastic.co/t/filter-by-categories/271788 "2021-04-30T13:49:36Z")

</div>

My Index has a property named categoryId.My category Ids at the moment are \[1,2,3\] but there could be more categories like \[1,2,3,4,5\] in the future. Each record in my index can belongs to no categoryId , one categoryId…

---

## [Watcher API Not Available](https://discuss.elastic.co/t/watcher-api-not-available/271664)

<div class="topic-metadata">

**Author:** [@Munavir\_Chavody](https://discuss.elastic.co/u/Munavir_Chavody)\
**Replies:** 3\
**Last updated:** [April 30, 2021, 1:39pm UTC](https://discuss.elastic.co/t/watcher-api-not-available/271664 "2021-04-30T13:39:06Z")

</div>

I'm trying to access Watcher API via my ES endpoint. I have 2 versions of the ES: 7.11 and 7.10, but both of the shouldn't have any differences as per the documentation. Now, the endpoint /\_watcher/\_query/watches works …

---

## [Data Streams with ECS mapping](https://discuss.elastic.co/t/data-streams-with-ecs-mapping/271765)

<div class="topic-metadata">

**Author:** [@jetnet](https://discuss.elastic.co/u/jetnet)\
**Replies:** 1\
**Last updated:** [April 30, 2021, 12:00pm UTC](https://discuss.elastic.co/t/data-streams-with-ecs-mapping/271765 "2021-04-30T12:00:30Z")

</div>

I use Logstash to create data streams like that: logs-syslog.message-namespace What's the best way to link a "legacy" ECS template ecs-logstash (which gets installed automatically) to that data stream? ELK version: 7.1…

---

## [Elasticsearch mapping with timezone](https://discuss.elastic.co/t/elasticsearch-mapping-with-timezone/271060)

<div class="topic-metadata">

**Author:** [@tkkchan](https://discuss.elastic.co/u/tkkchan)\
**Replies:** 10\
**Last updated:** [April 30, 2021, 11:06am UTC](https://discuss.elastic.co/t/elasticsearch-mapping-with-timezone/271060 "2021-04-30T11:06:27Z")

</div>

I have some JSON data that I am parsing with Filebeat and feeding into elasticsearch. There're some timestamps like this "joinTime": "2021-04-23 10:48:10+08:00" and I used the following in mapping to store it "joinTim…

---

## [Run custom tracks get type error](https://discuss.elastic.co/t/run-custom-tracks-get-type-error/271520)

<div class="topic-metadata">

**Author:** [@GITnewfish](https://discuss.elastic.co/u/GITnewfish)\
**Replies:** 3\
**Last updated:** [April 30, 2021, 9:21am UTC](https://discuss.elastic.co/t/run-custom-tracks-get-type-error/271520 "2021-04-30T09:21:05Z")

</div>

When I run custom tracks ,I got type error. I can't figure out, need help! Thanks! esrally version: esrally 1.4.1 es version: 6.4.0 my custom track: {% import "rally.helpers" as rally with context %} { "version": 2…

---

## [Exception in indexing function: ElasticsearchException got in indexing function: TransportError](https://discuss.elastic.co/t/exception-in-indexing-function-elasticsearchexception-got-in-indexing-function-transporterror/271220)

<div class="topic-metadata">

**Author:** [@sanjaysh](https://discuss.elastic.co/u/sanjaysh)\
**Replies:** 19\
**Last updated:** [April 30, 2021, 9:11am UTC](https://discuss.elastic.co/t/exception-in-indexing-function-elasticsearchexception-got-in-indexing-function-transporterror/271220 "2021-04-30T09:11:30Z")

</div>

Hello All, I was ingesting the data into the ElasticCloud and suddenly I got this error before the competition of the data I was having the data of 14BG and at 13.5 GB data are being completed but this error has come an…

---

## [Custom \_id for new user profile documents](https://discuss.elastic.co/t/custom-id-for-new-user-profile-documents/271745)

<div class="topic-metadata">

**Author:** [@Lukas\_Smilek](https://discuss.elastic.co/u/Lukas_Smilek)\
**Replies:** 2\
**Last updated:** [April 30, 2021, 8:56am UTC](https://discuss.elastic.co/t/custom-id-for-new-user-profile-documents/271745 "2021-04-30T08:56:35Z")

</div>

Hello, I went through the topics here and did some research and I am aware of the fact that specifying an custom \_id when indexing new document can slow down the performance. But I could not find how drastically it woul…

---

## [Error when running 7.12.1 on centos 7 in docker](https://discuss.elastic.co/t/error-when-running-7-12-1-on-centos-7-in-docker/271508)

<div class="topic-metadata">

**Author:** [@WiseOwl](https://discuss.elastic.co/u/WiseOwl)\
**Replies:** 3\
**Last updated:** [April 30, 2021, 8:40am UTC](https://discuss.elastic.co/t/error-when-running-7-12-1-on-centos-7-in-docker/271508 "2021-04-30T08:40:28Z")

</div>

Hi, Since the 7.12.1 update ES does not want to start in a docker container, running Centos 7. The systemd output is as such: systemd-entrypoint\[16341\]: \[0.001s\]\[warning\]\[os,container\] Duplicate cpuset controllers dete…

---

## [Fatal alert: bad\_certificate](https://discuss.elastic.co/t/fatal-alert-bad-certificate/271277)

<div class="topic-metadata">

**Author:** [@mirko.spezie](https://discuss.elastic.co/u/mirko.spezie)\
**Replies:** 5\
**Last updated:** [April 30, 2021, 8:17am UTC](https://discuss.elastic.co/t/fatal-alert-bad-certificate/271277 "2021-04-30T08:17:06Z")

</div>

Hi all, I've enabled 1 year ago a cluster with X-Pack security enabled. Everything was fine and the cluster went in production. From a couple of days I'm receiving an error regarding a bad\_certificate only for the secon…

---

## [How to completely reset forced shard allocation awareness?](https://discuss.elastic.co/t/how-to-completely-reset-forced-shard-allocation-awareness/271710)

<div class="topic-metadata">

**Author:** [@dschneiter](https://discuss.elastic.co/u/dschneiter)\
**Replies:** 3\
**Last updated:** [April 29, 2021, 9:21pm UTC](https://discuss.elastic.co/t/how-to-completely-reset-forced-shard-allocation-awareness/271710 "2021-04-29T21:21:27Z")

</div>

While teaching about shard allocation awareness and forced shard allocation awareness (Elasticsearch Engineer II course), one of the students made a typo in his request to configure forced shard allocation awareness whic…

---

## [How to remove a field from elastic search mapping?](https://discuss.elastic.co/t/how-to-remove-a-field-from-elastic-search-mapping/271691)

<div class="topic-metadata">

**Author:** [@vk98](https://discuss.elastic.co/u/vk98)\
**Replies:** 3\
**Last updated:** [April 30, 2021, 7:24am UTC](https://discuss.elastic.co/t/how-to-remove-a-field-from-elastic-search-mapping/271691 "2021-04-30T07:24:51Z")

</div>

I have added a field which is not actually required in elastic search. Now I want to get rid of it. Changing mapping or making a new one will reindex my whole data. Which is very huge and cant afford to do such thing. Ca…

---

## [Elasticseach failed shard allocation](https://discuss.elastic.co/t/elasticseach-failed-shard-allocation/271739)

<div class="topic-metadata">

**Author:** [@TheVintik](https://discuss.elastic.co/u/TheVintik)\
**Replies:** 7\
**Last updated:** [April 30, 2021, 7:23am UTC](https://discuss.elastic.co/t/elasticseach-failed-shard-allocation/271739 "2021-04-30T07:23:44Z")

</div>

My ES is in yellow state after another one node adding and restarting cluster. I have 4 unassigned shards (from 33), and here is response for one of unassigned shards: { "index" : "MY INDEX NAME", "shard" : 0, "pr…

---

## [Elasticsearch 7.12 High CPU usage](https://discuss.elastic.co/t/elasticsearch-7-12-high-cpu-usage/270757)

<div class="topic-metadata">

**Author:** [@Anabella\_Cristaldi](https://discuss.elastic.co/u/Anabella_Cristaldi)\
**Replies:** 7\
**Last updated:** [April 30, 2021, 6:51am UTC](https://discuss.elastic.co/t/elasticsearch-7-12-high-cpu-usage/270757 "2021-04-30T06:51:04Z")

</div>

Hi all, Last week in need to install a new cluster and I decided to use the 7.12 version. Initially I've configure a three node cluster (two data+master nodes, one master node). In this version elasticsearch automatic…

---

## [Not to able to create new node](https://discuss.elastic.co/t/not-to-able-to-create-new-node/271537)

<div class="topic-metadata">

**Author:** [@hussshe](https://discuss.elastic.co/u/hussshe)\
**Replies:** 5\
**Last updated:** [April 30, 2021, 2:38am UTC](https://discuss.elastic.co/t/not-to-able-to-create-new-node/271537 "2021-04-30T02:38:13Z")

</div>

Hello Elastic Members, ES Version: 7.12.0 OS: Windows 10 I am following an udemy course on ES. The trainer has given a task to add an additional node to the cluster(contains only 1 node) that runs on a same machine. S…

---

## [FSCrawler2.6 : failed to create elasticsearch client, disabling crawler](https://discuss.elastic.co/t/fscrawler2-6-failed-to-create-elasticsearch-client-disabling-crawler/271701)

<div class="topic-metadata">

**Author:** [@joseph-l.amalraj](https://discuss.elastic.co/u/joseph-l.amalraj)\
**Replies:** 6\
**Last updated:** [April 30, 2021, 2:16am UTC](https://discuss.elastic.co/t/fscrawler2-6-failed-to-create-elasticsearch-client-disabling-crawler/271701 "2021-04-30T02:16:06Z")

</div>

Hi, Can you please share your suggestions for this issue.. I am using FSCrawler v2.6 and my ELK v6.8.14.. when i tried to ingest pdf files, getting below errors.. FYI.. with the same settings.json and data, i was able…

---

## [How to search over all fields and return every document containing that search in elasticsearch?](https://discuss.elastic.co/t/how-to-search-over-all-fields-and-return-every-document-containing-that-search-in-elasticsearch/271533)

<div class="topic-metadata">

**Author:** [@Sander\_Marx](https://discuss.elastic.co/u/Sander_Marx)\
**Replies:** 2\
**Last updated:** [April 30, 2021, 1:01am UTC](https://discuss.elastic.co/t/how-to-search-over-all-fields-and-return-every-document-containing-that-search-in-elasticsearch/271533 "2021-04-30T01:01:55Z")

</div>

I have a problem regarding searching in elasticsearch. I have a index with multiple documents with several fields. I want to be able to search over all the fields running a query and want it to return all the documents …

---

## [Setting up ElasticCloud to handle large data - does adding new nodes just replicate or share data?](https://discuss.elastic.co/t/setting-up-elasticcloud-to-handle-large-data-does-adding-new-nodes-just-replicate-or-share-data/271725)

<div class="topic-metadata">

**Author:** [@M\_Gibbs](https://discuss.elastic.co/u/M_Gibbs)\
**Replies:** 4\
**Last updated:** [April 30, 2021, 12:27am UTC](https://discuss.elastic.co/t/setting-up-elasticcloud-to-handle-large-data-does-adding-new-nodes-just-replicate-or-share-data/271725 "2021-04-30T00:27:49Z")

</div>

Hi all, So we have a single node currently in ElasticCloud and I've been advised we need multiple nodes as we have a number of shards that are unable to be assigned due to the single node. So, we have one node with 928…

---

## [If an ML job doesnt find anomalies it will not display anything in the anomaly explorer an in single metric viewer?](https://discuss.elastic.co/t/if-an-ml-job-doesnt-find-anomalies-it-will-not-display-anything-in-the-anomaly-explorer-an-in-single-metric-viewer/271657)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 2\
**Last updated:** [April 29, 2021, 8:57pm UTC](https://discuss.elastic.co/t/if-an-ml-job-doesnt-find-anomalies-it-will-not-display-anything-in-the-anomaly-explorer-an-in-single-metric-viewer/271657 "2021-04-29T20:57:58Z")

</div>

Hi I have a multimetric job divided by hosts, it is posible that metrics for some host doesnt create anomalies and this specific host is nos displayed in anomaly explorer and in the single metric viewer? how can I make…

---

## [Elastic Stack Architecture Upgrade](https://discuss.elastic.co/t/elastic-stack-architecture-upgrade/271708)

<div class="topic-metadata">

**Author:** [@byoungman](https://discuss.elastic.co/u/byoungman)\
**Replies:** 1\
**Last updated:** [April 29, 2021, 8:30pm UTC](https://discuss.elastic.co/t/elastic-stack-architecture-upgrade/271708 "2021-04-29T20:30:01Z")

</div>

I have been tasked by my director with coming up with a 'right size' for our corporate Elastic Stack and I have the following question. We are using AWS Cloud and we're growing but we're not what you would call an extre…

---

## [How to speed up Language Identification Inference](https://discuss.elastic.co/t/how-to-speed-up-language-identification-inference/271660)

<div class="topic-metadata">

**Author:** [@rueian](https://discuss.elastic.co/u/rueian)\
**Replies:** 5\
**Last updated:** [April 29, 2021, 6:35pm UTC](https://discuss.elastic.co/t/how-to-speed-up-language-identification-inference/271660 "2021-04-29T18:35:34Z")

</div>

Hi, I were trying the language identification feature (Language identification | Machine Learning in the Elastic Stack \[7.12\] | Elastic), and noticed that the model inference was very slow. Originally, my elasticsearch …

---

## [Missing prepareSearch() method in RestHighLevelClient](https://discuss.elastic.co/t/missing-preparesearch-method-in-resthighlevelclient/271631)

<div class="topic-metadata">

**Author:** [@cmpich](https://discuss.elastic.co/u/cmpich)\
**Replies:** 3\
**Last updated:** [April 29, 2021, 6:13pm UTC](https://discuss.elastic.co/t/missing-preparesearch-method-in-resthighlevelclient/271631 "2021-04-29T18:13:05Z")

</div>

I am trying to use Aggregation API and for that documentation tells me to use SearchResponse sr = node.client().prepareSearch() .setQuery( /\* your query \*/ ) .addAggregation( /\* add an aggregation \*/ ) …

---

## [Does Elasticsearch support double bytes characters in path.data?](https://discuss.elastic.co/t/does-elasticsearch-support-double-bytes-characters-in-path-data/271650)

<div class="topic-metadata">

**Author:** [@Abhishek\_Shinde](https://discuss.elastic.co/u/Abhishek_Shinde)\
**Replies:** 1\
**Last updated:** [April 29, 2021, 5:06pm UTC](https://discuss.elastic.co/t/does-elasticsearch-support-double-bytes-characters-in-path-data/271650 "2021-04-29T17:06:55Z")

</div>

Does Elasticsearch support double bytes characters like Chinese, Japanese, Korean in path.data?

---

## [Cross cluster Search](https://discuss.elastic.co/t/cross-cluster-search/270882)

<div class="topic-metadata">

**Author:** [@kvmuralidhar](https://discuss.elastic.co/u/kvmuralidhar)\
**Replies:** 4\
**Last updated:** [April 29, 2021, 4:40pm UTC](https://discuss.elastic.co/t/cross-cluster-search/270882 "2021-04-29T16:40:44Z")

</div>

Hi. Has anyone implemented CCS between Elastic running on GCP or AWS and on on-prem hardware ? I am getting a connection refused error message when I try to add a remote cluster running on GCP or AWS. Thanks Murali

---

## [Pattern Replace Character Filter In a Normalizer](https://discuss.elastic.co/t/pattern-replace-character-filter-in-a-normalizer/271669)

<div class="topic-metadata">

**Author:** [@MilanGatyas](https://discuss.elastic.co/u/MilanGatyas)\
**Replies:** 0\
**Last updated:** [April 29, 2021, 2:58pm UTC](https://discuss.elastic.co/t/pattern-replace-character-filter-in-a-normalizer/271669 "2021-04-29T14:58:46Z")

</div>

My goal is to have a same pattern replace character filter on both my custom analyzer and normalizer. Seems like I can use the filter on the analyzer without issues, however facing error when trying to attach the filter …

---

## [Including data from SQL tables to Elasticsearch](https://discuss.elastic.co/t/including-data-from-sql-tables-to-elasticsearch/271611)

<div class="topic-metadata">

**Author:** [@mar-ro](https://discuss.elastic.co/u/mar-ro)\
**Replies:** 4\
**Last updated:** [April 29, 2021, 2:27pm UTC](https://discuss.elastic.co/t/including-data-from-sql-tables-to-elasticsearch/271611 "2021-04-29T14:27:39Z")

</div>

Good morning. I would like to know if it would be possible, in order to increase the performance of queries in a SQL database, to perform a data dump from the SQL database to elasticsearch, is that possible, or is it onl…

---

## [Increase shards without changing index name](https://discuss.elastic.co/t/increase-shards-without-changing-index-name/271409)

<div class="topic-metadata">

**Author:** [@ggio](https://discuss.elastic.co/u/ggio)\
**Replies:** 3\
**Last updated:** [April 29, 2021, 2:11pm UTC](https://discuss.elastic.co/t/increase-shards-without-changing-index-name/271409 "2021-04-29T14:11:28Z")

</div>

Hi, I have a couple of indexes which are very big and I want to increase the shards number. Split index API offered by ES seems to be very interesting and useful for my case but it requires to change the index name. W…

---

## [Simple elastic search cluster monitoring](https://discuss.elastic.co/t/simple-elastic-search-cluster-monitoring/271656)

<div class="topic-metadata">

**Author:** [@webfr](https://discuss.elastic.co/u/webfr)\
**Replies:** 0\
**Last updated:** [April 29, 2021, 1:52pm UTC](https://discuss.elastic.co/t/simple-elastic-search-cluster-monitoring/271656 "2021-04-29T13:52:28Z")

</div>

Hello guys, a little contribution from myself, a simple/quick script to monitor your cluster, tested on centos 7 / ES 7.11.2 :relaxed: You can easily cron it : \*/5 \* \* \* \* /root/ES\_health.sh \>\> /root/ES\_health.log ES…

---

## [Highlight feature - limitToMaxAnalyzedOffset - does still exist?](https://discuss.elastic.co/t/highlight-feature-limittomaxanalyzedoffset-does-still-exist/271644)

<div class="topic-metadata">

**Author:** [@jlarroque](https://discuss.elastic.co/u/jlarroque)\
**Replies:** 2\
**Last updated:** [April 29, 2021, 1:45pm UTC](https://discuss.elastic.co/t/highlight-feature-limittomaxanalyzedoffset-does-still-exist/271644 "2021-04-29T13:45:31Z")

</div>

Hi everyone, I was wondering if you could help me. I found an interesting feature added in a specific PR: But I can't find documentation of how to use that using java HighLevel rest client. Was that removed? That PR …

---

## [New line character in painless](https://discuss.elastic.co/t/new-line-character-in-painless/271604)

<div class="topic-metadata">

**Author:** [@lstoneir](https://discuss.elastic.co/u/lstoneir)\
**Replies:** 1\
**Last updated:** [April 29, 2021, 11:48am UTC](https://discuss.elastic.co/t/new-line-character-in-painless/271604 "2021-04-29T11:48:38Z")

</div>

i want to send new line char to api using watcher "actions": { "sms": { "webhook": { "scheme": "https", "host": "127.0.0.1", "port": 80, "method": "post", "path": "/api/…

---

## [ElasticsearchException got in indexing function: TransportError](https://discuss.elastic.co/t/elasticsearchexception-got-in-indexing-function-transporterror/271195)

<div class="topic-metadata">

**Author:** [@sanjay\_sheel](https://discuss.elastic.co/u/sanjay_sheel)\
**Replies:** 3\
**Last updated:** [April 29, 2021, 11:47am UTC](https://discuss.elastic.co/t/elasticsearchexception-got-in-indexing-function-transporterror/271195 "2021-04-29T11:47:25Z")

</div>

\[17:15:47\]{completed\_searching2.py:346}ERROR- Error Occured: Exception in indexing function: ElasticsearchException got in indexing function: TransportError(429, 'circuit\_breaking\_exception', '\[parent\] Data too large, da…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=653)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=655)
