# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1313

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1314

---

## [Bulk Operation Results from Databricks Spark Job](https://discuss.elastic.co/t/bulk-operation-results-from-databricks-spark-job/175648)

<div class="topic-metadata">

**Author:** [@RahulGS](https://discuss.elastic.co/u/RahulGS)\
**Replies:** 2\
**Last updated:** [May 2, 2019, 7:23pm UTC](https://discuss.elastic.co/t/bulk-operation-results-from-databricks-spark-job/175648 "2019-05-02T19:23:52Z")

</div>

Hello , We are using ElasticSearch 5.0 I am performing bulk writes from dataframe to elastic search using spark , writes are performed using .option("es.write.operations","upsert") and .mode("append") . Note we also …

---

## [Getting image content with sfcrawler from kibana](https://discuss.elastic.co/t/getting-image-content-with-sfcrawler-from-kibana/179413)

<div class="topic-metadata">

**Author:** [@kumar4](https://discuss.elastic.co/u/kumar4)\
**Replies:** 1\
**Last updated:** [May 2, 2019, 6:59pm UTC](https://discuss.elastic.co/t/getting-image-content-with-sfcrawler-from-kibana/179413 "2019-05-02T18:59:14Z")

</div>

i use fscrawler, i can index my pdf files, but my prblem is that i cant see the images that are inside the pdf file, i want to see the content of the image (i mean text diplayed in the image) is there any solution to tha…

---

## [Searching pharses within pdf in fsrcarwler using kibana](https://discuss.elastic.co/t/searching-pharses-within-pdf-in-fsrcarwler-using-kibana/179415)

<div class="topic-metadata">

**Author:** [@kumar4](https://discuss.elastic.co/u/kumar4)\
**Replies:** 1\
**Last updated:** [May 2, 2019, 6:58pm UTC](https://discuss.elastic.co/t/searching-pharses-within-pdf-in-fsrcarwler-using-kibana/179415 "2019-05-02T18:58:34Z")

</div>

i indexed my pdf files using fscrawler, and now i want to search pharses coresponding to "hello evryone" in m files in the dev tools console, what is the request to use, NB: i use this requetes but i retrives the conten…

---

## [Exemple of query to retrieve matching data](https://discuss.elastic.co/t/exemple-of-query-to-retrieve-matching-data/179418)

<div class="topic-metadata">

**Author:** [@kumar4](https://discuss.elastic.co/u/kumar4)\
**Replies:** 1\
**Last updated:** [May 2, 2019, 6:57pm UTC](https://discuss.elastic.co/t/exemple-of-query-to-retrieve-matching-data/179418 "2019-05-02T18:57:20Z")

</div>

i want to retrieve the data and sentences from pdf indexed with fscrawler, how can i get the content from pdf that match a sentence, for example i want to retrieve the detai of the pdf (title, ...) and the paragraphe con…

---

## [What version of fscrawler is compatible with elasticsearch 6.3](https://discuss.elastic.co/t/what-version-of-fscrawler-is-compatible-with-elasticsearch-6-3/179334)

<div class="topic-metadata">

**Author:** [@kumar4](https://discuss.elastic.co/u/kumar4)\
**Replies:** 3\
**Last updated:** [May 2, 2019, 6:56pm UTC](https://discuss.elastic.co/t/what-version-of-fscrawler-is-compatible-with-elasticsearch-6-3/179334 "2019-05-02T18:56:24Z")

</div>

i installed many version of fscrawler but no one works with es 6.3 (when tryin --loop 1 commande it throws compatibility error) so what version of fscrawler is compatible with elasticsearch 6.3

---

## [Is it possible to search text (words) in image and audio using elasticsearch](https://discuss.elastic.co/t/is-it-possible-to-search-text-words-in-image-and-audio-using-elasticsearch/179158)

<div class="topic-metadata">

**Author:** [@kumar4](https://discuss.elastic.co/u/kumar4)\
**Replies:** 3\
**Last updated:** [May 2, 2019, 6:55pm UTC](https://discuss.elastic.co/t/is-it-possible-to-search-text-words-in-image-and-audio-using-elasticsearch/179158 "2019-05-02T18:55:33Z")

</div>

hi dears, i want to know if it is possible to search words in images and audio flile, any help please thank you very much

---

## [Error when trying to list the index of fscrawler in cabana](https://discuss.elastic.co/t/error-when-trying-to-list-the-index-of-fscrawler-in-cabana/179410)

<div class="topic-metadata">

**Author:** [@kumar4](https://discuss.elastic.co/u/kumar4)\
**Replies:** 1\
**Last updated:** [May 2, 2019, 6:47pm UTC](https://discuss.elastic.co/t/error-when-trying-to-list-the-index-of-fscrawler-in-cabana/179410 "2019-05-02T18:47:21Z")

</div>

i use fscrawler 2.6 and in kibana when i try to do GET bidata (bigdata is the name of my index created with the commande bin/fscrawler --config\_dir ./test bigdata) it displays the folowing message :slight\_smile: #! Depr…

---

## [Java+elasticsearch for search feature](https://discuss.elastic.co/t/java-elasticsearch-for-search-feature/179402)

<div class="topic-metadata">

**Author:** [@sunilmchaudhari](https://discuss.elastic.co/u/sunilmchaudhari)\
**Replies:** 1\
**Last updated:** [May 2, 2019, 3:57pm UTC](https://discuss.elastic.co/t/java-elasticsearch-for-search-feature/179402 "2019-05-02T15:57:14Z")

</div>

Hi, It sounds out of the topic use case. But i want to use elasticsearch for fast searching to my relational database. Can I use elasticsearch at my DB layer in java application to search data in relational database? …

---

## [Elasticsearch 2.2 snapshot with exclude indices](https://discuss.elastic.co/t/elasticsearch-2-2-snapshot-with-exclude-indices/179366)

<div class="topic-metadata">

**Author:** [@Ronny\_Gorner](https://discuss.elastic.co/u/Ronny_Gorner)\
**Replies:** 1\
**Last updated:** [May 2, 2019, 3:56pm UTC](https://discuss.elastic.co/t/elasticsearch-2-2-snapshot-with-exclude-indices/179366 "2019-05-02T15:56:57Z")

</div>

Hi, I am getting nearby crazy :slight\_smile: I want to snapshot and to exlude my .kibana & .marvel indeces like this: curl -X PUT "localhost:9200/\_snapshot/backup/init" -H 'Content-Type: application/json' -d' { "indi…

---

## [Curator not working correctly](https://discuss.elastic.co/t/curator-not-working-correctly/179397)

<div class="topic-metadata">

**Author:** [@Hanneu](https://discuss.elastic.co/u/Hanneu)\
**Replies:** 2\
**Last updated:** [May 2, 2019, 3:34pm UTC](https://discuss.elastic.co/t/curator-not-working-correctly/179397 "2019-05-02T15:34:09Z")

</div>

Hello experts, For some reason, curator running on my ES single node cluster is not working correctly . Curator version is 5.4.1 Also, to add additional info, I strongly feel that issue is with delete\_indices.yml file b…

---

## [Elasticsearch(6.7.1) Index Lifecycle Management Policy Creation](https://discuss.elastic.co/t/elasticsearch-6-7-1-index-lifecycle-management-policy-creation/179304)

<div class="topic-metadata">

**Author:** [@safderali5](https://discuss.elastic.co/u/safderali5)\
**Replies:** 1\
**Last updated:** [May 2, 2019, 3:30pm UTC](https://discuss.elastic.co/t/elasticsearch-6-7-1-index-lifecycle-management-policy-creation/179304 "2019-05-02T15:30:05Z")

</div>

I am trying to experiment with Elasticsearch ILM feature. All the documentation and example show how to create ILM Policy, using REST API or using Kibana GUI. I want to ask is there a way to provide ILM policy Json stri…

---

## [org.elasticsearch.ElasticsearchException$1: Fielddata is disabled on text fields by default](https://discuss.elastic.co/t/org-elasticsearch-elasticsearchexception-1-fielddata-is-disabled-on-text-fields-by-default/179313)

<div class="topic-metadata">

**Author:** [@manue](https://discuss.elastic.co/u/manue)\
**Replies:** 11\
**Last updated:** [May 2, 2019, 3:21pm UTC](https://discuss.elastic.co/t/org-elasticsearch-elasticsearchexception-1-fielddata-is-disabled-on-text-fields-by-default/179313 "2019-05-02T15:21:14Z")

</div>

Could you help me to solver this error?: \[2019-05-02T10:35:37,497\]\[DEBUG\]\[o.e.a.s.TransportSearchAction\] \[K-elM\_U\] \[magento2\_product\_1\_v52\]\[3\], node\[K-elM\_UTTXCBvlkUTFuglg\], \[P\], s\[STARTED\], a\[id=hUhVYORgQ2GI24nBt3FqDw…

---

## [Elasticsearch highlighting: "copy\_to" without "store"](https://discuss.elastic.co/t/elasticsearch-highlighting-copy-to-without-store/179365)

<div class="topic-metadata">

**Author:** [@CanardMoussant](https://discuss.elastic.co/u/CanardMoussant)\
**Replies:** 7\
**Last updated:** [May 2, 2019, 2:50pm UTC](https://discuss.elastic.co/t/elasticsearch-highlighting-copy-to-without-store/179365 "2019-05-02T14:50:09Z")

</div>

I came across this post but that does not seem to help. I have the following ES mapping: properties { message { type: text analyzer: standard norms: false } additional { type: object …

---

## [How to make queryStringQuery?](https://discuss.elastic.co/t/how-to-make-querystringquery/179348)

<div class="topic-metadata">

**Author:** [@Aswini\_Kumar\_Rout](https://discuss.elastic.co/u/Aswini_Kumar_Rout)\
**Replies:** 3\
**Last updated:** [May 2, 2019, 1:05pm UTC](https://discuss.elastic.co/t/how-to-make-querystringquery/179348 "2019-05-02T13:05:54Z")

</div>

Can anybody please help me to convert the below query to a queryStringQuery which I can execute in java by QueryStringQueryBuilder . The Query:- { "bool" : { "must" : \[ { "bool" : { "must"…

---

## [Index Mappings over nested fields](https://discuss.elastic.co/t/index-mappings-over-nested-fields/179326)

<div class="topic-metadata">

**Author:** [@Fabio-sama](https://discuss.elastic.co/u/Fabio-sama)\
**Replies:** 4\
**Last updated:** [May 2, 2019, 12:08pm UTC](https://discuss.elastic.co/t/index-mappings-over-nested-fields/179326 "2019-05-02T12:08:51Z")

</div>

Hi there! I'd like to know whether it is possible to apply an index mapping so to manipulate some nested fields as soon as they arrive. To make it more understandable, let's say I have some in-coming documents structur…

---

## [Json object containing json array need to insert using bulk in an index](https://discuss.elastic.co/t/json-object-containing-json-array-need-to-insert-using-bulk-in-an-index/179128)

<div class="topic-metadata">

**Author:** [@vinayak](https://discuss.elastic.co/u/vinayak)\
**Replies:** 4\
**Last updated:** [May 2, 2019, 11:52am UTC](https://discuss.elastic.co/t/json-object-containing-json-array-need-to-insert-using-bulk-in-an-index/179128 "2019-05-02T11:52:04Z")

</div>

need to insert json object to an index.i know it is a silly question but not able to get rid of that.sample json data: {"test":\[ { "sourceNumber": 6, "sourceName": "Trade Days", "result": "false" }, { "sourceNumb…

---

## [Search by image using elastic search](https://discuss.elastic.co/t/search-by-image-using-elastic-search/179347)

<div class="topic-metadata">

**Author:** [@srikanthkadem](https://discuss.elastic.co/u/srikanthkadem)\
**Replies:** 1\
**Last updated:** [May 2, 2019, 11:41am UTC](https://discuss.elastic.co/t/search-by-image-using-elastic-search/179347 "2019-05-02T11:41:56Z")

</div>

hi , is it possible to implement search by image using elastic search. Regards Srikanth

---

## [Elastic Search Log](https://discuss.elastic.co/t/elastic-search-log/179332)

<div class="topic-metadata">

**Author:** [@aneesh](https://discuss.elastic.co/u/aneesh)\
**Replies:** 1\
**Last updated:** [May 2, 2019, 11:21am UTC](https://discuss.elastic.co/t/elastic-search-log/179332 "2019-05-02T11:21:01Z")

</div>

Does the elastic search maintains any log for the actions/ the queries executed . If yes then where can I see that? in Kibana?

---

## [Check for parsing errors before indexing](https://discuss.elastic.co/t/check-for-parsing-errors-before-indexing/179330)

<div class="topic-metadata">

**Author:** [@davidbien](https://discuss.elastic.co/u/davidbien)\
**Replies:** 5\
**Last updated:** [May 2, 2019, 11:07am UTC](https://discuss.elastic.co/t/check-for-parsing-errors-before-indexing/179330 "2019-05-02T11:07:27Z")

</div>

I use a python script to send aws cloudtrail logs to elasticsearch. It works most of the time however occasionally I get a parsing error like this: ('1 document(s) failed to index.', \[{'index': {'\_index': 'n\_cloudtrail…

---

## [“Permission Denied” starting Elasticsearch-7.0](https://discuss.elastic.co/t/permission-denied-starting-elasticsearch-7-0/179336)

<div class="topic-metadata">

**Author:** [@kthy](https://discuss.elastic.co/u/kthy)\
**Replies:** 2\
**Last updated:** [May 2, 2019, 11:03am UTC](https://discuss.elastic.co/t/permission-denied-starting-elasticsearch-7-0/179336 "2019-05-02T11:03:17Z")

</div>

I'm getting a permission denied error for /etc/default/elasticsearch when starting Elasticsearch: $ sudo systemctl status elasticsearch ● elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/system/…

---

## [Update\_rate in fscrawler](https://discuss.elastic.co/t/update-rate-in-fscrawler/179316)

<div class="topic-metadata">

**Author:** [@kumar4](https://discuss.elastic.co/u/kumar4)\
**Replies:** 1\
**Last updated:** [May 2, 2019, 11:01am UTC](https://discuss.elastic.co/t/update-rate-in-fscrawler/179316 "2019-05-02T11:01:13Z")

</div>

hi dears, i want to know what the field update\_rate means in fscrawler config file thank you

---

## [Exception in thread "main" java.net.ConnectException: Timeout connecting to \[localhost:9200\]](https://discuss.elastic.co/t/exception-in-thread-main-java-net-connectexception-timeout-connecting-to-localhost-9200/178744)

<div class="topic-metadata">

**Author:** [@Ravindra\_Nath](https://discuss.elastic.co/u/Ravindra_Nath)\
**Replies:** 7\
**Last updated:** [May 2, 2019, 10:58am UTC](https://discuss.elastic.co/t/exception-in-thread-main-java-net-connectexception-timeout-connecting-to-localhost-9200/178744 "2019-05-02T10:58:45Z")

</div>

Exception in thread "main" java.net.ConnectException: Timeout connecting to \[localhost:9200\] at org.elasticsearch.client.RestClient.extractAndWrapCause(RestClient.java:804) at org.elasticsearch.client.RestClient.perfor…

---

## [Index got deleted twice](https://discuss.elastic.co/t/index-got-deleted-twice/179323)

<div class="topic-metadata">

**Author:** [@Arvind\_Sharma](https://discuss.elastic.co/u/Arvind_Sharma)\
**Replies:** 1\
**Last updated:** [May 2, 2019, 10:58am UTC](https://discuss.elastic.co/t/index-got-deleted-twice/179323 "2019-05-02T10:58:30Z")

</div>

Is there any reason why my index can be deleted by itself.This index is quite heavy around 300 mb and having 100,000 + rows. Does elastic removes or clears index by itself in any ways? Thanks in Advance.

---

## [Highlight object field, get related field of that object](https://discuss.elastic.co/t/highlight-object-field-get-related-field-of-that-object/179290)

<div class="topic-metadata">

**Author:** [@Sylvain\_Attoumani](https://discuss.elastic.co/u/Sylvain_Attoumani)\
**Replies:** 3\
**Last updated:** [May 2, 2019, 10:56am UTC](https://discuss.elastic.co/t/highlight-object-field-get-related-field-of-that-object/179290 "2019-05-02T10:56:14Z")

</div>

I'm working with elasticsearch7 and I use highlight in a specific field of an object. My object get 3 attributes : attribute1 attribute2 attribute3 attribute1 and attribute2 are just number. But I want to search in my a…

---

## [Does IndexWriter memory stats account for all memory?](https://discuss.elastic.co/t/does-indexwriter-memory-stats-account-for-all-memory/179309)

<div class="topic-metadata">

**Author:** [@Attila\_Nagy](https://discuss.elastic.co/u/Attila_Nagy)\
**Replies:** 6\
**Last updated:** [May 2, 2019, 10:35am UTC](https://discuss.elastic.co/t/does-indexwriter-memory-stats-account-for-all-memory/179309 "2019-05-02T10:35:42Z")

</div>

Coming from https://github.com/elastic/elasticsearch/issues/41337, I've learnt that IndexWriter holds some memory when scroll contexts are open. The theory is that I have JVM OOMs due to long running scrolls and IndexWr…

---

## [Which one is better schema?](https://discuss.elastic.co/t/which-one-is-better-schema/179164)

<div class="topic-metadata">

**Author:** [@Devon\_Yoo](https://discuss.elastic.co/u/Devon_Yoo)\
**Replies:** 3\
**Last updated:** [May 2, 2019, 8:49am UTC](https://discuss.elastic.co/t/which-one-is-better-schema/179164 "2019-05-02T08:49:45Z")

</div>

I have two options for my Elasticsearch schema Option 1. One data entry for an image. The key is image unique id and the value is a long string of entire list of numbers. "visualwords" : { "image\_id" : { "type" : …

---

## [ELK integration with Sharepoint and SQL server](https://discuss.elastic.co/t/elk-integration-with-sharepoint-and-sql-server/179311)

<div class="topic-metadata">

**Author:** [@Alessio\_Creo](https://discuss.elastic.co/u/Alessio_Creo)\
**Replies:** 2\
**Last updated:** [May 2, 2019, 8:40am UTC](https://discuss.elastic.co/t/elk-integration-with-sharepoint-and-sql-server/179311 "2019-05-02T08:40:49Z")

</div>

Good morning, I need to read the audit Log from MS SQL Server and Sharepoint. Those products doesn't write on the windows event viewer. Is there any known way to collect the data and send it to Elasticsearch from those …

---

## [How to take regular elasticsearch index backup to GCS](https://discuss.elastic.co/t/how-to-take-regular-elasticsearch-index-backup-to-gcs/177859)

<div class="topic-metadata">

**Author:** [@sesha](https://discuss.elastic.co/u/sesha)\
**Replies:** 4\
**Last updated:** [May 2, 2019, 8:24am UTC](https://discuss.elastic.co/t/how-to-take-regular-elasticsearch-index-backup-to-gcs/177859 "2019-05-02T08:24:24Z")

</div>

My Elasticsearch cluster running in kubernetes cluster. Please guide me to config and take regular backup of indexes to GCS from kubernetes pods

---

## [Elasticsearch 6.7.1 & Magento 2.3.1](https://discuss.elastic.co/t/elasticsearch-6-7-1-magento-2-3-1/179305)

<div class="topic-metadata">

**Author:** [@manue](https://discuss.elastic.co/u/manue)\
**Replies:** 0\
**Last updated:** [May 2, 2019, 8:13am UTC](https://discuss.elastic.co/t/elasticsearch-6-7-1-magento-2-3-1/179305 "2019-05-02T08:13:38Z")

</div>

Someone who has experience in Elasticsearch with Magento 2? I have problems to join these two technologies. Now it is necessary to use it with Magento 2.3.1. I am using the version of Elasticsearch 6.7.1 Thank you so mu…

---

## [Failed to find metadata for existing index](https://discuss.elastic.co/t/failed-to-find-metadata-for-existing-index/179190)

<div class="topic-metadata">

**Author:** [@sinoohe](https://discuss.elastic.co/u/sinoohe)\
**Replies:** 3\
**Last updated:** [May 2, 2019, 7:52am UTC](https://discuss.elastic.co/t/failed-to-find-metadata-for-existing-index/179190 "2019-05-02T07:52:08Z")

</div>

I'm having problem on starting elasticsearch I removed a folder by mistake in elasticsearch data folder(/usr/share/elasticsearch/data/nodes/0) and unfortunately it does not start again!! it throws exception. How can I …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1312)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1314)
