# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1520 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1521 --- ## [Is it necessary to use Ingest Attachment Processor to index pdf files](https://discuss.elastic.co/t/is-it-necessary-to-use-ingest-attachment-processor-to-index-pdf-files/148265)
**Author:** [@rahulnama](https://discuss.elastic.co/u/rahulnama)\ **Replies:** 27\ **Last updated:** [October 12, 2018, 4:40am UTC](https://discuss.elastic.co/t/is-it-necessary-to-use-ingest-attachment-processor-to-index-pdf-files/148265 "2018-10-12T04:40:07Z")
Hello All I'm confused whether to use Ingest Attachment processor to index pdf files or not? I'm already converting the pdf to text and extracting the metadata using python. Now I guess I can directly send the text to… --- ## [Adding patterns in ES on AWS, pipeline definition through API](https://discuss.elastic.co/t/adding-patterns-in-es-on-aws-pipeline-definition-through-api/151378)
**Author:** [@bizmate](https://discuss.elastic.co/u/bizmate)\ **Replies:** 5\ **Last updated:** [October 11, 2018, 11:31pm UTC](https://discuss.elastic.co/t/adding-patterns-in-es-on-aws-pipeline-definition-through-api/151378 "2018-10-11T23:31:46Z")
Overall objective conversion from Logstash to Filebeat with ES pipeline, looking for pointers about: Migrate Logstash filters into an ES pipeline Migrated the patterns currently loaded in a directory but as I am using … --- ## [Elasticsearch Index Mapping issues](https://discuss.elastic.co/t/elasticsearch-index-mapping-issues/152096)
**Author:** [@motts](https://discuss.elastic.co/u/motts)\ **Replies:** 1\ **Last updated:** [October 11, 2018, 9:08pm UTC](https://discuss.elastic.co/t/elasticsearch-index-mapping-issues/152096 "2018-10-11T21:08:15Z")
Hello, I am on ES 2.4. I am having issues with my mapping it seems. If i go into Kibana and set my index pattern name, I do not see any ".raw" fields. However, if I change my index pattern to just "\*", then I get to see… --- ## [Why am I getting this \`unexpected byte \[0x10\]\` in the constructor for a custom PluginBuilder?](https://discuss.elastic.co/t/why-am-i-getting-this-unexpected-byte-0x10-in-the-constructor-for-a-custom-pluginbuilder/151760)
**Author:** [@Brett\_Anderson](https://discuss.elastic.co/u/Brett_Anderson)\ **Replies:** 1\ **Last updated:** [October 11, 2018, 8:53pm UTC](https://discuss.elastic.co/t/why-am-i-getting-this-unexpected-byte-0x10-in-the-constructor-for-a-custom-pluginbuilder/151760 "2018-10-11T20:53:45Z")
Using Elasticsearch 5.6.5 I'm getting the following strange error: org.elasticsearch.transport.RemoteTransportException: \[iad1esdn20vz166\]\[x.x.x.x:31203\]\[indices:data/read/search\[phase/query\]\] Caused by: java.lang.Ill… --- ## [Curator Reindex error](https://discuss.elastic.co/t/curator-reindex-error/151120)
**Author:** [@JimP](https://discuss.elastic.co/u/JimP)\ **Replies:** 5\ **Last updated:** [October 11, 2018, 7:46pm UTC](https://discuss.elastic.co/t/curator-reindex-error/151120 "2018-10-11T19:46:21Z")
I'm using painless in my reindex to create the new index name from xxxxx-yyyy.mm.dd to xxxxx-yyyy.mm.dd-ro, and I get the error that the post run quick check failed. I didn't know how to name the destination index witho… --- ## [Search result field name alias](https://discuss.elastic.co/t/search-result-field-name-alias/151913)
**Author:** [@jimyoo](https://discuss.elastic.co/u/jimyoo)\ **Replies:** 2\ **Last updated:** [October 11, 2018, 7:01pm UTC](https://discuss.elastic.co/t/search-result-field-name-alias/151913 "2018-10-11T19:01:07Z")
Hello, I am looking for a way to have a query that returns the name of field differently. Like SQL's " SELECT column\_name AS alias\_name". Feel like there would be an easier solution but only I can think of is using a… --- ## [Warmers in Elasticsearch 1.4](https://discuss.elastic.co/t/warmers-in-elasticsearch-1-4/152090)
**Author:** [@shums42](https://discuss.elastic.co/u/shums42)\ **Replies:** 4\ **Last updated:** [October 11, 2018, 6:56pm UTC](https://discuss.elastic.co/t/warmers-in-elasticsearch-1-4/152090 "2018-10-11T18:56:12Z")
I try to figure out how to use warmers in elasticsearch. I have read a lot of literature about this, but it remains unclear how exactly they work. Can somebody tell what "warming" means? --- ## [5.5.0 - JVM Heap and Garbage Collection issues when executing queries](https://discuss.elastic.co/t/5-5-0-jvm-heap-and-garbage-collection-issues-when-executing-queries/151127)
**Author:** [@awebb](https://discuss.elastic.co/u/awebb)\ **Replies:** 1\ **Last updated:** [October 11, 2018, 6:54pm UTC](https://discuss.elastic.co/t/5-5-0-jvm-heap-and-garbage-collection-issues-when-executing-queries/151127 "2018-10-11T18:54:01Z")
Hi, Hoping someone can point me in the right direction with an issue related to JVM heap and garbage collection issues when executing search queries. Here's what I know so far: Use case Performing queries against an … --- ## [Watcher name and watcher indices name](https://discuss.elastic.co/t/watcher-name-and-watcher-indices-name/149940)
**Author:** [@laurent\_telle](https://discuss.elastic.co/u/laurent_telle)\ **Replies:** 4\ **Last updated:** [October 11, 2018, 5:10pm UTC](https://discuss.elastic.co/t/watcher-name-and-watcher-indices-name/149940 "2018-10-11T17:10:18Z")
Hi, Is it possible to create watchers in a specific watcher name and give access to user only to this watcher indices then only to some specific watcher. watcher user and wtcher admin are too large ! --- ## [Accessing data of the watch itself](https://discuss.elastic.co/t/accessing-data-of-the-watch-itself/151625)
**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\ **Replies:** 6\ **Last updated:** [October 11, 2018, 4:54pm UTC](https://discuss.elastic.co/t/accessing-data-of-the-watch-itself/151625 "2018-10-11T16:54:56Z")
Hello, We are working on some watches and wanted to add the condition threshold in hte output of the html email. Is there a way to access data of the watch itself somehow? For example if this is the condition: "cond… --- ## [How to cope with huge nested fields?](https://discuss.elastic.co/t/how-to-cope-with-huge-nested-fields/152093)
**Author:** [@Milkana\_Stateva](https://discuss.elastic.co/u/Milkana_Stateva)\ **Replies:** 0\ **Last updated:** [October 11, 2018, 4:08pm UTC](https://discuss.elastic.co/t/how-to-cope-with-huge-nested-fields/152093 "2018-10-11T16:08:32Z")
Hi all, We have es 6.x with mapping of nested fields with various values and sizes. Some of the fields contain up to 1M short string values. The user should be able to filter and perform aggregations on them in reasonab… --- ## [Configuring index behavior between insert phase and query phase](https://discuss.elastic.co/t/configuring-index-behavior-between-insert-phase-and-query-phase/152087)
**Author:** [@Nirit\_Levi](https://discuss.elastic.co/u/Nirit_Levi)\ **Replies:** 0\ **Last updated:** [October 11, 2018, 3:43pm UTC](https://discuss.elastic.co/t/configuring-index-behavior-between-insert-phase-and-query-phase/152087 "2018-10-11T15:43:37Z")
Hi all We are struggling how to configure our index behavior between 3 phases it needs to cope with bravely (number of nodes,number of shards,merging segments, sorting the index, and size limitations and any other param… --- ## [My winlogbeat indicies RED](https://discuss.elastic.co/t/my-winlogbeat-indicies-red/151758)
**Author:** [@Serhiy\_H\_V](https://discuss.elastic.co/u/Serhiy_H_V)\ **Replies:** 2\ **Last updated:** [October 11, 2018, 3:01pm UTC](https://discuss.elastic.co/t/my-winlogbeat-indicies-red/151758 "2018-10-11T15:01:59Z")
Hi! After upgrade my ELK. Something wrong happened with my indicies winlogbeat,auditbeat,logstash(Status RED) I have 32GB of free space on file system. Settings: { "settings": { "index": { "codec": "best\_compres… --- ## [Update Nested field](https://discuss.elastic.co/t/update-nested-field/152078)
**Author:** [@Andreas\_Bakopoulos](https://discuss.elastic.co/u/Andreas_Bakopoulos)\ **Replies:** 0\ **Last updated:** [October 11, 2018, 2:53pm UTC](https://discuss.elastic.co/t/update-nested-field/152078 "2018-10-11T14:53:41Z")
Hello, I need to update all documents where a nested field of them has a certain value. The structure of the nested filed is the following: "categories": { "type": "nested", "properties": { "description": { "type"… --- ## [Multiple Dependent Signals Function Score Query](https://discuss.elastic.co/t/multiple-dependent-signals-function-score-query/152076)
**Author:** [@Sandeep42](https://discuss.elastic.co/u/Sandeep42)\ **Replies:** 0\ **Last updated:** [October 11, 2018, 2:48pm UTC](https://discuss.elastic.co/t/multiple-dependent-signals-function-score-query/152076 "2018-10-11T14:48:23Z")
Hi, I would like to do a non-trivial function\_score query for the domain in which I am working on. Let me try to explain you what I'm trying to achieve. Let's say you have an inventory of Apples. Each day, you get a ne… --- ## [X-pack configuration files](https://discuss.elastic.co/t/x-pack-configuration-files/151801)
**Author:** [@Stefano\_Bossi](https://discuss.elastic.co/u/Stefano_Bossi)\ **Replies:** 2\ **Last updated:** [October 11, 2018, 2:29pm UTC](https://discuss.elastic.co/t/x-pack-configuration-files/151801 "2018-10-11T14:29:40Z")
Dear ES community, I have recently upgraded my cluster from 6.2 to 6.4, everything was fine but now I want to clean up the old x-pack configuration files. I read the /etc/elasticsearch/x-pack directory is now deprecate… --- ## [Create indexs in elasticsearch using logstash & filebeat](https://discuss.elastic.co/t/create-indexs-in-elasticsearch-using-logstash-filebeat/152071)
**Author:** [@bob\_ve](https://discuss.elastic.co/u/bob_ve)\ **Replies:** 0\ **Last updated:** [October 11, 2018, 2:26pm UTC](https://discuss.elastic.co/t/create-indexs-in-elasticsearch-using-logstash-filebeat/152071 "2018-10-11T14:26:09Z")
I was not able to see any data or any indexs in elasticsearch . I was using filebeat --\> logstash --\> elasticsearch filebeat.yml filebeat.inputs: -\> type: log paths: - /var/log/hadoop/hadoop/hive/gc.log\* document\_… --- ## [Custom plugin integration with elasticsearch](https://discuss.elastic.co/t/custom-plugin-integration-with-elasticsearch/152041)
**Author:** [@raoga3](https://discuss.elastic.co/u/raoga3)\ **Replies:** 2\ **Last updated:** [October 11, 2018, 2:08pm UTC](https://discuss.elastic.co/t/custom-plugin-integration-with-elasticsearch/152041 "2018-10-11T14:08:19Z")
I have developed a custom search plugin which runs perfectly fine with elasticsearch version 6.2.4. I am aware that to have a smooth run for versions above 6.2.4, I need to recompile my plugin with that version. Out of c… --- ## [Upgrade assistant - how does the reindex helper work?](https://discuss.elastic.co/t/upgrade-assistant-how-does-the-reindex-helper-work/152067)
**Author:** [@juiip](https://discuss.elastic.co/u/juiip)\ **Replies:** 0\ **Last updated:** [October 11, 2018, 2:06pm UTC](https://discuss.elastic.co/t/upgrade-assistant-how-does-the-reindex-helper-work/152067 "2018-10-11T14:06:05Z")
Hi, I am in the process of planning the migration of our current Elasticsearch cluster (version 5.2), to version 6.x. Firstly, I was thinking to upgrade to 5.6 in order to have use of Kibana's upgrade assistant. Howeve… --- ## [Docker ElasticSearch: Load Template After Start](https://discuss.elastic.co/t/docker-elasticsearch-load-template-after-start/152065)
**Author:** [@rhino](https://discuss.elastic.co/u/rhino)\ **Replies:** 0\ **Last updated:** [October 11, 2018, 2:00pm UTC](https://discuss.elastic.co/t/docker-elasticsearch-load-template-after-start/152065 "2018-10-11T14:00:56Z")
Hello Community! Is there any solution to load the template directly after the docker container's start so it does not need to be loaded manually? Any help changing entrypoint or anything else would be very appreciated. … --- ## [Is there any way to find out ES data redundancy coefficient](https://discuss.elastic.co/t/is-there-any-way-to-find-out-es-data-redundancy-coefficient/152058)
**Author:** [@74db36a597f21b891b3f](https://discuss.elastic.co/u/74db36a597f21b891b3f)\ **Replies:** 0\ **Last updated:** [October 11, 2018, 1:38pm UTC](https://discuss.elastic.co/t/is-there-any-way-to-find-out-es-data-redundancy-coefficient/152058 "2018-10-11T13:38:06Z")
Hi there. Trying to count how many HDD do I need for ES cluster. Here is the couple of related questions: Is there any way to find out how much HDD space will need ES to store all data with certain index configuration… --- ## [Why can kibana\_dashboard\_only\_user hide navigation menu items but a custom role cannot?](https://discuss.elastic.co/t/why-can-kibana-dashboard-only-user-hide-navigation-menu-items-but-a-custom-role-cannot/151961)
**Author:** [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\ **Replies:** 3\ **Last updated:** [October 11, 2018, 1:28pm UTC](https://discuss.elastic.co/t/why-can-kibana-dashboard-only-user-hide-navigation-menu-items-but-a-custom-role-cannot/151961 "2018-10-11T13:28:30Z")
Hi I've been breaking my head over this for two days and I just can't figure it out. For whatever reason the kibana\_dashboard\_only user role can hides all navigation menus except for the dashboard button (good). If I … --- ## [MS SQL to Elastisearch](https://discuss.elastic.co/t/ms-sql-to-elastisearch/151361)
**Author:** [@Haitam\_Dadsi](https://discuss.elastic.co/u/Haitam_Dadsi)\ **Replies:** 1\ **Last updated:** [October 11, 2018, 1:10pm UTC](https://discuss.elastic.co/t/ms-sql-to-elastisearch/151361 "2018-10-11T13:10:44Z")
Hi guys, i need to create visualizations for ms sql Data , and i found out that it is possible to duplicate data into elasticsearch , Questions : How does elasticsearch manages relations between tables ? And what are thi… --- ## [\[Logstash\] ElasticSearch unrecheable](https://discuss.elastic.co/t/logstash-elasticsearch-unrecheable/151932)
**Author:** [@Dani\_Pinol](https://discuss.elastic.co/u/Dani_Pinol)\ **Replies:** 2\ **Last updated:** [October 11, 2018, 12:53pm UTC](https://discuss.elastic.co/t/logstash-elasticsearch-unrecheable/151932 "2018-10-11T12:53:01Z")
Hi, My ELK stack has been running great for months, until recently. I've been receiving the following error: timestamp=\>"2018-10-10T22:00:08.928000+0200", :message=\>"Attempted to send a bulk request to Elasticsearch co… --- ## [Parsing resume for relevance against job description](https://discuss.elastic.co/t/parsing-resume-for-relevance-against-job-description/151535)
**Author:** [@madhurtelang](https://discuss.elastic.co/u/madhurtelang)\ **Replies:** 4\ **Last updated:** [October 11, 2018, 12:50pm UTC](https://discuss.elastic.co/t/parsing-resume-for-relevance-against-job-description/151535 "2018-10-11T12:50:10Z")
Hi, I have a use case where I have to compare resume documents (ms word, pdf) against job description. Since resumes are highly unstructured documents, I am struggling to clean up the documents, removing invalid charact… --- ## [I lose entries when using the Watcher Index Action](https://discuss.elastic.co/t/i-lose-entries-when-using-the-watcher-index-action/151184)
**Author:** [@humalog](https://discuss.elastic.co/u/humalog)\ **Replies:** 9\ **Last updated:** [October 11, 2018, 12:43pm UTC](https://discuss.elastic.co/t/i-lose-entries-when-using-the-watcher-index-action/151184 "2018-10-11T12:43:43Z")
Hi, i want to build a warning system if there are too many failed logins. I want to index the entries, which appear in auth.log into a new index. I build an index with input { file { path =\> "/var/log/auth.… --- ## [Json serialization exception using aggregation in java](https://discuss.elastic.co/t/json-serialization-exception-using-aggregation-in-java/152047)
**Author:** [@saket\_satpute1](https://discuss.elastic.co/u/saket_satpute1)\ **Replies:** 0\ **Last updated:** [October 11, 2018, 12:29pm UTC](https://discuss.elastic.co/t/json-serialization-exception-using-aggregation-in-java/152047 "2018-10-11T12:29:47Z")
I was trying to create a rest api point for aggregation in elasticsearch using spring data elasticsearch. I am able to get the data in service layer but when controller (i.e. @RestController) is trying to return it to po… --- ## [Delete data by beat.name](https://discuss.elastic.co/t/delete-data-by-beat-name/151860)
**Author:** [@faulander](https://discuss.elastic.co/u/faulander)\ **Replies:** 12\ **Last updated:** [October 11, 2018, 12:03pm UTC](https://discuss.elastic.co/t/delete-data-by-beat-name/151860 "2018-10-11T12:03:49Z")
Hi Guys, Can you point me in the right direction when i want to delete data from a given hostname or beatname? i tried: POST metricbeat-6.4.0-2018.10.10/\_delete\_by\_query { "query": { "match": { "term" : {… --- ## [Elasticsearch - How to list exact match at the top](https://discuss.elastic.co/t/elasticsearch-how-to-list-exact-match-at-the-top/151251)
**Author:** [@somethingyouwant](https://discuss.elastic.co/u/somethingyouwant)\ **Replies:** 3\ **Last updated:** [October 10, 2018, 8:07am UTC](https://discuss.elastic.co/t/elasticsearch-how-to-list-exact-match-at-the-top/151251 "2018-10-10T08:07:58Z")
I am searching the word "Adana" in Elasticsearch and want it to come at top because it is the exact word, but it doesn't. Instead "Bilmemne Adana Otel" comes at top. Normal query doesn't do any good so I tried the bool… --- ## [Searching for matching fields](https://discuss.elastic.co/t/searching-for-matching-fields/148572)
**Author:** [@parosio](https://discuss.elastic.co/u/parosio)\ **Replies:** 4\ **Last updated:** [October 11, 2018, 11:48am UTC](https://discuss.elastic.co/t/searching-for-matching-fields/148572 "2018-10-11T11:48:03Z")
Hello, I'm trying to figure out if there's a way to query an index to retrieve the documents where field\_A = field\_B... Using data from https://demo.elastic.co (kibana\_sample\_data\_flights) Sort of (in SQL): select Or… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1519) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1521)