# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1703 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1704 --- ## [Unstructured Data - office documents, videos, pdfs, etc](https://discuss.elastic.co/t/unstructured-data-office-documents-videos-pdfs-etc/130054)
**Author:** [@dtreiber](https://discuss.elastic.co/u/dtreiber)\ **Replies:** 2\ **Last updated:** [April 30, 2018, 8:41pm UTC](https://discuss.elastic.co/t/unstructured-data-office-documents-videos-pdfs-etc/130054 "2018-04-30T20:41:23Z")
There appears to be mixed opinions on the use of Elastic Search for unstructured data search so I thought I would ask this group. Scenario - looking at replacing a GSA solution with an alternative search solution for an… --- ## [Difference between score of 0 and score of 1 for filtered queries (using bool query with filter vs constant\_score query with filter)](https://discuss.elastic.co/t/difference-between-score-of-0-and-score-of-1-for-filtered-queries-using-bool-query-with-filter-vs-constant-score-query-with-filter/129958)
**Author:** [@spynxo](https://discuss.elastic.co/u/spynxo)\ **Replies:** 2\ **Last updated:** [April 30, 2018, 7:21pm UTC](https://discuss.elastic.co/t/difference-between-score-of-0-and-score-of-1-for-filtered-queries-using-bool-query-with-filter-vs-constant-score-query-with-filter/129958 "2018-04-30T19:21:05Z")
Hello, Is there a difference between a score of 0 and a score of 1 in a filtered query. I am trying to decide which query to use. I would like to submit the queries under the filter context as it should be more performa… --- ## [Combine two queries](https://discuss.elastic.co/t/combine-two-queries/126637)
**Author:** [@subrato](https://discuss.elastic.co/u/subrato)\ **Replies:** 8\ **Last updated:** [April 30, 2018, 6:23pm UTC](https://discuss.elastic.co/t/combine-two-queries/126637 "2018-04-30T18:23:53Z")
I need to combine 2 queries and I am not sure how to do it. I have one field which has site names (we have few properties that I am scraping and putting cleaned html from it into Elastic Search) and few other fields (con… --- ## [Passing doc values as parameters to scripts](https://discuss.elastic.co/t/passing-doc-values-as-parameters-to-scripts/129741)
**Author:** [@Fullar\_Senjit](https://discuss.elastic.co/u/Fullar_Senjit)\ **Replies:** 1\ **Last updated:** [April 30, 2018, 5:09pm UTC](https://discuss.elastic.co/t/passing-doc-values-as-parameters-to-scripts/129741 "2018-04-30T17:09:47Z")
Is this possible ? GET hockey/player/\_search { "query": { "match\_all": {} }, "script\_fields": { "date\_add\_days\_script": { "script": { "id": "date\_add\_days", "params": { "days": 5, "curmillis": "doc\['born'\].v… --- ## [Exception when installing S3 plugin](https://discuss.elastic.co/t/exception-when-installing-s3-plugin/130010)
**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\ **Replies:** 4\ **Last updated:** [April 30, 2018, 4:29pm UTC](https://discuss.elastic.co/t/exception-when-installing-s3-plugin/130010 "2018-04-30T16:29:11Z")
I’ve received the following exception when trying to install the S3 plugin on one of the new nodes. I was able to install it on my older nodes and don’t recall running into this problem before. OS: Ubuntu 18.04 LTS JRE… --- ## [Error when loading the json file with the curl command](https://discuss.elastic.co/t/error-when-loading-the-json-file-with-the-curl-command/129530)
**Author:** [@Enonimous8](https://discuss.elastic.co/u/Enonimous8)\ **Replies:** 8\ **Last updated:** [April 30, 2018, 4:22pm UTC](https://discuss.elastic.co/t/error-when-loading-the-json-file-with-the-curl-command/129530 "2018-04-30T16:22:57Z")
Hi, I have to analyze some packages captured with wireshark on kibana. To do this I am following the guide: https://www.elastic.co/blog/analyzing-network-packets-with-wireshark-elasticsearch-and-kibana The problem occu… --- ## [Machine Learning functions](https://discuss.elastic.co/t/machine-learning-functions/129990)
**Author:** [@mkemalm](https://discuss.elastic.co/u/mkemalm)\ **Replies:** 1\ **Last updated:** [April 30, 2018, 4:22pm UTC](https://discuss.elastic.co/t/machine-learning-functions/129990 "2018-04-30T16:22:04Z")
Hi, in ML jobs functions are categorized in three groups; function itself, low function and high function. For example sum, low sum, high sum. ELK documents explain those functions as; function itself detects anomalies… --- ## [Why is doc\_count\_error\_upper\_bound negative?](https://discuss.elastic.co/t/why-is-doc-count-error-upper-bound-negative/130021)
**Author:** [@arunravimv](https://discuss.elastic.co/u/arunravimv)\ **Replies:** 1\ **Last updated:** [April 30, 2018, 4:17pm UTC](https://discuss.elastic.co/t/why-is-doc-count-error-upper-bound-negative/130021 "2018-04-30T16:17:29Z")
From the documentation, I was expecting this value to be anything greater than or equal to 0. Please correct me if am wrong and kindly explain (or point to a documentation) when it would be negative. Attached below is m… --- ## [Compute capacity needed to handle 5000 msg/sec and 20000 flow/min](https://discuss.elastic.co/t/compute-capacity-needed-to-handle-5000-msg-sec-and-20000-flow-min/130027)
**Author:** [@Suresh\_RS](https://discuss.elastic.co/u/Suresh_RS)\ **Replies:** 1\ **Last updated:** [April 30, 2018, 4:02pm UTC](https://discuss.elastic.co/t/compute-capacity-needed-to-handle-5000-msg-sec-and-20000-flow-min/130027 "2018-04-30T16:02:24Z")
We need to collect 5000 msg/sec and and 20000 flow/min from multiple VMs,What will be the compute capacity (CPU,RAM) needed for Logstash and elasticsearch? --- ## [How to gracefully stop or reload a node?](https://discuss.elastic.co/t/how-to-gracefully-stop-or-reload-a-node/130039)
**Author:** [@Sylmarch](https://discuss.elastic.co/u/Sylmarch)\ **Replies:** 1\ **Last updated:** [April 30, 2018, 4:00pm UTC](https://discuss.elastic.co/t/how-to-gracefully-stop-or-reload-a-node/130039 "2018-04-30T16:00:40Z")
AFAIK, when you update the elasticsearch.yml configuration file, the only way to apply the changes is to restart your node. Thus, does it exist a gracefully stop/reload process for a node? I mean something like tagging… --- ## [Cannot get curator to rollover an index](https://discuss.elastic.co/t/cannot-get-curator-to-rollover-an-index/130031)
**Author:** [@Badger](https://discuss.elastic.co/u/Badger)\ **Replies:** 2\ **Last updated:** [April 30, 2018, 3:20pm UTC](https://discuss.elastic.co/t/cannot-get-curator-to-rollover-an-index/130031 "2018-04-30T15:20:58Z")
I have a feeling there is going to be a forehead slapping moment here, but anyways... I am trying to rollover indexes based on size, and I cannot get it to work. The alias name I want to rollover is logstash-production, … --- ## [Help setting up bulk index](https://discuss.elastic.co/t/help-setting-up-bulk-index/130024)
**Author:** [@aswamina](https://discuss.elastic.co/u/aswamina)\ **Replies:** 5\ **Last updated:** [April 30, 2018, 2:29pm UTC](https://discuss.elastic.co/t/help-setting-up-bulk-index/130024 "2018-04-30T14:29:29Z")
Hi, I have a sample index called "restaurants" with an explicit mapping as follows { "mappings": { "categories": { "\_source": { "enabled": true }, "numeric\_detection": true, "date\_detection": true, "properties"… --- ## [Retrieving query\_score while using "replace" in the function\_score query](https://discuss.elastic.co/t/retrieving-query-score-while-using-replace-in-the-function-score-query/130034)
**Author:** [@xan\_ps](https://discuss.elastic.co/u/xan_ps)\ **Replies:** 0\ **Last updated:** [April 30, 2018, 2:17pm UTC](https://discuss.elastic.co/t/retrieving-query-score-while-using-replace-in-the-function-score-query/130034 "2018-04-30T14:17:00Z")
Using "replace" in the Elasticsearch function score discards the query\_score altogether. "only function score is used, the query score is ignored". In my requirement, I do want the "replace" as I'm sorting based ONLY o… --- ## ["Permission Denied" starting Elasticsearch](https://discuss.elastic.co/t/permission-denied-starting-elasticsearch/129882)
**Author:** [@Josh\_McDonald](https://discuss.elastic.co/u/Josh_McDonald)\ **Replies:** 5\ **Last updated:** [April 30, 2018, 1:31pm UTC](https://discuss.elastic.co/t/permission-denied-starting-elasticsearch/129882 "2018-04-30T13:31:26Z")
I am trying to start Elasticsearch and I'm getting an error: /usr/share/elasticsearch/bin/elasticsearch-env: line 70: /etc/default/elasticsearch: Permission denied --- ## [Curator system indices](https://discuss.elastic.co/t/curator-system-indices/130006)
**Author:** [@flochon](https://discuss.elastic.co/u/flochon)\ **Replies:** 4\ **Last updated:** [April 30, 2018, 12:54pm UTC](https://discuss.elastic.co/t/curator-system-indices/130006 "2018-04-30T12:54:24Z")
Hello, I use the curator for Elasticsearch and it runs properly for my indices. I want add to this curator the possibility to delete system indices but I don't know how to make that. Do you have some ideas ? --- ## [Elasticsearch query to fetch the metricbeat data](https://discuss.elastic.co/t/elasticsearch-query-to-fetch-the-metricbeat-data/130015)
**Author:** [@niraj\_pandey](https://discuss.elastic.co/u/niraj_pandey)\ **Replies:** 0\ **Last updated:** [April 30, 2018, 10:47am UTC](https://discuss.elastic.co/t/elasticsearch-query-to-fetch-the-metricbeat-data/130015 "2018-04-30T10:47:49Z")
Hi , i am trying to pull metricbeat data through python elasticsearch module. Here is the query res = elasticsearch.search(index='metricbeat-\*',size=10000,body={"sort": \[{"@timestamp": {"order": "desc"}}\],"query":{"mat… --- ## [Retrieve aggregation results after processing filters not working](https://discuss.elastic.co/t/retrieve-aggregation-results-after-processing-filters-not-working/129419)
**Author:** [@Islam\_Elshobokshy](https://discuss.elastic.co/u/Islam_Elshobokshy)\ **Replies:** 2\ **Last updated:** [April 30, 2018, 10:47am UTC](https://discuss.elastic.co/t/retrieve-aggregation-results-after-processing-filters-not-working/129419 "2018-04-30T10:47:42Z")
So I've got a query. It makes a few filters and then add an aggregations. ... $query-\>setFilter($bool) ... $query-\>setFilter($bool) ... $query-\>setFilter($bool) $agg = new Elastica\\Aggregation\\Terms('agg\_name'); $agg-\>s… --- ## [Storage gets full](https://discuss.elastic.co/t/storage-gets-full/130011)
**Author:** [@rrs](https://discuss.elastic.co/u/rrs)\ **Replies:** 0\ **Last updated:** [April 30, 2018, 10:33am UTC](https://discuss.elastic.co/t/storage-gets-full/130011 "2018-04-30T10:33:29Z")
Hi All, We have elasticsearch-2.3.3-1 installed on standalone host where it is running fine. From past few days the elasticsearch data filling my local 400GB drive, which can't be expanded, very fast and we are unable t… --- ## [Cannot connect to ES remotely even with ufw firewall](https://discuss.elastic.co/t/cannot-connect-to-es-remotely-even-with-ufw-firewall/129951)
**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\ **Replies:** 2\ **Last updated:** [April 30, 2018, 10:26am UTC](https://discuss.elastic.co/t/cannot-connect-to-es-remotely-even-with-ufw-firewall/129951 "2018-04-30T10:26:44Z")
I have configured Elasticsearch to bind to localhost:9200 on the DB server, then allow my app server to connect to it with ufw. However, when I try to curl the DB server from my app server, I am unable to connect to it. … --- ## [Is it possible to index a file with a size of 26GB in elasticsearch?](https://discuss.elastic.co/t/is-it-possible-to-index-a-file-with-a-size-of-26gb-in-elasticsearch/129831)
**Author:** [@Michel\_Budimbu-Esuku](https://discuss.elastic.co/u/Michel_Budimbu-Esuku)\ **Replies:** 4\ **Last updated:** [April 30, 2018, 9:09am UTC](https://discuss.elastic.co/t/is-it-possible-to-index-a-file-with-a-size-of-26gb-in-elasticsearch/129831 "2018-04-30T09:09:36Z")
Hello everybody I have a mbox file with a size of 26 GB (this file is called bigFile.mbox). I want to index bigFile.mbox in Elasticsearch. How can I do ? Here's what I tried to put in place: 1.I started writing a pyt… --- ## [Need some help with Ingest Attachment plugin](https://discuss.elastic.co/t/need-some-help-with-ingest-attachment-plugin/129948)
**Author:** [@kanon123](https://discuss.elastic.co/u/kanon123)\ **Replies:** 5\ **Last updated:** [April 30, 2018, 8:29am UTC](https://discuss.elastic.co/t/need-some-help-with-ingest-attachment-plugin/129948 "2018-04-30T08:29:21Z")
Hi, I got the plugin to work, i can take PDF file and index it using base64. I wanted to know if there is any way to analyze the PDF text and get the words count or get the keywords. Thanks. --- ## [Nested query with date range and exists returns incorrect result](https://discuss.elastic.co/t/nested-query-with-date-range-and-exists-returns-incorrect-result/129991)
**Author:** [@GustavoCaso](https://discuss.elastic.co/u/GustavoCaso)\ **Replies:** 0\ **Last updated:** [April 30, 2018, 7:49am UTC](https://discuss.elastic.co/t/nested-query-with-date-range-and-exists-returns-incorrect-result/129991 "2018-04-30T07:49:03Z")
I'm using ElasticSearch 2.3.0 Hi I have a document with this mapping { "profiles\_development\_20180430093459665":{ "mappings":{ "profile":{ "\_all":{ "anal… --- ## [Wikipedia River Plugin for Elasticsearch](https://discuss.elastic.co/t/wikipedia-river-plugin-for-elasticsearch/129799)
**Author:** [@asmael](https://discuss.elastic.co/u/asmael)\ **Replies:** 4\ **Last updated:** [April 30, 2018, 7:48am UTC](https://discuss.elastic.co/t/wikipedia-river-plugin-for-elasticsearch/129799 "2018-04-30T07:48:31Z")
hello , I'm using elasticsearch version 6.2.3 and I want to install the wikipedia river plugin in order to do the externel search. I'm wondering if this plugin exist in this version of ES can any one help me with insta… --- ## [Frequently gc in one node](https://discuss.elastic.co/t/frequently-gc-in-one-node/129199)
**Author:** [@andrewliuxxx](https://discuss.elastic.co/u/andrewliuxxx)\ **Replies:** 5\ **Last updated:** [April 30, 2018, 6:50am UTC](https://discuss.elastic.co/t/frequently-gc-in-one-node/129199 "2018-04-30T06:50:26Z")
I have a cluster with 120 nodes on 60 machines( 2 nodes on 1 machine). the version is 6.1.3. The cluster do nothing but indexing with a speed 1 million records every second. Several nodes will be out of memory about 5… --- ## [Too many dynamic script compilations within one minute](https://discuss.elastic.co/t/too-many-dynamic-script-compilations-within-one-minute/128956)
**Author:** [@idmanish](https://discuss.elastic.co/u/idmanish)\ **Replies:** 15\ **Last updated:** [April 30, 2018, 3:47am UTC](https://discuss.elastic.co/t/too-many-dynamic-script-compilations-within-one-minute/128956 "2018-04-30T03:47:06Z")
I am facing "max\_compilations\_per\_minute" error. TransportError(500, '{"error":{"root\_cause":\[{"type":"circuit\_breaking\_exception","reason":"\[script\] Too many dynamic script compilations within one minute, max: \[15/min\]… --- ## [Customize which tab of kibana can be shown](https://discuss.elastic.co/t/customize-which-tab-of-kibana-can-be-shown/129215)
**Author:** [@Ahmed\_Gamal1](https://discuss.elastic.co/u/Ahmed_Gamal1)\ **Replies:** 2\ **Last updated:** [April 30, 2018, 1:35am UTC](https://discuss.elastic.co/t/customize-which-tab-of-kibana-can-be-shown/129215 "2018-04-30T01:35:04Z")
As the title, I need to give my client access to kibana but he cannot see any tabs on the left instead of discover and dashboard, I can't find any article/doc that can help to this level of customization , any support p… --- ## [Curator rollover with max\_size](https://discuss.elastic.co/t/curator-rollover-with-max-size/129966)
**Author:** [@vonpelz](https://discuss.elastic.co/u/vonpelz)\ **Replies:** 5\ **Last updated:** [April 29, 2018, 9:01pm UTC](https://discuss.elastic.co/t/curator-rollover-with-max-size/129966 "2018-04-29T21:01:12Z")
I'd like to use rollover to roll over indices when they get larger than 5GB. I have an index called metricbeat that is constantly being written to. How do I rollover this to, say metricbeat-1, next time metricbeat-2, et… --- ## [Date doesn't seem to work with date\_histogram](https://discuss.elastic.co/t/date-doesnt-seem-to-work-with-date-histogram/129515)
**Author:** [@himberjack](https://discuss.elastic.co/u/himberjack)\ **Replies:** 2\ **Last updated:** [April 29, 2018, 7:25pm UTC](https://discuss.elastic.co/t/date-doesnt-seem-to-work-with-date-histogram/129515 "2018-04-29T19:25:01Z")
We've made a template that has: "properties": { "timestamp": { "type": "date", "format": "epoch\_second" }, When reading the \_mapping we get: "timestamp": { "type": "long" } We are unable to do date\_histogra… --- ## [Runtime Error on Terms Aggregation using Split Function](https://discuss.elastic.co/t/runtime-error-on-terms-aggregation-using-split-function/129967)
**Author:** [@Willian\_Fuks](https://discuss.elastic.co/u/Willian_Fuks)\ **Replies:** 0\ **Last updated:** [April 29, 2018, 4:50pm UTC](https://discuss.elastic.co/t/runtime-error-on-terms-aggregation-using-split-function/129967 "2018-04-29T16:50:50Z")
Hello, I just asked for help at SO and decided to ask here as well. I'm using a docker image ES 6.2.3 and a Python client to interact with ES. Created a mapping for testing like so: mapping = { 'settings': { … --- ## [Tie\_breaker - way to exclude same field analyzed using different analyzers in multi\_field](https://discuss.elastic.co/t/tie-breaker-way-to-exclude-same-field-analyzed-using-different-analyzers-in-multi-field/129568)
**Author:** [@Atul\_Bagga](https://discuss.elastic.co/u/Atul_Bagga)\ **Replies:** 0\ **Last updated:** [April 25, 2018, 8:44pm UTC](https://discuss.elastic.co/t/tie-breaker-way-to-exclude-same-field-analyzed-using-different-analyzers-in-multi-field/129568 "2018-04-25T20:44:31Z")
I have a mapping where name is analyzed using different analyzers standard, whitespace, custom (for camelcase) which makes it 3 different sub fields for name. When I use tie\_breaker option in multimatch query to have su… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1702) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1704)