# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1853 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1854 --- ## [Filter Data According to TImeStamp Difference](https://discuss.elastic.co/t/filter-data-according-to-timestamp-difference/110679)
**Author:** [@mohannadsalem](https://discuss.elastic.co/u/mohannadsalem)\ **Replies:** 1\ **Last updated:** [December 15, 2017, 9:12am UTC](https://discuss.elastic.co/t/filter-data-according-to-timestamp-difference/110679 "2017-12-15T09:12:09Z")
I am trying to apply a script to grab the difference between two records with this format { "\_index": "test", "\_type": "test", "\_id": "AWAwn3lqptselg3AANJ3", "\_score": 3.0308797, "\_source": { "timestamp": 15123855… --- ## [Transport client type mapping not working](https://discuss.elastic.co/t/transport-client-type-mapping-not-working/111932)
**Author:** [@nadiGam](https://discuss.elastic.co/u/nadiGam)\ **Replies:** 0\ **Last updated:** [December 15, 2017, 9:09am UTC](https://discuss.elastic.co/t/transport-client-type-mapping-not-working/111932 "2017-12-15T09:09:32Z")
I posted the question in stack overflow Thnxx --- ## [Fscrawler FATAL \[f.p.e.c.f.FsCrawler\] Fatal error received while running the crawler: \[listener timeout after waiting for \[30000\] ms\]](https://discuss.elastic.co/t/fscrawler-fatal-f-p-e-c-f-fscrawler-fatal-error-received-while-running-the-crawler-listener-timeout-after-waiting-for-30000-ms/111067)
**Author:** [@wuwo1952368901](https://discuss.elastic.co/u/wuwo1952368901)\ **Replies:** 1\ **Last updated:** [December 15, 2017, 8:53am UTC](https://discuss.elastic.co/t/fscrawler-fatal-f-p-e-c-f-fscrawler-fatal-error-received-while-running-the-crawler-listener-timeout-after-waiting-for-30000-ms/111067 "2017-12-15T08:53:11Z")
open 127.0.0.1:8080 is no working. my setting file: { "name" : "job\_name", "fs" : { "url" : "E:\\winlogbeat", "update\_rate" : "1m", "json\_support" : false, "filename\_as\_id" : false, "add\_filesize" : true, "remov… --- ## [How to use elasticsearch as a graph query solution](https://discuss.elastic.co/t/how-to-use-elasticsearch-as-a-graph-query-solution/111924)
**Author:** [@bryan\_rasmussen](https://discuss.elastic.co/u/bryan_rasmussen)\ **Replies:** 0\ **Last updated:** [December 15, 2017, 8:38am UTC](https://discuss.elastic.co/t/how-to-use-elasticsearch-as-a-graph-query-solution/111924 "2017-12-15T08:38:26Z")
I would like to get examples of how I should structure this data, and queries of it: Assuming I have a graph with Nodes NodeA, NodeB, NodeC PropA, PropB, PropC, PropD The prop nodes are properties of the Node nodes, … --- ## [X-pack basic](https://discuss.elastic.co/t/x-pack-basic/108709)
**Author:** [@GambitK](https://discuss.elastic.co/u/GambitK)\ **Replies:** 14\ **Last updated:** [December 15, 2017, 8:19am UTC](https://discuss.elastic.co/t/x-pack-basic/108709 "2017-12-15T08:19:29Z")
I've recently registered for a basic license of x-pack and tried installing it without luck. I only want the kibana UI feature for logstash that's available in the basic license. I don't want authentication. Is it possi… --- ## [ElasticSearch on Azure - How to Logstash and install plugins?](https://discuss.elastic.co/t/elasticsearch-on-azure-how-to-logstash-and-install-plugins/111300)
**Author:** [@Joff](https://discuss.elastic.co/u/Joff)\ **Replies:** 2\ **Last updated:** [December 15, 2017, 8:07am UTC](https://discuss.elastic.co/t/elasticsearch-on-azure-how-to-logstash-and-install-plugins/111300 "2017-12-15T08:07:32Z")
Hi, We are trying to develop a PoC for Elastic on Azure Cloud We installed the Elastic template from Azure Marketplace, selected 3 nodes and now we have following configuration: 1 Kibana VM 3 Data VM 3 Master VM Wh… --- ## [Ideal heap size for large RAM machine](https://discuss.elastic.co/t/ideal-heap-size-for-large-ram-machine/111915)
**Author:** [@vivek7mehta](https://discuss.elastic.co/u/vivek7mehta)\ **Replies:** 3\ **Last updated:** [December 15, 2017, 7:45am UTC](https://discuss.elastic.co/t/ideal-heap-size-for-large-ram-machine/111915 "2017-12-15T07:45:19Z")
As suggested here: https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html I should give leas than half of my memory to Lucene. It also suggests that I says that I should not assign more than 32GB … --- ## [Is it OK to rolling upgrade ES version by version?](https://discuss.elastic.co/t/is-it-ok-to-rolling-upgrade-es-version-by-version/111883)
**Author:** [@Morriaty](https://discuss.elastic.co/u/Morriaty)\ **Replies:** 2\ **Last updated:** [December 15, 2017, 6:47am UTC](https://discuss.elastic.co/t/is-it-ok-to-rolling-upgrade-es-version-by-version/111883 "2017-12-15T06:47:16Z")
I mean version 5.5 rolling upgrade to 5.6 and then to 6.0. --- ## [I have wrote a query in elastic search, but it shows data ffrom 5:00 am only.Before that 12:00 AM to 04:00 AM data, it does not shows.Why it it like that only?it is problem due to time -zone or what?Kindly provide some suggestions.I am pasting query:](https://discuss.elastic.co/t/i-have-wrote-a-query-in-elastic-search-but-it-shows-data-ffrom-5-00-am-only-before-that-12-00-am-to-04-00-am-data-it-does-not-shows-why-it-it-like-that-only-it-is-problem-due-to-time-zone-or-what-kindly-provide-some-suggestions-i-am-pasting-query/109347)
**Author:** [@vinayak](https://discuss.elastic.co/u/vinayak)\ **Replies:** 12\ **Last updated:** [December 15, 2017, 5:55am UTC](https://discuss.elastic.co/t/i-have-wrote-a-query-in-elastic-search-but-it-shows-data-ffrom-5-00-am-only-before-that-12-00-am-to-04-00-am-data-it-does-not-shows-why-it-it-like-that-only-it-is-problem-due-to-time-zone-or-what-kindly-provide-some-suggestions-i-am-pasting-query/109347 "2017-12-15T05:55:16Z")
POST alertbrowser/\_search?filter\_path=aggregations.hourlyData.buckets { "query":{ "bool":{ "must": \[ { "match": { "projectId": "aasish-webdemo-1-1498031057532" } … --- ## [X PACK Report Formatting 5.5.2 Issues](https://discuss.elastic.co/t/x-pack-report-formatting-5-5-2-issues/111470)
**Author:** [@tamisalex](https://discuss.elastic.co/u/tamisalex)\ **Replies:** 1\ **Last updated:** [December 15, 2017, 3:13am UTC](https://discuss.elastic.co/t/x-pack-report-formatting-5-5-2-issues/111470 "2017-12-15T03:13:50Z")
I'm having issues exporting some visualizations that use my custom plugins. The export generates and extra blank section and I can't seem to figure out how to remove it. \[Screenshot from 2017-12-12 20-47-41\] Here's my… --- ## [Not working ML job using partition\_field\_name of japanese character on Windows 10 Home](https://discuss.elastic.co/t/not-working-ml-job-using-partition-field-name-of-japanese-character-on-windows-10-home/111890)
**Author:** [@serive](https://discuss.elastic.co/u/serive)\ **Replies:** 3\ **Last updated:** [December 15, 2017, 2:59am UTC](https://discuss.elastic.co/t/not-working-ml-job-using-partition-field-name-of-japanese-character-on-windows-10-home/111890 "2017-12-15T02:59:32Z")
Hi I use Elastic Machine Leaning on Windows 10 Home. ML job is not working if I use partition\_field\_name for japanese character on it. But I make same ML job (same input data and condition) on Linux (using docker), I… --- ## [Could not index event to Elasticsearch in ES 6.0.0](https://discuss.elastic.co/t/could-not-index-event-to-elasticsearch-in-es-6-0-0/111325)
**Author:** [@tatdat](https://discuss.elastic.co/u/tatdat)\ **Replies:** 16\ **Last updated:** [December 14, 2017, 4:24pm UTC](https://discuss.elastic.co/t/could-not-index-event-to-elasticsearch-in-es-6-0-0/111325 "2017-12-14T16:24:19Z")
I'm using ES 6.0 and beat 6.0. I check in logstash-plain.log, i got many error like this \[2017-12-12T18:30:25,655\]\[WARN \]\[logstash.outputs.elasticsearch\] Could not index event to Elasticsearch. {:status=\>400, :action=\>… --- ## [asticsearch.hadoop.rest.EsHadoopInvalidRequest: \[HEAD\] 403](https://discuss.elastic.co/t/asticsearch-hadoop-rest-eshadoopinvalidrequest-head-403/111885)
**Author:** [@kibitayo](https://discuss.elastic.co/u/kibitayo)\ **Replies:** 0\ **Last updated:** [December 15, 2017, 2:09am UTC](https://discuss.elastic.co/t/asticsearch-hadoop-rest-eshadoopinvalidrequest-head-403/111885 "2017-12-15T02:09:59Z")
Attempt to push data to elasticsearch from spark results is 403 when an attempt is made to check if an index exists at org.elasticsearch.hadoop.rest.RestClient.checkResponse(RestClient.java:510) at org.elasticsearch.ha… --- ## [Configuring Heap Size in CentOS](https://discuss.elastic.co/t/configuring-heap-size-in-centos/110432)
**Author:** [@motts](https://discuss.elastic.co/u/motts)\ **Replies:** 16\ **Last updated:** [December 15, 2017, 1:24am UTC](https://discuss.elastic.co/t/configuring-heap-size-in-centos/110432 "2017-12-15T01:24:08Z")
I am new to ELK and I am trying to figure out this heap problem I am having. I am trying to search the site here, but I get multiple results on how to set heap and on what parts of ELK need the heap size adjusted. I am … --- ## [How to change ignore\_above?](https://discuss.elastic.co/t/how-to-change-ignore-above/111873)
**Author:** [@marksarnold](https://discuss.elastic.co/u/marksarnold)\ **Replies:** 0\ **Last updated:** [December 14, 2017, 11:06pm UTC](https://discuss.elastic.co/t/how-to-change-ignore-above/111873 "2017-12-14T23:06:19Z")
I have an index with an auto-generated mapping (see attachment). The field "log4j\_root\_cause" contains a Java stacktrace that might be quite lengthy. After importing data, I see that there are many documents that have … --- ## [Elasticsearch GC pausing during snapshot](https://discuss.elastic.co/t/elasticsearch-gc-pausing-during-snapshot/111872)
**Author:** [@Zuhaib\_Siddique](https://discuss.elastic.co/u/Zuhaib_Siddique)\ **Replies:** 0\ **Last updated:** [December 14, 2017, 11:01pm UTC](https://discuss.elastic.co/t/elasticsearch-gc-pausing-during-snapshot/111872 "2017-12-14T23:01:24Z")
Hey, So a sort of followup to the G1GC question. We notice at top of the hour + 05min we do a snapshot to S3 and we are seeing GC pause, enough that our indexing is impacted (timeouts indexing). New Relic tells us thi… --- ## [AWS EBS recommendations](https://discuss.elastic.co/t/aws-ebs-recommendations/108461)
**Author:** [@Rajesh\_Kodali](https://discuss.elastic.co/u/Rajesh_Kodali)\ **Replies:** 3\ **Last updated:** [December 14, 2017, 10:30pm UTC](https://discuss.elastic.co/t/aws-ebs-recommendations/108461 "2017-12-14T22:30:25Z")
We currently use m4.x2large instances running data nodes. I saw elastic recommends ephemeral instances. As m4.2xlarge doesn't offer instance disks, should we swith to another instance type? --- ## [How to filter values with wildcard symbols?](https://discuss.elastic.co/t/how-to-filter-values-with-wildcard-symbols/111841)
**Author:** [@asafonov303](https://discuss.elastic.co/u/asafonov303)\ **Replies:** 1\ **Last updated:** [December 14, 2017, 9:54pm UTC](https://discuss.elastic.co/t/how-to-filter-values-with-wildcard-symbols/111841 "2017-12-14T21:54:03Z")
Hi. I'm newbee in elasticsearch. My question is what's wrong with the query I'm using: Model (partially): { "hello\_world\_index" : { "mappings" : { "entity" : { "dynamic" : "strict", "proper… --- ## [Can aliases be created using the Java High Level REST Client 5.6.3?](https://discuss.elastic.co/t/can-aliases-be-created-using-the-java-high-level-rest-client-5-6-3/111842)
**Author:** [@amathuria](https://discuss.elastic.co/u/amathuria)\ **Replies:** 1\ **Last updated:** [December 14, 2017, 9:51pm UTC](https://discuss.elastic.co/t/can-aliases-be-created-using-the-java-high-level-rest-client-5-6-3/111842 "2017-12-14T21:51:50Z")
I can see the support here Is the same possible using the Java high level client 5.6.3? Thanks in advance. --- ## [Query es 2.3 to es 5.5](https://discuss.elastic.co/t/query-es-2-3-to-es-5-5/111618)
**Author:** [@piyush](https://discuss.elastic.co/u/piyush)\ **Replies:** 6\ **Last updated:** [December 14, 2017, 9:18pm UTC](https://discuss.elastic.co/t/query-es-2-3-to-es-5-5/111618 "2017-12-14T21:18:34Z")
Hi, Below is ES-2.3 query which returns 2 records but same query is returning all index records (documents). What could be causing this behavior? Index schema is same in both versions (2.3 and 5.5) \[ so analyzer are s… --- ## [Count document in absolute time interval](https://discuss.elastic.co/t/count-document-in-absolute-time-interval/111858)
**Author:** [@Detobel36](https://discuss.elastic.co/u/Detobel36)\ **Replies:** 0\ **Last updated:** [December 14, 2017, 8:36pm UTC](https://discuss.elastic.co/t/count-document-in-absolute-time-interval/111858 "2017-12-14T20:36:56Z")
Hi, I store some video information in ElasticSearch. And more particularly, the time (of the video) when a user begin to see the video and the time until he stop the video. Like in the next picture: \[capt\] I would l… --- ## [Override Image 's default not working in Docker](https://discuss.elastic.co/t/override-image-s-default-not-working-in-docker/111830)
**Author:** [@YeeP](https://discuss.elastic.co/u/YeeP)\ **Replies:** 1\ **Last updated:** [December 14, 2017, 7:36pm UTC](https://discuss.elastic.co/t/override-image-s-default-not-working-in-docker/111830 "2017-12-14T19:36:53Z")
I am setting up a test cluster to prepare for the upgrade to Elasticsearch 6.0.x. Here is a simplified version of the run command (the one I am currently using for 5.5 has several -E commands). The container runs just f… --- ## [How to monitor or find logs regarding elasticsearch-hadoop plugin for hive](https://discuss.elastic.co/t/how-to-monitor-or-find-logs-regarding-elasticsearch-hadoop-plugin-for-hive/109885)
**Author:** [@Harbeer\_Kadian](https://discuss.elastic.co/u/Harbeer_Kadian)\ **Replies:** 3\ **Last updated:** [December 14, 2017, 7:37pm UTC](https://discuss.elastic.co/t/how-to-monitor-or-find-logs-regarding-elasticsearch-hadoop-plugin-for-hive/109885 "2017-12-14T19:37:46Z")
I am using elasticsearch-hadoop plugin inside hive to insert record from hive to elasticsearch. I need to get hold of insertion logs and if possible some way to monitor how the insertion is going. I checked elasticsearch… --- ## [Duplicate documents get inserted when moving data from hive using elasticsearch-hadoop plugin to elasticsearch](https://discuss.elastic.co/t/duplicate-documents-get-inserted-when-moving-data-from-hive-using-elasticsearch-hadoop-plugin-to-elasticsearch/109895)
**Author:** [@Harbeer\_Kadian](https://discuss.elastic.co/u/Harbeer_Kadian)\ **Replies:** 3\ **Last updated:** [December 14, 2017, 7:37pm UTC](https://discuss.elastic.co/t/duplicate-documents-get-inserted-when-moving-data-from-hive-using-elasticsearch-hadoop-plugin-to-elasticsearch/109895 "2017-12-14T19:37:03Z")
My need is to insert records from hive to elasticsearch which was going fine for me. From past few days we are observing that few of the records get duplicated while inserted into elasticsearch. I browsed about this pro… --- ## [How we can use es-hadoop in AWS EMR to connect external elasticsearch](https://discuss.elastic.co/t/how-we-can-use-es-hadoop-in-aws-emr-to-connect-external-elasticsearch/108088)
**Author:** [@nand\_kishore](https://discuss.elastic.co/u/nand_kishore)\ **Replies:** 3\ **Last updated:** [December 14, 2017, 7:35pm UTC](https://discuss.elastic.co/t/how-we-can-use-es-hadoop-in-aws-emr-to-connect-external-elasticsearch/108088 "2017-12-14T19:35:51Z")
Dear all , I have AWS EMR and ELK stack installed on some other server. Since Hadoop is already installed in EMR so how can we connect with Elasticsearch. How much ES-Hadoop help us in AWS EMR. What configuration we n… --- ## [Elasticsearch for Apache Hadoop 6.1.0 released](https://discuss.elastic.co/t/elasticsearch-for-apache-hadoop-6-1-0-released/111846)
**Author:** [@james.baiera](https://discuss.elastic.co/u/james.baiera)\ **Replies:** 0\ **Last updated:** [December 14, 2017, 7:33pm UTC](https://discuss.elastic.co/t/elasticsearch-for-apache-hadoop-6-1-0-released/111846 "2017-12-14T19:33:03Z")
I am proud to announce that ES-Hadoop 6.1.0 has been released! You can read more about these releases here. --- ## [Timeseries with startDate-endDate. Aggregations on different date intervals](https://discuss.elastic.co/t/timeseries-with-startdate-enddate-aggregations-on-different-date-intervals/111833)
**Author:** [@delk13](https://discuss.elastic.co/u/delk13)\ **Replies:** 0\ **Last updated:** [December 14, 2017, 6:06pm UTC](https://discuss.elastic.co/t/timeseries-with-startdate-enddate-aggregations-on-different-date-intervals/111833 "2017-12-14T18:06:17Z")
Hi team, Problem statement I want to store events over time as new record in my storage system. imagine I want to monitor taxi location changes. I could keep data in a format \[taxi\_id, time\_start, time\_end, location\_id… --- ## [Clustering question (storage needs and performance)](https://discuss.elastic.co/t/clustering-question-storage-needs-and-performance/111030)
**Author:** [@asp](https://discuss.elastic.co/u/asp)\ **Replies:** 18\ **Last updated:** [December 14, 2017, 4:51pm UTC](https://discuss.elastic.co/t/clustering-question-storage-needs-and-performance/111030 "2017-12-14T16:51:49Z")
Hi, currently we have a big machine running a single instance of logstash, kibana and elasticsearch. It has 128GB RAM 700GB storage and 8 CPU. It's a virtual machine, disk is located in a NAS. I think we are currently… --- ## [Elasticsearch not running but not reachable](https://discuss.elastic.co/t/elasticsearch-not-running-but-not-reachable/111744)
**Author:** [@marouane](https://discuss.elastic.co/u/marouane)\ **Replies:** 2\ **Last updated:** [December 14, 2017, 3:56pm UTC](https://discuss.elastic.co/t/elasticsearch-not-running-but-not-reachable/111744 "2017-12-14T15:56:45Z")
Hello every one , i'm working on starting elasticsearch on my navigator using my ip\_@:9200 but i got no thing : This the log that i have : 14/12/2017 11:43:50\[2017-12-14T10:43:50,587\]\[INFO \]\[o.e.n.Node \] \[\] initializi… --- ## [Elasticsearch 1.7.3 & query\_string](https://discuss.elastic.co/t/elasticsearch-1-7-3-query-string/111658)
**Author:** [@Velusamy\_Velu](https://discuss.elastic.co/u/Velusamy_Velu)\ **Replies:** 4\ **Last updated:** [December 14, 2017, 3:40pm UTC](https://discuss.elastic.co/t/elasticsearch-1-7-3-query-string/111658 "2017-12-14T15:40:45Z")
My client is still using ES 1.7.3. I ran the following query against it and couldn't get the expected result. ES is running on a Linux Mint 18.3 cinnamon 64 bit version. curl -XPOST 'localhost:9200/\_search?pretty' -d ' … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1852) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1854)