# \#none

**URL:** https://discuss.elastic.co/tag/none.md?page=1475

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1476

---

## [Java API substring search query](https://discuss.elastic.co/t/java-api-substring-search-query/230808)

<div class="topic-metadata">

**Author:** [@JavaDeveloper](https://discuss.elastic.co/u/JavaDeveloper)\
**Replies:** 2\
**Last updated:** [May 2, 2020, 4:36pm UTC](https://discuss.elastic.co/t/java-api-substring-search-query/230808 "2020-05-02T16:36:42Z")

</div>

Hi everyone. Elasticsearch question about JAVA API: I have a string (36 characters) where only last 8 characters are different (other chars are prefix) and therefore I want to do search query over these last 8 characte…

---

## [How to search for maximum hitting IPs if those IPs are showing in the error.message field](https://discuss.elastic.co/t/how-to-search-for-maximum-hitting-ips-if-those-ips-are-showing-in-the-error-message-field/230792)

<div class="topic-metadata">

**Author:** [@Dheeraj\_Bhargav](https://discuss.elastic.co/u/Dheeraj_Bhargav)\
**Replies:** 3\
**Last updated:** [May 2, 2020, 1:00pm UTC](https://discuss.elastic.co/t/how-to-search-for-maximum-hitting-ips-if-those-ips-are-showing-in-the-error-message-field/230792 "2020-05-02T13:00:17Z")

</div>

I am getting multiple hits in my IIS logs and want a query to get which IP is hitting multiple times. and those ips are showing in the error.message field as a string.

---

## [Latitude/Longitude values - zero's get removed](https://discuss.elastic.co/t/latitude-longitude-values-zeros-get-removed/230789)

<div class="topic-metadata">

**Author:** [@Sketchy](https://discuss.elastic.co/u/Sketchy)\
**Replies:** 1\
**Last updated:** [May 2, 2020, 12:42pm UTC](https://discuss.elastic.co/t/latitude-longitude-values-zeros-get-removed/230789 "2020-05-02T12:42:49Z")

</div>

I am recieving json that contains Latitude and Longitude, in the message they look like this: "Latitude": -37.000000, "Longitude": 145.000000 In the output they look like this: "Latitude" =\> -37.0, "Longitude" =\> 145.…

---

## [How calculate time différence between two rows in csv file?](https://discuss.elastic.co/t/how-calculate-time-difference-between-two-rows-in-csv-file/230192)

<div class="topic-metadata">

**Author:** [@Emna1](https://discuss.elastic.co/u/Emna1)\
**Replies:** 5\
**Last updated:** [April 29, 2020, 2:14pm UTC](https://discuss.elastic.co/t/how-calculate-time-difference-between-two-rows-in-csv-file/230192 "2020-04-29T14:14:12Z")

</div>

Hi, Please i need to calculate différence of time between two rows in my file My csv file it looks like this ent\_sort , Date , car enter, 2020-04-28 05:04:02 , c1 …

---

## [Does a Logstash pipeline created in Kibana automatically start in Elastic cloud?](https://discuss.elastic.co/t/does-a-logstash-pipeline-created-in-kibana-automatically-start-in-elastic-cloud/230750)

<div class="topic-metadata">

**Author:** [@cristianplaytreks](https://discuss.elastic.co/u/cristianplaytreks)\
**Replies:** 3\
**Last updated:** [May 2, 2020, 11:10am UTC](https://discuss.elastic.co/t/does-a-logstash-pipeline-created-in-kibana-automatically-start-in-elastic-cloud/230750 "2020-05-02T11:10:08Z")

</div>

Hi! TL;DR How do I check the status of the Logstash pipeline in Elastic cloud? I created a new deployment in Elastic cloud and then I created a new Logstash pipeline. However, I'm not sure how to check any information …

---

## [Not able to index records which contain missing fields ElasticSearch 7.4](https://discuss.elastic.co/t/not-able-to-index-records-which-contain-missing-fields-elasticsearch-7-4/230782)

<div class="topic-metadata">

**Author:** [@yoyomonkey](https://discuss.elastic.co/u/yoyomonkey)\
**Replies:** 1\
**Last updated:** [May 2, 2020, 10:54am UTC](https://discuss.elastic.co/t/not-able-to-index-records-which-contain-missing-fields-elasticsearch-7-4/230782 "2020-05-02T10:54:02Z")

</div>

Hello all, Can someone point me in the right direction of any documents or links that may be able to help me. I have am using kinesis to ingest just 2 simple events 2020-01-09 15:35:51,334 tid:LE7WZpV000NCG4NeSUVwBvW6…

---

## [Elasticsearch timeout for search query](https://discuss.elastic.co/t/elasticsearch-timeout-for-search-query/230067)

<div class="topic-metadata">

**Author:** [@Rakesh\_B](https://discuss.elastic.co/u/Rakesh_B)\
**Replies:** 6\
**Last updated:** [May 2, 2020, 7:23am UTC](https://discuss.elastic.co/t/elasticsearch-timeout-for-search-query/230067 "2020-05-02T07:23:48Z")

</div>

Hi, Elasticsearch version 7.6.1 We have a total of 55 indices with 228 shards and a disk space of 4.8 TB Our indexing rate ranges from (3000-8000 docs per second) with a total of 250 million docs coming per day. We h…

---

## [Parsing artifactory logs using 7.6.2](https://discuss.elastic.co/t/parsing-artifactory-logs-using-7-6-2/230786)

<div class="topic-metadata">

**Author:** [@nsrushi](https://discuss.elastic.co/u/nsrushi)\
**Replies:** 0\
**Last updated:** [May 2, 2020, 2:02am UTC](https://discuss.elastic.co/t/parsing-artifactory-logs-using-7-6-2/230786 "2020-05-02T02:02:49Z")

</div>

Hi there I setup filebeat to send JFROG artifactory logs and it is not showing any logs i the filebeat Kibana. here is my filebeat configuraion input\_type: log Paths that should be crawled and fetched. Glob based …

---

## [Invalid aggregation order path](https://discuss.elastic.co/t/invalid-aggregation-order-path/228472)

<div class="topic-metadata">

**Author:** [@Damiano](https://discuss.elastic.co/u/Damiano)\
**Replies:** 2\
**Last updated:** [May 2, 2020, 1:21am UTC](https://discuss.elastic.co/t/invalid-aggregation-order-path/228472 "2020-05-02T01:21:35Z")

</div>

Hello everybody! I am using ElasticSearch 7.6 with a test index that has the following mapping: { "test" : { "mappings" : { "properties" : { "amount" : { "type" : "long" }, …

---

## [Can I blow out elasticsearch log directory "/var/log/elasticsearch" or is that a no no?](https://discuss.elastic.co/t/can-i-blow-out-elasticsearch-log-directory-var-log-elasticsearch-or-is-that-a-no-no/230780)

<div class="topic-metadata">

**Author:** [@syost](https://discuss.elastic.co/u/syost)\
**Replies:** 1\
**Last updated:** [May 2, 2020, 12:59am UTC](https://discuss.elastic.co/t/can-i-blow-out-elasticsearch-log-directory-var-log-elasticsearch-or-is-that-a-no-no/230780 "2020-05-02T00:59:40Z")

</div>

I would like to monitor elasticsearch logs using filebeat and I see in my "elasticsearch.yml" these are stored... path.logs: /var/log/elasticsearch There's a bunch of stuff in here and I would just like to delete every…

---

## [Grokparsefailure with nginx logs](https://discuss.elastic.co/t/grokparsefailure-with-nginx-logs/230753)

<div class="topic-metadata">

**Author:** [@cloudbadmin](https://discuss.elastic.co/u/cloudbadmin)\
**Replies:** 1\
**Last updated:** [May 2, 2020, 12:40am UTC](https://discuss.elastic.co/t/grokparsefailure-with-nginx-logs/230753 "2020-05-02T00:40:35Z")

</div>

we have a custom nginx log that looks like this 172.16.23.132 - \[172.16.23.132\] - - \[30/Apr/2020:20:49:22 +0000\] \\"GET /health HTTP/2.0\\" 200 7 \\"-\\" \\"curl/7.58.0\\" 52 0.013 \[foobar-apiservice-443\] 172.24.12.90:9001 7 …

---

## [Export Multiple Dashboards API](https://discuss.elastic.co/t/export-multiple-dashboards-api/230774)

<div class="topic-metadata">

**Author:** [@Gundam\_Airline](https://discuss.elastic.co/u/Gundam_Airline)\
**Replies:** 1\
**Last updated:** [May 1, 2020, 11:11pm UTC](https://discuss.elastic.co/t/export-multiple-dashboards-api/230774 "2020-05-01T23:11:28Z")

</div>

Hi All, I am trying to export multiple dashboard at once. I have no issue doing an export for 1 dashboard. Two dashboard is where I am seeing an error. I went to https://www.elastic.co/guide/en/kibana/current/dashboard-…

---

## [I am trying push data to elasticsearch using aws lambda function written in node js and getting this error](https://discuss.elastic.co/t/i-am-trying-push-data-to-elasticsearch-using-aws-lambda-function-written-in-node-js-and-getting-this-error/230743)

<div class="topic-metadata">

**Author:** [@rishabh\_jain](https://discuss.elastic.co/u/rishabh_jain)\
**Replies:** 3\
**Last updated:** [May 1, 2020, 8:42pm UTC](https://discuss.elastic.co/t/i-am-trying-push-data-to-elasticsearch-using-aws-lambda-function-written-in-node-js-and-getting-this-error/230743 "2020-05-01T20:42:57Z")

</div>

Elasticsearch ERROR: 2020-05-01T13:31:11Z Error: Request error, retrying POST https://xxx.gcp.cloud.es.io:9243/a\_comment/comment/\_search =\> socket hang up at Log.error (/app/node\_modules/elasticsearch/src/lib/log.js:2…

---

## [Elastic Search Version Based Update API](https://discuss.elastic.co/t/elastic-search-version-based-update-api/230762)

<div class="topic-metadata">

**Author:** [@rishabh\_jain](https://discuss.elastic.co/u/rishabh_jain)\
**Replies:** 0\
**Last updated:** [May 1, 2020, 8:17pm UTC](https://discuss.elastic.co/t/elastic-search-version-based-update-api/230762 "2020-05-01T20:17:15Z")

</div>

is there any way in which i can do upsert on the basis of version i.e if document doesnt exists then it would create the document and if exists then it would look for version if new version is greater than existing ver…

---

## [Group by date aggregation on day by day?](https://discuss.elastic.co/t/group-by-date-aggregation-on-day-by-day/230703)

<div class="topic-metadata">

**Author:** [@Ramesh\_Kumar](https://discuss.elastic.co/u/Ramesh_Kumar)\
**Replies:** 6\
**Last updated:** [May 1, 2020, 6:57pm UTC](https://discuss.elastic.co/t/group-by-date-aggregation-on-day-by-day/230703 "2020-05-01T18:57:19Z")

</div>

{ "size": 0, "aggs" : { "group\_by\_day" : { "date\_histogram" : { "field" : "date\_inserted", "interval": "day" } } } }

---

## [How do I send a custom metric from within my code?](https://discuss.elastic.co/t/how-do-i-send-a-custom-metric-from-within-my-code/230689)

<div class="topic-metadata">

**Author:** [@michielvoo](https://discuss.elastic.co/u/michielvoo)\
**Replies:** 4\
**Last updated:** [May 1, 2020, 3:56pm UTC](https://discuss.elastic.co/t/how-do-i-send-a-custom-metric-from-within-my-code/230689 "2020-05-01T15:56:11Z")

</div>

I am in the process of understanding the Elastic product suite, and I don't fully understand 'Metrics'. I know I can send structured log events to Elasticsearch, and I can search and filter on specific fields that I adde…

---

## [How to normalize for time in Kibana](https://discuss.elastic.co/t/how-to-normalize-for-time-in-kibana/230624)

<div class="topic-metadata">

**Author:** [@vstevenson](https://discuss.elastic.co/u/vstevenson)\
**Replies:** 6\
**Last updated:** [May 1, 2020, 3:47pm UTC](https://discuss.elastic.co/t/how-to-normalize-for-time-in-kibana/230624 "2020-05-01T15:47:00Z")

</div>

In my index, I am tracking the performance of widgets. I have the install date of each widget. I would like to determine which widgets have had the most number of parts replaced on them per time, accounting for the fact …

---

## [How to use bulk api for partial updates of documents that may not exist?](https://discuss.elastic.co/t/how-to-use-bulk-api-for-partial-updates-of-documents-that-may-not-exist/230722)

<div class="topic-metadata">

**Author:** [@rmavilia\_w](https://discuss.elastic.co/u/rmavilia_w)\
**Replies:** 1\
**Last updated:** [May 1, 2020, 3:33pm UTC](https://discuss.elastic.co/t/how-to-use-bulk-api-for-partial-updates-of-documents-that-may-not-exist/230722 "2020-05-01T15:33:06Z")

</div>

I am trying to use the \_bulk endpoint with update requests but I have a few different data pipelines that are going to be putting together the pieces of my documents. I have realized that the reason my updates aren't wor…

---

## [Getting the Object from searchResponse](https://discuss.elastic.co/t/getting-the-object-from-searchresponse/230727)

<div class="topic-metadata">

**Author:** [@Siddharth1010](https://discuss.elastic.co/u/Siddharth1010)\
**Replies:** 0\
**Last updated:** [May 1, 2020, 3:16pm UTC](https://discuss.elastic.co/t/getting-the-object-from-searchresponse/230727 "2020-05-01T15:16:51Z")

</div>

I am trying to retrieve the Object from my searchresponse which I obtained through searchResponse = restHighLevelClient.search(searchRequest); I am using the following method SearchHit\[\] result = searchResponse.g…

---

## [Apply More Like This to subset data](https://discuss.elastic.co/t/apply-more-like-this-to-subset-data/230716)

<div class="topic-metadata">

**Author:** [@lschnei](https://discuss.elastic.co/u/lschnei)\
**Replies:** 0\
**Last updated:** [May 1, 2020, 2:16pm UTC](https://discuss.elastic.co/t/apply-more-like-this-to-subset-data/230716 "2020-05-01T14:16:31Z")

</div>

Hi there, I'm trying to apply a more like this query to a subset of my data filtered for dates. I'd like the final score to only be the score of more like this on the subset. How should i proceed ? I have been trying …

---

## [Elastic unable to start](https://discuss.elastic.co/t/elastic-unable-to-start/230677)

<div class="topic-metadata">

**Author:** [@Alexy\_Kouakou](https://discuss.elastic.co/u/Alexy_Kouakou)\
**Replies:** 1\
**Last updated:** [May 1, 2020, 2:07pm UTC](https://discuss.elastic.co/t/elastic-unable-to-start/230677 "2020-05-01T14:07:39Z")

</div>

Hi, Please Help me My elastic refuses to start. This is the systemctl status elasticsearch.service log ● elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; enabled;…

---

## [Roles](https://discuss.elastic.co/t/roles/230036)

<div class="topic-metadata">

**Author:** [@jppedals](https://discuss.elastic.co/u/jppedals)\
**Replies:** 2\
**Last updated:** [May 1, 2020, 1:37pm UTC](https://discuss.elastic.co/t/roles/230036 "2020-05-01T13:37:38Z")

</div>

So My issue is I am not very good with using kibana and i have custom roles but the custom roles cant save search and they cant generate a .CSV report for export if anyone can assist with this that would be great.

---

## [How to write mutate for nested field as array in config file?](https://discuss.elastic.co/t/how-to-write-mutate-for-nested-field-as-array-in-config-file/230655)

<div class="topic-metadata">

**Author:** [@apremgeorge](https://discuss.elastic.co/u/apremgeorge)\
**Replies:** 1\
**Last updated:** [May 1, 2020, 1:26pm UTC](https://discuss.elastic.co/t/how-to-write-mutate-for-nested-field-as-array-in-config-file/230655 "2020-05-01T13:26:16Z")

</div>

I have written the logstash config file to upload a csv, filter { csv { separator =\> "," skip\_header =\> true columns =\> \[LoanID,Applicant\_Income1,Occupation1,Time\_At\_Work1,Date\_Of\_Join1,Gender,LoanAmount,Marital\_…

---

## [Logstash parse JSON into individual events](https://discuss.elastic.co/t/logstash-parse-json-into-individual-events/230661)

<div class="topic-metadata">

**Author:** [@hiba](https://discuss.elastic.co/u/hiba)\
**Replies:** 2\
**Last updated:** [May 1, 2020, 1:15pm UTC](https://discuss.elastic.co/t/logstash-parse-json-into-individual-events/230661 "2020-05-01T13:15:07Z")

</div>

Hi, Im trying an HTTP Poller which returns me the response in the below format: {"term":"hamma","suggestions":{"cities":\[{"id":101509,"name":"Hammaliya","type":"city","region":"Sri Lanka","country":"Sri Lanka"},{"id":8…

---

## [String to nested type, possible?](https://discuss.elastic.co/t/string-to-nested-type-possible/230712)

<div class="topic-metadata">

**Author:** [@karimelc](https://discuss.elastic.co/u/karimelc)\
**Replies:** 0\
**Last updated:** [May 1, 2020, 1:08pm UTC](https://discuss.elastic.co/t/string-to-nested-type-possible/230712 "2020-05-01T13:08:19Z")

</div>

Hi, I have an existing index where the field items looks like: "items": "{"productA":{"qty":3},"productB":{"qty":5},"productC":{"qty":9}}" The field items is mapped as type text. The field items can contain any number…

---

## [Elasticseach as input in logstash? - From the beginning](https://discuss.elastic.co/t/elasticseach-as-input-in-logstash-from-the-beginning/230671)

<div class="topic-metadata">

**Author:** [@Rysiu](https://discuss.elastic.co/u/Rysiu)\
**Replies:** 1\
**Last updated:** [May 1, 2020, 12:27pm UTC](https://discuss.elastic.co/t/elasticseach-as-input-in-logstash-from-the-beginning/230671 "2020-05-01T12:27:01Z")

</div>

Hi, I have a big problem. Is there any way to configure Logstash input (elasticsearch) so that after rebooting Logstash does not load the whole elasticsearch index (input) from the beginning? So that it will load the …

---

## [Issue with elasticsearch edge\_ngram query](https://discuss.elastic.co/t/issue-with-elasticsearch-edge-ngram-query/230699)

<div class="topic-metadata">

**Author:** [@sai\_saran](https://discuss.elastic.co/u/sai_saran)\
**Replies:** 0\
**Last updated:** [May 1, 2020, 10:54am UTC](https://discuss.elastic.co/t/issue-with-elasticsearch-edge-ngram-query/230699 "2020-05-01T10:54:43Z")

</div>

I am using edge-gram to search in Elasticsearch. This is the analyse I used { "settings": { "analysis": { "analyzer": { "my\_analyzer": { "tokenizer": "my\_tokenizer"…

---

## [Plugin \[my-plugin\] was built for Elasticsearch version 7.6.0 but version 7.6.2 is running](https://discuss.elastic.co/t/plugin-my-plugin-was-built-for-elasticsearch-version-7-6-0-but-version-7-6-2-is-running/230708)

<div class="topic-metadata">

**Author:** [@p4charu](https://discuss.elastic.co/u/p4charu)\
**Replies:** 1\
**Last updated:** [May 1, 2020, 12:05pm UTC](https://discuss.elastic.co/t/plugin-my-plugin-was-built-for-elasticsearch-version-7-6-0-but-version-7-6-2-is-running/230708 "2020-05-01T12:05:09Z")

</div>

Hello, We are facing a problem here with elastic search not installing our custom plugin. We built a filter plugin with ElasticSearch 7.6.0 using org.elasticsearch.gradle:build-tools:7.6.0 But can't use it with Elasti…

---

## [Help with data structure (small project)](https://discuss.elastic.co/t/help-with-data-structure-small-project/230684)

<div class="topic-metadata">

**Author:** [@freddedotme](https://discuss.elastic.co/u/freddedotme)\
**Replies:** 8\
**Last updated:** [May 1, 2020, 12:04pm UTC](https://discuss.elastic.co/t/help-with-data-structure-small-project/230684 "2020-05-01T12:04:19Z")

</div>

Hi there! I'm quite new to ES and would need some guidance from you, if possible. The scenario is the following: I have approximately 20 unique people, all identified by a separate UUID. Each person has around 2000 u…

---

## [Remove fields with empty value](https://discuss.elastic.co/t/remove-fields-with-empty-value/230470)

<div class="topic-metadata">

**Author:** [@vikramaddagulla](https://discuss.elastic.co/u/vikramaddagulla)\
**Replies:** 5\
**Last updated:** [May 1, 2020, 11:41am UTC](https://discuss.elastic.co/t/remove-fields-with-empty-value/230470 "2020-05-01T11:41:09Z")

</div>

Hello, I am receiving the data in logstash and I can see that at times, some of the fields do not have any values. Please see below for : flowid compositedetails causedby I would like to remove these fields if th…

[Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1474)

[Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1476)
