# Latest **URL:** https://discuss.elastic.co/latest.md?page=1877 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1878 --- ## [Sink data from hive to es](https://discuss.elastic.co/t/sink-data-from-hive-to-es/262062)
**Author:** [@yeziblo](https://discuss.elastic.co/u/yeziblo)\ **Replies:** 0\ **Last updated:** [January 25, 2021, 7:37am UTC](https://discuss.elastic.co/t/sink-data-from-hive-to-es/262062 "2021-01-25T07:37:35Z")
Hi guys, I want to sink my data from hive to es. data in hive just like this: CREATE TABLE \`dwd\_ddjk\_hospital\`( \`orgid\` bigint, \`orgcode\` string, … --- ## [Unable to upload json fields which contains korean in its field name](https://discuss.elastic.co/t/unable-to-upload-json-fields-which-contains-korean-in-its-field-name/261760)
**Author:** [@Subhas\_Patil](https://discuss.elastic.co/u/Subhas_Patil)\ **Replies:** 3\ **Last updated:** [January 25, 2021, 7:15am UTC](https://discuss.elastic.co/t/unable-to-upload-json-fields-which-contains-korean-in-its-field-name/261760 "2021-01-25T07:15:36Z")
Iam trying to upload the json data into app search but its giving me errors because the field names contain a few korean language fields. Any help to resolve this would be appreciated. --- ## [Intercept incoming data to logstash pipeline](https://discuss.elastic.co/t/intercept-incoming-data-to-logstash-pipeline/262028)
**Author:** [@g2h2o](https://discuss.elastic.co/u/g2h2o)\ **Replies:** 2\ **Last updated:** [January 25, 2021, 7:02am UTC](https://discuss.elastic.co/t/intercept-incoming-data-to-logstash-pipeline/262028 "2021-01-25T07:02:52Z")
Actually we are getting jenkins build logs result into elasticsearch through filebeats and logstash. We are receiving the expected data in logstash but for an unknown reason is getting repeated constantly. Seems that t… --- ## [Logstash error: Could not process event: no implicit conversion of NilClass into String](https://discuss.elastic.co/t/logstash-error-could-not-process-event-no-implicit-conversion-of-nilclass-into-string/262056)
**Author:** [@Subhas\_Patil](https://discuss.elastic.co/u/Subhas_Patil)\ **Replies:** 0\ **Last updated:** [January 25, 2021, 5:51am UTC](https://discuss.elastic.co/t/logstash-error-could-not-process-event-no-implicit-conversion-of-nilclass-into-string/262056 "2021-01-25T05:51:14Z")
Iam getting the error Could not process event: no implicit conversion of NilClass into String in logstash ruby filter. Here is the ruby file which iam using in the logstash filter: def filter(event) require 'json' … --- ## [Data plugin search bar on filter removal doesn't refresh automatically](https://discuss.elastic.co/t/data-plugin-search-bar-on-filter-removal-doesnt-refresh-automatically/260502)
**Author:** [@praveer](https://discuss.elastic.co/u/praveer)\ **Replies:** 3\ **Last updated:** [January 25, 2021, 5:41am UTC](https://discuss.elastic.co/t/data-plugin-search-bar-on-filter-removal-doesnt-refresh-automatically/260502 "2021-01-25T05:41:46Z")
Hi Team, I am using data plugin for elastic queries. In my project i have used kibana search bar as below \ **Author:** [@Finley](https://discuss.elastic.co/u/Finley)\ **Replies:** 2\ **Last updated:** [January 25, 2021, 4:42am UTC](https://discuss.elastic.co/t/cold-phase-staying-in-data-data-hot-node/262052 "2021-01-25T04:42:34Z") Hello, I am trying to setup an elasticsearch cluster. I setted up 9 nodes with these roles : master-1 \[master\] master-2 \[master\] master-3 \[master\] data-1 \[data, data\_hot\] data-2 \[data\_warm\] data-3 \[data\_warm\] da… --- ## [What line indicates that filebeat is creating an index in Elasticsearch](https://discuss.elastic.co/t/what-line-indicates-that-filebeat-is-creating-an-index-in-elasticsearch/261791)
**Author:** [@rajeshkp](https://discuss.elastic.co/u/rajeshkp)\ **Replies:** 2\ **Last updated:** [January 25, 2021, 4:34am UTC](https://discuss.elastic.co/t/what-line-indicates-that-filebeat-is-creating-an-index-in-elasticsearch/261791 "2021-01-25T04:34:09Z")
What line indicates that Filebeat 7.7.0 is creating an index in Elasticsearch. We are trying to debug the fact that its not creating an Elasticsearch index, but the harvester fails saying the index is missing. Isn't it t… --- ## [How to keep data when upgrading kibana docker?](https://discuss.elastic.co/t/how-to-keep-data-when-upgrading-kibana-docker/261877)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 6\ **Last updated:** [January 25, 2021, 4:17am UTC](https://discuss.elastic.co/t/how-to-keep-data-when-upgrading-kibana-docker/261877 "2021-01-25T04:17:08Z")
version: '3.6' services: elasticsearch: image: elasticsearch:7.9.1 container\_name: elasticsearch-docker environment: - node.name=es-docker - cluster.name=es-single-node - discovery.type=s… --- ## [Conditional update based on priority in Elasticsearch](https://discuss.elastic.co/t/conditional-update-based-on-priority-in-elasticsearch/262036)
**Author:** [@Ahmed\_Sharara](https://discuss.elastic.co/u/Ahmed_Sharara)\ **Replies:** 8\ **Last updated:** [January 25, 2021, 4:15am UTC](https://discuss.elastic.co/t/conditional-update-based-on-priority-in-elasticsearch/262036 "2021-01-25T04:15:54Z")
Hello, I'm using logstash to index data from Kafka to Elasticsearch. There are multiple events with the same id. I'm using upsert in logstash to update existing documents with the new values based on the \_id. sample in… --- ## [Is it safe to delete SLM history indexes](https://discuss.elastic.co/t/is-it-safe-to-delete-slm-history-indexes/261965)
**Author:** [@robbyku](https://discuss.elastic.co/u/robbyku)\ **Replies:** 2\ **Last updated:** [January 25, 2021, 4:10am UTC](https://discuss.elastic.co/t/is-it-safe-to-delete-slm-history-indexes/261965 "2021-01-25T04:10:29Z")
Hi, I have added a new master-eligible node (say node04) and was decommissioning another master-eligible node (say node03), due to a different es version, from the cluster of 3 nodes. So I used the cluster allocation fi… --- ## [How to get a better performance to load ElasticSearch data into Hive?](https://discuss.elastic.co/t/how-to-get-a-better-performance-to-load-elasticsearch-data-into-hive/262051)
**Author:** [@Sean\_Han](https://discuss.elastic.co/u/Sean_Han)\ **Replies:** 0\ **Last updated:** [January 25, 2021, 3:40am UTC](https://discuss.elastic.co/t/how-to-get-a-better-performance-to-load-elasticsearch-data-into-hive/262051 "2021-01-25T03:40:28Z")
We created the Hive external table using ElasticSearch StorageHandler as shown below: CREATE EXTERNAL TABLE DEFAULT.ES\_TEST ( REG\_DATE STRING , STR1 STRING , STR2 STRING , STR3 STRING , STR4 STRING , S… --- ## [How Logstash Process data](https://discuss.elastic.co/t/how-logstash-process-data/261216)
**Author:** [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\ **Replies:** 2\ **Last updated:** [January 25, 2021, 2:49am UTC](https://discuss.elastic.co/t/how-logstash-process-data/261216 "2021-01-25T02:49:33Z")
Hello Team I am in requirement of pushing data from Oracle Table to Elasticsearch Index. My Oracle Table is of 300GB in Size. I would like to understand , How Logstash process the data when he pulls from Oracle { inpu… --- ## [Installing Elastic Search on shared webhosting](https://discuss.elastic.co/t/installing-elastic-search-on-shared-webhosting/262046)
**Author:** [@MyGIS](https://discuss.elastic.co/u/MyGIS)\ **Replies:** 3\ **Last updated:** [January 25, 2021, 1:54am UTC](https://discuss.elastic.co/t/installing-elastic-search-on-shared-webhosting/262046 "2021-01-25T01:54:36Z")
Hello, Is it possible to installed Elasticsearch on a shared web hosting such as Hostgator or Bluehost? Thanks. --- ## [What are the possible values of type in task](https://discuss.elastic.co/t/what-are-the-possible-values-of-type-in-task/261534)
**Author:** [@kender1314](https://discuss.elastic.co/u/kender1314)\ **Replies:** 5\ **Last updated:** [January 25, 2021, 1:33am UTC](https://discuss.elastic.co/t/what-are-the-possible-values-of-type-in-task/261534 "2021-01-25T01:33:12Z")
As the documentation says，when I execute command GET \_tasks?actions=\*search&detailed return result { "nodes" : { "oTUltX4IQMOUUVeiohTt8A" : { "name" : "H5dfFeA", "transport\_address" : "127.0.0.1:9300", "host" : "… --- ## [Elastic ILM does not work as expected after upgrading Elastic](https://discuss.elastic.co/t/elastic-ilm-does-not-work-as-expected-after-upgrading-elastic/261554)
**Author:** [@Ali\_Nazemian](https://discuss.elastic.co/u/Ali_Nazemian)\ **Replies:** 2\ **Last updated:** [January 25, 2021, 12:36am UTC](https://discuss.elastic.co/t/elastic-ilm-does-not-work-as-expected-after-upgrading-elastic/261554 "2021-01-25T00:36:09Z")
After I have upgraded my Elasticsearch cluster from 7.9 to 7.10.1 my ILM for filebeat does not work as expected. I can see that the corresponding indices are being marked as Warm when I check the index management, but I … --- ## [NEST client always using PUT http method instead of POST](https://discuss.elastic.co/t/nest-client-always-using-put-http-method-instead-of-post/261552)
**Author:** [@Izzy](https://discuss.elastic.co/u/Izzy)\ **Replies:** 0\ **Last updated:** [January 19, 2021, 1:56pm UTC](https://discuss.elastic.co/t/nest-client-always-using-put-http-method-instead-of-post/261552 "2021-01-19T13:56:39Z")
I'm trying to index my documents and expect them to have unique Ids, for doing that I'm using pipeline processor in order to remove the Id field from my model. However, Id always stored as 0 in elastic side. I noticed … --- ## [Best practices for managing application logs](https://discuss.elastic.co/t/best-practices-for-managing-application-logs/261824)
**Author:** [@pampua84](https://discuss.elastic.co/u/pampua84)\ **Replies:** 1\ **Last updated:** [January 25, 2021, 12:07am UTC](https://discuss.elastic.co/t/best-practices-for-managing-application-logs/261824 "2021-01-25T00:07:17Z")
Hello boys and girls, I have a few questions about best practices for managing my application logs on elastic: Is it a good idea to create an index by app and day to improve search performance? I have logs in Json for… --- ## [Problem with centos 7 install](https://discuss.elastic.co/t/problem-with-centos-7-install/261941)
**Author:** [@cyrduf](https://discuss.elastic.co/u/cyrduf)\ **Replies:** 1\ **Last updated:** [January 24, 2021, 11:56pm UTC](https://discuss.elastic.co/t/problem-with-centos-7-install/261941 "2021-01-24T23:56:41Z")
Hello, I have some problems after elasticsearch installation on centos 7 VM. There is the log and if you can help me to solve. Best Regards \[root@localhost log\]# sudo yum install -y elasticsearch Modules complémenta… --- ## [Bitnami Elasticsearch in Azure(X-Pack)](https://discuss.elastic.co/t/bitnami-elasticsearch-in-azure-x-pack/261727)
**Author:** [@roman.pavliuk](https://discuss.elastic.co/u/roman.pavliuk)\ **Replies:** 6\ **Last updated:** [January 24, 2021, 11:52pm UTC](https://discuss.elastic.co/t/bitnami-elasticsearch-in-azure-x-pack/261727 "2021-01-24T23:52:27Z")
Hi all. I want to use Bitnami Elasticsearch in Azure portal, but I don't need X-Pack. How I can disable it or install Bitnami Elk without X-Pack? When I starting to create in from Marketplace, I don't see any setting ho… --- ## [Data node is not reporting CPU](https://discuss.elastic.co/t/data-node-is-not-reporting-cpu/261697)
**Author:** [@Mike\_Connor](https://discuss.elastic.co/u/Mike_Connor)\ **Replies:** 3\ **Last updated:** [January 24, 2021, 10:06pm UTC](https://discuss.elastic.co/t/data-node-is-not-reporting-cpu/261697 "2021-01-24T22:06:49Z")
Hello, I have a cloud.elastic.co deployment with some hot and warm nodes. One of the hot nodes has not been reporting CPU usage since it was launched. Was hoping it would sort itself out, even tried a restart. I hav… --- ## [Create custom source elasticWorkplace](https://discuss.elastic.co/t/create-custom-source-elasticworkplace/252247)
**Author:** [@JorgeL-TI](https://discuss.elastic.co/u/JorgeL-TI)\ **Replies:** 39\ **Last updated:** [January 24, 2021, 9:12pm UTC](https://discuss.elastic.co/t/create-custom-source-elasticworkplace/252247 "2021-01-24T21:12:45Z")
Hello, I am using workplace search, and I want now to create a customised source. I explain my project. It consists of a search of documents (PDFs) that need to have a label with their topic. So I try to download thi… --- ## [Poretect plain text password in Kibana yml file](https://discuss.elastic.co/t/poretect-plain-text-password-in-kibana-yml-file/261999)
**Author:** [@navin1093](https://discuss.elastic.co/u/navin1093)\ **Replies:** 3\ **Last updated:** [January 24, 2021, 5:05pm UTC](https://discuss.elastic.co/t/poretect-plain-text-password-in-kibana-yml-file/261999 "2021-01-24T17:05:13Z")
Hi experts, Please share me way to protect hard coded sensitive data in kibana.yml elasticsearch.username: "kibana" elasticsearch.password: "PasswordAsPlainText" For logstash i use keystore. so i just need use ${ES\_PW… --- ## [Throttle filter: Notify on throttle](https://discuss.elastic.co/t/throttle-filter-notify-on-throttle/261861)
**Author:** [@holobolo0815](https://discuss.elastic.co/u/holobolo0815)\ **Replies:** 8\ **Last updated:** [January 24, 2021, 4:51pm UTC](https://discuss.elastic.co/t/throttle-filter-notify-on-throttle/261861 "2021-01-24T16:51:15Z")
When using the throttle filter, how would I go about notifying one event once the throttle has triggered? Meaning if I allow 5 events per minute, I'd like to know somehow if there has been a 6th event and send a mail or… --- ## [Canvas SQL: Unexpected result of an SQL query](https://discuss.elastic.co/t/canvas-sql-unexpected-result-of-an-sql-query/259386)
**Author:** [@Abdelhalim](https://discuss.elastic.co/u/Abdelhalim)\ **Replies:** 14\ **Last updated:** [January 24, 2021, 2:49pm UTC](https://discuss.elastic.co/t/canvas-sql-unexpected-result-of-an-sql-query/259386 "2021-01-24T14:49:31Z")
Hello everybody, I am trying to display in canvas the users that have more than 10 authentication failed, so I am using this SQL query: SELECT COUNT(\*) as result\_count FROM ( SELECT user.name, COUNT(\*) as result FROM… --- ## [Nanosecond support in Logs UI](https://discuss.elastic.co/t/nanosecond-support-in-logs-ui/261048)
**Author:** [@data\_smith](https://discuss.elastic.co/u/data_smith)\ **Replies:** 2\ **Last updated:** [January 24, 2021, 12:58pm UTC](https://discuss.elastic.co/t/nanosecond-support-in-logs-ui/261048 "2021-01-24T12:58:02Z")
Does anyone know if the Logs UI supports timetamps in data\_nanos format? If not, is this feature coming in the future? I couldn't get it to work with nanoseconds. --- ## [Bad Request - Specifying types in document get requests is deprecated](https://discuss.elastic.co/t/bad-request-specifying-types-in-document-get-requests-is-deprecated/262024)
**Author:** [@shlomys](https://discuss.elastic.co/u/shlomys)\ **Replies:** 2\ **Last updated:** [January 24, 2021, 12:39pm UTC](https://discuss.elastic.co/t/bad-request-specifying-types-in-document-get-requests-is-deprecated/262024 "2021-01-24T12:39:48Z")
Hi, Since upgrading elastic stack docker containers to 7.10.2 I get the following error whenever trying to open a new transaction with the .net Elastic.Apm 1.7.1 : StatusCode: 400, ReasonPhrase: 'Bad Request', Version:… --- ## [How to index nanoseconds precision events with Logstash (7.10) and type date\_nanos](https://discuss.elastic.co/t/how-to-index-nanoseconds-precision-events-with-logstash-7-10-and-type-date-nanos/262029)
**Author:** [@juan.domenech](https://discuss.elastic.co/u/juan.domenech)\ **Replies:** 0\ **Last updated:** [January 24, 2021, 11:14am UTC](https://discuss.elastic.co/t/how-to-index-nanoseconds-precision-events-with-logstash-7-10-and-type-date-nanos/262029 "2021-01-24T11:14:24Z")
Problem statement Elasticsearch 7.10 supports timestamp with nanoseconds precision (type date\_nanos) Kibana 7.10 visualises these timestamps but Logstash can't handle them yet (precision above milliseconds is lost whe… --- ## [Accessing individual values in a logstash](https://discuss.elastic.co/t/accessing-individual-values-in-a-logstash/262027)
**Author:** [@learner1](https://discuss.elastic.co/u/learner1)\ **Replies:** 0\ **Last updated:** [January 24, 2021, 9:53am UTC](https://discuss.elastic.co/t/accessing-individual-values-in-a-logstash/262027 "2021-01-24T09:53:06Z")
I'm trying to mask some values in the logs but looks like it's not working because of the log format. Here is the format: "\_source": { "log": "2021-01-24 07:15:37 +0000 \[warn\]: #0 dump an error event: error\_cl… --- ## [How to manage data with high update rate?](https://discuss.elastic.co/t/how-to-manage-data-with-high-update-rate/261995)
**Author:** [@alireza\_jazayerei](https://discuss.elastic.co/u/alireza_jazayerei)\ **Replies:** 4\ **Last updated:** [January 24, 2021, 5:34am UTC](https://discuss.elastic.co/t/how-to-manage-data-with-high-update-rate/261995 "2021-01-24T05:34:34Z")
hello everyone I want to implement an advanced search system that has the ability to sort results by their popularity. I feel that update operation is expensive in elastic search. what is the best way to store user like… --- ## [\[Solved\] Data path already locked by another beat](https://discuss.elastic.co/t/solved-data-path-already-locked-by-another-beat/262018)
**Author:** [@jfasajr](https://discuss.elastic.co/u/jfasajr)\ **Replies:** 1\ **Last updated:** [January 24, 2021, 2:33am UTC](https://discuss.elastic.co/t/solved-data-path-already-locked-by-another-beat/262018 "2021-01-24T02:33:40Z")
I'm not particularly sure what to do about the following error. I've read a few things and everyone seems to say that it's either a failed shutdown or second instance. However none of my troubleshooting has rendered resu… [Previous page](https://discuss.elastic.co/latest.md?page=1876) [Next page](https://discuss.elastic.co/latest.md?page=1878)