# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1783 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1784 --- ## [Logstash failed to parse the Log file content \[0\] "\_grokparsefailure"](https://discuss.elastic.co/t/logstash-failed-to-parse-the-log-file-content-0-grokparsefailure/120487)
**Author:** [@karthik\_s2](https://discuss.elastic.co/u/karthik_s2)\ **Replies:** 1\ **Last updated:** [February 19, 2018, 4:48pm UTC](https://discuss.elastic.co/t/logstash-failed-to-parse-the-log-file-content-0-grokparsefailure/120487 "2018-02-19T16:48:53Z")
My sample log content. \[2018-02-12 05:25:22,996\] ERROR \[VBH-1\] (ClassA.java:55) - Could not process a new task \[2018-02-13 08:02:24,690\] ERROR \[CTY-2\] C:31:cvbb09:0x73636711c67k4g2e (ClassB.java:159) - Calling command … --- ## [Data base Synchronize with elastic search in real time](https://discuss.elastic.co/t/data-base-synchronize-with-elastic-search-in-real-time/120192)
**Author:** [@dnguptha](https://discuss.elastic.co/u/dnguptha)\ **Replies:** 5\ **Last updated:** [February 19, 2018, 4:26pm UTC](https://discuss.elastic.co/t/data-base-synchronize-with-elastic-search-in-real-time/120192 "2018-02-19T16:26:44Z")
Hi, I am new to elastic search, the data being inserted into the database I wanna load the data into elastic search. when new record has being inserted into database elastic search has to Synchronize with DB automatica… --- ## [Loading CSV to elasticsearch index with mapping using Python API](https://discuss.elastic.co/t/loading-csv-to-elasticsearch-index-with-mapping-using-python-api/120037)
**Author:** [@druzmieres](https://discuss.elastic.co/u/druzmieres)\ **Replies:** 1\ **Last updated:** [February 19, 2018, 4:09pm UTC](https://discuss.elastic.co/t/loading-csv-to-elasticsearch-index-with-mapping-using-python-api/120037 "2018-02-19T16:09:29Z")
Using the elasticsearch Python API I want to create an elasticsearch index with a mapping so that when I upload a CSV file the documents are uploaded according to this mapping. I have this (I removed some fields so the m… --- ## [ES ignores mapping when using Python DSL bulk](https://discuss.elastic.co/t/es-ignores-mapping-when-using-python-dsl-bulk/120050)
**Author:** [@druzmieres](https://discuss.elastic.co/u/druzmieres)\ **Replies:** 1\ **Last updated:** [February 19, 2018, 4:04pm UTC](https://discuss.elastic.co/t/es-ignores-mapping-when-using-python-dsl-bulk/120050 "2018-02-19T16:04:18Z")
I'm trying to upload a CSV file to an elasticsearch index. Let's say the file is something like this (no headers, just data): bird,10,dog cat,20,giraffe This is the code I have: from elasticsearch\_dsl import DocType, … --- ## [ML Job on Scripted field](https://discuss.elastic.co/t/ml-job-on-scripted-field/116820)
**Author:** [@sarvendra.singh](https://discuss.elastic.co/u/sarvendra.singh)\ **Replies:** 21\ **Last updated:** [February 19, 2018, 3:55pm UTC](https://discuss.elastic.co/t/ml-job-on-scripted-field/116820 "2018-02-19T15:55:13Z")
Hi Team, Need your advice relating to creating machine learning job. I am trying to create single metric job for detecting anomalies in mean of some scripted field(which is created with help of injected fields using l… --- ## [How to improve the data import speed](https://discuss.elastic.co/t/how-to-improve-the-data-import-speed/120309)
**Author:** [@Eric\_Yin](https://discuss.elastic.co/u/Eric_Yin)\ **Replies:** 10\ **Last updated:** [February 19, 2018, 3:44pm UTC](https://discuss.elastic.co/t/how-to-improve-the-data-import-speed/120309 "2018-02-19T15:44:24Z")
Dear ELK developers, I use the elasticsearch to store the telecommunication level big data which involve more than 3000 fields and relative more than 1000 formula(scripted). I already use bulk to import the data with n… --- ## [ES 5.2.2 data node crash (OutOfMemoryError)](https://discuss.elastic.co/t/es-5-2-2-data-node-crash-outofmemoryerror/120415)
**Author:** [@farin99](https://discuss.elastic.co/u/farin99)\ **Replies:** 8\ **Last updated:** [February 19, 2018, 3:31pm UTC](https://discuss.elastic.co/t/es-5-2-2-data-node-crash-outofmemoryerror/120415 "2018-02-19T15:31:44Z")
Hi, I have 4 cold elastic search data nodes that some time receive OutOfMemoryError. It seems to be related to moving indexes to these nodes. The cold nodes spec is: 8 Cores, 32 GB (16 assigned to JVM) 5 spinning disks … --- ## [Elasticsearch.service: Can't open PID file /run/elasticsearch/elasticsearch.pid No such file or directory](https://discuss.elastic.co/t/elasticsearch-service-cant-open-pid-file-run-elasticsearch-elasticsearch-pid-no-such-file-or-directory/119597)
**Author:** [@stardiviner](https://discuss.elastic.co/u/stardiviner)\ **Replies:** 9\ **Last updated:** [February 19, 2018, 3:23pm UTC](https://discuss.elastic.co/t/elasticsearch-service-cant-open-pid-file-run-elasticsearch-elasticsearch-pid-no-such-file-or-directory/119597 "2018-02-19T15:23:21Z")
Environment: Arch Linux ElasticSearch package version: 6.2.1-1 (Arch package version) Config files: (All configs are by default from package). Systemd service unit file: /usr/lib/systemd/system/elasticsearch.servic… --- ## [Query\_string in Java API 5.4](https://discuss.elastic.co/t/query-string-in-java-api-5-4/120456)
**Author:** [@Hrachya\_Yeghishyan](https://discuss.elastic.co/u/Hrachya_Yeghishyan)\ **Replies:** 3\ **Last updated:** [February 19, 2018, 3:11pm UTC](https://discuss.elastic.co/t/query-string-in-java-api-5-4/120456 "2018-02-19T15:11:04Z")
Is there an equivalent of the query\_string for the ES Java API 5.4, as it look like that queryString is unavailable in this version? Also there isn't anything descriptive about the queryStringQuery in the documentation … --- ## [Elasticsearch message field limit?](https://discuss.elastic.co/t/elasticsearch-message-field-limit/120464)
**Author:** [@Amgryptio](https://discuss.elastic.co/u/Amgryptio)\ **Replies:** 0\ **Last updated:** [February 19, 2018, 1:43pm UTC](https://discuss.elastic.co/t/elasticsearch-message-field-limit/120464 "2018-02-19T13:43:55Z")
Hi, I'm currently looking at storing a somewhat large amount of information inside 1 field, I read about the max number of bytes ES could handle so before I started inserting data I used the below template to create the… --- ## [Bulk index operation for multiple indices](https://discuss.elastic.co/t/bulk-index-operation-for-multiple-indices/120373)
**Author:** [@Phuong\_Hoang](https://discuss.elastic.co/u/Phuong_Hoang)\ **Replies:** 1\ **Last updated:** [February 19, 2018, 1:13pm UTC](https://discuss.elastic.co/t/bulk-index-operation-for-multiple-indices/120373 "2018-02-19T13:13:42Z")
I am using esrally version 0.9.1, elasticsearch version 6.1.3 After executing the custom track for multiple indices, I can index documents for only oci-vcn but not oci-user(testing with the existing es-cluster) How cou… --- ## [Elastic Search Testenvironment virtual](https://discuss.elastic.co/t/elastic-search-testenvironment-virtual/120460)
**Author:** [@Robbi](https://discuss.elastic.co/u/Robbi)\ **Replies:** 0\ **Last updated:** [February 19, 2018, 1:11pm UTC](https://discuss.elastic.co/t/elastic-search-testenvironment-virtual/120460 "2018-02-19T13:11:08Z")
Hi Community! I plan to test elastic search, with kibana and logstash and it would be nice someone can say what Hardware requirements are useful. In my test I will index about 5 GB data per day and I want to have the S… --- ## [Not able to start the elasticsearch service in windows after uninstalled the X-pack](https://discuss.elastic.co/t/not-able-to-start-the-elasticsearch-service-in-windows-after-uninstalled-the-x-pack/120454)
**Author:** [@Hari\_Baskar](https://discuss.elastic.co/u/Hari_Baskar)\ **Replies:** 1\ **Last updated:** [February 19, 2018, 1:04pm UTC](https://discuss.elastic.co/t/not-able-to-start-the-elasticsearch-service-in-windows-after-uninstalled-the-x-pack/120454 "2018-02-19T13:04:15Z")
I'm getting some errors while starting the elasticsearch service, after uninstalled the xpack. \[2018-02-19T18:13:39,056\]\[WARN \]\[o.e.b.ElasticsearchUncaughtExceptionHandler\] \[HARIBASKAR\] uncaught exception in thread \[mai… --- ## [Bulk with \_op\_type:create throws exception id must be provided](https://discuss.elastic.co/t/bulk-with-op-type-create-throws-exception-id-must-be-provided/120444)
**Author:** [@Fahad\_Sheikh](https://discuss.elastic.co/u/Fahad_Sheikh)\ **Replies:** 0\ **Last updated:** [February 19, 2018, 12:07pm UTC](https://discuss.elastic.co/t/bulk-with-op-type-create-throws-exception-id-must-be-provided/120444 "2018-02-19T12:07:32Z")
elasticsearch.exceptions.RequestError: TransportError(400, u'action\_request\_validation\_exception', u'Validation Failed: 1: an id must be provided if version type or value are set;') Using elasticsearch.helpers for pytho… --- ## [Dangling Indices in Ingest nodes after deleting Indices with Currator](https://discuss.elastic.co/t/dangling-indices-in-ingest-nodes-after-deleting-indices-with-currator/120434)
**Author:** [@hadi](https://discuss.elastic.co/u/hadi)\ **Replies:** 0\ **Last updated:** [February 19, 2018, 11:18am UTC](https://discuss.elastic.co/t/dangling-indices-in-ingest-nodes-after-deleting-indices-with-currator/120434 "2018-02-19T11:18:13Z")
Hi, After running curator for deleting indicies older than two weeks, I see following error in Ingest nodes elasticsearch logs! tailf /var/log/elasticsearch/dbus.log \[2018-02-19T10:26:09,264\]\[WARN \]\[o.e.g.DanglingInd… --- ## [ES Not Starting and No Logs On Azure Ubuntu Instance](https://discuss.elastic.co/t/es-not-starting-and-no-logs-on-azure-ubuntu-instance/120432)
**Author:** [@Donglecow](https://discuss.elastic.co/u/Donglecow)\ **Replies:** 1\ **Last updated:** [February 19, 2018, 11:27am UTC](https://discuss.elastic.co/t/es-not-starting-and-no-logs-on-azure-ubuntu-instance/120432 "2018-02-19T11:27:19Z")
I am deploying an Elasticsearch installation to an Azure Ubuntu (16.04.03 LTS) instance. I've done many ES installs before, so am familiar with the process, but on this particular machine I'm having trouble getting it to… --- ## [Run elasticsearch as a service 2.3.0](https://discuss.elastic.co/t/run-elasticsearch-as-a-service-2-3-0/120045)
**Author:** [@axsm](https://discuss.elastic.co/u/axsm)\ **Replies:** 1\ **Last updated:** [February 19, 2018, 11:18am UTC](https://discuss.elastic.co/t/run-elasticsearch-as-a-service-2-3-0/120045 "2018-02-19T11:18:06Z")
Hi, I'm just trying to run elasticsearch 2.3.0 as a service on a linux machine\[Xubuntu 16.04\], using systemd. I installed elasticsearch manually, I downloaded elasticsearch-2.3.0.zip and unziped into my machine and ran … --- ## [Machine Learning alert correlation software programming in Java or Python is suitable](https://discuss.elastic.co/t/machine-learning-alert-correlation-software-programming-in-java-or-python-is-suitable/120430)
**Author:** [@rijinmp](https://discuss.elastic.co/u/rijinmp)\ **Replies:** 0\ **Last updated:** [February 19, 2018, 10:36am UTC](https://discuss.elastic.co/t/machine-learning-alert-correlation-software-programming-in-java-or-python-is-suitable/120430 "2018-02-19T10:36:40Z")
Hi All , I would like to create a software for Machine learning anomaly's correlation . If multiple anomalies are occurring simultaneously , then this software will read anomalies alerts from elastic search's " .ml "… --- ## [Upgrade Elasticsearch from 6.0.0 to 6.2.1 breaks XPack security audit log bulk indexing](https://discuss.elastic.co/t/upgrade-elasticsearch-from-6-0-0-to-6-2-1-breaks-xpack-security-audit-log-bulk-indexing/119302)
**Author:** [@aaronloesattv](https://discuss.elastic.co/u/aaronloesattv)\ **Replies:** 4\ **Last updated:** [February 19, 2018, 10:08am UTC](https://discuss.elastic.co/t/upgrade-elasticsearch-from-6-0-0-to-6-2-1-breaks-xpack-security-audit-log-bulk-indexing/119302 "2018-02-19T10:08:49Z")
We are using the docker images of the elastic stack. we were upgrading from 6.0.0 to 6.2.1 and when we did, some of our nodes were logging a bunch of errors reporting that they were failing to bulk index the security aud… --- ## [Updating X-Pack's RAP Data in an Elastic Cluster](https://discuss.elastic.co/t/updating-x-packs-rap-data-in-an-elastic-cluster/120391)
**Author:** [@Ong](https://discuss.elastic.co/u/Ong)\ **Replies:** 4\ **Last updated:** [February 19, 2018, 9:15am UTC](https://discuss.elastic.co/t/updating-x-packs-rap-data-in-an-elastic-cluster/120391 "2018-02-19T09:15:17Z")
I have a 3 node Elasticsearch cluster with X-Pack installed on each of the nodes. If I were to update the Role Access Profile data of X-Pack security, do I need to update each of the X-Pack instances on each Elasticsear… --- ## [Using already indexed data for benchmarking](https://discuss.elastic.co/t/using-already-indexed-data-for-benchmarking/120406)
**Author:** [@toka](https://discuss.elastic.co/u/toka)\ **Replies:** 1\ **Last updated:** [February 19, 2018, 8:43am UTC](https://discuss.elastic.co/t/using-already-indexed-data-for-benchmarking/120406 "2018-02-19T08:43:53Z")
Hi! I was able to use an existing cluster with Rally (trough the pipeline benchmark-only), but I would like to use an existing index and its data as well. I checked the track reference and a source-file field is mandat… --- ## [X-pack with ansible role license failing](https://discuss.elastic.co/t/x-pack-with-ansible-role-license-failing/119807)
**Author:** [@cchaffee](https://discuss.elastic.co/u/cchaffee)\ **Replies:** 1\ **Last updated:** [February 19, 2018, 8:35am UTC](https://discuss.elastic.co/t/x-pack-with-ansible-role-license-failing/119807 "2018-02-19T08:35:16Z")
Hello, currently trying to run the ansible playbooks from this repo: Running the xpack-centos-7 test suite but when it gets to the license part it fails because it doesn't have a license for the security features. I a… --- ## [Rejected mapping because final mapping would have more than one type](https://discuss.elastic.co/t/rejected-mapping-because-final-mapping-would-have-more-than-one-type/120118)
**Author:** [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\ **Replies:** 5\ **Last updated:** [February 19, 2018, 8:30am UTC](https://discuss.elastic.co/t/rejected-mapping-because-final-mapping-would-have-more-than-one-type/120118 "2018-02-19T08:30:41Z")
Hi, I just migrated my ES from AWS elasticservice to a EC2 instance and despite not having changed anything to my configs or logstash (running on a separate instance) my mapping is suddenly getting rejected. \[logstash.… --- ## [X-pack Watcher email alert with full information stripped from JSON file](https://discuss.elastic.co/t/x-pack-watcher-email-alert-with-full-information-stripped-from-json-file/119667)
**Author:** [@Jay.Dhillon](https://discuss.elastic.co/u/Jay.Dhillon)\ **Replies:** 5\ **Last updated:** [February 19, 2018, 8:17am UTC](https://discuss.elastic.co/t/x-pack-watcher-email-alert-with-full-information-stripped-from-json-file/119667 "2018-02-19T08:17:20Z")
How can define Watcher watches script to detect a keyword from JSON files? and How to include more information from JSON file(From Azure EventHUB)? Currently using below Advanced JSON watch but seems like not working. { … --- ## [Logstash or Beats (or both) for data feeding](https://discuss.elastic.co/t/logstash-or-beats-or-both-for-data-feeding/120410)
**Author:** [@emil.mirzayev](https://discuss.elastic.co/u/emil.mirzayev)\ **Replies:** 0\ **Last updated:** [February 19, 2018, 8:09am UTC](https://discuss.elastic.co/t/logstash-or-beats-or-both-for-data-feeding/120410 "2018-02-19T08:09:56Z")
Hi there! I am using Elastic for a while now and now want to finally add it to our production. I will have, e.g, ~200mb of log files daily about user money spending and plus some event/alarm logs. I using Python I wrot… --- ## [Upgrade to Elasticsearch 6.1 on CentOS 7 fails: cannot create elasticsearch.keystore.tmp](https://discuss.elastic.co/t/upgrade-to-elasticsearch-6-1-on-centos-7-fails-cannot-create-elasticsearch-keystore-tmp/117258)
**Author:** [@trimegistus](https://discuss.elastic.co/u/trimegistus)\ **Replies:** 6\ **Last updated:** [February 19, 2018, 7:36am UTC](https://discuss.elastic.co/t/upgrade-to-elasticsearch-6-1-on-centos-7-fails-cannot-create-elasticsearch-keystore-tmp/117258 "2018-02-19T07:36:04Z")
I installed the s3 snapshot plugin on my ES 5.6 cluster. Those nodes are CentOS 7.4. I installed ES using yum. I needed to upgrade to v6, so I wanted to make a backup. I installed the repository-s3. I read the document… --- ## [Protobuf code plugin without Logstash](https://discuss.elastic.co/t/protobuf-code-plugin-without-logstash/120357)
**Author:** [@mlobo](https://discuss.elastic.co/u/mlobo)\ **Replies:** 3\ **Last updated:** [February 19, 2018, 7:16am UTC](https://discuss.elastic.co/t/protobuf-code-plugin-without-logstash/120357 "2018-02-19T07:16:28Z")
Hi, I want to do a POC to send data (hello world), using protobuf, to my Elasticsearch. I see that there is a "protobuf codec plugin" but is for Logstash https://www.elastic.co/guide/en/logstash/current/plugins-codecs-p… --- ## [Centralized Pipeline Management Issues](https://discuss.elastic.co/t/centralized-pipeline-management-issues/120392)
**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\ **Replies:** 1\ **Last updated:** [February 19, 2018, 6:35am UTC](https://discuss.elastic.co/t/centralized-pipeline-management-issues/120392 "2018-02-19T06:35:18Z")
I have two ElasticStack setups running on 6.1.1, one of them has X-Pack installed with Centralized Pipeline Management configured, the other does not have x-pack. The following pipeline works on the non-xpack setup. On… --- ## [Unsupported Mapping definition](https://discuss.elastic.co/t/unsupported-mapping-definition/120347)
**Author:** [@xxTeja83xx](https://discuss.elastic.co/u/xxTeja83xx)\ **Replies:** 0\ **Last updated:** [February 18, 2018, 11:32am UTC](https://discuss.elastic.co/t/unsupported-mapping-definition/120347 "2018-02-18T11:32:37Z")
Hello, im new to elastic, got and old project with not updateable Elasticsearch 2.4 i tried to index on my local dev maschine but got the following error: \[Elastica\\Exception\\ResponseException\] {"root\_cause":\[{"type… --- ## [How to shutdown elasticsearch](https://discuss.elastic.co/t/how-to-shutdown-elasticsearch/120135)
**Author:** [@Gaurav\_Agarwal](https://discuss.elastic.co/u/Gaurav_Agarwal)\ **Replies:** 2\ **Last updated:** [February 19, 2018, 6:06am UTC](https://discuss.elastic.co/t/how-to-shutdown-elasticsearch/120135 "2018-02-19T06:06:23Z")
Hii How to shutdown or stop a running node of elasticsearch on windows. I downloaded elastic search as a service regards Gaurav [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1782) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1784)